2024-09-13T15:49:36.597 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T15:49:36.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T15:49:36.725 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903772 branch: wip-rishabh-testing-20240910.095512-reef description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/fs/norstats}} email: null first_in_suite: false job_id: '7903772' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240910.095512-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 50bbe7f395997dcd871813949c49addbbf630361 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: 50bbe7f395997dcd871813949c49addbbf630361 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - wsync rbytes: false syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.095512-reef sha1: 50bbe7f395997dcd871813949c49addbbf630361 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1152 sha1: 50bbe7f395997dcd871813949c49addbbf630361 sleep_before_teardown: 0 subset: 984/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.095512-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 50bbe7f395997dcd871813949c49addbbf630361 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOzsk6ZZ444Uq170dx+5zjA6zv0Tw2cDan2ipcbnMsMvc/mL43EUzKoy684Zk4PYLBgGP65tvHohQfojacNttM= smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPKuuzVhoMmllXdO62DNYoRLxExuMJ5T4XNlTtc79sV8BHjkY/QlKkeyN6icV7Bi95+E+XgJAmtWMYR3ZGdvsiU= smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFFqfattyGiUq6iDMWJ1+Wo/ZeGLZ5WrAjnZiM+tQ7RtprRegmiBiJ0zzA7ZppQa/rf7tXptKtCOo7BFuTnucO4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:36:41 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T15:49:36.725 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa; will attempt to use it 2024-09-13T15:49:36.726 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa/tasks 2024-09-13T15:49:36.726 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T15:49:36.727 INFO:teuthology.task.internal:Checking packages... 2024-09-13T15:49:36.749 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '50bbe7f395997dcd871813949c49addbbf630361' 2024-09-13T15:49:36.749 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T15:49:36.749 INFO:teuthology.packaging:ref: None 2024-09-13T15:49:36.749 INFO:teuthology.packaging:tag: None 2024-09-13T15:49:36.750 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.095512-reef 2024-09-13T15:49:36.750 INFO:teuthology.packaging:sha1: 50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:49:36.750 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240910.095512-reef 2024-09-13T15:49:36.903 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-850.g50bbe7f3 2024-09-13T15:49:36.905 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T15:49:36.910 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T15:49:36.911 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T15:49:36.918 INFO:teuthology.task.internal:Saving configuration 2024-09-13T15:49:36.938 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T15:49:36.945 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T15:49:36.974 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903772', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 15:44:37.517536', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOzsk6ZZ444Uq170dx+5zjA6zv0Tw2cDan2ipcbnMsMvc/mL43EUzKoy684Zk4PYLBgGP65tvHohQfojacNttM='} 2024-09-13T15:49:37.004 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903772', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 15:44:37.513784', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPKuuzVhoMmllXdO62DNYoRLxExuMJ5T4XNlTtc79sV8BHjkY/QlKkeyN6icV7Bi95+E+XgJAmtWMYR3ZGdvsiU='} 2024-09-13T15:49:37.034 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903772', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 15:44:37.515832', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFFqfattyGiUq6iDMWJ1+Wo/ZeGLZ5WrAjnZiM+tQ7RtprRegmiBiJ0zzA7ZppQa/rf7tXptKtCOo7BFuTnucO4='} 2024-09-13T15:49:37.034 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T15:49:37.040 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-13T15:49:37.040 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-13T15:49:37.040 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-13T15:49:37.040 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T15:49:37.141 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdfc8637be0>, signals=[15]) 2024-09-13T15:49:37.141 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T15:49:37.146 INFO:teuthology.task.internal:Opening connections... 2024-09-13T15:49:37.146 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T15:49:37.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:49:37.237 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T15:49:37.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:49:37.323 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T15:49:37.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:49:37.409 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T15:49:37.415 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-09-13T15:49:37.434 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-09-13T15:49:37.434 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-09-13T15:49:37.492 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-09-13T15:49:37.492 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2024-09-13T15:49:37.492 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-09-13T15:49:37.492 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-09-13T15:49:37.492 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2024-09-13T15:49:37.492 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2024-09-13T15:49:37.492 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T15:49:37.492 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-09-13T15:49:37.493 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2024-09-13T15:49:37.493 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T15:49:37.493 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-09-13T15:49:37.493 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T15:49:37.493 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T15:49:37.493 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T15:49:37.494 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-09-13T15:49:37.526 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2024-09-13T15:49:37.545 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2024-09-13T15:49:37.545 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-09-13T15:49:37.603 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2024-09-13T15:49:37.604 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="9" 2024-09-13T15:49:37.604 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2024-09-13T15:49:37.604 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2024-09-13T15:49:37.604 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="9" 2024-09-13T15:49:37.604 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el9" 2024-09-13T15:49:37.604 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T15:49:37.604 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2024-09-13T15:49:37.604 INFO:teuthology.orchestra.run.smithi139.stdout:LOGO="fedora-logo-icon" 2024-09-13T15:49:37.605 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T15:49:37.605 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2024-09-13T15:49:37.605 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T15:49:37.605 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T15:49:37.605 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T15:49:37.605 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-09-13T15:49:37.634 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-09-13T15:49:37.653 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-09-13T15:49:37.654 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-09-13T15:49:37.712 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-09-13T15:49:37.712 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-09-13T15:49:37.712 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-09-13T15:49:37.712 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-09-13T15:49:37.712 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-09-13T15:49:37.712 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-09-13T15:49:37.712 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T15:49:37.713 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-09-13T15:49:37.713 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-09-13T15:49:37.713 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T15:49:37.713 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-09-13T15:49:37.713 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T15:49:37.713 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T15:49:37.713 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T15:49:37.713 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-09-13T15:49:37.743 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T15:49:37.753 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T15:49:37.763 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T15:49:37.764 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2024-09-13T15:49:37.766 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2024-09-13T15:49:37.768 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2024-09-13T15:49:37.785 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T15:49:37.791 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T15:49:37.791 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2024-09-13T15:49:37.825 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2024-09-13T15:49:37.827 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2024-09-13T15:49:37.934 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T15:49:38.036 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T15:49:38.059 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-13T15:49:38.060 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-13T15:49:38.060 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-13T15:49:38.060 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T15:49:38.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:49:38.078 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-13T15:49:38.257 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T15:49:38.257 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T15:49:38.257 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-09-13T15:49:38.275 INFO:teuthology.orchestra.run.smithi086.stdout:5.14.0-503.el9.x86_64 2024-09-13T15:49:38.276 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T15:49:38.276 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T15:49:38.276 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum upgrade -y linux-firmware 2024-09-13T15:49:40.949 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-09-13T15:49:42.676 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-13T15:49:47.018 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-13T15:49:48.435 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - Extras packages 93 kB/s | 19 kB 00:00 2024-09-13T15:49:49.948 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-13T15:49:55.353 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-13T15:49:57.476 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-13T15:49:57.477 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-09-13T15:49:57.477 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-13T15:49:57.605 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T15:49:57.606 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T15:49:57.767 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-13T15:49:57.767 DEBUG:teuthology.orchestra.run.smithi086:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-13T15:49:57.770 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi086.front.sepia.ceph.com to complete... 2024-09-13T15:50:04.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13 15:50:04 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-13T15:50:04.081 INFO:teuthology.orchestra.run.smithi086.stderr:FINISHED --2024-09-13 15:50:04-- 2024-09-13T15:50:04.081 INFO:teuthology.orchestra.run.smithi086.stderr:Total wall clock time: 6.3s 2024-09-13T15:50:04.082 INFO:teuthology.orchestra.run.smithi086.stderr:Downloaded: 1 files, 343M in 6.0s (57.1 MB/s) 2024-09-13T15:50:04.084 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T15:50:04.084 DEBUG:teuthology.orchestra.run.smithi086:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-13T15:50:06.187 INFO:teuthology.orchestra.run.smithi086.stdout:Verifying... ######################################## 2024-09-13T15:50:06.400 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing... ######################################## 2024-09-13T15:50:06.518 INFO:teuthology.orchestra.run.smithi086.stdout:Updating / installing... 2024-09-13T15:50:14.473 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-13T15:50:54.303 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi086.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-13T15:50:54.303 DEBUG:teuthology.orchestra.run.smithi086:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-13T15:50:54.394 INFO:teuthology.orchestra.run.smithi086.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:50:54.394 INFO:teuthology.orchestra.run.smithi086.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:50:54.394 INFO:teuthology.orchestra.run.smithi086.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:50:54.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:50:54.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-13T15:50:54.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-13T15:50:54.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-13T15:50:54.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-13T15:50:54.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-13T15:50:54.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-13T15:50:54.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T15:50:54.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T15:50:54.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T15:50:54.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T15:50:54.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T15:50:54.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T15:50:54.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T15:50:54.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-13T15:50:54.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T15:50:54.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T15:50:54.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T15:50:54.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T15:50:54.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T15:50:54.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T15:50:54.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T15:50:54.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T15:50:54.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T15:50:54.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T15:50:54.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T15:50:54.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T15:50:54.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-13T15:50:54.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-13T15:50:54.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-13T15:50:54.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T15:50:54.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-13T15:50:54.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T15:50:54.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T15:50:54.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T15:50:54.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-13T15:50:54.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T15:50:54.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T15:50:54.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T15:50:54.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-13T15:50:54.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T15:50:54.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T15:50:54.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T15:50:54.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T15:50:54.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T15:50:54.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T15:50:54.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T15:50:54.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T15:50:54.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T15:50:54.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T15:50:54.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T15:50:54.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T15:50:54.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T15:50:54.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T15:50:54.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T15:50:54.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T15:50:54.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T15:50:54.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T15:50:54.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T15:50:54.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T15:50:54.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T15:50:54.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T15:50:54.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T15:50:54.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-13T15:50:54.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-13T15:50:54.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T15:50:54.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T15:50:54.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T15:50:54.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T15:50:54.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T15:50:54.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T15:50:54.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T15:50:54.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T15:50:54.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T15:50:54.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T15:50:54.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T15:50:54.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T15:50:54.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T15:50:54.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T15:50:54.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T15:50:54.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T15:50:54.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T15:50:54.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T15:50:54.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T15:50:54.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T15:50:54.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T15:50:54.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T15:50:54.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-13T15:50:54.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-13T15:50:54.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T15:50:54.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T15:50:54.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T15:50:54.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T15:50:54.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T15:50:54.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T15:50:54.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T15:50:54.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-13T15:50:54.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T15:50:54.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T15:50:54.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-13T15:50:54.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T15:50:54.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T15:50:54.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T15:50:54.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T15:50:54.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T15:50:54.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T15:50:54.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T15:50:54.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T15:50:54.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T15:50:54.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T15:50:54.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T15:50:54.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T15:50:54.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T15:50:54.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T15:50:54.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T15:50:54.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T15:50:54.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T15:50:54.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T15:50:54.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T15:50:54.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T15:50:54.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T15:50:54.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T15:50:54.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T15:50:54.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T15:50:54.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T15:50:54.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T15:50:54.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T15:50:54.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T15:50:54.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T15:50:54.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T15:50:54.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T15:50:54.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T15:50:54.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T15:50:54.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T15:50:54.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T15:50:54.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-13T15:50:54.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T15:50:54.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T15:50:54.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T15:50:54.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T15:50:54.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T15:50:54.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T15:50:54.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T15:50:54.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T15:50:54.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T15:50:54.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T15:50:54.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T15:50:54.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T15:50:54.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T15:50:54.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T15:50:54.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T15:50:54.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T15:50:54.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T15:50:54.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-13T15:50:54.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T15:50:54.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-13T15:50:54.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-13T15:50:54.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-13T15:50:54.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-13T15:50:54.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-13T15:50:54.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T15:50:54.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-13T15:50:54.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-13T15:50:54.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T15:50:54.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-13T15:50:54.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-13T15:50:54.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T15:50:54.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T15:50:54.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-13T15:50:54.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-13T15:50:54.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T15:50:54.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T15:50:54.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-13T15:50:54.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T15:50:54.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T15:50:54.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T15:50:54.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-13T15:50:54.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-13T15:50:54.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T15:50:54.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-13T15:50:54.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-13T15:50:54.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T15:50:54.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-13T15:50:54.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T15:50:54.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-13T15:50:54.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T15:50:54.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T15:50:54.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T15:50:54.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T15:50:54.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T15:50:54.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-13T15:50:54.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T15:50:54.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T15:50:54.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T15:50:54.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T15:50:54.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T15:50:54.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T15:50:54.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T15:50:54.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-13T15:50:54.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T15:50:54.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T15:50:54.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T15:50:54.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-13T15:50:54.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-13T15:50:54.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T15:50:54.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T15:50:54.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T15:50:54.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-13T15:50:54.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-13T15:50:54.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-13T15:50:54.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-13T15:50:54.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-13T15:50:54.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-13T15:50:54.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T15:50:54.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T15:50:54.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-13T15:50:54.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-13T15:50:54.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T15:50:54.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-13T15:50:54.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-13T15:50:54.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T15:50:54.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T15:50:54.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-13T15:50:54.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-13T15:50:54.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-13T15:50:54.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T15:50:54.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-13T15:50:54.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T15:50:54.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T15:50:54.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T15:50:54.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-13T15:50:54.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T15:50:54.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-13T15:50:54.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T15:50:54.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-13T15:50:54.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-13T15:50:54.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-13T15:50:54.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-13T15:50:54.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T15:50:54.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-13T15:50:54.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T15:50:54.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-13T15:50:54.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T15:50:54.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T15:50:54.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T15:50:54.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T15:50:54.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T15:50:54.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T15:50:54.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T15:50:54.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T15:50:54.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T15:50:54.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T15:50:54.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T15:50:54.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T15:50:54.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T15:50:54.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-13T15:50:54.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-13T15:50:54.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T15:50:54.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-13T15:50:54.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T15:50:54.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T15:50:54.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-13T15:50:54.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T15:50:54.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T15:50:54.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T15:50:54.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T15:50:54.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T15:50:54.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T15:50:54.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T15:50:54.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T15:50:54.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T15:50:54.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T15:50:54.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T15:50:54.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T15:50:54.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T15:50:54.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T15:50:54.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T15:50:54.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T15:50:54.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T15:50:54.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T15:50:54.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T15:50:54.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T15:50:54.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T15:50:54.420 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T15:50:54.420 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T15:50:54.420 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T15:50:54.420 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T15:50:54.420 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T15:50:54.420 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T15:50:54.420 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T15:50:54.420 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T15:50:54.420 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T15:50:54.420 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T15:50:54.420 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T15:50:54.420 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T15:50:54.420 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T15:50:54.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T15:50:54.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T15:50:54.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T15:50:54.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T15:50:54.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T15:50:54.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T15:50:54.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T15:50:54.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T15:50:54.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T15:50:54.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T15:50:54.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T15:50:54.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T15:50:54.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T15:50:54.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T15:50:54.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T15:50:54.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T15:50:54.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T15:50:54.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T15:50:54.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T15:50:54.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T15:50:54.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T15:50:54.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T15:50:54.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T15:50:54.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T15:50:54.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T15:50:54.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T15:50:54.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T15:50:54.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T15:50:54.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T15:50:54.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T15:50:54.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-13T15:50:54.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T15:50:54.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T15:50:54.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T15:50:54.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-13T15:50:54.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T15:50:54.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T15:50:54.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T15:50:54.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T15:50:54.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T15:50:54.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T15:50:54.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T15:50:54.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T15:50:54.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T15:50:54.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T15:50:54.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T15:50:54.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T15:50:54.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T15:50:54.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T15:50:54.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T15:50:54.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T15:50:54.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T15:50:54.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T15:50:54.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T15:50:54.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T15:50:54.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T15:50:54.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T15:50:54.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T15:50:54.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T15:50:54.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T15:50:54.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T15:50:54.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T15:50:54.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T15:50:54.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T15:50:54.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T15:50:54.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T15:50:54.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T15:50:54.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T15:50:54.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T15:50:54.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T15:50:54.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T15:50:54.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T15:50:54.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T15:50:54.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T15:50:54.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T15:50:54.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T15:50:54.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T15:50:54.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T15:50:54.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T15:50:54.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T15:50:54.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T15:50:54.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T15:50:54.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T15:50:54.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T15:50:54.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T15:50:54.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T15:50:54.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T15:50:54.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T15:50:54.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T15:50:54.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T15:50:54.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T15:50:54.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T15:50:54.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T15:50:54.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T15:50:54.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T15:50:54.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T15:50:54.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T15:50:54.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T15:50:54.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T15:50:54.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T15:50:54.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T15:50:54.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T15:50:54.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T15:50:54.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T15:50:54.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T15:50:54.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T15:50:54.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T15:50:54.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T15:50:54.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T15:50:54.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T15:50:54.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T15:50:54.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T15:50:54.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T15:50:54.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T15:50:54.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T15:50:54.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T15:50:54.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T15:50:54.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T15:50:54.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T15:50:54.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T15:50:54.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T15:50:54.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T15:50:54.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T15:50:54.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-13T15:50:54.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T15:50:54.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T15:50:54.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T15:50:54.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T15:50:54.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T15:50:54.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T15:50:54.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T15:50:54.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T15:50:54.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T15:50:54.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T15:50:54.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T15:50:54.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T15:50:54.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T15:50:54.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T15:50:54.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T15:50:54.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T15:50:54.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T15:50:54.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T15:50:54.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T15:50:54.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T15:50:54.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T15:50:54.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T15:50:54.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T15:50:54.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T15:50:54.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T15:50:54.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T15:50:54.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T15:50:54.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T15:50:54.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T15:50:54.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T15:50:54.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T15:50:54.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T15:50:54.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T15:50:54.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T15:50:54.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T15:50:54.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T15:50:54.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T15:50:54.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T15:50:54.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T15:50:54.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T15:50:54.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T15:50:54.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-13T15:50:54.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-13T15:50:54.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T15:50:54.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T15:50:54.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-13T15:50:54.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T15:50:54.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T15:50:54.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T15:50:54.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T15:50:54.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T15:50:54.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T15:50:54.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T15:50:54.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T15:50:54.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T15:50:54.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T15:50:54.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T15:50:54.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T15:50:54.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T15:50:54.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T15:50:54.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T15:50:54.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T15:50:54.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T15:50:54.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T15:50:54.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T15:50:54.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T15:50:54.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T15:50:54.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T15:50:54.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T15:50:54.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-13T15:50:54.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T15:50:54.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-13T15:50:54.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T15:50:54.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T15:50:54.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-13T15:50:54.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-13T15:50:54.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T15:50:54.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T15:50:54.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T15:50:54.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T15:50:54.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T15:50:54.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T15:50:54.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T15:50:54.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-13T15:50:54.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-13T15:50:54.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T15:50:54.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-13T15:50:54.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T15:50:54.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-13T15:50:54.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T15:50:54.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-13T15:50:54.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T15:50:54.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-13T15:50:54.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-13T15:50:54.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T15:50:54.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-13T15:50:54.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T15:50:54.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-13T15:50:54.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T15:50:54.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-13T15:50:54.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T15:50:54.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-13T15:50:54.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T15:50:54.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-13T15:50:54.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-13T15:50:54.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T15:50:54.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T15:50:54.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T15:50:54.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T15:50:54.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-13T15:50:54.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T15:50:54.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-13T15:50:54.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T15:50:54.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T15:50:54.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T15:50:54.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T15:50:54.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T15:50:54.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T15:50:54.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T15:50:54.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T15:50:54.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-13T15:50:54.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T15:50:54.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-13T15:50:54.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T15:50:54.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T15:50:54.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T15:50:54.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T15:50:54.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T15:50:54.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-13T15:50:54.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T15:50:54.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T15:50:54.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T15:50:54.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T15:50:54.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-13T15:50:54.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T15:50:54.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T15:50:54.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T15:50:54.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T15:50:54.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T15:50:54.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T15:50:54.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T15:50:54.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T15:50:54.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-13T15:50:54.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-13T15:50:54.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T15:50:54.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T15:50:54.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T15:50:54.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T15:50:54.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T15:50:54.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T15:50:54.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T15:50:54.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T15:50:54.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T15:50:54.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T15:50:54.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T15:50:54.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T15:50:54.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T15:50:54.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T15:50:54.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T15:50:54.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T15:50:54.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-13T15:50:54.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T15:50:54.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T15:50:54.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T15:50:54.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T15:50:54.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T15:50:54.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-13T15:50:54.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-13T15:50:54.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T15:50:54.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T15:50:54.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T15:50:54.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T15:50:54.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T15:50:54.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T15:50:54.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T15:50:54.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-13T15:50:54.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T15:50:54.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T15:50:54.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-13T15:50:54.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T15:50:54.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T15:50:54.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T15:50:54.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T15:50:54.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-13T15:50:54.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-13T15:50:54.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T15:50:54.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T15:50:54.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T15:50:54.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T15:50:54.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-13T15:50:54.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T15:50:54.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-13T15:50:54.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T15:50:54.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T15:50:54.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T15:50:54.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T15:50:54.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T15:50:54.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T15:50:54.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T15:50:54.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-13T15:50:54.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T15:50:54.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T15:50:54.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-13T15:50:54.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T15:50:54.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T15:50:54.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T15:50:54.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-13T15:50:54.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-13T15:50:54.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-13T15:50:54.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-13T15:50:54.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-13T15:50:54.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-13T15:50:54.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T15:50:54.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T15:50:54.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T15:50:54.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T15:50:54.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-13T15:50:54.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T15:50:54.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-13T15:50:54.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-13T15:50:54.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T15:50:54.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-13T15:50:54.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-13T15:50:54.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T15:50:54.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T15:50:54.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T15:50:54.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-13T15:50:54.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T15:50:54.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T15:50:54.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T15:50:54.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-13T15:50:54.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-13T15:50:54.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T15:50:54.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T15:50:54.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T15:50:54.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T15:50:54.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-13T15:50:54.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T15:50:54.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T15:50:54.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T15:50:54.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T15:50:54.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-13T15:50:54.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T15:50:54.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-13T15:50:54.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T15:50:54.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-13T15:50:54.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T15:50:54.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-13T15:50:54.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T15:50:54.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-13T15:50:54.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T15:50:54.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T15:50:54.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T15:50:54.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-13T15:50:54.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-13T15:50:54.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T15:50:54.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-13T15:50:54.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T15:50:54.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-13T15:50:54.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T15:50:54.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-13T15:50:54.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T15:50:54.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T15:50:54.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-13T15:50:54.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T15:50:54.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T15:50:54.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-13T15:50:54.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T15:50:54.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T15:50:54.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-13T15:50:54.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T15:50:54.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T15:50:54.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-13T15:50:54.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-13T15:50:54.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T15:50:54.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-13T15:50:54.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-13T15:50:54.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T15:50:54.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-13T15:50:54.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T15:50:54.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-13T15:50:54.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T15:50:54.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-13T15:50:54.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T15:50:54.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-13T15:50:54.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T15:50:54.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-13T15:50:54.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-13T15:50:54.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T15:50:54.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-13T15:50:54.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-13T15:50:54.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T15:50:54.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T15:50:54.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T15:50:54.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T15:50:54.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T15:50:54.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T15:50:54.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-13T15:50:54.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T15:50:54.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T15:50:54.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T15:50:54.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-13T15:50:54.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-13T15:50:54.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T15:50:54.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T15:50:54.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T15:50:54.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-13T15:50:54.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T15:50:54.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-13T15:50:54.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T15:50:54.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-13T15:50:54.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T15:50:54.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-13T15:50:54.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T15:50:54.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-13T15:50:54.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T15:50:54.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-13T15:50:54.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T15:50:54.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-13T15:50:54.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T15:50:54.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-13T15:50:54.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T15:50:54.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-13T15:50:54.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T15:50:54.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-13T15:50:54.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T15:50:54.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-13T15:50:54.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T15:50:54.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-13T15:50:54.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T15:50:54.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T15:50:54.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-13T15:50:54.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T15:50:54.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T15:50:54.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T15:50:54.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-13T15:50:54.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-13T15:50:54.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T15:50:54.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T15:50:54.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-13T15:50:54.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-13T15:50:54.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T15:50:54.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-13T15:50:54.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T15:50:54.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-13T15:50:54.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-13T15:50:54.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T15:50:54.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-13T15:50:54.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T15:50:54.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T15:50:54.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-13T15:50:54.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T15:50:54.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-13T15:50:54.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T15:50:54.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-13T15:50:54.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T15:50:54.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T15:50:54.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-13T15:50:54.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-13T15:50:54.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T15:50:54.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T15:50:54.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-13T15:50:54.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T15:50:54.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-13T15:50:54.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T15:50:54.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-13T15:50:54.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T15:50:54.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T15:50:54.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T15:50:54.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T15:50:54.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-13T15:50:54.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-13T15:50:54.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-13T15:50:54.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T15:50:54.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-13T15:50:54.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T15:50:54.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-13T15:50:54.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T15:50:54.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T15:50:54.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-13T15:50:54.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T15:50:54.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T15:50:54.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T15:50:54.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T15:50:54.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-13T15:50:54.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-13T15:50:54.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T15:50:54.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T15:50:54.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-13T15:50:54.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T15:50:54.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T15:50:54.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T15:50:54.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T15:50:54.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-13T15:50:54.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T15:50:54.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-13T15:50:54.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T15:50:54.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-13T15:50:54.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T15:50:54.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T15:50:54.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-13T15:50:54.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T15:50:54.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T15:50:54.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-13T15:50:54.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T15:50:54.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T15:50:54.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-13T15:50:54.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T15:50:54.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-13T15:50:54.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T15:50:54.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T15:50:54.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-13T15:50:54.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T15:50:54.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T15:50:54.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T15:50:54.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-13T15:50:54.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T15:50:54.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T15:50:54.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T15:50:54.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T15:50:54.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T15:50:54.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-13T15:50:54.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T15:50:54.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T15:50:54.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-13T15:50:54.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T15:50:54.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T15:50:54.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-13T15:50:54.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T15:50:54.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T15:50:54.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-13T15:50:54.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T15:50:54.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T15:50:54.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T15:50:54.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T15:50:54.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T15:50:54.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-13T15:50:54.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T15:50:54.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T15:50:54.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T15:50:54.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T15:50:54.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T15:50:54.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T15:50:54.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T15:50:54.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T15:50:54.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T15:50:54.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T15:50:54.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T15:50:54.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T15:50:54.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-13T15:50:54.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T15:50:54.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T15:50:54.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T15:50:54.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-13T15:50:54.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T15:50:54.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T15:50:54.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T15:50:54.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T15:50:54.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T15:50:54.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-13T15:50:54.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-13T15:50:54.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T15:50:54.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T15:50:54.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T15:50:54.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-13T15:50:54.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T15:50:54.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T15:50:54.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T15:50:54.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T15:50:54.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T15:50:54.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T15:50:54.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-13T15:50:54.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T15:50:54.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-13T15:50:54.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-13T15:50:54.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T15:50:54.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-13T15:50:54.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T15:50:54.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-13T15:50:54.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T15:50:54.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-13T15:50:54.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-13T15:50:54.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T15:50:54.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-13T15:50:54.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-13T15:50:54.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T15:50:54.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T15:50:54.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-13T15:50:54.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T15:50:54.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T15:50:54.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T15:50:54.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T15:50:54.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-13T15:50:54.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-13T15:50:54.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T15:50:54.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-13T15:50:54.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-13T15:50:54.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T15:50:54.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-13T15:50:54.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T15:50:54.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T15:50:54.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T15:50:54.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-13T15:50:54.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-13T15:50:54.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T15:50:54.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-13T15:50:54.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-13T15:50:54.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T15:50:54.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T15:50:54.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T15:50:54.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T15:50:54.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T15:50:54.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T15:50:54.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T15:50:54.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T15:50:54.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T15:50:54.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T15:50:54.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T15:50:54.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T15:50:54.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-13T15:50:54.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T15:50:54.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T15:50:54.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T15:50:54.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T15:50:54.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T15:50:54.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T15:50:54.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T15:50:54.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T15:50:54.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T15:50:54.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T15:50:54.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T15:50:54.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T15:50:54.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-13T15:50:54.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T15:50:54.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T15:50:54.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-13T15:50:54.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-13T15:50:54.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T15:50:54.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T15:50:54.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T15:50:54.477 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T15:50:54.477 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-13T15:50:54.477 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T15:50:54.478 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T15:50:54.478 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-13T15:50:54.478 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-13T15:50:54.478 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-13T15:50:54.478 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T15:50:54.479 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T15:50:54.479 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-13T15:50:54.479 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T15:50:54.479 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T15:50:54.479 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T15:50:54.479 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T15:50:54.480 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T15:50:54.480 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T15:50:54.480 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T15:50:54.480 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T15:50:54.480 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T15:50:54.481 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T15:50:54.481 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T15:50:54.481 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T15:50:54.481 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T15:50:54.481 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T15:50:54.482 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T15:50:54.482 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T15:50:54.482 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T15:50:54.482 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T15:50:54.482 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T15:50:54.482 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T15:50:54.483 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T15:50:54.483 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T15:50:54.483 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T15:50:54.483 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T15:50:54.483 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T15:50:54.484 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T15:50:54.484 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T15:50:54.484 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T15:50:54.484 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T15:50:54.484 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T15:50:54.484 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T15:50:54.485 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-13T15:50:54.485 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T15:50:54.485 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T15:50:54.485 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T15:50:54.485 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T15:50:54.486 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T15:50:54.486 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-13T15:50:54.486 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T15:50:54.486 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T15:50:54.486 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-13T15:50:54.486 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T15:50:54.487 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T15:50:54.487 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T15:50:54.487 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-13T15:50:54.487 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T15:50:54.487 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T15:50:54.488 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-13T15:50:54.488 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T15:50:54.488 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-13T15:50:54.488 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T15:50:54.488 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-13T15:50:54.489 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T15:50:54.489 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-13T15:50:54.489 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T15:50:54.489 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T15:50:54.489 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-13T15:50:54.489 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T15:50:54.490 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-13T15:50:54.490 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-13T15:50:54.490 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T15:50:54.490 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-13T15:50:54.490 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T15:50:54.491 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T15:50:54.491 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T15:50:54.491 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-13T15:50:54.491 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-13T15:50:54.491 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-13T15:50:54.491 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-13T15:50:54.492 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-13T15:50:54.492 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T15:50:54.492 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-13T15:50:54.492 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T15:50:54.492 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T15:50:54.493 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-13T15:50:54.493 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T15:50:54.493 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T15:50:54.493 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-13T15:50:54.493 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T15:50:54.493 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T15:50:54.494 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T15:50:54.494 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T15:50:54.494 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T15:50:54.494 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T15:50:54.494 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T15:50:54.495 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-13T15:50:54.495 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T15:50:54.495 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T15:50:54.495 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T15:50:54.495 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-13T15:50:54.495 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T15:50:54.496 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T15:50:54.496 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T15:50:54.496 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-13T15:50:54.496 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T15:50:54.496 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-13T15:50:54.497 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T15:50:54.497 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-13T15:50:54.497 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T15:50:54.497 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T15:50:54.497 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T15:50:54.497 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T15:50:54.498 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-13T15:50:54.498 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T15:50:54.498 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-13T15:50:54.498 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T15:50:54.498 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T15:50:54.499 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-13T15:50:54.499 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T15:50:54.499 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T15:50:54.499 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T15:50:54.499 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-13T15:50:54.499 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T15:50:54.500 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T15:50:54.500 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-13T15:50:54.500 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T15:50:54.500 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T15:50:54.500 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T15:50:54.501 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T15:50:54.501 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T15:50:54.501 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T15:50:54.501 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T15:50:54.501 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T15:50:54.502 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T15:50:54.502 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T15:50:54.502 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T15:50:54.502 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-13T15:50:54.502 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T15:50:54.502 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T15:50:54.503 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T15:50:54.503 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T15:50:54.503 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-13T15:50:54.503 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T15:50:54.503 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-13T15:50:54.504 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-13T15:50:54.504 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T15:50:54.504 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-13T15:50:54.504 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T15:50:54.504 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T15:50:54.504 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T15:50:54.505 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T15:50:54.505 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T15:50:54.505 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T15:50:54.505 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-13T15:50:54.505 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T15:50:54.506 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-13T15:50:54.506 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-13T15:50:54.506 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-13T15:50:54.506 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T15:50:54.506 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T15:50:54.506 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T15:50:54.507 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T15:50:54.507 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T15:50:54.507 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T15:50:54.507 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T15:50:54.507 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T15:50:54.508 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T15:50:54.508 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T15:50:54.508 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T15:50:54.508 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T15:50:54.508 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T15:50:54.508 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T15:50:54.509 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T15:50:54.509 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T15:50:54.509 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T15:50:54.509 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T15:50:54.509 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-13T15:50:54.510 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-13T15:50:54.510 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T15:50:54.510 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T15:50:54.510 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T15:50:54.510 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T15:50:54.510 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-13T15:50:54.511 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-13T15:50:54.511 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T15:50:54.511 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T15:50:54.511 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-13T15:50:54.511 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T15:50:54.512 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-13T15:50:54.512 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-13T15:50:54.512 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T15:50:54.512 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-13T15:50:54.512 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T15:50:54.513 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-13T15:50:54.513 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T15:50:54.513 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T15:50:54.513 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T15:50:54.513 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T15:50:54.513 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T15:50:54.514 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-13T15:50:54.514 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-13T15:50:54.514 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T15:50:54.514 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T15:50:54.514 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T15:50:54.515 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T15:50:54.515 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-13T15:50:54.515 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T15:50:54.515 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-13T15:50:54.515 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T15:50:54.516 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T15:50:54.516 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-13T15:50:54.516 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T15:50:54.516 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T15:50:54.516 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T15:50:54.517 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T15:50:54.517 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T15:50:54.517 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T15:50:54.517 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T15:50:54.517 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T15:50:54.517 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T15:50:54.517 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T15:50:54.517 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-13T15:50:54.518 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T15:50:54.518 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T15:50:54.518 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T15:50:54.518 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T15:50:54.518 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T15:50:54.518 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T15:50:54.518 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T15:50:54.518 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-13T15:50:54.518 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T15:50:54.518 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-13T15:50:54.518 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T15:50:54.518 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T15:50:54.518 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T15:50:54.518 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T15:50:54.519 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T15:50:54.519 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T15:50:54.519 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T15:50:54.519 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T15:50:54.519 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T15:50:54.519 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T15:50:54.519 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T15:50:54.519 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T15:50:54.519 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T15:50:54.519 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T15:50:54.519 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T15:50:54.519 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T15:50:54.519 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T15:50:54.519 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T15:50:54.520 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T15:50:54.520 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T15:50:54.520 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T15:50:54.520 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T15:50:54.520 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T15:50:54.520 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T15:50:54.520 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T15:50:54.520 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T15:50:54.520 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T15:50:54.520 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T15:50:54.520 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T15:50:54.520 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T15:50:54.520 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T15:50:54.520 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T15:50:54.521 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T15:50:54.521 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T15:50:54.521 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T15:50:54.521 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T15:50:54.521 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T15:50:54.521 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T15:50:54.521 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T15:50:54.521 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T15:50:54.521 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T15:50:54.521 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T15:50:54.521 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T15:50:54.521 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T15:50:54.521 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T15:50:54.522 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-13T15:50:54.522 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T15:50:54.522 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T15:50:54.522 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T15:50:54.522 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T15:50:54.522 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T15:50:54.522 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T15:50:54.522 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T15:50:54.522 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T15:50:54.522 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T15:50:54.522 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T15:50:54.522 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T15:50:54.522 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T15:50:54.522 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T15:50:54.523 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T15:50:54.523 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T15:50:54.523 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-13T15:50:54.523 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T15:50:54.523 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T15:50:54.523 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T15:50:54.523 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-13T15:50:54.523 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-13T15:50:54.523 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T15:50:54.523 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T15:50:54.523 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T15:50:54.523 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T15:50:54.523 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-13T15:50:54.524 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T15:50:54.524 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T15:50:54.524 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T15:50:54.524 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T15:50:54.524 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-13T15:50:54.524 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-13T15:50:54.524 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T15:50:54.524 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T15:50:54.524 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T15:50:54.524 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-13T15:50:54.524 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-13T15:50:54.524 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-13T15:50:54.524 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-13T15:50:54.524 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-13T15:50:54.525 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-13T15:50:54.525 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-13T15:50:54.525 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-13T15:50:54.525 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-13T15:50:54.525 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-13T15:50:54.525 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T15:50:54.525 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T15:50:54.525 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-13T15:50:54.525 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T15:50:54.525 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T15:50:54.525 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T15:50:54.525 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T15:50:54.525 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T15:50:54.526 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T15:50:54.526 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T15:50:54.526 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T15:50:54.526 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T15:50:54.526 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T15:50:54.526 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T15:50:54.526 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T15:50:54.526 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-13T15:50:54.526 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T15:50:54.526 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T15:50:54.526 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T15:50:54.526 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T15:50:54.526 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T15:50:54.526 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T15:50:54.527 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T15:50:54.527 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T15:50:54.527 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T15:50:54.527 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T15:50:54.527 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T15:50:54.527 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T15:50:54.527 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T15:50:54.527 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T15:50:54.527 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T15:50:54.527 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T15:50:54.527 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T15:50:54.527 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T15:50:54.527 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T15:50:54.527 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T15:50:54.528 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T15:50:54.528 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T15:50:54.528 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T15:50:54.528 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T15:50:54.528 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T15:50:54.528 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T15:50:54.528 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-13T15:50:54.528 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-13T15:50:54.528 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T15:50:54.528 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T15:50:54.528 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T15:50:54.528 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-13T15:50:54.528 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T15:50:54.528 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T15:50:54.529 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-13T15:50:54.529 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T15:50:54.529 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-13T15:50:54.529 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-13T15:50:54.529 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T15:50:54.529 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-13T15:50:54.529 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T15:50:54.529 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-13T15:50:54.529 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T15:50:54.529 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T15:50:54.529 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-13T15:50:54.529 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T15:50:54.529 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-13T15:50:54.529 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T15:50:54.530 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-13T15:50:54.530 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T15:50:54.530 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-13T15:50:54.530 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T15:50:54.530 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-13T15:50:54.530 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T15:50:54.530 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-13T15:50:54.530 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T15:50:54.530 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-13T15:50:54.530 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-13T15:50:54.530 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-13T15:50:54.530 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T15:50:54.530 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-13T15:50:54.530 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-13T15:50:54.531 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T15:50:54.531 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-13T15:50:54.531 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-13T15:50:54.531 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T15:50:54.531 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-13T15:50:54.531 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-13T15:50:54.531 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T15:50:54.531 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-13T15:50:54.531 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T15:50:54.531 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-13T15:50:54.531 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T15:50:54.531 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-13T15:50:54.531 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T15:50:54.531 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-13T15:50:54.532 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T15:50:54.532 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-13T15:50:54.532 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T15:50:54.532 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-13T15:50:54.532 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T15:50:54.532 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-13T15:50:54.532 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T15:50:54.532 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-13T15:50:54.532 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-13T15:50:54.532 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T15:50:54.532 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-13T15:50:54.532 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T15:50:54.532 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-13T15:50:54.532 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T15:50:54.533 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T15:50:54.533 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T15:50:54.533 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T15:50:54.533 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-13T15:50:54.533 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T15:50:54.533 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T15:50:54.533 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-13T15:50:54.533 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T15:50:54.533 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-13T15:50:54.533 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T15:50:54.533 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-13T15:50:54.533 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T15:50:54.533 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T15:50:54.534 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T15:50:54.534 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T15:50:54.534 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T15:50:54.534 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T15:50:54.534 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T15:50:54.534 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T15:50:54.534 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T15:50:54.534 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T15:50:54.534 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T15:50:54.534 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T15:50:54.534 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T15:50:54.534 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T15:50:54.534 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T15:50:54.534 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T15:50:54.535 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T15:50:54.535 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T15:50:54.535 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T15:50:54.535 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T15:50:54.535 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T15:50:54.535 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T15:50:54.535 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T15:50:54.535 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T15:50:54.535 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T15:50:54.535 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T15:50:54.535 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T15:50:54.535 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T15:50:54.535 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T15:50:54.535 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T15:50:54.536 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T15:50:54.536 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T15:50:54.536 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T15:50:54.536 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T15:50:54.536 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T15:50:54.536 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T15:50:54.536 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T15:50:54.536 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T15:50:54.536 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T15:50:54.536 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T15:50:54.536 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T15:50:54.536 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T15:50:54.536 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T15:50:54.536 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T15:50:54.537 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T15:50:54.537 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T15:50:54.537 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T15:50:54.537 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T15:50:54.537 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T15:50:54.537 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T15:50:54.537 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-13T15:50:54.537 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-13T15:50:54.537 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T15:50:54.537 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-13T15:50:54.537 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T15:50:54.537 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-13T15:50:54.537 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T15:50:54.537 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T15:50:54.538 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T15:50:54.538 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T15:50:54.538 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T15:50:54.538 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-13T15:50:54.538 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T15:50:54.538 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-13T15:50:54.538 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T15:50:54.538 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-13T15:50:54.538 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T15:50:54.538 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-13T15:50:54.538 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T15:50:54.538 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-13T15:50:54.538 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-13T15:50:54.538 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T15:50:54.539 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-13T15:50:54.539 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T15:50:54.539 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T15:50:54.539 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-13T15:50:54.539 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T15:50:54.539 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-13T15:50:54.539 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T15:50:54.539 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-13T15:50:54.539 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T15:50:54.539 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-13T15:50:54.540 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T15:50:54.540 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-13T15:50:54.540 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T15:50:54.540 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-13T15:50:54.540 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-13T15:50:54.540 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-13T15:50:54.540 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T15:50:54.540 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-13T15:50:54.540 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-13T15:50:54.540 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-13T15:50:54.540 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-13T15:50:54.540 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T15:50:54.540 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T15:50:54.541 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-13T15:50:54.541 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-13T15:50:54.541 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T15:50:54.541 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T15:50:54.541 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T15:50:54.541 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T15:50:54.541 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-13T15:50:54.541 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T15:50:54.541 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T15:50:54.541 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-13T15:50:54.541 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T15:50:54.541 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-13T15:50:54.541 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T15:50:54.541 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-13T15:50:54.541 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T15:50:54.542 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T15:50:54.542 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T15:50:54.542 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T15:50:54.542 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-13T15:50:54.542 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-13T15:50:54.542 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-13T15:50:54.542 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T15:50:54.542 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-13T15:50:54.542 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-13T15:50:54.542 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T15:50:54.542 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T15:50:54.542 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T15:50:54.542 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T15:50:54.542 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T15:50:54.543 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T15:50:54.543 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T15:50:54.543 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T15:50:54.543 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-13T15:50:54.543 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T15:50:54.543 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T15:50:54.543 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T15:50:54.543 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T15:50:54.543 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T15:50:54.543 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-13T15:50:54.543 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T15:50:54.543 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-13T15:50:54.543 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T15:50:54.543 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T15:50:54.544 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T15:50:54.544 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T15:50:54.544 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-13T15:50:54.544 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T15:50:54.544 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-13T15:50:54.544 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T15:50:54.544 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T15:50:54.544 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-13T15:50:54.544 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T15:50:54.544 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T15:50:54.544 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T15:50:54.544 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T15:50:54.544 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T15:50:54.545 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T15:50:54.545 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T15:50:54.545 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T15:50:54.545 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T15:50:54.545 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T15:50:54.545 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T15:50:54.545 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T15:50:54.545 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T15:50:54.545 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T15:50:54.545 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T15:50:54.545 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T15:50:54.545 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T15:50:54.545 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T15:50:54.545 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T15:50:54.546 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T15:50:54.546 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T15:50:54.546 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-13T15:50:54.546 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T15:50:54.546 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T15:50:54.546 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-13T15:50:54.546 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T15:50:54.546 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-13T15:50:54.546 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-13T15:50:54.546 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T15:50:54.546 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-13T15:50:54.546 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T15:50:54.546 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T15:50:54.546 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T15:50:54.547 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T15:50:54.547 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-13T15:50:54.547 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-13T15:50:54.547 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-13T15:50:54.547 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T15:50:54.547 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T15:50:54.547 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T15:50:54.547 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T15:50:54.547 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T15:50:54.547 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-13T15:50:54.547 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-13T15:50:54.547 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T15:50:54.547 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T15:50:54.547 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T15:50:54.548 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-13T15:50:54.548 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T15:50:54.548 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T15:50:54.548 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T15:50:54.548 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T15:50:54.548 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T15:50:54.548 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T15:50:54.548 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T15:50:54.548 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T15:50:54.548 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T15:50:54.548 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T15:50:54.548 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-13T15:50:54.548 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T15:50:54.549 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T15:50:54.549 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T15:50:54.549 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T15:50:54.549 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T15:50:54.549 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T15:50:54.549 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T15:50:54.549 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T15:50:54.549 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T15:50:54.549 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T15:50:54.549 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T15:50:54.549 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T15:50:54.549 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T15:50:54.549 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T15:50:54.549 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T15:50:54.550 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T15:50:54.550 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T15:50:54.550 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T15:50:54.550 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T15:50:54.550 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T15:50:54.550 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T15:50:54.550 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T15:50:54.550 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T15:50:54.550 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T15:50:54.550 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T15:50:54.550 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T15:50:54.550 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T15:50:54.550 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T15:50:54.550 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T15:50:54.551 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T15:50:54.551 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T15:50:54.551 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T15:50:54.551 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T15:50:54.551 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T15:50:54.551 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T15:50:54.551 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T15:50:54.551 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T15:50:54.551 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T15:50:54.551 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-13T15:50:54.551 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T15:50:54.551 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T15:50:54.551 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T15:50:54.551 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T15:50:54.552 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T15:50:54.552 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T15:50:54.552 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T15:50:54.552 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-13T15:50:54.552 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T15:50:54.552 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T15:50:54.552 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T15:50:54.552 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T15:50:54.552 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T15:50:54.552 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T15:50:54.552 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T15:50:54.552 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T15:50:54.552 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T15:50:54.553 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T15:50:54.553 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T15:50:54.553 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T15:50:54.553 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T15:50:54.553 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T15:50:54.553 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T15:50:54.553 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T15:50:54.553 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T15:50:54.553 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T15:50:54.553 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T15:50:54.553 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T15:50:54.553 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T15:50:54.553 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T15:50:54.553 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T15:50:54.554 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T15:50:54.554 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T15:50:54.554 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T15:50:54.554 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T15:50:54.554 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-13T15:50:54.554 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T15:50:54.554 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-13T15:50:54.554 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T15:50:54.554 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T15:50:54.554 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T15:50:54.554 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T15:50:54.554 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T15:50:54.554 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T15:50:54.554 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T15:50:54.555 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-13T15:50:54.555 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T15:50:54.555 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-13T15:50:54.555 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T15:50:54.555 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-13T15:50:54.555 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T15:50:54.555 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-13T15:50:54.555 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-13T15:50:54.555 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T15:50:54.555 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T15:50:54.555 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T15:50:54.555 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T15:50:54.555 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T15:50:54.555 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T15:50:54.556 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T15:50:54.556 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T15:50:54.556 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T15:50:54.556 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T15:50:54.556 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T15:50:54.556 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T15:50:54.556 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T15:50:54.556 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T15:50:54.556 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T15:50:54.556 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T15:50:54.556 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-13T15:50:54.556 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T15:50:54.556 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T15:50:54.557 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T15:50:54.557 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T15:50:54.557 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T15:50:54.557 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T15:50:54.557 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T15:50:54.557 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T15:50:54.557 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T15:50:54.557 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T15:50:54.557 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T15:50:54.557 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T15:50:54.557 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T15:50:54.557 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T15:50:54.557 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T15:50:54.558 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T15:50:54.558 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T15:50:54.558 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T15:50:54.558 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T15:50:54.558 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T15:50:54.558 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T15:50:54.558 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T15:50:54.558 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T15:50:54.558 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T15:50:54.558 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T15:50:54.558 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T15:50:54.558 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T15:50:54.558 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T15:50:54.558 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T15:50:54.559 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T15:50:54.559 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T15:50:54.559 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T15:50:54.559 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T15:50:54.559 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T15:50:54.559 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T15:50:54.559 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T15:50:54.559 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T15:50:54.559 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T15:50:54.559 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T15:50:54.559 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T15:50:54.559 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T15:50:54.559 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T15:50:54.559 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T15:50:54.560 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T15:50:54.560 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T15:50:54.560 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T15:50:54.560 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T15:50:54.560 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T15:50:54.560 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T15:50:54.560 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T15:50:54.560 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T15:50:54.560 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T15:50:54.560 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T15:50:54.560 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T15:50:54.560 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T15:50:54.560 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T15:50:54.560 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T15:50:54.561 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T15:50:54.561 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-13T15:50:54.561 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T15:50:54.561 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T15:50:54.561 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T15:50:54.561 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T15:50:54.561 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-13T15:50:54.561 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T15:50:54.561 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T15:50:54.561 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T15:50:54.561 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T15:50:54.561 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T15:50:54.561 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T15:50:54.562 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T15:50:54.562 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T15:50:54.562 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T15:50:54.562 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T15:50:54.562 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T15:50:54.562 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T15:50:54.562 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T15:50:54.562 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T15:50:54.562 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T15:50:54.562 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T15:50:54.562 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T15:50:54.562 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T15:50:54.562 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T15:50:54.562 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T15:50:54.563 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T15:50:54.563 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T15:50:54.563 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T15:50:54.563 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T15:50:54.563 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T15:50:54.563 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T15:50:54.563 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T15:50:54.563 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T15:50:54.563 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T15:50:54.563 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T15:50:54.563 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T15:50:54.563 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T15:50:54.563 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T15:50:54.564 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T15:50:54.564 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T15:50:54.564 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T15:50:54.564 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T15:50:54.564 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T15:50:54.564 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T15:50:54.564 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T15:50:54.564 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T15:50:54.564 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T15:50:54.564 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T15:50:54.564 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T15:50:54.564 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T15:50:54.564 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T15:50:54.564 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T15:50:54.565 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T15:50:54.565 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T15:50:54.565 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T15:50:54.565 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T15:50:54.565 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T15:50:54.565 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T15:50:54.565 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T15:50:54.565 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T15:50:54.565 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T15:50:54.565 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T15:50:54.565 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T15:50:54.565 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T15:50:54.565 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T15:50:54.565 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T15:50:54.566 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T15:50:54.566 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T15:50:54.566 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T15:50:54.566 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T15:50:54.566 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T15:50:54.566 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T15:50:54.566 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T15:50:54.566 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T15:50:54.566 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T15:50:54.566 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T15:50:54.566 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-13T15:50:54.566 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T15:50:54.566 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-13T15:50:54.566 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T15:50:54.567 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-13T15:50:54.567 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T15:50:54.567 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T15:50:54.567 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T15:50:54.567 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T15:50:54.567 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-13T15:50:54.567 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T15:50:54.567 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-13T15:50:54.567 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T15:50:54.567 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T15:50:54.567 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T15:50:54.567 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-13T15:50:54.567 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T15:50:54.567 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T15:50:54.568 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T15:50:54.568 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T15:50:54.568 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T15:50:54.568 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T15:50:54.568 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T15:50:54.568 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T15:50:54.568 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T15:50:54.568 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T15:50:54.568 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T15:50:54.568 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T15:50:54.568 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T15:50:54.568 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T15:50:54.568 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T15:50:54.568 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T15:50:54.569 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T15:50:54.569 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T15:50:54.569 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T15:50:54.569 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T15:50:54.569 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T15:50:54.569 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T15:50:54.569 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T15:50:54.569 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T15:50:54.569 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T15:50:54.569 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T15:50:54.569 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T15:50:54.569 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T15:50:54.569 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T15:50:54.569 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T15:50:54.570 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T15:50:54.570 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T15:50:54.570 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T15:50:54.570 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T15:50:54.570 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T15:50:54.570 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T15:50:54.570 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T15:50:54.570 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T15:50:54.570 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T15:50:54.570 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T15:50:54.570 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T15:50:54.570 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T15:50:54.570 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T15:50:54.571 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-13T15:50:54.571 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T15:50:54.571 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T15:50:54.571 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-13T15:50:54.571 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-13T15:50:54.571 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T15:50:54.571 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T15:50:54.571 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T15:50:54.571 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-13T15:50:54.571 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T15:50:54.571 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-13T15:50:54.571 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T15:50:54.571 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T15:50:54.571 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-13T15:50:54.572 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T15:50:54.572 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-13T15:50:54.572 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T15:50:54.572 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T15:50:54.572 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T15:50:54.572 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T15:50:54.572 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T15:50:54.572 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-13T15:50:54.572 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T15:50:54.572 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-13T15:50:54.572 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-13T15:50:54.572 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-13T15:50:54.572 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-13T15:50:54.572 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-13T15:50:54.573 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-13T15:50:54.573 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T15:50:54.573 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T15:50:54.573 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T15:50:54.573 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T15:50:54.573 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T15:50:54.573 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T15:50:54.573 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T15:50:54.573 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T15:50:54.573 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T15:50:54.573 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T15:50:54.573 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T15:50:54.573 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T15:50:54.573 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T15:50:54.574 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-13T15:50:54.574 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T15:50:54.578 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:50:54.578 DEBUG:teuthology.orchestra.run.smithi086:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-13T15:50:54.602 INFO:teuthology.orchestra.run.smithi086.stdout:postinstall scriptlet (using /bin/sh): 2024-09-13T15:50:54.602 INFO:teuthology.orchestra.run.smithi086.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T15:50:54.602 INFO:teuthology.orchestra.run.smithi086.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T15:50:54.602 INFO:teuthology.orchestra.run.smithi086.stdout:fi 2024-09-13T15:50:54.602 INFO:teuthology.orchestra.run.smithi086.stdout:for file in vmlinuz System.map config; do 2024-09-13T15:50:54.602 INFO:teuthology.orchestra.run.smithi086.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-13T15:50:54.602 INFO:teuthology.orchestra.run.smithi086.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T15:50:54.602 INFO:teuthology.orchestra.run.smithi086.stdout: fi 2024-09-13T15:50:54.602 INFO:teuthology.orchestra.run.smithi086.stdout:done 2024-09-13T15:50:54.602 INFO:teuthology.orchestra.run.smithi086.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-13T15:50:54.602 INFO:teuthology.orchestra.run.smithi086.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-13T15:50:54.602 INFO:teuthology.orchestra.run.smithi086.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T15:50:54.603 INFO:teuthology.orchestra.run.smithi086.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T15:50:54.603 INFO:teuthology.orchestra.run.smithi086.stdout:fi 2024-09-13T15:50:54.603 INFO:teuthology.orchestra.run.smithi086.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-13T15:50:54.603 INFO:teuthology.orchestra.run.smithi086.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:50:54.603 INFO:teuthology.orchestra.run.smithi086.stdout:fi 2024-09-13T15:50:54.603 INFO:teuthology.orchestra.run.smithi086.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-13T15:50:54.603 INFO:teuthology.orchestra.run.smithi086.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T15:50:54.603 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:50:54.603 INFO:teuthology.orchestra.run.smithi086.stdout:fi 2024-09-13T15:50:54.604 DEBUG:teuthology.orchestra.run.smithi086:> sudo rpm -qi grub2-tools 2024-09-13T15:50:54.685 INFO:teuthology.orchestra.run.smithi086.stdout:Name : grub2-tools 2024-09-13T15:50:54.686 INFO:teuthology.orchestra.run.smithi086.stdout:Epoch : 1 2024-09-13T15:50:54.686 INFO:teuthology.orchestra.run.smithi086.stdout:Version : 2.06 2024-09-13T15:50:54.686 INFO:teuthology.orchestra.run.smithi086.stdout:Release : 82.el9 2024-09-13T15:50:54.686 INFO:teuthology.orchestra.run.smithi086.stdout:Architecture: x86_64 2024-09-13T15:50:54.686 INFO:teuthology.orchestra.run.smithi086.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T15:50:54.686 INFO:teuthology.orchestra.run.smithi086.stdout:Group : Unspecified 2024-09-13T15:50:54.686 INFO:teuthology.orchestra.run.smithi086.stdout:Size : 8274670 2024-09-13T15:50:54.686 INFO:teuthology.orchestra.run.smithi086.stdout:License : GPLv3+ 2024-09-13T15:50:54.686 INFO:teuthology.orchestra.run.smithi086.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T15:50:54.686 INFO:teuthology.orchestra.run.smithi086.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T15:50:54.686 INFO:teuthology.orchestra.run.smithi086.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T15:50:54.686 INFO:teuthology.orchestra.run.smithi086.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T15:50:54.687 INFO:teuthology.orchestra.run.smithi086.stdout:Packager : builder@centos.org 2024-09-13T15:50:54.687 INFO:teuthology.orchestra.run.smithi086.stdout:Vendor : CentOS 2024-09-13T15:50:54.687 INFO:teuthology.orchestra.run.smithi086.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T15:50:54.687 INFO:teuthology.orchestra.run.smithi086.stdout:Summary : Support tools for GRUB. 2024-09-13T15:50:54.687 INFO:teuthology.orchestra.run.smithi086.stdout:Description : 2024-09-13T15:50:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T15:50:54.687 INFO:teuthology.orchestra.run.smithi086.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T15:50:54.687 INFO:teuthology.orchestra.run.smithi086.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T15:50:54.687 INFO:teuthology.orchestra.run.smithi086.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T15:50:54.687 INFO:teuthology.orchestra.run.smithi086.stdout:hardware devices. 2024-09-13T15:50:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T15:50:54.687 INFO:teuthology.orchestra.run.smithi086.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T15:50:54.688 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T15:50:54.688 INFO:teuthology.task.kernel:Updating grub on smithi086 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:50:54.688 DEBUG:teuthology.orchestra.run.smithi086:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T15:50:55.274 INFO:teuthology.orchestra.run.smithi086.stderr:Generating grub configuration file ... 2024-09-13T15:50:56.625 INFO:teuthology.orchestra.run.smithi086.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T15:50:56.658 INFO:teuthology.orchestra.run.smithi086.stderr:done 2024-09-13T15:50:56.660 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-09-13T15:50:56.676 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.lA8y9sayMo 2024-09-13T15:50:56.677 DEBUG:teuthology.orchestra.run.smithi086:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.lA8y9sayMo 2024-09-13T15:50:56.743 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.lA8y9sayMo 2024-09-13T15:50:56.885 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.lA8y9sayMo is 6KB 2024-09-13T15:50:56.933 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.lA8y9sayMo 2024-09-13T15:50:56.948 DEBUG:teuthology.orchestra.run.smithi086:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T15:50:57.028 INFO:teuthology.orchestra.run.smithi086.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T15:50:57.028 INFO:teuthology.orchestra.run.smithi086.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T15:50:57.028 INFO:teuthology.orchestra.run.smithi086.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T15:50:57.028 INFO:teuthology.orchestra.run.smithi086.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-13T15:50:57.030 DEBUG:teuthology.orchestra.run.smithi086:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:50:57.186 DEBUG:teuthology.orchestra.run.smithi086:> sudo shutdown -r now 2024-09-13T15:51:27.189 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-13T15:51:27.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-13T15:51:27.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:52:27.202 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T15:52:36.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-13T15:52:36.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:52:43.759 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-09-13T15:52:44.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-13T15:52:44.268 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T15:52:44.269 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-09-13T15:52:44.302 INFO:teuthology.orchestra.run.smithi086.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:52:44.303 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:52:44.303 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T15:52:44.303 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T15:52:45.307 DEBUG:teuthology.parallel:result is None 2024-09-13T15:52:45.307 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T15:52:45.314 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T15:52:45.314 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T15:52:45.318 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T15:52:45.321 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T15:52:45.349 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T15:52:45.358 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T15:52:45.374 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T15:52:45.375 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T15:52:45.394 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T15:52:45.397 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T15:52:45.504 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T15:52:45.513 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T15:52:45.513 DEBUG:teuthology.orchestra.run.smithi139:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T15:52:45.530 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:52:45.531 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T15:52:45.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:52:45.548 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T15:52:45.552 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T15:52:45.574 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T15:52:45.608 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T15:52:45.627 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T15:52:45.648 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T15:52:45.662 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T15:52:45.669 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T15:52:45.704 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T15:52:45.707 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T15:52:45.714 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T15:52:45.714 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T15:52:45.717 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T15:52:45.720 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T15:52:45.771 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T15:52:45.782 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T15:52:45.782 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T15:52:45.786 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T15:52:45.790 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T15:52:45.818 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T15:52:45.931 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T15:52:46.002 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T15:52:46.074 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T15:52:46.134 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T15:52:46.134 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T15:52:46.208 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T15:52:46.261 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T15:52:46.312 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T15:52:46.409 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T15:52:46.439 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T15:52:46.439 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T15:52:46.506 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T15:52:46.559 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T15:52:46.605 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T15:52:46.699 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T15:52:46.731 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T15:52:46.731 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T15:52:46.797 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2024-09-13T15:52:46.801 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2024-09-13T15:52:46.804 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2024-09-13T15:52:46.840 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T15:52:46.876 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T15:52:46.884 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T15:52:47.299 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T15:52:47.305 INFO:teuthology.task.internal:Starting timer... 2024-09-13T15:52:47.306 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T15:52:47.317 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T15:52:47.327 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-13T15:52:47.327 DEBUG:teuthology.orchestra.run.smithi086:> sudo service auditd rotate 2024-09-13T15:52:47.413 INFO:teuthology.orchestra.run.smithi086.stdout:Rotating logs: 2024-09-13T15:52:47.416 DEBUG:teuthology.orchestra.run.smithi139:> sudo service auditd rotate 2024-09-13T15:52:47.455 INFO:teuthology.orchestra.run.smithi139.stdout:Rotating logs: 2024-09-13T15:52:47.457 DEBUG:teuthology.orchestra.run.smithi194:> sudo service auditd rotate 2024-09-13T15:52:47.509 INFO:teuthology.orchestra.run.smithi194.stdout:Rotating logs: 2024-09-13T15:52:47.511 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T15:52:47.511 DEBUG:teuthology.orchestra.run.smithi086:> /usr/sbin/getenforce 2024-09-13T15:52:47.554 INFO:teuthology.orchestra.run.smithi086.stdout:Permissive 2024-09-13T15:52:47.554 DEBUG:teuthology.orchestra.run.smithi139:> /usr/sbin/getenforce 2024-09-13T15:52:47.577 INFO:teuthology.orchestra.run.smithi139.stdout:Permissive 2024-09-13T15:52:47.577 DEBUG:teuthology.orchestra.run.smithi194:> /usr/sbin/getenforce 2024-09-13T15:52:47.599 INFO:teuthology.orchestra.run.smithi194.stdout:Permissive 2024-09-13T15:52:47.599 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi086.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi139.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi194.front.sepia.ceph.com': 'permissive'} 2024-09-13T15:52:47.599 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T15:52:47.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:52:47.658 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T15:52:47.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:52:47.689 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T15:52:47.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:52:47.716 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T15:52:47.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo /usr/sbin/setenforce permissive 2024-09-13T15:52:47.859 DEBUG:teuthology.orchestra.run.smithi139:> sudo /usr/sbin/setenforce permissive 2024-09-13T15:52:47.889 DEBUG:teuthology.orchestra.run.smithi194:> sudo /usr/sbin/setenforce permissive 2024-09-13T15:52:47.918 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T15:52:47.926 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T15:52:47.938 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T15:52:47.939 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi086.front.sepia.ceph.com,smithi139.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T15:57:32.614 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi086.front.sepia.ceph.com'), Remote(name='ubuntu@smithi139.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2024-09-13T15:57:32.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-13T15:57:32.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:57:32.731 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-09-13T15:57:32.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-13T15:57:32.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T15:57:32.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:57:32.934 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-09-13T15:57:33.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T15:57:33.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-13T15:57:33.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:57:33.122 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-09-13T15:57:33.203 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-13T15:57:33.203 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T15:57:33.213 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T15:57:33.213 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T15:57:33.214 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T15:57:33.218 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T15:57:33.218 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T15:57:33.220 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T15:57:33.220 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T15:57:33.250 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T15:57:33.265 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T15:57:33.273 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T15:57:33.277 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T15:57:33.290 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: ntpd: command not found 2024-09-13T15:57:33.293 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T15:57:33.302 INFO:teuthology.orchestra.run.smithi139.stdout:506 Cannot talk to daemon 2024-09-13T15:57:33.302 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T15:57:33.316 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T15:57:33.319 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: ntpd: command not found 2024-09-13T15:57:33.330 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T15:57:33.331 INFO:teuthology.orchestra.run.smithi194.stdout:506 Cannot talk to daemon 2024-09-13T15:57:33.345 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T15:57:33.354 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: ntpd: command not found 2024-09-13T15:57:33.359 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T15:57:33.378 INFO:teuthology.orchestra.run.smithi086.stdout:506 Cannot talk to daemon 2024-09-13T15:57:33.382 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-09-13T15:57:33.386 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T15:57:33.386 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-09-13T15:57:33.386 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:57:33.386 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:57:33.386 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:57:33.386 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:57:33.408 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T15:57:33.414 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-09-13T15:57:33.418 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T15:57:33.418 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-09-13T15:57:33.418 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:57:33.418 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:57:33.418 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:57:33.418 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:57:33.437 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T15:57:33.539 INFO:teuthology.orchestra.run.smithi086.stderr:bash: line 1: ntpq: command not found 2024-09-13T15:57:33.547 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T15:57:33.547 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2024-09-13T15:57:33.547 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:57:33.547 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:57:33.547 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:57:33.548 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:57:33.548 INFO:teuthology.run_tasks:Running task install... 2024-09-13T15:57:33.656 DEBUG:teuthology.task.install:project ceph 2024-09-13T15:57:33.656 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}} 2024-09-13T15:57:33.656 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'} 2024-09-13T15:57:33.657 INFO:teuthology.task.install:Using flavor: default 2024-09-13T15:57:33.662 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T15:57:33.662 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T15:57:33.663 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'tag': None, 'wait_for_package': False} 2024-09-13T15:57:33.663 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:57:33.666 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'tag': None, 'wait_for_package': False} 2024-09-13T15:57:33.666 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:57:33.667 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'tag': None, 'wait_for_package': False} 2024-09-13T15:57:33.668 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:57:33.836 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/ 2024-09-13T15:57:33.836 INFO:teuthology.task.install.rpm:Package version is 18.2.4-850.g50bbe7f3 2024-09-13T15:57:33.855 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/ 2024-09-13T15:57:33.855 INFO:teuthology.task.install.rpm:Package version is 18.2.4-850.g50bbe7f3 2024-09-13T15:57:33.856 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/ 2024-09-13T15:57:33.856 INFO:teuthology.task.install.rpm:Package version is 18.2.4-850.g50bbe7f3 2024-09-13T15:57:33.967 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T15:57:33.967 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T15:57:33.967 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T15:57:33.978 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T15:57:33.978 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T15:57:33.978 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T15:57:33.989 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T15:57:33.989 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T15:57:33.989 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T15:57:34.006 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T15:57:34.007 DEBUG:teuthology.orchestra.run.smithi194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50bbe7f395997dcd871813949c49addbbf630361/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T15:57:34.019 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T15:57:34.020 DEBUG:teuthology.orchestra.run.smithi139:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50bbe7f395997dcd871813949c49addbbf630361/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T15:57:34.025 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T15:57:34.025 DEBUG:teuthology.orchestra.run.smithi086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50bbe7f395997dcd871813949c49addbbf630361/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T15:57:34.076 DEBUG:teuthology.orchestra.run.smithi194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T15:57:34.089 DEBUG:teuthology.orchestra.run.smithi139:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T15:57:34.124 DEBUG:teuthology.orchestra.run.smithi086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T15:57:34.154 DEBUG:teuthology.orchestra.run.smithi194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T15:57:34.166 DEBUG:teuthology.orchestra.run.smithi139:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T15:57:34.203 DEBUG:teuthology.orchestra.run.smithi086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T15:57:34.218 INFO:teuthology.orchestra.run.smithi194.stdout:check_obsoletes = 1 2024-09-13T15:57:34.220 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum clean all 2024-09-13T15:57:34.231 INFO:teuthology.orchestra.run.smithi139.stdout:check_obsoletes = 1 2024-09-13T15:57:34.233 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum clean all 2024-09-13T15:57:34.258 INFO:teuthology.orchestra.run.smithi086.stdout:check_obsoletes = 1 2024-09-13T15:57:34.261 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum clean all 2024-09-13T15:57:34.445 INFO:teuthology.orchestra.run.smithi194.stdout:45 files removed 2024-09-13T15:57:34.456 INFO:teuthology.orchestra.run.smithi139.stdout:45 files removed 2024-09-13T15:57:34.472 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T15:57:34.483 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T15:57:34.524 INFO:teuthology.orchestra.run.smithi086.stdout:45 files removed 2024-09-13T15:57:34.556 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T15:57:35.012 INFO:teuthology.orchestra.run.smithi139.stdout:ceph packages for x86_64 310 kB/s | 77 kB 00:00 2024-09-13T15:57:35.029 INFO:teuthology.orchestra.run.smithi194.stdout:ceph packages for x86_64 274 kB/s | 77 kB 00:00 2024-09-13T15:57:35.251 INFO:teuthology.orchestra.run.smithi086.stdout:ceph packages for x86_64 258 kB/s | 77 kB 00:00 2024-09-13T15:57:35.279 INFO:teuthology.orchestra.run.smithi139.stdout:ceph noarch packages 51 kB/s | 11 kB 00:00 2024-09-13T15:57:35.313 INFO:teuthology.orchestra.run.smithi194.stdout:ceph noarch packages 48 kB/s | 11 kB 00:00 2024-09-13T15:57:35.543 INFO:teuthology.orchestra.run.smithi086.stdout:ceph noarch packages 46 kB/s | 11 kB 00:00 2024-09-13T15:57:35.555 INFO:teuthology.orchestra.run.smithi139.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-13T15:57:35.588 INFO:teuthology.orchestra.run.smithi194.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-13T15:57:35.819 INFO:teuthology.orchestra.run.smithi086.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-13T15:57:36.321 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-13T15:57:36.377 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-13T15:57:37.338 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-13T15:57:38.048 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-13T15:57:38.511 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-13T15:57:40.789 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - AppStream 8.7 MB/s | 20 MB 00:02 2024-09-13T15:57:43.732 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-13T15:57:44.204 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-13T15:57:45.131 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-13T15:57:45.232 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 19 kB 00:00 2024-09-13T15:57:46.295 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-13T15:57:46.496 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:01 2024-09-13T15:57:47.348 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:01 2024-09-13T15:57:47.497 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-13T15:57:48.252 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-13T15:57:51.859 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-13T15:57:53.644 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-13T15:57:53.881 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-13T15:57:54.136 INFO:teuthology.orchestra.run.smithi194.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T15:57:54.136 INFO:teuthology.orchestra.run.smithi194.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T15:57:54.146 INFO:teuthology.orchestra.run.smithi194.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T15:57:54.147 INFO:teuthology.orchestra.run.smithi194.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T15:57:54.148 INFO:teuthology.orchestra.run.smithi194.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T15:57:54.149 INFO:teuthology.orchestra.run.smithi194.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T15:57:54.150 INFO:teuthology.orchestra.run.smithi194.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T15:57:54.153 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T15:57:54.154 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T15:57:54.213 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-13T15:57:54.226 INFO:teuthology.orchestra.run.smithi194.stdout:====================================================================================== 2024-09-13T15:57:54.227 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-13T15:57:54.227 INFO:teuthology.orchestra.run.smithi194.stdout:====================================================================================== 2024-09-13T15:57:54.227 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-13T15:57:54.227 INFO:teuthology.orchestra.run.smithi194.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T15:57:54.227 INFO:teuthology.orchestra.run.smithi194.stdout: ceph x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 6.5 k 2024-09-13T15:57:54.227 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 5.1 M 2024-09-13T15:57:54.227 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 852 k 2024-09-13T15:57:54.227 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 143 k 2024-09-13T15:57:54.227 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 1.5 M 2024-09-13T15:57:54.227 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 139 k 2024-09-13T15:57:54.227 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 3.5 M 2024-09-13T15:57:54.227 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 7.4 M 2024-09-13T15:57:54.228 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 49 k 2024-09-13T15:57:54.228 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 7.8 M 2024-09-13T15:57:54.228 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 40 M 2024-09-13T15:57:54.228 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 264 k 2024-09-13T15:57:54.228 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 226 k 2024-09-13T15:57:54.228 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 224 k 2024-09-13T15:57:54.228 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 18 k 2024-09-13T15:57:54.228 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T15:57:54.229 INFO:teuthology.orchestra.run.smithi194.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T15:57:54.229 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T15:57:54.229 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 31 k 2024-09-13T15:57:54.229 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 712 k 2024-09-13T15:57:54.229 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 127 k 2024-09-13T15:57:54.229 INFO:teuthology.orchestra.run.smithi194.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T15:57:54.229 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T15:57:54.229 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T15:57:54.229 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T15:57:54.229 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T15:57:54.229 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T15:57:54.229 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 162 k 2024-09-13T15:57:54.230 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 319 k 2024-09-13T15:57:54.230 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 301 k 2024-09-13T15:57:54.230 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 99 k 2024-09-13T15:57:54.230 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 87 k 2024-09-13T15:57:54.230 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T15:57:54.230 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 172 k 2024-09-13T15:57:54.230 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T15:57:54.230 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2024-09-13T15:57:54.230 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T15:57:54.230 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T15:57:54.230 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T15:57:54.230 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T15:57:54.230 INFO:teuthology.orchestra.run.smithi194.stdout: librados2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.3 M 2024-09-13T15:57:54.231 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T15:57:54.231 INFO:teuthology.orchestra.run.smithi194.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T15:57:54.231 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T15:57:54.231 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-13T15:57:54.231 INFO:teuthology.orchestra.run.smithi194.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T15:57:54.231 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T15:57:54.231 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 18 M 2024-09-13T15:57:54.231 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 24 k 2024-09-13T15:57:54.231 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 2.1 M 2024-09-13T15:57:54.231 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 246 k 2024-09-13T15:57:54.231 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.7 M 2024-09-13T15:57:54.231 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 17 M 2024-09-13T15:57:54.232 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 16 k 2024-09-13T15:57:54.232 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 25 k 2024-09-13T15:57:54.232 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T15:57:54.232 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T15:57:54.232 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T15:57:54.232 INFO:teuthology.orchestra.run.smithi194.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T15:57:54.232 INFO:teuthology.orchestra.run.smithi194.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T15:57:54.232 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T15:57:54.232 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T15:57:54.233 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T15:57:54.233 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 166 k 2024-09-13T15:57:54.233 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T15:57:54.233 INFO:teuthology.orchestra.run.smithi194.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T15:57:54.233 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T15:57:54.233 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T15:57:54.233 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T15:57:54.233 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 477 k 2024-09-13T15:57:54.233 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T15:57:54.233 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.5 M 2024-09-13T15:57:54.233 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T15:57:54.233 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T15:57:54.233 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T15:57:54.234 INFO:teuthology.orchestra.run.smithi194.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T15:57:54.234 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T15:57:54.234 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T15:57:54.234 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T15:57:54.234 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T15:57:54.234 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T15:57:54.234 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T15:57:54.234 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T15:57:54.234 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 45 k 2024-09-13T15:57:54.234 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 129 k 2024-09-13T15:57:54.234 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T15:57:54.234 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T15:57:54.234 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T15:57:54.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T15:57:54.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T15:57:54.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T15:57:54.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T15:57:54.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T15:57:54.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T15:57:54.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T15:57:54.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T15:57:54.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T15:57:54.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T15:57:54.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T15:57:54.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T15:57:54.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T15:57:54.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T15:57:54.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T15:57:54.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T15:57:54.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T15:57:54.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T15:57:54.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T15:57:54.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T15:57:54.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T15:57:54.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T15:57:54.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T15:57:54.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T15:57:54.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T15:57:54.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T15:57:54.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T15:57:54.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T15:57:54.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T15:57:54.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T15:57:54.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T15:57:54.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T15:57:54.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T15:57:54.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T15:57:54.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T15:57:54.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T15:57:54.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T15:57:54.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T15:57:54.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T15:57:54.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T15:57:54.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T15:57:54.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T15:57:54.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T15:57:54.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T15:57:54.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T15:57:54.238 INFO:teuthology.orchestra.run.smithi194.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T15:57:54.238 INFO:teuthology.orchestra.run.smithi194.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T15:57:54.238 INFO:teuthology.orchestra.run.smithi194.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T15:57:54.238 INFO:teuthology.orchestra.run.smithi194.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T15:57:54.238 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T15:57:54.238 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T15:57:54.238 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T15:57:54.238 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-13T15:57:54.239 INFO:teuthology.orchestra.run.smithi194.stdout:====================================================================================== 2024-09-13T15:57:54.239 INFO:teuthology.orchestra.run.smithi194.stdout:Install 130 Packages 2024-09-13T15:57:54.239 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 8 Packages 2024-09-13T15:57:54.239 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T15:57:54.239 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 203 M 2024-09-13T15:57:54.239 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-13T15:57:54.676 INFO:teuthology.orchestra.run.smithi194.stdout:(1/138): ceph-18.2.4-850.g50bbe7f3.el9.x86_64.r 49 kB/s | 6.5 kB 00:00 2024-09-13T15:57:54.943 INFO:teuthology.orchestra.run.smithi194.stdout:(2/138): ceph-base-18.2.4-850.g50bbe7f3.el9.x86 13 MB/s | 5.1 MB 00:00 2024-09-13T15:57:54.977 INFO:teuthology.orchestra.run.smithi194.stdout:(3/138): ceph-fuse-18.2.4-850.g50bbe7f3.el9.x86 2.8 MB/s | 852 kB 00:00 2024-09-13T15:57:55.002 INFO:teuthology.orchestra.run.smithi194.stdout:(4/138): ceph-immutable-object-cache-18.2.4-850 2.4 MB/s | 143 kB 00:00 2024-09-13T15:57:55.094 INFO:teuthology.orchestra.run.smithi194.stdout:(5/138): ceph-mgr-18.2.4-850.g50bbe7f3.el9.x86_ 16 MB/s | 1.5 MB 00:00 2024-09-13T15:57:55.311 INFO:teuthology.orchestra.run.smithi194.stdout:(6/138): ceph-mon-18.2.4-850.g50bbe7f3.el9.x86_ 22 MB/s | 4.7 MB 00:00 2024-09-13T15:57:55.353 INFO:teuthology.orchestra.run.smithi194.stdout:(7/138): ceph-mds-18.2.4-850.g50bbe7f3.el9.x86_ 5.6 MB/s | 2.1 MB 00:00 2024-09-13T15:57:55.745 INFO:teuthology.orchestra.run.smithi194.stdout:(8/138): ceph-common-18.2.4-850.g50bbe7f3.el9.x 15 MB/s | 18 MB 00:01 2024-09-13T15:57:55.795 INFO:teuthology.orchestra.run.smithi194.stdout:(9/138): ceph-selinux-18.2.4-850.g50bbe7f3.el9. 506 kB/s | 25 kB 00:00 2024-09-13T15:57:55.912 INFO:teuthology.orchestra.run.smithi139.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T15:57:55.914 INFO:teuthology.orchestra.run.smithi139.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T15:57:55.925 INFO:teuthology.orchestra.run.smithi139.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T15:57:55.926 INFO:teuthology.orchestra.run.smithi139.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T15:57:55.927 INFO:teuthology.orchestra.run.smithi139.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T15:57:55.928 INFO:teuthology.orchestra.run.smithi139.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T15:57:55.930 INFO:teuthology.orchestra.run.smithi139.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T15:57:55.933 INFO:teuthology.orchestra.run.smithi139.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T15:57:55.934 INFO:teuthology.orchestra.run.smithi139.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T15:57:55.993 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-13T15:57:56.018 INFO:teuthology.orchestra.run.smithi139.stdout:====================================================================================== 2024-09-13T15:57:56.018 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-13T15:57:56.018 INFO:teuthology.orchestra.run.smithi139.stdout:====================================================================================== 2024-09-13T15:57:56.018 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-13T15:57:56.018 INFO:teuthology.orchestra.run.smithi139.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T15:57:56.018 INFO:teuthology.orchestra.run.smithi139.stdout: ceph x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 6.5 k 2024-09-13T15:57:56.018 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 5.1 M 2024-09-13T15:57:56.018 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 852 k 2024-09-13T15:57:56.019 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 143 k 2024-09-13T15:57:56.019 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 1.5 M 2024-09-13T15:57:56.019 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 139 k 2024-09-13T15:57:56.019 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 3.5 M 2024-09-13T15:57:56.019 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 7.4 M 2024-09-13T15:57:56.019 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 49 k 2024-09-13T15:57:56.019 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 7.8 M 2024-09-13T15:57:56.019 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 40 M 2024-09-13T15:57:56.019 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 264 k 2024-09-13T15:57:56.019 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 226 k 2024-09-13T15:57:56.019 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 224 k 2024-09-13T15:57:56.019 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-top noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 18 k 2024-09-13T15:57:56.019 INFO:teuthology.orchestra.run.smithi139.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T15:57:56.020 INFO:teuthology.orchestra.run.smithi139.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T15:57:56.020 INFO:teuthology.orchestra.run.smithi139.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T15:57:56.020 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 31 k 2024-09-13T15:57:56.020 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 712 k 2024-09-13T15:57:56.020 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 127 k 2024-09-13T15:57:56.020 INFO:teuthology.orchestra.run.smithi139.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T15:57:56.020 INFO:teuthology.orchestra.run.smithi139.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T15:57:56.020 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T15:57:56.020 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T15:57:56.020 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T15:57:56.020 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T15:57:56.020 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 162 k 2024-09-13T15:57:56.020 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 319 k 2024-09-13T15:57:56.020 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 301 k 2024-09-13T15:57:56.021 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 99 k 2024-09-13T15:57:56.021 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 87 k 2024-09-13T15:57:56.021 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T15:57:56.021 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 172 k 2024-09-13T15:57:56.021 INFO:teuthology.orchestra.run.smithi139.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T15:57:56.021 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrading: 2024-09-13T15:57:56.021 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T15:57:56.021 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T15:57:56.021 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T15:57:56.021 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T15:57:56.021 INFO:teuthology.orchestra.run.smithi139.stdout: librados2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.3 M 2024-09-13T15:57:56.021 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T15:57:56.021 INFO:teuthology.orchestra.run.smithi139.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T15:57:56.022 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T15:57:56.022 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-13T15:57:56.022 INFO:teuthology.orchestra.run.smithi139.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T15:57:56.022 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T15:57:56.022 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 18 M 2024-09-13T15:57:56.022 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 24 k 2024-09-13T15:57:56.022 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 2.1 M 2024-09-13T15:57:56.022 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 246 k 2024-09-13T15:57:56.022 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.7 M 2024-09-13T15:57:56.022 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 17 M 2024-09-13T15:57:56.022 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 16 k 2024-09-13T15:57:56.022 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 25 k 2024-09-13T15:57:56.022 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T15:57:56.022 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T15:57:56.023 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T15:57:56.023 INFO:teuthology.orchestra.run.smithi139.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T15:57:56.023 INFO:teuthology.orchestra.run.smithi139.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T15:57:56.023 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T15:57:56.023 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T15:57:56.023 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T15:57:56.023 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 166 k 2024-09-13T15:57:56.023 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T15:57:56.023 INFO:teuthology.orchestra.run.smithi139.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T15:57:56.023 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T15:57:56.023 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T15:57:56.023 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T15:57:56.023 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 477 k 2024-09-13T15:57:56.024 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T15:57:56.024 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.5 M 2024-09-13T15:57:56.024 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T15:57:56.024 INFO:teuthology.orchestra.run.smithi139.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T15:57:56.024 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T15:57:56.024 INFO:teuthology.orchestra.run.smithi139.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T15:57:56.024 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T15:57:56.024 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T15:57:56.024 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T15:57:56.024 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T15:57:56.024 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T15:57:56.024 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T15:57:56.024 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T15:57:56.024 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 45 k 2024-09-13T15:57:56.025 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 129 k 2024-09-13T15:57:56.025 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T15:57:56.025 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T15:57:56.025 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T15:57:56.025 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T15:57:56.025 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T15:57:56.025 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T15:57:56.025 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T15:57:56.025 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T15:57:56.025 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T15:57:56.025 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T15:57:56.025 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T15:57:56.026 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T15:57:56.026 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T15:57:56.026 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T15:57:56.026 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T15:57:56.026 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T15:57:56.026 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T15:57:56.026 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T15:57:56.026 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T15:57:56.026 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T15:57:56.026 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T15:57:56.026 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T15:57:56.026 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T15:57:56.026 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T15:57:56.026 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T15:57:56.027 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T15:57:56.027 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T15:57:56.027 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T15:57:56.027 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T15:57:56.027 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T15:57:56.027 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T15:57:56.027 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T15:57:56.027 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T15:57:56.027 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T15:57:56.027 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T15:57:56.027 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T15:57:56.027 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T15:57:56.027 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T15:57:56.027 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T15:57:56.028 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T15:57:56.028 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T15:57:56.028 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T15:57:56.028 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T15:57:56.028 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T15:57:56.028 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T15:57:56.028 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T15:57:56.028 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T15:57:56.028 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T15:57:56.028 INFO:teuthology.orchestra.run.smithi139.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T15:57:56.028 INFO:teuthology.orchestra.run.smithi139.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T15:57:56.028 INFO:teuthology.orchestra.run.smithi139.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T15:57:56.028 INFO:teuthology.orchestra.run.smithi139.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T15:57:56.029 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T15:57:56.029 INFO:teuthology.orchestra.run.smithi139.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T15:57:56.029 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T15:57:56.029 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-13T15:57:56.029 INFO:teuthology.orchestra.run.smithi139.stdout:====================================================================================== 2024-09-13T15:57:56.029 INFO:teuthology.orchestra.run.smithi139.stdout:Install 130 Packages 2024-09-13T15:57:56.029 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrade 8 Packages 2024-09-13T15:57:56.029 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T15:57:56.030 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 203 M 2024-09-13T15:57:56.030 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-13T15:57:56.095 INFO:teuthology.orchestra.run.smithi194.stdout:(10/138): ceph-osd-18.2.4-850.g50bbe7f3.el9.x86 21 MB/s | 17 MB 00:00 2024-09-13T15:57:56.187 INFO:teuthology.orchestra.run.smithi194.stdout:(11/138): ceph-radosgw-18.2.4-850.g50bbe7f3.el9 9.3 MB/s | 7.8 MB 00:00 2024-09-13T15:57:56.212 INFO:teuthology.orchestra.run.smithi194.stdout:(12/138): cephfs-mirror-18.2.4-850.g50bbe7f3.el 1.9 MB/s | 224 kB 00:00 2024-09-13T15:57:56.229 INFO:teuthology.orchestra.run.smithi194.stdout:(13/138): libcephfs-devel-18.2.4-850.g50bbe7f3. 744 kB/s | 31 kB 00:00 2024-09-13T15:57:56.263 INFO:teuthology.orchestra.run.smithi194.stdout:(14/138): libcephfs2-18.2.4-850.g50bbe7f3.el9.x 14 MB/s | 712 kB 00:00 2024-09-13T15:57:56.288 INFO:teuthology.orchestra.run.smithi194.stdout:(15/138): libcephsqlite-18.2.4-850.g50bbe7f3.el 2.8 MB/s | 166 kB 00:00 2024-09-13T15:57:56.313 INFO:teuthology.orchestra.run.smithi194.stdout:(16/138): librados-devel-18.2.4-850.g50bbe7f3.e 2.5 MB/s | 127 kB 00:00 2024-09-13T15:57:56.347 INFO:teuthology.orchestra.run.smithi194.stdout:(17/138): libradosstriper1-18.2.4-850.g50bbe7f3 8.0 MB/s | 477 kB 00:00 2024-09-13T15:57:56.375 INFO:teuthology.orchestra.run.smithi086.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T15:57:56.376 INFO:teuthology.orchestra.run.smithi086.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T15:57:56.387 INFO:teuthology.orchestra.run.smithi086.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T15:57:56.388 INFO:teuthology.orchestra.run.smithi086.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T15:57:56.389 INFO:teuthology.orchestra.run.smithi086.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T15:57:56.390 INFO:teuthology.orchestra.run.smithi086.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T15:57:56.391 INFO:teuthology.orchestra.run.smithi086.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T15:57:56.394 INFO:teuthology.orchestra.run.smithi086.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T15:57:56.395 INFO:teuthology.orchestra.run.smithi086.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T15:57:56.397 INFO:teuthology.orchestra.run.smithi194.stdout:(18/138): python3-ceph-argparse-18.2.4-850.g50b 900 kB/s | 45 kB 00:00 2024-09-13T15:57:56.456 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-13T15:57:56.472 INFO:teuthology.orchestra.run.smithi194.stdout:(19/138): python3-ceph-common-18.2.4-850.g50bbe 1.7 MB/s | 129 kB 00:00 2024-09-13T15:57:56.476 INFO:teuthology.orchestra.run.smithi086.stdout:====================================================================================== 2024-09-13T15:57:56.476 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-09-13T15:57:56.476 INFO:teuthology.orchestra.run.smithi086.stdout:====================================================================================== 2024-09-13T15:57:56.476 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-13T15:57:56.476 INFO:teuthology.orchestra.run.smithi086.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T15:57:56.476 INFO:teuthology.orchestra.run.smithi086.stdout: ceph x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 6.5 k 2024-09-13T15:57:56.476 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 5.1 M 2024-09-13T15:57:56.476 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 852 k 2024-09-13T15:57:56.476 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 143 k 2024-09-13T15:57:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 1.5 M 2024-09-13T15:57:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 139 k 2024-09-13T15:57:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 3.5 M 2024-09-13T15:57:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 7.4 M 2024-09-13T15:57:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 49 k 2024-09-13T15:57:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 7.8 M 2024-09-13T15:57:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 40 M 2024-09-13T15:57:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 264 k 2024-09-13T15:57:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 226 k 2024-09-13T15:57:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 224 k 2024-09-13T15:57:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-top noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 18 k 2024-09-13T15:57:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T15:57:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T15:57:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T15:57:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 31 k 2024-09-13T15:57:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 712 k 2024-09-13T15:57:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 127 k 2024-09-13T15:57:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T15:57:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T15:57:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T15:57:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T15:57:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T15:57:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T15:57:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 162 k 2024-09-13T15:57:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 319 k 2024-09-13T15:57:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 301 k 2024-09-13T15:57:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 99 k 2024-09-13T15:57:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 87 k 2024-09-13T15:57:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T15:57:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 172 k 2024-09-13T15:57:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T15:57:56.479 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrading: 2024-09-13T15:57:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T15:57:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T15:57:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T15:57:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T15:57:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: librados2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.3 M 2024-09-13T15:57:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T15:57:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T15:57:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T15:57:56.480 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-09-13T15:57:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T15:57:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T15:57:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 18 M 2024-09-13T15:57:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 24 k 2024-09-13T15:57:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 2.1 M 2024-09-13T15:57:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 246 k 2024-09-13T15:57:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.7 M 2024-09-13T15:57:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 17 M 2024-09-13T15:57:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 16 k 2024-09-13T15:57:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 25 k 2024-09-13T15:57:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T15:57:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T15:57:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T15:57:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T15:57:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T15:57:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T15:57:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T15:57:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T15:57:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 166 k 2024-09-13T15:57:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T15:57:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T15:57:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T15:57:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T15:57:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T15:57:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 477 k 2024-09-13T15:57:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T15:57:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.5 M 2024-09-13T15:57:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T15:57:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T15:57:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T15:57:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T15:57:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T15:57:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T15:57:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T15:57:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T15:57:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T15:57:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T15:57:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T15:57:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 45 k 2024-09-13T15:57:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 129 k 2024-09-13T15:57:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T15:57:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T15:57:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T15:57:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T15:57:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T15:57:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T15:57:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T15:57:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T15:57:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T15:57:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T15:57:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T15:57:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T15:57:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T15:57:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T15:57:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T15:57:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T15:57:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T15:57:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T15:57:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T15:57:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T15:57:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T15:57:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T15:57:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T15:57:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T15:57:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T15:57:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T15:57:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T15:57:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T15:57:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T15:57:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T15:57:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T15:57:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T15:57:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T15:57:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T15:57:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T15:57:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T15:57:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T15:57:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T15:57:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T15:57:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T15:57:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T15:57:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T15:57:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T15:57:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T15:57:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T15:57:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T15:57:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T15:57:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T15:57:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T15:57:56.487 INFO:teuthology.orchestra.run.smithi086.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T15:57:56.487 INFO:teuthology.orchestra.run.smithi086.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T15:57:56.487 INFO:teuthology.orchestra.run.smithi086.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T15:57:56.487 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T15:57:56.487 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T15:57:56.487 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T15:57:56.487 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-13T15:57:56.487 INFO:teuthology.orchestra.run.smithi086.stdout:====================================================================================== 2024-09-13T15:57:56.487 INFO:teuthology.orchestra.run.smithi086.stdout:Install 130 Packages 2024-09-13T15:57:56.487 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrade 8 Packages 2024-09-13T15:57:56.487 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T15:57:56.488 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 203 M 2024-09-13T15:57:56.488 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-13T15:57:56.526 INFO:teuthology.orchestra.run.smithi139.stdout:(1/138): ceph-18.2.4-850.g50bbe7f3.el9.x86_64.r 36 kB/s | 6.5 kB 00:00 2024-09-13T15:57:56.539 INFO:teuthology.orchestra.run.smithi194.stdout:(20/138): librgw2-18.2.4-850.g50bbe7f3.el9.x86_ 20 MB/s | 4.5 MB 00:00 2024-09-13T15:57:56.565 INFO:teuthology.orchestra.run.smithi194.stdout:(21/138): python3-cephfs-18.2.4-850.g50bbe7f3.e 1.7 MB/s | 162 kB 00:00 2024-09-13T15:57:56.598 INFO:teuthology.orchestra.run.smithi194.stdout:(22/138): python3-rados-18.2.4-850.g50bbe7f3.el 5.3 MB/s | 319 kB 00:00 2024-09-13T15:57:56.632 INFO:teuthology.orchestra.run.smithi194.stdout:(23/138): python3-rbd-18.2.4-850.g50bbe7f3.el9. 4.4 MB/s | 301 kB 00:00 2024-09-13T15:57:56.682 INFO:teuthology.orchestra.run.smithi194.stdout:(24/138): python3-rgw-18.2.4-850.g50bbe7f3.el9. 1.2 MB/s | 99 kB 00:00 2024-09-13T15:57:56.707 INFO:teuthology.orchestra.run.smithi194.stdout:(25/138): rbd-fuse-18.2.4-850.g50bbe7f3.el9.x86 1.1 MB/s | 87 kB 00:00 2024-09-13T15:57:56.783 INFO:teuthology.orchestra.run.smithi194.stdout:(26/138): rbd-nbd-18.2.4-850.g50bbe7f3.el9.x86_ 2.2 MB/s | 172 kB 00:00 2024-09-13T15:57:56.850 INFO:teuthology.orchestra.run.smithi194.stdout:(27/138): rbd-mirror-18.2.4-850.g50bbe7f3.el9.x 18 MB/s | 3.0 MB 00:00 2024-09-13T15:57:56.875 INFO:teuthology.orchestra.run.smithi194.stdout:(28/138): ceph-grafana-dashboards-18.2.4-850.g5 266 kB/s | 24 kB 00:00 2024-09-13T15:57:56.900 INFO:teuthology.orchestra.run.smithi194.stdout:(29/138): ceph-mgr-cephadm-18.2.4-850.g50bbe7f3 2.7 MB/s | 139 kB 00:00 2024-09-13T15:57:56.926 INFO:teuthology.orchestra.run.smithi139.stdout:(2/138): ceph-fuse-18.2.4-850.g50bbe7f3.el9.x86 2.1 MB/s | 852 kB 00:00 2024-09-13T15:57:57.110 INFO:teuthology.orchestra.run.smithi139.stdout:(3/138): ceph-immutable-object-cache-18.2.4-850 778 kB/s | 143 kB 00:00 2024-09-13T15:57:57.199 INFO:teuthology.orchestra.run.smithi086.stdout:(1/138): ceph-18.2.4-850.g50bbe7f3.el9.x86_64.r 20 kB/s | 6.5 kB 00:00 2024-09-13T15:57:57.200 INFO:teuthology.orchestra.run.smithi194.stdout:(30/138): ceph-mgr-dashboard-18.2.4-850.g50bbe7 11 MB/s | 3.5 MB 00:00 2024-09-13T15:57:57.300 INFO:teuthology.orchestra.run.smithi194.stdout:(31/138): ceph-mgr-modules-core-18.2.4-850.g50b 2.4 MB/s | 246 kB 00:00 2024-09-13T15:57:57.409 INFO:teuthology.orchestra.run.smithi194.stdout:(32/138): ceph-mgr-diskprediction-local-18.2.4- 15 MB/s | 7.4 MB 00:00 2024-09-13T15:57:57.410 INFO:teuthology.orchestra.run.smithi139.stdout:(4/138): ceph-base-18.2.4-850.g50bbe7f3.el9.x86 4.8 MB/s | 5.1 MB 00:01 2024-09-13T15:57:57.434 INFO:teuthology.orchestra.run.smithi194.stdout:(33/138): ceph-mgr-rook-18.2.4-850.g50bbe7f3.el 369 kB/s | 49 kB 00:00 2024-09-13T15:57:57.467 INFO:teuthology.orchestra.run.smithi194.stdout:(34/138): ceph-prometheus-alerts-18.2.4-850.g50 287 kB/s | 16 kB 00:00 2024-09-13T15:57:57.501 INFO:teuthology.orchestra.run.smithi194.stdout:(35/138): ceph-volume-18.2.4-850.g50bbe7f3.el9. 3.9 MB/s | 264 kB 00:00 2024-09-13T15:57:57.508 INFO:teuthology.orchestra.run.smithi086.stdout:(2/138): ceph-fuse-18.2.4-850.g50bbe7f3.el9.x86 2.7 MB/s | 852 kB 00:00 2024-09-13T15:57:57.551 INFO:teuthology.orchestra.run.smithi194.stdout:(36/138): cephadm-18.2.4-850.g50bbe7f3.el9.noar 2.6 MB/s | 226 kB 00:00 2024-09-13T15:57:57.568 INFO:teuthology.orchestra.run.smithi194.stdout:(37/138): cephfs-top-18.2.4-850.g50bbe7f3.el9.n 273 kB/s | 18 kB 00:00 2024-09-13T15:57:57.593 INFO:teuthology.orchestra.run.smithi139.stdout:(5/138): ceph-mgr-18.2.4-850.g50bbe7f3.el9.x86_ 8.0 MB/s | 1.5 MB 00:00 2024-09-13T15:57:57.624 INFO:teuthology.orchestra.run.smithi086.stdout:(3/138): ceph-immutable-object-cache-18.2.4-850 1.2 MB/s | 143 kB 00:00 2024-09-13T15:57:57.792 INFO:teuthology.orchestra.run.smithi086.stdout:(4/138): ceph-mds-18.2.4-850.g50bbe7f3.el9.x86_ 13 MB/s | 2.1 MB 00:00 2024-09-13T15:57:57.860 INFO:teuthology.orchestra.run.smithi139.stdout:(6/138): ceph-mds-18.2.4-850.g50bbe7f3.el9.x86_ 2.8 MB/s | 2.1 MB 00:00 2024-09-13T15:57:57.909 INFO:teuthology.orchestra.run.smithi086.stdout:(5/138): ceph-mgr-18.2.4-850.g50bbe7f3.el9.x86_ 13 MB/s | 1.5 MB 00:00 2024-09-13T15:57:57.943 INFO:teuthology.orchestra.run.smithi194.stdout:(38/138): ceph-test-18.2.4-850.g50bbe7f3.el9.x8 18 MB/s | 40 MB 00:02 2024-09-13T15:57:57.968 INFO:teuthology.orchestra.run.smithi194.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 191 kB/s | 80 kB 00:00 2024-09-13T15:57:57.977 INFO:teuthology.orchestra.run.smithi139.stdout:(7/138): ceph-mon-18.2.4-850.g50bbe7f3.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-13T15:57:58.127 INFO:teuthology.orchestra.run.smithi194.stdout:(40/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-09-13T15:57:58.150 INFO:teuthology.orchestra.run.smithi086.stdout:(6/138): ceph-mon-18.2.4-850.g50bbe7f3.el9.x86_ 19 MB/s | 4.7 MB 00:00 2024-09-13T15:57:58.152 INFO:teuthology.orchestra.run.smithi194.stdout:(41/138): libquadmath-11.5.0-2.el9.x86_64.rpm 917 kB/s | 191 kB 00:00 2024-09-13T15:57:58.178 INFO:teuthology.orchestra.run.smithi139.stdout:(8/138): ceph-common-18.2.4-850.g50bbe7f3.el9.x 10 MB/s | 18 MB 00:01 2024-09-13T15:57:58.202 INFO:teuthology.orchestra.run.smithi194.stdout:(42/138): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-13T15:57:58.227 INFO:teuthology.orchestra.run.smithi194.stdout:(43/138): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-13T15:57:58.253 INFO:teuthology.orchestra.run.smithi139.stdout:(9/138): ceph-selinux-18.2.4-850.g50bbe7f3.el9. 337 kB/s | 25 kB 00:00 2024-09-13T15:57:58.286 INFO:teuthology.orchestra.run.smithi194.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-13T15:57:58.311 INFO:teuthology.orchestra.run.smithi194.stdout:(45/138): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-13T15:57:58.370 INFO:teuthology.orchestra.run.smithi194.stdout:(46/138): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-13T15:57:58.479 INFO:teuthology.orchestra.run.smithi194.stdout:(47/138): automake-1.16.2-8.el9.noarch.rpm 4.0 MB/s | 689 kB 00:00 2024-09-13T15:57:58.512 INFO:teuthology.orchestra.run.smithi194.stdout:(48/138): boost-program-options-1.75.0-8.el9.x8 3.2 MB/s | 107 kB 00:00 2024-09-13T15:57:58.554 INFO:teuthology.orchestra.run.smithi194.stdout:(49/138): bison-3.7.4-5.el9.x86_64.rpm 5.0 MB/s | 943 kB 00:00 2024-09-13T15:57:58.579 INFO:teuthology.orchestra.run.smithi194.stdout:(50/138): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-09-13T15:57:58.605 INFO:teuthology.orchestra.run.smithi194.stdout:(51/138): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-13T15:57:58.638 INFO:teuthology.orchestra.run.smithi194.stdout:(52/138): python3-cryptography-36.0.1-4.el9.x86 2.4 MB/s | 1.2 MB 00:00 2024-09-13T15:57:58.664 INFO:teuthology.orchestra.run.smithi194.stdout:(53/138): flexiblas-3.0.4-8.el9.x86_64.rpm 391 kB/s | 33 kB 00:00 2024-09-13T15:57:58.678 INFO:teuthology.orchestra.run.smithi139.stdout:(10/138): ceph-radosgw-18.2.4-850.g50bbe7f3.el9 11 MB/s | 7.8 MB 00:00 2024-09-13T15:57:58.706 INFO:teuthology.orchestra.run.smithi194.stdout:(54/138): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-09-13T15:57:58.726 INFO:teuthology.orchestra.run.smithi086.stdout:(7/138): ceph-base-18.2.4-850.g50bbe7f3.el9.x86 2.8 MB/s | 5.1 MB 00:01 2024-09-13T15:57:58.731 INFO:teuthology.orchestra.run.smithi194.stdout:(55/138): flexiblas-openblas-openmp-3.0.4-8.el9 197 kB/s | 18 kB 00:00 2024-09-13T15:57:58.745 INFO:teuthology.orchestra.run.smithi139.stdout:(11/138): cephfs-mirror-18.2.4-850.g50bbe7f3.el 3.3 MB/s | 224 kB 00:00 2024-09-13T15:57:58.756 INFO:teuthology.orchestra.run.smithi194.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-13T15:57:58.806 INFO:teuthology.orchestra.run.smithi194.stdout:(57/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-09-13T15:57:58.831 INFO:teuthology.orchestra.run.smithi194.stdout:(58/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-09-13T15:57:58.845 INFO:teuthology.orchestra.run.smithi139.stdout:(12/138): libcephfs-devel-18.2.4-850.g50bbe7f3. 310 kB/s | 31 kB 00:00 2024-09-13T15:57:58.865 INFO:teuthology.orchestra.run.smithi194.stdout:(59/138): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-09-13T15:57:58.890 INFO:teuthology.orchestra.run.smithi194.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-13T15:57:58.916 INFO:teuthology.orchestra.run.smithi194.stdout:(61/138): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-13T15:57:58.929 INFO:teuthology.orchestra.run.smithi139.stdout:(13/138): libcephfs2-18.2.4-850.g50bbe7f3.el9.x 8.4 MB/s | 712 kB 00:00 2024-09-13T15:57:58.941 INFO:teuthology.orchestra.run.smithi194.stdout:(62/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-13T15:57:58.966 INFO:teuthology.orchestra.run.smithi194.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 770 kB/s | 38 kB 00:00 2024-09-13T15:57:58.987 INFO:teuthology.orchestra.run.smithi139.stdout:(14/138): libcephsqlite-18.2.4-850.g50bbe7f3.el 2.8 MB/s | 166 kB 00:00 2024-09-13T15:57:59.016 INFO:teuthology.orchestra.run.smithi194.stdout:(64/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-13T15:57:59.043 INFO:teuthology.orchestra.run.smithi086.stdout:(8/138): ceph-osd-18.2.4-850.g50bbe7f3.el9.x86_ 19 MB/s | 17 MB 00:00 2024-09-13T15:57:59.045 INFO:teuthology.orchestra.run.smithi139.stdout:(15/138): librados-devel-18.2.4-850.g50bbe7f3.e 2.1 MB/s | 127 kB 00:00 2024-09-13T15:57:59.092 INFO:teuthology.orchestra.run.smithi194.stdout:(65/138): openblas-openmp-0.3.26-2.el9.x86_64.r 33 MB/s | 4.9 MB 00:00 2024-09-13T15:57:59.093 INFO:teuthology.orchestra.run.smithi086.stdout:(9/138): ceph-selinux-18.2.4-850.g50bbe7f3.el9. 507 kB/s | 25 kB 00:00 2024-09-13T15:57:59.129 INFO:teuthology.orchestra.run.smithi139.stdout:(16/138): libradosstriper1-18.2.4-850.g50bbe7f3 5.6 MB/s | 477 kB 00:00 2024-09-13T15:57:59.167 INFO:teuthology.orchestra.run.smithi194.stdout:(66/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-09-13T15:57:59.209 INFO:teuthology.orchestra.run.smithi194.stdout:(67/138): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-13T15:57:59.234 INFO:teuthology.orchestra.run.smithi194.stdout:(68/138): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-13T15:57:59.276 INFO:teuthology.orchestra.run.smithi194.stdout:(69/138): postgresql-13.16-1.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2024-09-13T15:57:59.326 INFO:teuthology.orchestra.run.smithi194.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-13T15:57:59.401 INFO:teuthology.orchestra.run.smithi194.stdout:(71/138): postgresql-server-13.16-1.el9.x86_64. 30 MB/s | 5.8 MB 00:00 2024-09-13T15:57:59.426 INFO:teuthology.orchestra.run.smithi194.stdout:(72/138): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-13T15:57:59.443 INFO:teuthology.orchestra.run.smithi194.stdout:(73/138): python3-jsonpatch-1.21-16.el9.noarch. 614 kB/s | 26 kB 00:00 2024-09-13T15:57:59.460 INFO:teuthology.orchestra.run.smithi194.stdout:(74/138): python3-jsonpointer-2.0-4.el9.noarch. 570 kB/s | 19 kB 00:00 2024-09-13T15:57:59.486 INFO:teuthology.orchestra.run.smithi194.stdout:(75/138): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-13T15:57:59.511 INFO:teuthology.orchestra.run.smithi194.stdout:(76/138): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-13T15:57:59.594 INFO:teuthology.orchestra.run.smithi194.stdout:(77/138): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-13T15:57:59.613 INFO:teuthology.orchestra.run.smithi139.stdout:(17/138): librgw2-18.2.4-850.g50bbe7f3.el9.x86_ 9.2 MB/s | 4.5 MB 00:00 2024-09-13T15:57:59.619 INFO:teuthology.orchestra.run.smithi194.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-13T15:57:59.645 INFO:teuthology.orchestra.run.smithi194.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-13T15:57:59.662 INFO:teuthology.orchestra.run.smithi194.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-13T15:57:59.687 INFO:teuthology.orchestra.run.smithi194.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-13T15:57:59.697 INFO:teuthology.orchestra.run.smithi139.stdout:(18/138): python3-ceph-argparse-18.2.4-850.g50b 540 kB/s | 45 kB 00:00 2024-09-13T15:57:59.713 INFO:teuthology.orchestra.run.smithi194.stdout:(82/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-13T15:57:59.735 INFO:teuthology.orchestra.run.smithi086.stdout:(10/138): ceph-radosgw-18.2.4-850.g50bbe7f3.el9 7.7 MB/s | 7.8 MB 00:01 2024-09-13T15:57:59.738 INFO:teuthology.orchestra.run.smithi194.stdout:(83/138): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-13T15:57:59.763 INFO:teuthology.orchestra.run.smithi194.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-13T15:57:59.773 INFO:teuthology.orchestra.run.smithi139.stdout:(19/138): python3-ceph-common-18.2.4-850.g50bbe 1.7 MB/s | 129 kB 00:00 2024-09-13T15:57:59.789 INFO:teuthology.orchestra.run.smithi194.stdout:(85/138): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-13T15:57:59.819 INFO:teuthology.orchestra.run.smithi086.stdout:(11/138): cephfs-mirror-18.2.4-850.g50bbe7f3.el 2.6 MB/s | 224 kB 00:00 2024-09-13T15:57:59.864 INFO:teuthology.orchestra.run.smithi194.stdout:(86/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-13T15:57:59.872 INFO:teuthology.orchestra.run.smithi139.stdout:(20/138): python3-cephfs-18.2.4-850.g50bbe7f3.e 1.6 MB/s | 162 kB 00:00 2024-09-13T15:57:59.889 INFO:teuthology.orchestra.run.smithi194.stdout:(87/138): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-13T15:57:59.902 INFO:teuthology.orchestra.run.smithi086.stdout:(12/138): libcephfs-devel-18.2.4-850.g50bbe7f3. 375 kB/s | 31 kB 00:00 2024-09-13T15:57:59.914 INFO:teuthology.orchestra.run.smithi194.stdout:(88/138): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-13T15:57:59.940 INFO:teuthology.orchestra.run.smithi194.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T15:57:59.956 INFO:teuthology.orchestra.run.smithi139.stdout:(21/138): python3-rados-18.2.4-850.g50bbe7f3.el 3.7 MB/s | 319 kB 00:00 2024-09-13T15:57:59.965 INFO:teuthology.orchestra.run.smithi194.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-13T15:57:59.990 INFO:teuthology.orchestra.run.smithi194.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-13T15:58:00.002 INFO:teuthology.orchestra.run.smithi086.stdout:(13/138): libcephfs2-18.2.4-850.g50bbe7f3.el9.x 7.0 MB/s | 712 kB 00:00 2024-09-13T15:58:00.015 INFO:teuthology.orchestra.run.smithi194.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-13T15:58:00.056 INFO:teuthology.orchestra.run.smithi139.stdout:(22/138): python3-rbd-18.2.4-850.g50bbe7f3.el9. 2.9 MB/s | 301 kB 00:00 2024-09-13T15:58:00.065 INFO:teuthology.orchestra.run.smithi194.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.4 MB/s | 111 kB 00:00 2024-09-13T15:58:00.095 INFO:teuthology.orchestra.run.smithi086.stdout:(14/138): libcephsqlite-18.2.4-850.g50bbe7f3.el 1.8 MB/s | 166 kB 00:00 2024-09-13T15:58:00.100 INFO:teuthology.orchestra.run.smithi194.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 3.6 MB/s | 308 kB 00:00 2024-09-13T15:58:00.124 INFO:teuthology.orchestra.run.smithi194.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T15:58:00.140 INFO:teuthology.orchestra.run.smithi139.stdout:(23/138): python3-rgw-18.2.4-850.g50bbe7f3.el9. 1.2 MB/s | 99 kB 00:00 2024-09-13T15:58:00.149 INFO:teuthology.orchestra.run.smithi194.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T15:58:00.175 INFO:teuthology.orchestra.run.smithi194.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-13T15:58:00.177 INFO:teuthology.orchestra.run.smithi086.stdout:(15/138): librados-devel-18.2.4-850.g50bbe7f3.e 1.5 MB/s | 127 kB 00:00 2024-09-13T15:58:00.240 INFO:teuthology.orchestra.run.smithi139.stdout:(24/138): rbd-fuse-18.2.4-850.g50bbe7f3.el9.x86 867 kB/s | 87 kB 00:00 2024-09-13T15:58:00.242 INFO:teuthology.orchestra.run.smithi194.stdout:(98/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-13T15:58:00.278 INFO:teuthology.orchestra.run.smithi086.stdout:(16/138): libradosstriper1-18.2.4-850.g50bbe7f3 4.7 MB/s | 477 kB 00:00 2024-09-13T15:58:00.283 INFO:teuthology.orchestra.run.smithi194.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 13 MB/s | 548 kB 00:00 2024-09-13T15:58:00.309 INFO:teuthology.orchestra.run.smithi194.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-13T15:58:00.334 INFO:teuthology.orchestra.run.smithi194.stdout:(101/138): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-13T15:58:00.359 INFO:teuthology.orchestra.run.smithi194.stdout:(102/138): python3-certifi-2023.05.07-4.el9.noa 570 kB/s | 14 kB 00:00 2024-09-13T15:58:00.393 INFO:teuthology.orchestra.run.smithi194.stdout:(103/138): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-13T15:58:00.426 INFO:teuthology.orchestra.run.smithi194.stdout:(104/138): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-13T15:58:00.485 INFO:teuthology.orchestra.run.smithi194.stdout:(105/138): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-13T15:58:00.510 INFO:teuthology.orchestra.run.smithi194.stdout:(106/138): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-13T15:58:00.536 INFO:teuthology.orchestra.run.smithi194.stdout:(107/138): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-13T15:58:00.561 INFO:teuthology.orchestra.run.smithi194.stdout:(108/138): python3-google-auth-2.34.0-1.el9.noa 1.6 MB/s | 220 kB 00:00 2024-09-13T15:58:00.595 INFO:teuthology.orchestra.run.smithi194.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2024-09-13T15:58:00.620 INFO:teuthology.orchestra.run.smithi194.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2024-09-13T15:58:00.645 INFO:teuthology.orchestra.run.smithi194.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-13T15:58:00.671 INFO:teuthology.orchestra.run.smithi194.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-13T15:58:00.696 INFO:teuthology.orchestra.run.smithi194.stdout:(113/138): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-13T15:58:00.713 INFO:teuthology.orchestra.run.smithi194.stdout:(114/138): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-13T15:58:00.728 INFO:teuthology.orchestra.run.smithi086.stdout:(17/138): librgw2-18.2.4-850.g50bbe7f3.el9.x86_ 9.9 MB/s | 4.5 MB 00:00 2024-09-13T15:58:00.746 INFO:teuthology.orchestra.run.smithi194.stdout:(115/138): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-09-13T15:58:00.770 INFO:teuthology.orchestra.run.smithi086.stdout:(18/138): python3-ceph-argparse-18.2.4-850.g50b 1.1 MB/s | 45 kB 00:00 2024-09-13T15:58:00.771 INFO:teuthology.orchestra.run.smithi194.stdout:(116/138): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-13T15:58:00.797 INFO:teuthology.orchestra.run.smithi194.stdout:(117/138): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-09-13T15:58:00.822 INFO:teuthology.orchestra.run.smithi194.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-13T15:58:00.845 INFO:teuthology.orchestra.run.smithi086.stdout:(19/138): python3-ceph-common-18.2.4-850.g50bbe 1.7 MB/s | 129 kB 00:00 2024-09-13T15:58:00.848 INFO:teuthology.orchestra.run.smithi194.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-13T15:58:00.865 INFO:teuthology.orchestra.run.smithi139.stdout:(25/138): ceph-test-18.2.4-850.g50bbe7f3.el9.x8 15 MB/s | 40 MB 00:02 2024-09-13T15:58:00.932 INFO:teuthology.orchestra.run.smithi139.stdout:(26/138): rbd-mirror-18.2.4-850.g50bbe7f3.el9.x 4.3 MB/s | 3.0 MB 00:00 2024-09-13T15:58:00.957 INFO:teuthology.orchestra.run.smithi139.stdout:(27/138): rbd-nbd-18.2.4-850.g50bbe7f3.el9.x86_ 1.8 MB/s | 172 kB 00:00 2024-09-13T15:58:00.983 INFO:teuthology.orchestra.run.smithi139.stdout:(28/138): ceph-grafana-dashboards-18.2.4-850.g5 487 kB/s | 24 kB 00:00 2024-09-13T15:58:01.006 INFO:teuthology.orchestra.run.smithi194.stdout:(120/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-13T15:58:01.008 INFO:teuthology.orchestra.run.smithi139.stdout:(29/138): ceph-mgr-cephadm-18.2.4-850.g50bbe7f3 2.7 MB/s | 139 kB 00:00 2024-09-13T15:58:01.031 INFO:teuthology.orchestra.run.smithi194.stdout:(121/138): python3-rsa-4.9-2.el9.noarch.rpm 322 kB/s | 59 kB 00:00 2024-09-13T15:58:01.065 INFO:teuthology.orchestra.run.smithi194.stdout:(122/138): python3-routes-2.5.1-5.el9.noarch.rp 778 kB/s | 188 kB 00:00 2024-09-13T15:58:01.090 INFO:teuthology.orchestra.run.smithi194.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-13T15:58:01.116 INFO:teuthology.orchestra.run.smithi194.stdout:(124/138): python3-tempora-5.0.0-2.el9.noarch.r 329 kB/s | 36 kB 00:00 2024-09-13T15:58:01.141 INFO:teuthology.orchestra.run.smithi194.stdout:(125/138): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-13T15:58:01.166 INFO:teuthology.orchestra.run.smithi194.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 808 kB/s | 20 kB 00:00 2024-09-13T15:58:01.191 INFO:teuthology.orchestra.run.smithi194.stdout:(127/138): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-13T15:58:01.200 INFO:teuthology.orchestra.run.smithi139.stdout:(30/138): ceph-osd-18.2.4-850.g50bbe7f3.el9.x86 5.0 MB/s | 17 MB 00:03 2024-09-13T15:58:01.208 INFO:teuthology.orchestra.run.smithi194.stdout:(128/138): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-13T15:58:01.233 INFO:teuthology.orchestra.run.smithi194.stdout:(129/138): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-09-13T15:58:01.267 INFO:teuthology.orchestra.run.smithi139.stdout:(31/138): ceph-mgr-dashboard-18.2.4-850.g50bbe7 12 MB/s | 3.5 MB 00:00 2024-09-13T15:58:01.284 INFO:teuthology.orchestra.run.smithi086.stdout:(20/138): ceph-test-18.2.4-850.g50bbe7f3.el9.x8 18 MB/s | 40 MB 00:02 2024-09-13T15:58:01.292 INFO:teuthology.orchestra.run.smithi139.stdout:(32/138): ceph-mgr-modules-core-18.2.4-850.g50b 2.6 MB/s | 246 kB 00:00 2024-09-13T15:58:01.300 INFO:teuthology.orchestra.run.smithi194.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-13T15:58:01.313 INFO:teuthology.orchestra.run.smithi086.stdout:(21/138): python3-cephfs-18.2.4-850.g50bbe7f3.e 347 kB/s | 162 kB 00:00 2024-09-13T15:58:01.342 INFO:teuthology.orchestra.run.smithi139.stdout:(33/138): ceph-mgr-rook-18.2.4-850.g50bbe7f3.el 658 kB/s | 49 kB 00:00 2024-09-13T15:58:01.346 INFO:teuthology.orchestra.run.smithi086.stdout:(22/138): python3-rados-18.2.4-850.g50bbe7f3.el 5.1 MB/s | 319 kB 00:00 2024-09-13T15:58:01.359 INFO:teuthology.orchestra.run.smithi139.stdout:(34/138): ceph-prometheus-alerts-18.2.4-850.g50 245 kB/s | 16 kB 00:00 2024-09-13T15:58:01.380 INFO:teuthology.orchestra.run.smithi086.stdout:(23/138): python3-rbd-18.2.4-850.g50bbe7f3.el9. 4.4 MB/s | 301 kB 00:00 2024-09-13T15:58:01.393 INFO:teuthology.orchestra.run.smithi139.stdout:(35/138): ceph-volume-18.2.4-850.g50bbe7f3.el9. 5.1 MB/s | 264 kB 00:00 2024-09-13T15:58:01.408 INFO:teuthology.orchestra.run.smithi086.stdout:(24/138): python3-rgw-18.2.4-850.g50bbe7f3.el9. 1.7 MB/s | 99 kB 00:00 2024-09-13T15:58:01.418 INFO:teuthology.orchestra.run.smithi139.stdout:(36/138): cephadm-18.2.4-850.g50bbe7f3.el9.noar 3.8 MB/s | 226 kB 00:00 2024-09-13T15:58:01.439 INFO:teuthology.orchestra.run.smithi086.stdout:(25/138): rbd-fuse-18.2.4-850.g50bbe7f3.el9.x86 1.5 MB/s | 87 kB 00:00 2024-09-13T15:58:01.510 INFO:teuthology.orchestra.run.smithi139.stdout:(37/138): ceph-mgr-diskprediction-local-18.2.4- 15 MB/s | 7.4 MB 00:00 2024-09-13T15:58:01.531 INFO:teuthology.orchestra.run.smithi086.stdout:(26/138): rbd-nbd-18.2.4-850.g50bbe7f3.el9.x86_ 1.8 MB/s | 172 kB 00:00 2024-09-13T15:58:01.535 INFO:teuthology.orchestra.run.smithi139.stdout:(38/138): cephfs-top-18.2.4-850.g50bbe7f3.el9.n 128 kB/s | 18 kB 00:00 2024-09-13T15:58:01.584 INFO:teuthology.orchestra.run.smithi194.stdout:(131/138): librados2-18.2.4-850.g50bbe7f3.el9.x 8.8 MB/s | 3.3 MB 00:00 2024-09-13T15:58:01.623 INFO:teuthology.orchestra.run.smithi086.stdout:(27/138): rbd-mirror-18.2.4-850.g50bbe7f3.el9.x 14 MB/s | 3.0 MB 00:00 2024-09-13T15:58:01.627 INFO:teuthology.orchestra.run.smithi139.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 382 kB/s | 80 kB 00:00 2024-09-13T15:58:01.634 INFO:teuthology.orchestra.run.smithi194.stdout:(132/138): librbd1-18.2.4-850.g50bbe7f3.el9.x86 7.5 MB/s | 3.0 MB 00:00 2024-09-13T15:58:01.665 INFO:teuthology.orchestra.run.smithi086.stdout:(28/138): ceph-grafana-dashboards-18.2.4-850.g5 183 kB/s | 24 kB 00:00 2024-09-13T15:58:01.693 INFO:teuthology.orchestra.run.smithi194.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 701 kB/s | 41 kB 00:00 2024-09-13T15:58:01.752 INFO:teuthology.orchestra.run.smithi139.stdout:(40/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-13T15:58:01.778 INFO:teuthology.orchestra.run.smithi139.stdout:(41/138): libquadmath-11.5.0-2.el9.x86_64.rpm 789 kB/s | 191 kB 00:00 2024-09-13T15:58:01.809 INFO:teuthology.orchestra.run.smithi194.stdout:(134/138): NetworkManager-tui-1.49.90-1.el9.x86 2.1 MB/s | 249 kB 00:00 2024-09-13T15:58:01.811 INFO:teuthology.orchestra.run.smithi139.stdout:(42/138): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-09-13T15:58:01.836 INFO:teuthology.orchestra.run.smithi139.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-13T15:58:01.865 INFO:teuthology.orchestra.run.smithi086.stdout:(29/138): ceph-common-18.2.4-850.g50bbe7f3.el9. 3.7 MB/s | 18 MB 00:04 2024-09-13T15:58:01.869 INFO:teuthology.orchestra.run.smithi139.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-13T15:58:01.894 INFO:teuthology.orchestra.run.smithi139.stdout:(45/138): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-13T15:58:01.915 INFO:teuthology.orchestra.run.smithi086.stdout:(30/138): ceph-mgr-cephadm-18.2.4-850.g50bbe7f3 476 kB/s | 139 kB 00:00 2024-09-13T15:58:01.928 INFO:teuthology.orchestra.run.smithi139.stdout:(46/138): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-13T15:58:01.962 INFO:teuthology.orchestra.run.smithi139.stdout:(47/138): python3-cryptography-36.0.1-4.el9.x86 5.9 MB/s | 1.2 MB 00:00 2024-09-13T15:58:01.993 INFO:teuthology.orchestra.run.smithi194.stdout:(135/138): NetworkManager-1.49.90-1.el9.x86_64. 3.3 MB/s | 2.3 MB 00:00 2024-09-13T15:58:01.999 INFO:teuthology.orchestra.run.smithi086.stdout:(31/138): ceph-mgr-dashboard-18.2.4-850.g50bbe7 11 MB/s | 3.5 MB 00:00 2024-09-13T15:58:02.025 INFO:teuthology.orchestra.run.smithi086.stdout:(32/138): ceph-mgr-modules-core-18.2.4-850.g50b 2.2 MB/s | 246 kB 00:00 2024-09-13T15:58:02.066 INFO:teuthology.orchestra.run.smithi086.stdout:(33/138): ceph-mgr-rook-18.2.4-850.g50bbe7f3.el 741 kB/s | 49 kB 00:00 2024-09-13T15:58:02.108 INFO:teuthology.orchestra.run.smithi086.stdout:(34/138): ceph-prometheus-alerts-18.2.4-850.g50 197 kB/s | 16 kB 00:00 2024-09-13T15:58:02.134 INFO:teuthology.orchestra.run.smithi086.stdout:(35/138): ceph-volume-18.2.4-850.g50bbe7f3.el9. 3.9 MB/s | 264 kB 00:00 2024-09-13T15:58:02.158 INFO:teuthology.orchestra.run.smithi086.stdout:(36/138): cephadm-18.2.4-850.g50bbe7f3.el9.noar 4.4 MB/s | 226 kB 00:00 2024-09-13T15:58:02.177 INFO:teuthology.orchestra.run.smithi194.stdout:(136/138): NetworkManager-libnm-1.49.90-1.el9.x 3.0 MB/s | 1.8 MB 00:00 2024-09-13T15:58:02.201 INFO:teuthology.orchestra.run.smithi086.stdout:(37/138): cephfs-top-18.2.4-850.g50bbe7f3.el9.n 274 kB/s | 18 kB 00:00 2024-09-13T15:58:02.210 INFO:teuthology.orchestra.run.smithi194.stdout:(137/138): openssl-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 1.4 MB 00:00 2024-09-13T15:58:02.376 INFO:teuthology.orchestra.run.smithi086.stdout:(38/138): fuse-2.9.9-16.el9.x86_64.rpm 369 kB/s | 80 kB 00:00 2024-09-13T15:58:02.427 INFO:teuthology.orchestra.run.smithi194.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 5.5 MB/s | 2.4 MB 00:00 2024-09-13T15:58:02.434 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-13T15:58:02.434 INFO:teuthology.orchestra.run.smithi194.stdout:Total 25 MB/s | 203 MB 00:08 2024-09-13T15:58:02.476 INFO:teuthology.orchestra.run.smithi086.stdout:(39/138): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-13T15:58:02.501 INFO:teuthology.orchestra.run.smithi086.stdout:(40/138): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-13T15:58:02.551 INFO:teuthology.orchestra.run.smithi086.stdout:(41/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-13T15:58:02.610 INFO:teuthology.orchestra.run.smithi086.stdout:(42/138): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-13T15:58:02.644 INFO:teuthology.orchestra.run.smithi086.stdout:(43/138): python3-cryptography-36.0.1-4.el9.x86 8.6 MB/s | 1.2 MB 00:00 2024-09-13T15:58:02.645 INFO:teuthology.orchestra.run.smithi139.stdout:(48/138): boost-program-options-1.75.0-8.el9.x8 156 kB/s | 107 kB 00:00 2024-09-13T15:58:02.669 INFO:teuthology.orchestra.run.smithi086.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-13T15:58:02.702 INFO:teuthology.orchestra.run.smithi086.stdout:(45/138): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-13T15:58:02.728 INFO:teuthology.orchestra.run.smithi086.stdout:(46/138): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-13T15:58:02.771 INFO:teuthology.orchestra.run.smithi139.stdout:(49/138): automake-1.16.2-8.el9.noarch.rpm 787 kB/s | 689 kB 00:00 2024-09-13T15:58:02.820 INFO:teuthology.orchestra.run.smithi086.stdout:(47/138): ceph-mgr-diskprediction-local-18.2.4- 7.8 MB/s | 7.4 MB 00:00 2024-09-13T15:58:02.838 INFO:teuthology.orchestra.run.smithi139.stdout:(50/138): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-13T15:58:02.895 INFO:teuthology.orchestra.run.smithi086.stdout:(48/138): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-09-13T15:58:02.962 INFO:teuthology.orchestra.run.smithi086.stdout:(49/138): boost-program-options-1.75.0-8.el9.x8 756 kB/s | 107 kB 00:00 2024-09-13T15:58:03.004 INFO:teuthology.orchestra.run.smithi086.stdout:(50/138): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-13T15:58:03.037 INFO:teuthology.orchestra.run.smithi086.stdout:(51/138): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-09-13T15:58:03.071 INFO:teuthology.orchestra.run.smithi086.stdout:(52/138): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-13T15:58:03.113 INFO:teuthology.orchestra.run.smithi086.stdout:(53/138): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-13T15:58:03.180 INFO:teuthology.orchestra.run.smithi139.stdout:(51/138): elfutils-libelf-devel-0.191-4.el9.x86 41 kB/s | 22 kB 00:00 2024-09-13T15:58:03.213 INFO:teuthology.orchestra.run.smithi086.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 128 kB/s | 18 kB 00:00 2024-09-13T15:58:03.257 INFO:teuthology.orchestra.run.smithi086.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 79 kB/s | 11 kB 00:00 2024-09-13T15:58:03.305 INFO:teuthology.orchestra.run.smithi086.stdout:(56/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-13T15:58:03.330 INFO:teuthology.orchestra.run.smithi086.stdout:(57/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-13T15:58:03.381 INFO:teuthology.orchestra.run.smithi086.stdout:(58/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 360 kB/s | 45 kB 00:00 2024-09-13T15:58:03.429 INFO:teuthology.orchestra.run.smithi139.stdout:(52/138): flexiblas-3.0.4-8.el9.x86_64.rpm 55 kB/s | 33 kB 00:00 2024-09-13T15:58:03.430 INFO:teuthology.orchestra.run.smithi086.stdout:(59/138): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-13T15:58:03.465 INFO:teuthology.orchestra.run.smithi086.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 293 kB/s | 24 kB 00:00 2024-09-13T15:58:03.498 INFO:teuthology.orchestra.run.smithi086.stdout:(61/138): libtool-2.4.6-46.el9.x86_64.rpm 3.4 MB/s | 581 kB 00:00 2024-09-13T15:58:03.544 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-13T15:58:03.549 INFO:teuthology.orchestra.run.smithi086.stdout:(62/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 401 kB/s | 47 kB 00:00 2024-09-13T15:58:03.563 INFO:teuthology.orchestra.run.smithi139.stdout:(53/138): flex-2.6.4-9.el9.x86_64.rpm 396 kB/s | 313 kB 00:00 2024-09-13T15:58:03.599 INFO:teuthology.orchestra.run.smithi086.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 385 kB/s | 38 kB 00:00 2024-09-13T15:58:03.624 INFO:teuthology.orchestra.run.smithi086.stdout:(64/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-09-13T15:58:03.686 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-13T15:58:03.686 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-13T15:58:03.716 INFO:teuthology.orchestra.run.smithi086.stdout:(65/138): openblas-openmp-0.3.26-2.el9.x86_64.r 30 MB/s | 4.9 MB 00:00 2024-09-13T15:58:03.775 INFO:teuthology.orchestra.run.smithi086.stdout:(66/138): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-13T15:58:03.842 INFO:teuthology.orchestra.run.smithi086.stdout:(67/138): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-13T15:58:03.869 INFO:teuthology.orchestra.run.smithi086.stdout:(68/138): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-13T15:58:03.922 INFO:teuthology.orchestra.run.smithi139.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 37 kB/s | 18 kB 00:00 2024-09-13T15:58:03.942 INFO:teuthology.orchestra.run.smithi086.stdout:(69/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-13T15:58:04.030 INFO:teuthology.orchestra.run.smithi139.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 24 kB/s | 11 kB 00:00 2024-09-13T15:58:04.059 INFO:teuthology.orchestra.run.smithi086.stdout:(70/138): postgresql-server-13.16-1.el9.x86_64. 27 MB/s | 5.8 MB 00:00 2024-09-13T15:58:04.085 INFO:teuthology.orchestra.run.smithi086.stdout:(71/138): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-13T15:58:04.168 INFO:teuthology.orchestra.run.smithi086.stdout:(72/138): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-09-13T15:58:04.210 INFO:teuthology.orchestra.run.smithi086.stdout:(73/138): python3-jsonpatch-1.21-16.el9.noarch. 205 kB/s | 26 kB 00:00 2024-09-13T15:58:04.235 INFO:teuthology.orchestra.run.smithi086.stdout:(74/138): python3-jinja2-2.11.3-6.el9.noarch.rp 1.4 MB/s | 248 kB 00:00 2024-09-13T15:58:04.247 INFO:teuthology.orchestra.run.smithi139.stdout:(56/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-13T15:58:04.277 INFO:teuthology.orchestra.run.smithi086.stdout:(75/138): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-13T15:58:04.302 INFO:teuthology.orchestra.run.smithi086.stdout:(76/138): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-13T15:58:04.344 INFO:teuthology.orchestra.run.smithi086.stdout:(77/138): python3-markupsafe-1.1.1-12.el9.x86_6 320 kB/s | 35 kB 00:00 2024-09-13T15:58:04.411 INFO:teuthology.orchestra.run.smithi086.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-13T15:58:04.436 INFO:teuthology.orchestra.run.smithi086.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-13T15:58:04.512 INFO:teuthology.orchestra.run.smithi086.stdout:(80/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 5.1 MB 00:00 2024-09-13T15:58:04.553 INFO:teuthology.orchestra.run.smithi086.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 361 kB/s | 42 kB 00:00 2024-09-13T15:58:04.579 INFO:teuthology.orchestra.run.smithi086.stdout:(82/138): python3-packaging-20.9-5.el9.noarch.r 462 kB/s | 77 kB 00:00 2024-09-13T15:58:04.604 INFO:teuthology.orchestra.run.smithi086.stdout:(83/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-13T15:58:04.623 INFO:teuthology.orchestra.run.smithi139.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 76 kB/s | 45 kB 00:00 2024-09-13T15:58:04.629 INFO:teuthology.orchestra.run.smithi086.stdout:(84/138): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-13T15:58:04.671 INFO:teuthology.orchestra.run.smithi086.stdout:(85/138): python3-pytz-2021.1-5.el9.noarch.rpm 553 kB/s | 51 kB 00:00 2024-09-13T15:58:04.706 INFO:teuthology.orchestra.run.smithi139.stdout:(58/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 204 kB/s | 160 kB 00:00 2024-09-13T15:58:04.713 INFO:teuthology.orchestra.run.smithi086.stdout:(86/138): python3-requests-oauthlib-1.3.0-12.el 493 kB/s | 54 kB 00:00 2024-09-13T15:58:04.787 INFO:teuthology.orchestra.run.smithi086.stdout:(87/138): python3-toml-0.10.2-6.el9.noarch.rpm 362 kB/s | 42 kB 00:00 2024-09-13T15:58:04.812 INFO:teuthology.orchestra.run.smithi086.stdout:(88/138): socat-1.7.4.1-6.el9.x86_64.rpm 3.0 MB/s | 304 kB 00:00 2024-09-13T15:58:04.879 INFO:teuthology.orchestra.run.smithi086.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 631 kB/s | 58 kB 00:00 2024-09-13T15:58:04.937 INFO:teuthology.orchestra.run.smithi086.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.0 MB/s | 96 kB 00:00 2024-09-13T15:58:04.983 INFO:teuthology.orchestra.run.smithi086.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 614 kB/s | 64 kB 00:00 2024-09-13T15:58:05.013 INFO:teuthology.orchestra.run.smithi086.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 412 kB/s | 45 kB 00:00 2024-09-13T15:58:05.064 INFO:teuthology.orchestra.run.smithi086.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.4 MB/s | 111 kB 00:00 2024-09-13T15:58:05.230 INFO:teuthology.orchestra.run.smithi086.stdout:(94/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-13T15:58:05.248 INFO:teuthology.orchestra.run.smithi139.stdout:(59/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 45 kB/s | 24 kB 00:00 2024-09-13T15:58:05.272 INFO:teuthology.orchestra.run.smithi086.stdout:(95/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 1.2 MB/s | 308 kB 00:00 2024-09-13T15:58:05.298 INFO:teuthology.orchestra.run.smithi086.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-13T15:58:05.315 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-13T15:58:05.315 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-13T15:58:05.323 INFO:teuthology.orchestra.run.smithi086.stdout:(97/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 283 kB/s | 26 kB 00:00 2024-09-13T15:58:05.348 INFO:teuthology.orchestra.run.smithi086.stdout:(98/138): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T15:58:05.407 INFO:teuthology.orchestra.run.smithi086.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 9.2 MB/s | 548 kB 00:00 2024-09-13T15:58:05.432 INFO:teuthology.orchestra.run.smithi086.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-13T15:58:05.473 INFO:teuthology.orchestra.run.smithi139.stdout:(60/138): librdkafka-1.6.1-102.el9.x86_64.rpm 544 kB/s | 662 kB 00:01 2024-09-13T15:58:05.474 INFO:teuthology.orchestra.run.smithi086.stdout:(101/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 839 kB 00:00 2024-09-13T15:58:05.499 INFO:teuthology.orchestra.run.smithi086.stdout:(102/138): python3-cachetools-4.2.4-1.el9.noarc 482 kB/s | 32 kB 00:00 2024-09-13T15:58:05.524 INFO:teuthology.orchestra.run.smithi086.stdout:(103/138): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-13T15:58:05.550 INFO:teuthology.orchestra.run.smithi086.stdout:(104/138): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-13T15:58:05.602 INFO:teuthology.orchestra.run.smithi086.stdout:(105/138): python3-google-auth-2.34.0-1.el9.noa 4.1 MB/s | 220 kB 00:00 2024-09-13T15:58:05.623 INFO:teuthology.orchestra.run.smithi139.stdout:(61/138): libtool-2.4.6-46.el9.x86_64.rpm 581 kB/s | 581 kB 00:00 2024-09-13T15:58:05.634 INFO:teuthology.orchestra.run.smithi086.stdout:(106/138): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-09-13T15:58:05.659 INFO:teuthology.orchestra.run.smithi086.stdout:(107/138): python3-jaraco-8.2.1-3.el9.noarch.rp 189 kB/s | 11 kB 00:00 2024-09-13T15:58:05.684 INFO:teuthology.orchestra.run.smithi086.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-13T15:58:05.709 INFO:teuthology.orchestra.run.smithi086.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 465 kB/s | 23 kB 00:00 2024-09-13T15:58:05.735 INFO:teuthology.orchestra.run.smithi086.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-13T15:58:05.760 INFO:teuthology.orchestra.run.smithi086.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-13T15:58:05.793 INFO:teuthology.orchestra.run.smithi086.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-13T15:58:05.819 INFO:teuthology.orchestra.run.smithi086.stdout:(113/138): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-13T15:58:05.844 INFO:teuthology.orchestra.run.smithi086.stdout:(114/138): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-13T15:58:05.857 INFO:teuthology.orchestra.run.smithi139.stdout:(62/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 78 kB/s | 47 kB 00:00 2024-09-13T15:58:05.878 INFO:teuthology.orchestra.run.smithi086.stdout:(115/138): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-13T15:58:05.911 INFO:teuthology.orchestra.run.smithi086.stdout:(116/138): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-13T15:58:05.937 INFO:teuthology.orchestra.run.smithi086.stdout:(117/138): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-13T15:58:05.962 INFO:teuthology.orchestra.run.smithi086.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-13T15:58:05.987 INFO:teuthology.orchestra.run.smithi086.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 616 kB/s | 31 kB 00:00 2024-09-13T15:58:06.012 INFO:teuthology.orchestra.run.smithi086.stdout:(120/138): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-13T15:58:06.038 INFO:teuthology.orchestra.run.smithi086.stdout:(121/138): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-13T15:58:06.054 INFO:teuthology.orchestra.run.smithi086.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 859 kB/s | 36 kB 00:00 2024-09-13T15:58:06.080 INFO:teuthology.orchestra.run.smithi086.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-13T15:58:06.105 INFO:teuthology.orchestra.run.smithi086.stdout:(124/138): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-13T15:58:06.130 INFO:teuthology.orchestra.run.smithi086.stdout:(125/138): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-13T15:58:06.155 INFO:teuthology.orchestra.run.smithi086.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 812 kB/s | 20 kB 00:00 2024-09-13T15:58:06.215 INFO:teuthology.orchestra.run.smithi139.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 65 kB/s | 38 kB 00:00 2024-09-13T15:58:06.263 INFO:teuthology.orchestra.run.smithi086.stdout:(127/138): libarrow-9.0.0-11.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-09-13T15:58:06.265 INFO:teuthology.orchestra.run.smithi139.stdout:(64/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 373 kB/s | 292 kB 00:00 2024-09-13T15:58:06.289 INFO:teuthology.orchestra.run.smithi086.stdout:(128/138): python3-werkzeug-2.0.3-3.el9.1.noarc 2.3 MB/s | 427 kB 00:00 2024-09-13T15:58:06.315 INFO:teuthology.orchestra.run.smithi086.stdout:(129/138): re2-20211101-20.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-13T15:58:06.373 INFO:teuthology.orchestra.run.smithi086.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-13T15:58:06.557 INFO:teuthology.orchestra.run.smithi086.stdout:(131/138): librados2-18.2.4-850.g50bbe7f3.el9.x 12 MB/s | 3.3 MB 00:00 2024-09-13T15:58:06.632 INFO:teuthology.orchestra.run.smithi086.stdout:(132/138): librbd1-18.2.4-850.g50bbe7f3.el9.x86 9.5 MB/s | 3.0 MB 00:00 2024-09-13T15:58:06.691 INFO:teuthology.orchestra.run.smithi086.stdout:(133/138): NetworkManager-1.49.90-1.el9.x86_64. 7.3 MB/s | 2.3 MB 00:00 2024-09-13T15:58:06.749 INFO:teuthology.orchestra.run.smithi086.stdout:(134/138): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-13T15:58:06.783 INFO:teuthology.orchestra.run.smithi086.stdout:(135/138): NetworkManager-team-1.49.90-1.el9.x8 270 kB/s | 41 kB 00:00 2024-09-13T15:58:06.833 INFO:teuthology.orchestra.run.smithi086.stdout:(136/138): openssl-3.2.2-6.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-13T15:58:06.917 INFO:teuthology.orchestra.run.smithi086.stdout:(137/138): NetworkManager-libnm-1.49.90-1.el9.x 5.0 MB/s | 1.8 MB 00:00 2024-09-13T15:58:06.974 INFO:teuthology.orchestra.run.smithi139.stdout:(65/138): openblas-openmp-0.3.26-2.el9.x86_64.r 4.5 MB/s | 4.9 MB 00:01 2024-09-13T15:58:07.092 INFO:teuthology.orchestra.run.smithi086.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.8 MB/s | 2.4 MB 00:00 2024-09-13T15:58:07.097 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-13T15:58:07.098 INFO:teuthology.orchestra.run.smithi086.stdout:Total 19 MB/s | 203 MB 00:10 2024-09-13T15:58:07.266 INFO:teuthology.orchestra.run.smithi139.stdout:(66/138): postgresql-13.16-1.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:00 2024-09-13T15:58:07.450 INFO:teuthology.orchestra.run.smithi139.stdout:(67/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-09-13T15:58:07.908 INFO:teuthology.orchestra.run.smithi139.stdout:(68/138): postgresql-contrib-13.16-1.el9.x86_64 975 kB/s | 910 kB 00:00 2024-09-13T15:58:08.000 INFO:teuthology.orchestra.run.smithi139.stdout:(69/138): postgresql-private-libs-13.16-1.el9.x 187 kB/s | 137 kB 00:00 2024-09-13T15:58:08.600 INFO:teuthology.orchestra.run.smithi139.stdout:(70/138): postgresql-server-13.16-1.el9.x86_64. 5.0 MB/s | 5.8 MB 00:01 2024-09-13T15:58:08.750 INFO:teuthology.orchestra.run.smithi139.stdout:(71/138): python3-devel-3.9.19-8.el9.x86_64.rpm 326 kB/s | 245 kB 00:00 2024-09-13T15:58:08.907 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-13T15:58:09.081 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-13T15:58:09.081 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-13T15:58:09.101 INFO:teuthology.orchestra.run.smithi139.stdout:(72/138): python3-babel-2.9.1-2.el9.noarch.rpm 5.0 MB/s | 6.0 MB 00:01 2024-09-13T15:58:09.351 INFO:teuthology.orchestra.run.smithi139.stdout:(73/138): python3-jsonpatch-1.21-16.el9.noarch. 43 kB/s | 26 kB 00:00 2024-09-13T15:58:09.402 INFO:teuthology.orchestra.run.smithi139.stdout:(74/138): python3-jinja2-2.11.3-6.el9.noarch.rp 310 kB/s | 248 kB 00:00 2024-09-13T15:58:09.643 INFO:teuthology.orchestra.run.smithi139.stdout:(75/138): python3-jsonpointer-2.0-4.el9.noarch. 35 kB/s | 19 kB 00:00 2024-09-13T15:58:10.035 INFO:teuthology.orchestra.run.smithi139.stdout:(76/138): python3-markupsafe-1.1.1-12.el9.x86_6 55 kB/s | 35 kB 00:00 2024-09-13T15:58:10.144 INFO:teuthology.orchestra.run.smithi139.stdout:(77/138): python3-mako-1.1.4-6.el9.noarch.rpm 219 kB/s | 172 kB 00:00 2024-09-13T15:58:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-13T15:58:10.877 INFO:teuthology.orchestra.run.smithi139.stdout:(78/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.2 MB/s | 5.1 MB 00:01 2024-09-13T15:58:10.902 INFO:teuthology.orchestra.run.smithi139.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 293 kB/s | 222 kB 00:00 2024-09-13T15:58:10.928 INFO:teuthology.orchestra.run.smithi139.stdout:(80/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 281 kB/s | 250 kB 00:00 2024-09-13T15:58:10.972 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T15:58:11.095 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T15:58:11.147 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T15:58:11.181 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T15:58:11.215 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T15:58:11.255 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-13T15:58:11.255 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-13T15:58:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T15:58:11.486 INFO:teuthology.orchestra.run.smithi139.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 73 kB/s | 42 kB 00:00 2024-09-13T15:58:11.520 INFO:teuthology.orchestra.run.smithi139.stdout:(82/138): python3-packaging-20.9-5.el9.noarch.r 120 kB/s | 77 kB 00:00 2024-09-13T15:58:11.571 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T15:58:11.628 INFO:teuthology.orchestra.run.smithi139.stdout:(83/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 227 kB/s | 159 kB 00:00 2024-09-13T15:58:11.674 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:58:11.784 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:58:11.808 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:58:11.883 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:58:11.912 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T15:58:12.058 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T15:58:12.110 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T15:58:12.111 INFO:teuthology.orchestra.run.smithi139.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 86 kB/s | 51 kB 00:00 2024-09-13T15:58:12.138 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:58:12.229 INFO:teuthology.orchestra.run.smithi139.stdout:(85/138): python3-requests-oauthlib-1.3.0-12.el 89 kB/s | 54 kB 00:00 2024-09-13T15:58:12.238 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:58:12.254 INFO:teuthology.orchestra.run.smithi139.stdout:(86/138): python3-pyasn1-modules-0.4.8-6.el9.no 363 kB/s | 279 kB 00:00 2024-09-13T15:58:12.264 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T15:58:12.435 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T15:58:12.559 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T15:58:12.660 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:58:12.736 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:58:12.804 INFO:teuthology.orchestra.run.smithi139.stdout:(87/138): python3-toml-0.10.2-6.el9.noarch.rpm 72 kB/s | 42 kB 00:00 2024-09-13T15:58:13.023 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:58:13.029 INFO:teuthology.orchestra.run.smithi139.stdout:(88/138): socat-1.7.4.1-6.el9.x86_64.rpm 392 kB/s | 304 kB 00:00 2024-09-13T15:58:13.057 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T15:58:13.091 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T15:58:13.155 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T15:58:13.190 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T15:58:13.226 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T15:58:13.294 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T15:58:13.349 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T15:58:13.379 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T15:58:13.414 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T15:58:13.430 INFO:teuthology.orchestra.run.smithi139.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 92 kB/s | 58 kB 00:00 2024-09-13T15:58:13.489 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T15:58:13.533 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 27/146 2024-09-13T15:58:13.568 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 28/146 2024-09-13T15:58:13.641 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 29/146 2024-09-13T15:58:13.672 INFO:teuthology.orchestra.run.smithi139.stdout:(90/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-13T15:58:13.730 INFO:teuthology.orchestra.run.smithi139.stdout:(91/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 138 kB/s | 96 kB 00:00 2024-09-13T15:58:13.775 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T15:58:13.789 INFO:teuthology.orchestra.run.smithi139.stdout:(92/138): fmt-8.1.1-5.el9.x86_64.rpm 1.9 MB/s | 111 kB 00:00 2024-09-13T15:58:13.831 INFO:teuthology.orchestra.run.smithi139.stdout:(93/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 7.2 MB/s | 308 kB 00:00 2024-09-13T15:58:13.837 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T15:58:14.047 INFO:teuthology.orchestra.run.smithi139.stdout:(94/138): libarrow-9.0.0-11.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-13T15:58:14.073 INFO:teuthology.orchestra.run.smithi139.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-13T15:58:14.098 INFO:teuthology.orchestra.run.smithi139.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T15:58:14.123 INFO:teuthology.orchestra.run.smithi139.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-13T15:58:14.165 INFO:teuthology.orchestra.run.smithi139.stdout:(98/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 87 kB/s | 64 kB 00:00 2024-09-13T15:58:14.215 INFO:teuthology.orchestra.run.smithi139.stdout:(99/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-13T15:58:14.249 INFO:teuthology.orchestra.run.smithi139.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-13T15:58:14.274 INFO:teuthology.orchestra.run.smithi139.stdout:(101/138): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-13T15:58:14.300 INFO:teuthology.orchestra.run.smithi139.stdout:(102/138): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-13T15:58:14.325 INFO:teuthology.orchestra.run.smithi139.stdout:(103/138): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-09-13T15:58:14.350 INFO:teuthology.orchestra.run.smithi139.stdout:(104/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 66 kB/s | 45 kB 00:00 2024-09-13T15:58:14.375 INFO:teuthology.orchestra.run.smithi139.stdout:(105/138): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-09-13T15:58:14.376 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T15:58:14.409 INFO:teuthology.orchestra.run.smithi139.stdout:(106/138): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-13T15:58:14.434 INFO:teuthology.orchestra.run.smithi139.stdout:(107/138): python3-jaraco-8.2.1-3.el9.noarch.rp 209 kB/s | 11 kB 00:00 2024-09-13T15:58:14.454 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T15:58:14.459 INFO:teuthology.orchestra.run.smithi139.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 365 kB/s | 18 kB 00:00 2024-09-13T15:58:14.484 INFO:teuthology.orchestra.run.smithi139.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-13T15:58:14.491 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T15:58:14.510 INFO:teuthology.orchestra.run.smithi139.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-09-13T15:58:14.535 INFO:teuthology.orchestra.run.smithi139.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-13T15:58:14.537 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 35/146 2024-09-13T15:58:14.560 INFO:teuthology.orchestra.run.smithi139.stdout:(112/138): python3-google-auth-2.34.0-1.el9.noa 1.0 MB/s | 220 kB 00:00 2024-09-13T15:58:14.579 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T15:58:14.585 INFO:teuthology.orchestra.run.smithi139.stdout:(113/138): python3-logutils-0.3.5-21.el9.noarch 922 kB/s | 46 kB 00:00 2024-09-13T15:58:14.611 INFO:teuthology.orchestra.run.smithi139.stdout:(114/138): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-13T15:58:14.636 INFO:teuthology.orchestra.run.smithi139.stdout:(115/138): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-13T15:58:14.661 INFO:teuthology.orchestra.run.smithi139.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-13T15:58:14.687 INFO:teuthology.orchestra.run.smithi139.stdout:(117/138): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-13T15:58:14.712 INFO:teuthology.orchestra.run.smithi139.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-13T15:58:14.737 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T15:58:14.746 INFO:teuthology.orchestra.run.smithi139.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 526 kB/s | 31 kB 00:00 2024-09-13T15:58:14.771 INFO:teuthology.orchestra.run.smithi139.stdout:(120/138): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-13T15:58:14.796 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T15:58:14.796 INFO:teuthology.orchestra.run.smithi139.stdout:(121/138): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-13T15:58:14.821 INFO:teuthology.orchestra.run.smithi139.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-13T15:58:14.847 INFO:teuthology.orchestra.run.smithi139.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-13T15:58:14.880 INFO:teuthology.orchestra.run.smithi139.stdout:(124/138): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-09-13T15:58:14.906 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T15:58:14.906 INFO:teuthology.orchestra.run.smithi139.stdout:(125/138): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-13T15:58:14.931 INFO:teuthology.orchestra.run.smithi139.stdout:(126/138): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-13T15:58:14.941 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T15:58:14.956 INFO:teuthology.orchestra.run.smithi139.stdout:(127/138): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-13T15:58:14.981 INFO:teuthology.orchestra.run.smithi139.stdout:(128/138): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-13T15:58:14.996 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T15:58:15.007 INFO:teuthology.orchestra.run.smithi139.stdout:(129/138): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-13T15:58:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T15:58:15.082 INFO:teuthology.orchestra.run.smithi139.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-13T15:58:15.092 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T15:58:15.129 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T15:58:15.175 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T15:58:15.220 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T15:58:15.265 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T15:58:15.397 INFO:teuthology.orchestra.run.smithi139.stdout:(131/138): librbd1-18.2.4-850.g50bbe7f3.el9.x86 7.7 MB/s | 3.0 MB 00:00 2024-09-13T15:58:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T15:58:15.438 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T15:58:15.471 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T15:58:15.491 INFO:teuthology.orchestra.run.smithi139.stdout:(132/138): librados2-18.2.4-850.g50bbe7f3.el9.x 6.5 MB/s | 3.3 MB 00:00 2024-09-13T15:58:15.573 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T15:58:15.591 INFO:teuthology.orchestra.run.smithi139.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 408 kB/s | 41 kB 00:00 2024-09-13T15:58:15.613 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T15:58:15.653 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T15:58:15.667 INFO:teuthology.orchestra.run.smithi139.stdout:(134/138): NetworkManager-1.49.90-1.el9.x86_64. 4.0 MB/s | 2.3 MB 00:00 2024-09-13T15:58:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T15:58:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T15:58:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T15:58:15.750 INFO:teuthology.orchestra.run.smithi139.stdout:(135/138): NetworkManager-libnm-1.49.90-1.el9.x 5.1 MB/s | 1.8 MB 00:00 2024-09-13T15:58:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T15:58:15.776 INFO:teuthology.orchestra.run.smithi139.stdout:(136/138): NetworkManager-tui-1.49.90-1.el9.x86 1.3 MB/s | 249 kB 00:00 2024-09-13T15:58:15.793 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T15:58:15.828 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T15:58:15.842 INFO:teuthology.orchestra.run.smithi139.stdout:(137/138): openssl-3.2.2-6.el9.x86_64.rpm 7.7 MB/s | 1.4 MB 00:00 2024-09-13T15:58:15.858 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T15:58:15.893 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T15:58:15.926 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T15:58:15.968 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T15:58:15.984 INFO:teuthology.orchestra.run.smithi139.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 10 MB/s | 2.4 MB 00:00 2024-09-13T15:58:15.990 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-13T15:58:15.990 INFO:teuthology.orchestra.run.smithi139.stdout:Total 10 MB/s | 203 MB 00:19 2024-09-13T15:58:16.002 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T15:58:16.037 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T15:58:16.084 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T15:58:16.181 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T15:58:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T15:58:16.945 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T15:58:17.002 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T15:58:17.035 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T15:58:17.087 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-13T15:58:17.133 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T15:58:17.169 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T15:58:17.232 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-13T15:58:17.232 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-13T15:58:17.282 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-13T15:58:17.354 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T15:58:17.392 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T15:58:17.438 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T15:58:17.472 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T15:58:17.488 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T15:58:17.555 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T15:58:17.599 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T15:58:17.660 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T15:58:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T15:58:18.083 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T15:58:18.189 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:58:18.254 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T15:58:18.373 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T15:58:18.389 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:58:18.424 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:58:18.561 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:58:18.599 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T15:58:18.795 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T15:58:18.860 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T15:58:18.885 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:58:18.957 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-13T15:58:18.957 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-13T15:58:19.008 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:58:19.053 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T15:58:19.275 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T15:58:19.433 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T15:58:19.568 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:58:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T15:58:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T15:58:19.676 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:58:19.700 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T15:58:19.732 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T15:58:20.033 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T15:58:20.036 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:58:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T15:58:20.081 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T15:58:20.117 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T15:58:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T15:58:20.182 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 85/146 2024-09-13T15:58:20.197 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T15:58:20.219 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T15:58:20.249 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T15:58:20.283 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T15:58:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T15:58:20.418 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T15:58:20.453 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T15:58:20.499 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T15:58:20.579 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T15:58:20.623 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 27/146 2024-09-13T15:58:20.631 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T15:58:20.656 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T15:58:20.667 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 28/146 2024-09-13T15:58:20.727 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T15:58:20.751 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 29/146 2024-09-13T15:58:20.758 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 89/146 2024-09-13T15:58:20.928 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T15:58:20.990 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T15:58:21.616 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T15:58:21.714 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T15:58:21.778 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T15:58:21.816 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 35/146 2024-09-13T15:58:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T15:58:22.032 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T15:58:22.099 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T15:58:22.228 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T15:58:22.278 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T15:58:22.338 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T15:58:22.421 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T15:58:22.462 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T15:58:22.498 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T15:58:22.556 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T15:58:22.609 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T15:58:22.802 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:58:22.837 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:58:22.902 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T15:58:23.072 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T15:58:23.117 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T15:58:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T15:58:23.277 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T15:58:23.317 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T15:58:23.357 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:58:23.363 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T15:58:23.392 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T15:58:23.407 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T15:58:23.420 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T15:58:23.453 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T15:58:23.488 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T15:58:23.488 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T15:58:23.488 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T15:58:23.488 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T15:58:23.490 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T15:58:23.516 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T15:58:23.532 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T15:58:23.570 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T15:58:23.607 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T15:58:23.642 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T15:58:23.675 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T15:58:23.718 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T15:58:23.751 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T15:58:23.786 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T15:58:23.835 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T15:58:23.957 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T15:58:24.024 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T15:58:24.753 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-13T15:58:24.829 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T15:58:24.867 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T15:58:24.899 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T15:58:24.923 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T15:58:24.959 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T15:58:24.963 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T15:58:24.988 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T15:58:24.993 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T15:58:25.039 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T15:58:25.104 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T15:58:25.151 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T15:58:25.352 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T15:58:25.403 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T15:58:25.440 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T15:58:25.456 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:58:25.533 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T15:58:25.574 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:58:25.599 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:58:25.673 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:58:25.702 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T15:58:25.841 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T15:58:25.891 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T15:58:25.919 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:58:26.154 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:58:26.220 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T15:58:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T15:58:26.388 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T15:58:26.500 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T15:58:26.516 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T15:58:26.621 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:58:26.684 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:58:26.959 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:58:27.005 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T15:58:27.040 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T15:58:27.113 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T15:58:27.147 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T15:58:27.183 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T15:58:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T15:58:27.305 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T15:58:27.336 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T15:58:27.371 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T15:58:27.454 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T15:58:27.491 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 27/146 2024-09-13T15:58:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 28/146 2024-09-13T15:58:27.608 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 29/146 2024-09-13T15:58:27.742 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T15:58:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T15:58:28.066 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T15:58:28.183 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T15:58:28.219 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T15:58:28.333 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T15:58:28.334 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T15:58:28.405 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T15:58:28.444 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T15:58:28.482 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 35/146 2024-09-13T15:58:28.523 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T15:58:28.682 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T15:58:28.735 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T15:58:28.842 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T15:58:28.880 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T15:58:28.935 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T15:58:28.999 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T15:58:29.033 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T15:58:29.040 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T15:58:29.076 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T15:58:29.080 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T15:58:29.122 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T15:58:29.167 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T15:58:29.209 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T15:58:29.225 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T15:58:29.261 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 85/146 2024-09-13T15:58:29.309 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T15:58:29.344 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T15:58:29.386 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T15:58:29.427 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T15:58:29.529 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T15:58:29.561 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T15:58:29.601 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T15:58:29.627 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T15:58:29.654 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T15:58:29.687 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T15:58:29.715 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T15:58:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T15:58:29.749 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T15:58:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T15:58:29.786 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T15:58:29.816 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T15:58:29.850 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T15:58:29.892 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T15:58:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T15:58:29.934 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T15:58:29.935 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 89/146 2024-09-13T15:58:29.968 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T15:58:30.028 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T15:58:30.175 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T15:58:30.272 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T15:58:30.320 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T15:58:31.039 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T15:58:31.093 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T15:58:31.126 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T15:58:31.224 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T15:58:31.260 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T15:58:31.434 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T15:58:31.466 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T15:58:31.543 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T15:58:32.185 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T15:58:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T15:58:32.318 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:58:32.357 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:58:32.975 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:58:33.019 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T15:58:33.212 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T15:58:33.212 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T15:58:33.213 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T15:58:33.213 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T15:58:33.261 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T15:58:33.532 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T15:58:33.652 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T15:58:33.689 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T15:58:33.721 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T15:58:34.029 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T15:58:34.076 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T15:58:34.166 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T15:58:34.197 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 85/146 2024-09-13T15:58:34.234 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T15:58:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T15:58:34.679 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T15:58:34.750 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T15:58:34.781 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 89/146 2024-09-13T15:58:34.865 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T15:58:34.865 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /sys 2024-09-13T15:58:34.865 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /proc 2024-09-13T15:58:34.865 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /mnt 2024-09-13T15:58:34.865 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /var/tmp 2024-09-13T15:58:34.865 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /home 2024-09-13T15:58:34.865 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /root 2024-09-13T15:58:34.865 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /tmp 2024-09-13T15:58:34.865 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T15:58:35.024 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T15:58:35.040 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T15:58:35.040 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:35.040 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T15:58:35.041 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T15:58:36.500 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T15:58:36.527 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T15:58:36.527 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:36.527 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T15:58:36.527 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T15:58:36.527 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T15:58:36.527 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T15:58:36.735 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T15:58:36.759 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T15:58:36.759 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:36.759 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T15:58:36.759 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T15:58:36.760 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T15:58:36.760 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T15:58:36.789 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:58:36.827 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:58:37.211 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T15:58:37.236 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T15:58:37.236 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:37.236 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T15:58:37.236 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T15:58:37.236 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T15:58:37.237 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T15:58:37.333 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T15:58:37.343 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:58:37.381 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T15:58:37.390 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T15:58:37.453 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T15:58:37.492 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T15:58:37.492 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T15:58:37.492 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T15:58:37.492 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T15:58:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T15:58:37.639 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T15:58:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T15:58:37.765 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T15:58:37.852 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T15:58:37.983 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T15:58:38.020 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T15:58:38.052 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T15:58:38.088 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T15:58:38.511 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T15:58:38.536 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T15:58:38.565 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 109/146 2024-09-13T15:58:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 110/146 2024-09-13T15:58:38.659 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T15:58:39.703 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T15:58:39.744 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T15:58:40.715 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T15:58:40.753 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T15:58:40.855 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T15:58:41.009 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 114/146 2024-09-13T15:58:41.038 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T15:58:41.062 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T15:58:41.062 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:41.062 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T15:58:41.062 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T15:58:41.062 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T15:58:41.063 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T15:58:41.114 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T15:58:41.127 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T15:58:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 117/146 2024-09-13T15:58:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 118/146 2024-09-13T15:58:41.983 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T15:58:42.008 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T15:58:42.031 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T15:58:42.031 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:42.032 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T15:58:42.032 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:58:42.032 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:58:42.032 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T15:58:42.075 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T15:58:42.099 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T15:58:42.099 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:42.099 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T15:58:42.099 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T15:58:42.150 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T15:58:42.174 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T15:58:42.174 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:42.174 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T15:58:42.174 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:58:42.174 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:58:42.175 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T15:58:42.467 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T15:58:42.492 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T15:58:42.493 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:42.493 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T15:58:42.493 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T15:58:42.493 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T15:58:42.493 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T15:58:45.952 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T15:58:45.952 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /sys 2024-09-13T15:58:45.953 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /proc 2024-09-13T15:58:45.953 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /mnt 2024-09-13T15:58:45.953 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /var/tmp 2024-09-13T15:58:45.953 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /home 2024-09-13T15:58:45.953 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /root 2024-09-13T15:58:45.953 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /tmp 2024-09-13T15:58:45.953 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T15:58:46.138 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 124/146 2024-09-13T15:58:46.138 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T15:58:46.174 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T15:58:46.174 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:46.174 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T15:58:46.174 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T15:58:46.178 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 125/146 2024-09-13T15:58:46.220 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 126/146 2024-09-13T15:58:46.251 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T15:58:46.451 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T15:58:46.499 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T15:58:46.521 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 130/146 2024-09-13T15:58:46.550 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T15:58:46.589 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T15:58:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:58:47.245 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:58:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:58:47.766 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T15:58:47.824 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T15:58:47.824 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:47.824 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T15:58:47.824 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T15:58:47.824 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T15:58:47.824 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T15:58:48.058 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T15:58:48.090 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 134/146 2024-09-13T15:58:48.109 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T15:58:48.109 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:48.109 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T15:58:48.109 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T15:58:48.109 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T15:58:48.109 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T15:58:48.174 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T15:58:48.225 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T15:58:48.303 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T15:58:48.335 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T15:58:48.360 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T15:58:48.386 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T15:58:48.386 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T15:58:48.470 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T15:58:48.471 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T15:58:48.546 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T15:58:48.571 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T15:58:48.577 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:58:48.577 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:58:48.592 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T15:58:48.643 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T15:58:48.643 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:48.644 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T15:58:48.644 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T15:58:48.644 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T15:58:48.644 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T15:58:48.756 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:58:48.756 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T15:58:48.767 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T15:58:48.827 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T15:58:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T15:58:48.894 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T15:58:48.909 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T15:58:49.141 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T15:58:49.173 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T15:58:49.173 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /sys 2024-09-13T15:58:49.173 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /proc 2024-09-13T15:58:49.173 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /mnt 2024-09-13T15:58:49.173 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /var/tmp 2024-09-13T15:58:49.174 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /home 2024-09-13T15:58:49.174 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /root 2024-09-13T15:58:49.174 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /tmp 2024-09-13T15:58:49.174 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T15:58:49.213 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T15:58:49.298 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T15:58:49.332 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T15:58:49.348 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T15:58:49.348 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:49.348 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T15:58:49.349 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T15:58:49.407 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T15:58:49.570 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T15:58:49.620 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T15:58:49.660 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T15:58:49.694 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T15:58:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T15:58:50.252 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T15:58:50.290 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 109/146 2024-09-13T15:58:50.358 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 110/146 2024-09-13T15:58:50.390 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T15:58:50.817 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T15:58:50.844 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T15:58:50.844 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:50.844 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T15:58:50.844 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T15:58:50.845 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T15:58:50.845 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T15:58:51.060 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T15:58:51.084 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T15:58:51.084 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:51.084 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T15:58:51.084 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T15:58:51.084 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T15:58:51.085 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T15:58:51.528 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T15:58:51.552 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T15:58:51.552 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:51.552 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T15:58:51.552 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T15:58:51.552 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T15:58:51.552 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T15:58:51.588 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T15:58:51.634 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T15:58:51.658 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T15:58:51.707 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T15:58:51.762 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T15:58:51.947 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T15:58:52.004 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T15:58:52.090 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T15:58:52.178 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T15:58:52.318 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T15:58:52.354 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T15:58:52.385 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T15:58:52.421 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T15:58:52.722 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T15:58:52.750 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T15:58:52.819 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T15:58:52.845 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T15:58:52.874 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 109/146 2024-09-13T15:58:52.888 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T15:58:52.937 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 110/146 2024-09-13T15:58:52.967 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T15:58:53.060 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 114/146 2024-09-13T15:58:53.094 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T15:58:53.146 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T15:58:53.146 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:53.146 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T15:58:53.146 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T15:58:53.146 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T15:58:53.147 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T15:58:53.225 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T15:58:53.251 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T15:58:53.378 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 117/146 2024-09-13T15:58:53.444 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 118/146 2024-09-13T15:58:53.950 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T15:58:53.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 1/146 2024-09-13T15:58:53.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2/146 2024-09-13T15:58:53.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 3/146 2024-09-13T15:58:53.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 4/146 2024-09-13T15:58:53.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 5/146 2024-09-13T15:58:53.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 6/146 2024-09-13T15:58:53.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 7/146 2024-09-13T15:58:53.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:58:53.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:58:53.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T15:58:53.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 11/146 2024-09-13T15:58:53.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 12/146 2024-09-13T15:58:53.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:58:53.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 14/146 2024-09-13T15:58:53.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 15/146 2024-09-13T15:58:53.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 16/146 2024-09-13T15:58:53.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 17/146 2024-09-13T15:58:53.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 18/146 2024-09-13T15:58:53.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 19/146 2024-09-13T15:58:53.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 20/146 2024-09-13T15:58:53.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 21/146 2024-09-13T15:58:53.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 22/146 2024-09-13T15:58:53.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 23/146 2024-09-13T15:58:53.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 24/146 2024-09-13T15:58:53.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 25/146 2024-09-13T15:58:53.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 26/146 2024-09-13T15:58:53.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 27/146 2024-09-13T15:58:53.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 28/146 2024-09-13T15:58:53.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 29/146 2024-09-13T15:58:53.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 30/146 2024-09-13T15:58:53.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 31/146 2024-09-13T15:58:53.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 32/146 2024-09-13T15:58:53.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 33/146 2024-09-13T15:58:53.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 34/146 2024-09-13T15:58:53.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 35/146 2024-09-13T15:58:53.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 36/146 2024-09-13T15:58:53.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 37/146 2024-09-13T15:58:53.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 38/146 2024-09-13T15:58:53.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T15:58:53.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T15:58:53.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T15:58:53.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T15:58:53.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T15:58:53.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T15:58:53.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T15:58:53.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T15:58:53.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T15:58:53.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T15:58:53.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T15:58:53.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T15:58:53.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T15:58:53.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T15:58:53.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T15:58:53.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T15:58:53.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T15:58:53.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T15:58:53.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T15:58:53.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T15:58:53.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T15:58:53.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T15:58:53.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T15:58:53.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T15:58:53.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T15:58:53.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T15:58:53.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T15:58:53.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T15:58:53.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T15:58:53.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T15:58:53.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T15:58:53.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T15:58:53.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T15:58:53.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T15:58:53.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T15:58:53.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T15:58:53.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T15:58:53.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T15:58:53.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T15:58:53.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T15:58:53.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T15:58:53.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T15:58:53.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T15:58:53.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T15:58:53.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T15:58:53.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T15:58:53.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T15:58:53.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T15:58:53.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T15:58:53.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T15:58:53.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T15:58:53.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T15:58:53.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T15:58:53.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T15:58:53.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T15:58:53.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T15:58:53.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T15:58:53.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T15:58:53.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T15:58:53.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T15:58:53.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T15:58:53.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T15:58:53.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T15:58:53.961 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T15:58:53.961 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T15:58:53.961 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T15:58:53.961 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T15:58:53.961 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T15:58:53.961 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T15:58:53.961 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T15:58:53.961 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T15:58:53.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T15:58:53.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T15:58:53.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T15:58:53.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T15:58:53.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T15:58:53.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T15:58:53.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T15:58:53.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T15:58:53.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T15:58:53.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T15:58:53.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T15:58:53.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T15:58:53.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T15:58:53.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T15:58:53.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T15:58:53.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T15:58:53.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T15:58:53.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T15:58:53.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T15:58:53.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T15:58:53.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T15:58:53.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 131/146 2024-09-13T15:58:53.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T15:58:53.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 133/146 2024-09-13T15:58:53.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T15:58:53.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T15:58:53.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T15:58:53.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T15:58:53.964 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T15:58:53.964 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T15:58:53.964 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T15:58:53.964 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T15:58:53.964 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T15:58:53.964 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T15:58:53.964 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T15:58:53.964 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T15:58:54.006 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T15:58:54.044 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T15:58:54.221 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T15:58:54.247 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T15:58:54.298 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T15:58:54.298 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:54.298 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T15:58:54.298 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:58:54.298 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:58:54.298 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T15:58:54.340 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T15:58:54.390 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T15:58:54.390 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:54.390 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T15:58:54.390 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T15:58:54.440 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T15:58:54.492 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T15:58:54.492 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:54.492 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T15:58:54.493 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:58:54.493 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:58:54.493 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T15:58:54.824 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T15:58:54.876 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T15:58:54.876 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:54.876 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T15:58:54.876 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T15:58:54.876 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T15:58:54.876 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T15:58:55.013 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T15:58:55.044 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T15:58:55.147 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T15:58:55.309 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 114/146 2024-09-13T15:58:55.338 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T15:58:55.362 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T15:58:55.362 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:55.362 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T15:58:55.362 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T15:58:55.363 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T15:58:55.363 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T15:58:55.414 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T15:58:55.426 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T15:58:55.520 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 117/146 2024-09-13T15:58:55.572 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 118/146 2024-09-13T15:58:56.291 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T15:58:56.316 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T15:58:56.340 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T15:58:56.340 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:56.340 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T15:58:56.340 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:58:56.340 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:58:56.340 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T15:58:56.384 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T15:58:56.407 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T15:58:56.407 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:56.407 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T15:58:56.407 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T15:58:56.451 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T15:58:56.474 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T15:58:56.474 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:56.474 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T15:58:56.474 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:58:56.474 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:58:56.475 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T15:58:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T15:58:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T15:58:56.479 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2024-09-13T15:58:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T15:58:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T15:58:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T15:58:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T15:58:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T15:58:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T15:58:56.480 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-13T15:58:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T15:58:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T15:58:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T15:58:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:58:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:58:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:58:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:58:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:58:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:58:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:58:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:58:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:58:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:58:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T15:58:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T15:58:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T15:58:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T15:58:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T15:58:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T15:58:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T15:58:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T15:58:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T15:58:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T15:58:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T15:58:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T15:58:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T15:58:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T15:58:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T15:58:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T15:58:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T15:58:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T15:58:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T15:58:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T15:58:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T15:58:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T15:58:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T15:58:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T15:58:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T15:58:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T15:58:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T15:58:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T15:58:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T15:58:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T15:58:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T15:58:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T15:58:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T15:58:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T15:58:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T15:58:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T15:58:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T15:58:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T15:58:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T15:58:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T15:58:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T15:58:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T15:58:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T15:58:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T15:58:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T15:58:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T15:58:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T15:58:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T15:58:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T15:58:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T15:58:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T15:58:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T15:58:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T15:58:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T15:58:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T15:58:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T15:58:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T15:58:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T15:58:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T15:58:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T15:58:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T15:58:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T15:58:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T15:58:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T15:58:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T15:58:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T15:58:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T15:58:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T15:58:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T15:58:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T15:58:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T15:58:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T15:58:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T15:58:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T15:58:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T15:58:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T15:58:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T15:58:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T15:58:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T15:58:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T15:58:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T15:58:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T15:58:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:58:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T15:58:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T15:58:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T15:58:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T15:58:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T15:58:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T15:58:56.491 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T15:58:56.491 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T15:58:56.491 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-13T15:58:56.768 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T15:58:56.791 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T15:58:56.792 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:58:56.792 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T15:58:56.792 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T15:58:56.792 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T15:58:56.792 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T15:58:56.860 DEBUG:teuthology.parallel:result is None 2024-09-13T15:58:58.871 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 124/146 2024-09-13T15:58:58.912 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 125/146 2024-09-13T15:58:58.955 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 126/146 2024-09-13T15:58:59.043 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T15:58:59.275 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T15:58:59.324 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T15:58:59.362 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 130/146 2024-09-13T15:58:59.394 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T15:58:59.437 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T15:59:00.226 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:59:00.269 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:59:00.310 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:59:00.430 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 124/146 2024-09-13T15:59:00.471 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 125/146 2024-09-13T15:59:00.511 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 126/146 2024-09-13T15:59:00.543 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T15:59:00.716 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T15:59:00.766 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T15:59:00.796 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 130/146 2024-09-13T15:59:00.826 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T15:59:00.873 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T15:59:01.470 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:59:01.512 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:59:01.532 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:59:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 134/146 2024-09-13T15:59:01.665 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T15:59:01.718 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T15:59:01.821 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T15:59:01.861 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T15:59:01.885 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T15:59:01.921 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T15:59:01.921 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T15:59:02.028 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T15:59:02.028 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T15:59:02.154 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T15:59:02.178 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T15:59:02.194 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:59:02.195 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:59:02.352 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 134/146 2024-09-13T15:59:02.439 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:59:02.439 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T15:59:02.450 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T15:59:02.490 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T15:59:02.557 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T15:59:02.571 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T15:59:02.603 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T15:59:02.628 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T15:59:02.630 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T15:59:02.662 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T15:59:02.662 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T15:59:02.755 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T15:59:02.755 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T15:59:02.839 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T15:59:02.841 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T15:59:02.841 INFO:teuthology.orchestra.run.smithi086.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-13T15:59:02.841 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T15:59:02.864 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T15:59:02.869 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:59:02.869 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:59:03.057 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:59:03.058 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T15:59:03.141 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T15:59:03.212 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T15:59:08.082 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 1/146 2024-09-13T15:59:08.082 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2/146 2024-09-13T15:59:08.082 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 3/146 2024-09-13T15:59:08.082 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 4/146 2024-09-13T15:59:08.082 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 5/146 2024-09-13T15:59:08.082 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 6/146 2024-09-13T15:59:08.083 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 7/146 2024-09-13T15:59:08.083 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:59:08.083 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:59:08.083 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T15:59:08.083 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 11/146 2024-09-13T15:59:08.083 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 12/146 2024-09-13T15:59:08.083 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:59:08.083 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 14/146 2024-09-13T15:59:08.083 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 15/146 2024-09-13T15:59:08.083 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 16/146 2024-09-13T15:59:08.083 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 17/146 2024-09-13T15:59:08.084 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 18/146 2024-09-13T15:59:08.084 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 19/146 2024-09-13T15:59:08.084 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 20/146 2024-09-13T15:59:08.084 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 21/146 2024-09-13T15:59:08.084 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 22/146 2024-09-13T15:59:08.084 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 23/146 2024-09-13T15:59:08.084 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 24/146 2024-09-13T15:59:08.084 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 25/146 2024-09-13T15:59:08.084 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 26/146 2024-09-13T15:59:08.084 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 27/146 2024-09-13T15:59:08.095 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 28/146 2024-09-13T15:59:08.095 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 29/146 2024-09-13T15:59:08.095 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 30/146 2024-09-13T15:59:08.095 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 31/146 2024-09-13T15:59:08.095 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 32/146 2024-09-13T15:59:08.095 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 33/146 2024-09-13T15:59:08.096 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 34/146 2024-09-13T15:59:08.096 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 35/146 2024-09-13T15:59:08.096 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 36/146 2024-09-13T15:59:08.096 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 37/146 2024-09-13T15:59:08.096 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 38/146 2024-09-13T15:59:08.096 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T15:59:08.096 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T15:59:08.096 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T15:59:08.096 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T15:59:08.096 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T15:59:08.096 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T15:59:08.096 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T15:59:08.097 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T15:59:08.097 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T15:59:08.097 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T15:59:08.097 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T15:59:08.097 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T15:59:08.097 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T15:59:08.097 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T15:59:08.097 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T15:59:08.097 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T15:59:08.097 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T15:59:08.097 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T15:59:08.097 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T15:59:08.098 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T15:59:08.098 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T15:59:08.098 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T15:59:08.098 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T15:59:08.098 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T15:59:08.098 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T15:59:08.098 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T15:59:08.098 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T15:59:08.098 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T15:59:08.098 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T15:59:08.098 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T15:59:08.098 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T15:59:08.098 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T15:59:08.099 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T15:59:08.099 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T15:59:08.099 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T15:59:08.099 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T15:59:08.099 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T15:59:08.099 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T15:59:08.099 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T15:59:08.099 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T15:59:08.099 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T15:59:08.099 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T15:59:08.099 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T15:59:08.099 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T15:59:08.099 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T15:59:08.099 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T15:59:08.100 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T15:59:08.100 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T15:59:08.100 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T15:59:08.100 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T15:59:08.100 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T15:59:08.100 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T15:59:08.100 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T15:59:08.100 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T15:59:08.100 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T15:59:08.100 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T15:59:08.100 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T15:59:08.100 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T15:59:08.100 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T15:59:08.101 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T15:59:08.101 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T15:59:08.101 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T15:59:08.101 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T15:59:08.101 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T15:59:08.101 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T15:59:08.101 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T15:59:08.101 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T15:59:08.101 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T15:59:08.101 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T15:59:08.101 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T15:59:08.101 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T15:59:08.101 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T15:59:08.102 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T15:59:08.102 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T15:59:08.102 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T15:59:08.102 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T15:59:08.102 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T15:59:08.102 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T15:59:08.102 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T15:59:08.102 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T15:59:08.102 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T15:59:08.102 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T15:59:08.102 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T15:59:08.102 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T15:59:08.102 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T15:59:08.103 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T15:59:08.103 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T15:59:08.103 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T15:59:08.103 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T15:59:08.103 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T15:59:08.103 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T15:59:08.103 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T15:59:08.103 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 131/146 2024-09-13T15:59:08.103 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T15:59:08.103 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 133/146 2024-09-13T15:59:08.103 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T15:59:08.103 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T15:59:08.103 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T15:59:08.103 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T15:59:08.104 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T15:59:08.104 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T15:59:08.104 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T15:59:08.104 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T15:59:08.104 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T15:59:08.104 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T15:59:08.104 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T15:59:08.104 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T15:59:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T15:59:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 1/146 2024-09-13T15:59:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2/146 2024-09-13T15:59:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 3/146 2024-09-13T15:59:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 4/146 2024-09-13T15:59:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 5/146 2024-09-13T15:59:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 6/146 2024-09-13T15:59:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 7/146 2024-09-13T15:59:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:59:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:59:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T15:59:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 11/146 2024-09-13T15:59:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 12/146 2024-09-13T15:59:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:59:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 14/146 2024-09-13T15:59:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 15/146 2024-09-13T15:59:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 16/146 2024-09-13T15:59:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 17/146 2024-09-13T15:59:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 18/146 2024-09-13T15:59:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 19/146 2024-09-13T15:59:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 20/146 2024-09-13T15:59:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 21/146 2024-09-13T15:59:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 22/146 2024-09-13T15:59:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 23/146 2024-09-13T15:59:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 24/146 2024-09-13T15:59:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 25/146 2024-09-13T15:59:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 26/146 2024-09-13T15:59:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 27/146 2024-09-13T15:59:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 28/146 2024-09-13T15:59:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 29/146 2024-09-13T15:59:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 30/146 2024-09-13T15:59:08.183 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 31/146 2024-09-13T15:59:08.183 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 32/146 2024-09-13T15:59:08.183 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 33/146 2024-09-13T15:59:08.183 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 34/146 2024-09-13T15:59:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 35/146 2024-09-13T15:59:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 36/146 2024-09-13T15:59:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 37/146 2024-09-13T15:59:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 38/146 2024-09-13T15:59:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T15:59:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T15:59:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T15:59:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T15:59:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T15:59:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T15:59:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T15:59:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T15:59:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T15:59:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T15:59:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T15:59:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T15:59:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T15:59:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T15:59:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T15:59:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T15:59:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T15:59:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T15:59:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T15:59:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T15:59:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T15:59:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T15:59:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T15:59:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T15:59:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T15:59:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T15:59:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T15:59:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T15:59:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T15:59:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T15:59:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T15:59:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T15:59:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T15:59:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T15:59:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T15:59:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T15:59:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T15:59:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T15:59:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T15:59:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T15:59:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T15:59:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T15:59:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T15:59:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T15:59:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T15:59:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T15:59:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T15:59:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T15:59:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T15:59:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T15:59:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T15:59:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T15:59:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T15:59:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T15:59:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T15:59:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T15:59:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T15:59:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T15:59:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T15:59:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T15:59:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T15:59:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T15:59:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T15:59:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T15:59:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T15:59:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T15:59:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T15:59:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T15:59:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T15:59:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T15:59:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T15:59:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T15:59:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T15:59:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T15:59:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T15:59:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T15:59:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T15:59:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T15:59:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T15:59:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T15:59:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T15:59:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T15:59:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T15:59:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T15:59:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T15:59:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T15:59:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T15:59:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T15:59:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T15:59:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T15:59:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T15:59:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T15:59:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 131/146 2024-09-13T15:59:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T15:59:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 133/146 2024-09-13T15:59:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T15:59:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T15:59:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T15:59:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T15:59:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T15:59:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T15:59:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T15:59:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T15:59:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T15:59:08.193 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T15:59:08.193 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T15:59:08.193 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T15:59:10.214 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T15:59:10.214 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T15:59:10.214 INFO:teuthology.orchestra.run.smithi086.stdout:Upgraded: 2024-09-13T15:59:10.215 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T15:59:10.215 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T15:59:10.215 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T15:59:10.215 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T15:59:10.215 INFO:teuthology.orchestra.run.smithi086.stdout: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.215 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.215 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T15:59:10.215 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T15:59:10.215 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-13T15:59:10.215 INFO:teuthology.orchestra.run.smithi086.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T15:59:10.215 INFO:teuthology.orchestra.run.smithi086.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T15:59:10.215 INFO:teuthology.orchestra.run.smithi086.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T15:59:10.215 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.216 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.216 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.216 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.216 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.216 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.216 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.216 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.216 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.216 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.216 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.216 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.216 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.217 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.217 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.217 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.217 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.217 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.217 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.217 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.217 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.217 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.217 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.217 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T15:59:10.217 INFO:teuthology.orchestra.run.smithi086.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T15:59:10.218 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T15:59:10.218 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T15:59:10.218 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T15:59:10.218 INFO:teuthology.orchestra.run.smithi086.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T15:59:10.218 INFO:teuthology.orchestra.run.smithi086.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T15:59:10.218 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T15:59:10.218 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T15:59:10.218 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T15:59:10.218 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T15:59:10.218 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.218 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.218 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.219 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T15:59:10.219 INFO:teuthology.orchestra.run.smithi086.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T15:59:10.219 INFO:teuthology.orchestra.run.smithi086.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T15:59:10.219 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T15:59:10.219 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T15:59:10.219 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.219 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.219 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T15:59:10.219 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.219 INFO:teuthology.orchestra.run.smithi086.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T15:59:10.219 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T15:59:10.219 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T15:59:10.220 INFO:teuthology.orchestra.run.smithi086.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T15:59:10.220 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T15:59:10.220 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T15:59:10.220 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T15:59:10.220 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T15:59:10.220 INFO:teuthology.orchestra.run.smithi086.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T15:59:10.220 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T15:59:10.220 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T15:59:10.220 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T15:59:10.220 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T15:59:10.220 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T15:59:10.220 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T15:59:10.220 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T15:59:10.221 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T15:59:10.221 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.221 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.221 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.221 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T15:59:10.221 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T15:59:10.221 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T15:59:10.221 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T15:59:10.221 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T15:59:10.221 INFO:teuthology.orchestra.run.smithi086.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T15:59:10.221 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T15:59:10.221 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T15:59:10.221 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T15:59:10.222 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T15:59:10.222 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T15:59:10.222 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T15:59:10.222 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T15:59:10.222 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T15:59:10.222 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T15:59:10.222 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T15:59:10.222 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T15:59:10.222 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T15:59:10.222 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T15:59:10.222 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T15:59:10.222 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T15:59:10.222 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T15:59:10.222 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T15:59:10.222 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T15:59:10.223 INFO:teuthology.orchestra.run.smithi086.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T15:59:10.223 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T15:59:10.223 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T15:59:10.223 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T15:59:10.223 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T15:59:10.223 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T15:59:10.223 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T15:59:10.223 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T15:59:10.223 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T15:59:10.223 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T15:59:10.223 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.223 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.223 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T15:59:10.224 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T15:59:10.224 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T15:59:10.224 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.224 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T15:59:10.224 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T15:59:10.224 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T15:59:10.224 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T15:59:10.224 INFO:teuthology.orchestra.run.smithi086.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T15:59:10.224 INFO:teuthology.orchestra.run.smithi086.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T15:59:10.224 INFO:teuthology.orchestra.run.smithi086.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T15:59:10.224 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T15:59:10.224 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T15:59:10.224 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T15:59:10.225 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T15:59:10.225 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.225 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.225 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.225 INFO:teuthology.orchestra.run.smithi086.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T15:59:10.225 INFO:teuthology.orchestra.run.smithi086.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T15:59:10.225 INFO:teuthology.orchestra.run.smithi086.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T15:59:10.225 INFO:teuthology.orchestra.run.smithi086.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T15:59:10.225 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T15:59:10.225 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T15:59:10.226 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T15:59:10.226 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T15:59:10.226 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-13T15:59:10.804 DEBUG:teuthology.parallel:result is None 2024-09-13T15:59:10.810 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T15:59:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T15:59:10.811 INFO:teuthology.orchestra.run.smithi139.stdout:Upgraded: 2024-09-13T15:59:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T15:59:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T15:59:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T15:59:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T15:59:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T15:59:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T15:59:10.811 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-13T15:59:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T15:59:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T15:59:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T15:59:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:59:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T15:59:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T15:59:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T15:59:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T15:59:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T15:59:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T15:59:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T15:59:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T15:59:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T15:59:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T15:59:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T15:59:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T15:59:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T15:59:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T15:59:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T15:59:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T15:59:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T15:59:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T15:59:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T15:59:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T15:59:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T15:59:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T15:59:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T15:59:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T15:59:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T15:59:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T15:59:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T15:59:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T15:59:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T15:59:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T15:59:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T15:59:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T15:59:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T15:59:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T15:59:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T15:59:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T15:59:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T15:59:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T15:59:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T15:59:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T15:59:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T15:59:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T15:59:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T15:59:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T15:59:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T15:59:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T15:59:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T15:59:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T15:59:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T15:59:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T15:59:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T15:59:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T15:59:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T15:59:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T15:59:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T15:59:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T15:59:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T15:59:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T15:59:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T15:59:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T15:59:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T15:59:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T15:59:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T15:59:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T15:59:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T15:59:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T15:59:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T15:59:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T15:59:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T15:59:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T15:59:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T15:59:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T15:59:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T15:59:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T15:59:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T15:59:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T15:59:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T15:59:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T15:59:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T15:59:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T15:59:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T15:59:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T15:59:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:59:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T15:59:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T15:59:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T15:59:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T15:59:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T15:59:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T15:59:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T15:59:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T15:59:10.823 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-13T15:59:11.187 DEBUG:teuthology.parallel:result is None 2024-09-13T15:59:11.188 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:59:11.337 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T15:59:11.384 INFO:teuthology.orchestra.run.smithi086.stdout:18.2.4-850.g50bbe7f3.el9 2024-09-13T15:59:11.384 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-850.g50bbe7f3.el9 2024-09-13T15:59:11.385 INFO:teuthology.task.install:The correct ceph version 18.2.4-850.g50bbe7f3 is installed. 2024-09-13T15:59:11.386 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:59:11.529 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T15:59:11.553 INFO:teuthology.orchestra.run.smithi139.stdout:18.2.4-850.g50bbe7f3.el9 2024-09-13T15:59:11.553 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-850.g50bbe7f3.el9 2024-09-13T15:59:11.553 INFO:teuthology.task.install:The correct ceph version 18.2.4-850.g50bbe7f3 is installed. 2024-09-13T15:59:11.555 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:59:11.702 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T15:59:11.728 INFO:teuthology.orchestra.run.smithi194.stdout:18.2.4-850.g50bbe7f3.el9 2024-09-13T15:59:11.729 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-850.g50bbe7f3.el9 2024-09-13T15:59:11.729 INFO:teuthology.task.install:The correct ceph version 18.2.4-850.g50bbe7f3 is installed. 2024-09-13T15:59:11.731 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T15:59:11.731 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T15:59:11.731 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T15:59:11.789 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T15:59:11.790 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T15:59:11.820 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T15:59:11.820 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T15:59:11.851 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T15:59:11.851 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T15:59:11.852 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T15:59:11.909 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T15:59:12.008 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T15:59:12.008 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T15:59:12.037 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T15:59:12.106 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T15:59:12.107 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T15:59:12.138 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T15:59:12.207 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T15:59:12.207 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T15:59:12.207 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T15:59:12.263 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T15:59:12.364 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T15:59:12.365 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T15:59:12.394 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T15:59:12.462 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T15:59:12.462 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T15:59:12.488 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T15:59:12.554 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T15:59:12.554 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T15:59:12.554 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T15:59:12.612 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T15:59:12.708 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T15:59:12.708 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T15:59:12.738 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T15:59:12.807 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T15:59:12.807 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T15:59:12.832 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T15:59:12.896 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-13T15:59:12.990 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'subvols': {'create': 2}} 2024-09-13T15:59:12.990 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:59:12.991 INFO:tasks.cephadm:Cluster fsid is 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T15:59:12.991 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-13T15:59:12.991 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.86', 'mon.b': '172.21.15.139', 'mon.c': '172.21.15.194'} 2024-09-13T15:59:12.991 INFO:tasks.cephadm:First mon is mon.a on smithi086 2024-09-13T15:59:12.991 INFO:tasks.cephadm:First mgr is x 2024-09-13T15:59:12.992 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-13T15:59:12.992 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname $(hostname -s) 2024-09-13T15:59:13.049 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname $(hostname -s) 2024-09-13T15:59:13.079 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname $(hostname -s) 2024-09-13T15:59:13.104 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-13T15:59:13.104 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:59:13.256 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82946/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.4-850-g50bbe7f3', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.4-850.g50bbe7f3'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 12:31:04.094992', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240910.095512-reef', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-13T15:59:13.403 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-rishabh-testing-20240910.095512-reef, sha1 50bbe7f395997dcd871813949c49addbbf630361 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:59:13.405 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/x86_64/flavors/default/cephadm 2024-09-13T15:59:13.405 DEBUG:teuthology.orchestra.run.smithi086:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T15:59:13.846 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r--. 1 ubuntu ubuntu 217224 Sep 13 15:59 /home/ubuntu/cephtest/cephadm 2024-09-13T15:59:13.847 DEBUG:teuthology.orchestra.run.smithi139:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T15:59:14.181 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r--. 1 ubuntu ubuntu 217224 Sep 13 15:59 /home/ubuntu/cephtest/cephadm 2024-09-13T15:59:14.182 DEBUG:teuthology.orchestra.run.smithi194:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T15:59:14.527 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r--. 1 ubuntu ubuntu 217224 Sep 13 15:59 /home/ubuntu/cephtest/cephadm 2024-09-13T15:59:14.527 DEBUG:teuthology.orchestra.run.smithi086:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T15:59:14.565 DEBUG:teuthology.orchestra.run.smithi139:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T15:59:14.585 DEBUG:teuthology.orchestra.run.smithi194:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T15:59:14.622 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 on all hosts... 2024-09-13T15:59:14.622 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 pull 2024-09-13T15:59:14.626 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 pull 2024-09-13T15:59:14.629 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 pull 2024-09-13T15:59:16.147 INFO:teuthology.orchestra.run.smithi139.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361... 2024-09-13T15:59:16.155 INFO:teuthology.orchestra.run.smithi194.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361... 2024-09-13T15:59:16.452 INFO:teuthology.orchestra.run.smithi086.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361... 2024-09-13T15:59:45.026 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T15:59:45.026 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable)", 2024-09-13T15:59:45.026 INFO:teuthology.orchestra.run.smithi139.stdout: "image_id": "152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c", 2024-09-13T15:59:45.026 INFO:teuthology.orchestra.run.smithi139.stdout: "repo_digests": [ 2024-09-13T15:59:45.026 INFO:teuthology.orchestra.run.smithi139.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a" 2024-09-13T15:59:45.026 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T15:59:45.026 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T15:59:45.162 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-13T15:59:45.162 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_version": "ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable)", 2024-09-13T15:59:45.162 INFO:teuthology.orchestra.run.smithi194.stdout: "image_id": "152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c", 2024-09-13T15:59:45.162 INFO:teuthology.orchestra.run.smithi194.stdout: "repo_digests": [ 2024-09-13T15:59:45.162 INFO:teuthology.orchestra.run.smithi194.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a" 2024-09-13T15:59:45.163 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-13T15:59:45.163 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-13T15:59:45.765 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T15:59:45.765 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_version": "ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable)", 2024-09-13T15:59:45.765 INFO:teuthology.orchestra.run.smithi086.stdout: "image_id": "152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c", 2024-09-13T15:59:45.765 INFO:teuthology.orchestra.run.smithi086.stdout: "repo_digests": [ 2024-09-13T15:59:45.766 INFO:teuthology.orchestra.run.smithi086.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a" 2024-09-13T15:59:45.766 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T15:59:45.766 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T15:59:45.788 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph 2024-09-13T15:59:45.869 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph 2024-09-13T15:59:45.902 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph 2024-09-13T15:59:45.933 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /etc/ceph 2024-09-13T15:59:45.989 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /etc/ceph 2024-09-13T15:59:46.019 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /etc/ceph 2024-09-13T15:59:46.047 INFO:tasks.cephadm:Writing seed config... 2024-09-13T15:59:46.048 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-09-13T15:59:46.049 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-13T15:59:46.049 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-13T15:59:46.049 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-13T15:59:46.049 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-13T15:59:46.049 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-13T15:59:46.049 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-13T15:59:46.049 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-13T15:59:46.049 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-13T15:59:46.049 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-13T15:59:46.049 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-13T15:59:46.049 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-13T15:59:46.049 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-13T15:59:46.049 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-13T15:59:46.049 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-13T15:59:46.050 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-13T15:59:46.050 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-13T15:59:46.050 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-13T15:59:46.050 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-13T15:59:46.050 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-13T15:59:46.050 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-13T15:59:46.050 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-13T15:59:46.050 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-13T15:59:46.050 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-13T15:59:46.050 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-13T15:59:46.050 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-13T15:59:46.051 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-13T15:59:46.051 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-13T15:59:46.051 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-13T15:59:46.051 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-13T15:59:46.051 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-13T15:59:46.051 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-13T15:59:46.051 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-13T15:59:46.051 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-13T15:59:46.051 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-13T15:59:46.051 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-13T15:59:46.051 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-13T15:59:46.051 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-13T15:59:46.051 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-13T15:59:46.052 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-13T15:59:46.052 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-13T15:59:46.052 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-13T15:59:46.052 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-13T15:59:46.052 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-13T15:59:46.052 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-13T15:59:46.052 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-13T15:59:46.052 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-13T15:59:46.053 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T15:59:46.053 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-13T15:59:46.089 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 1ecdfbda-71e9-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-13T15:59:46.089 DEBUG:teuthology.orchestra.run.smithi086:mon.a> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mon.a.service 2024-09-13T15:59:46.133 DEBUG:teuthology.orchestra.run.smithi086:mgr.x> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mgr.x.service 2024-09-13T15:59:46.179 INFO:tasks.cephadm:Bootstrapping... 2024-09-13T15:59:46.179 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 -v bootstrap --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.86 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-13T15:59:46.380 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-13T15:59:46.380 INFO:teuthology.orchestra.run.smithi086.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361', '-v', 'bootstrap', '--fsid', '1ecdfbda-71e9-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.86', '--skip-admin-label'] 2024-09-13T15:59:46.424 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stdout 5.2.2 2024-09-13T15:59:46.424 INFO:teuthology.orchestra.run.smithi086.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-13T15:59:46.424 INFO:teuthology.orchestra.run.smithi086.stdout:Verifying podman|docker is present... 2024-09-13T15:59:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stdout 5.2.2 2024-09-13T15:59:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:Verifying lvm2 is present... 2024-09-13T15:59:46.469 INFO:teuthology.orchestra.run.smithi086.stdout:Verifying time synchronization is in place... 2024-09-13T15:59:46.482 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T15:59:46.482 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T15:59:46.495 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T15:59:46.495 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout inactive 2024-09-13T15:59:46.508 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout enabled 2024-09-13T15:59:46.520 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout active 2024-09-13T15:59:46.521 INFO:teuthology.orchestra.run.smithi086.stdout:Unit chronyd.service is enabled and running 2024-09-13T15:59:46.521 INFO:teuthology.orchestra.run.smithi086.stdout:Repeating the final host check... 2024-09-13T15:59:46.563 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stdout 5.2.2 2024-09-13T15:59:46.563 INFO:teuthology.orchestra.run.smithi086.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-13T15:59:46.564 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl is present 2024-09-13T15:59:46.564 INFO:teuthology.orchestra.run.smithi086.stdout:lvcreate is present 2024-09-13T15:59:46.575 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T15:59:46.575 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T15:59:46.587 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T15:59:46.587 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout inactive 2024-09-13T15:59:46.600 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout enabled 2024-09-13T15:59:46.613 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout active 2024-09-13T15:59:46.613 INFO:teuthology.orchestra.run.smithi086.stdout:Unit chronyd.service is enabled and running 2024-09-13T15:59:46.613 INFO:teuthology.orchestra.run.smithi086.stdout:Host looks OK 2024-09-13T15:59:46.613 INFO:teuthology.orchestra.run.smithi086.stdout:Cluster fsid: 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T15:59:46.613 INFO:teuthology.orchestra.run.smithi086.stdout:Acquiring lock 140622481604720 on /run/cephadm/1ecdfbda-71e9-11ef-bceb-c7b262605968.lock 2024-09-13T15:59:46.613 INFO:teuthology.orchestra.run.smithi086.stdout:Lock 140622481604720 acquired on /run/cephadm/1ecdfbda-71e9-11ef-bceb-c7b262605968.lock 2024-09-13T15:59:46.614 INFO:teuthology.orchestra.run.smithi086.stdout:Verifying IP 172.21.15.86 port 3300 ... 2024-09-13T15:59:46.614 INFO:teuthology.orchestra.run.smithi086.stdout:Verifying IP 172.21.15.86 port 6789 ... 2024-09-13T15:59:46.614 INFO:teuthology.orchestra.run.smithi086.stdout:Base mon IP(s) is [172.21.15.86:3300, 172.21.15.86:6789], mon addrv is [v2:172.21.15.86:3300,v1:172.21.15.86:6789] 2024-09-13T15:59:46.621 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.86 metric 100 2024-09-13T15:59:46.621 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.86 metric 100 2024-09-13T15:59:46.627 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-13T15:59:46.627 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-13T15:59:46.627 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-13T15:59:46.633 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-13T15:59:46.633 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-13T15:59:46.633 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T15:59:46.633 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-13T15:59:46.633 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d809/64 scope link noprefixroute 2024-09-13T15:59:46.633 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T15:59:46.634 INFO:teuthology.orchestra.run.smithi086.stdout:Mon IP `172.21.15.86` is in CIDR network `172.21.0.0/20` 2024-09-13T15:59:46.634 INFO:teuthology.orchestra.run.smithi086.stdout:Mon IP `172.21.15.86` is in CIDR network `172.21.0.0/20` 2024-09-13T15:59:46.634 INFO:teuthology.orchestra.run.smithi086.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-13T15:59:46.634 INFO:teuthology.orchestra.run.smithi086.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-13T15:59:46.635 INFO:teuthology.orchestra.run.smithi086.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361... 2024-09-13T15:59:47.754 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stdout 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c 2024-09-13T15:59:47.754 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361... 2024-09-13T15:59:47.754 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stderr Getting image source signatures 2024-09-13T15:59:47.754 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stderr Copying blob sha256:3bf8bde7788a2a6694fefa78ba3da98c997a778335fd0748e145012f747287ae 2024-09-13T15:59:47.754 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-13T15:59:47.754 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stderr Copying config sha256:152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c 2024-09-13T15:59:47.754 INFO:teuthology.orchestra.run.smithi086.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-13T15:59:48.905 INFO:teuthology.orchestra.run.smithi086.stdout:ceph: stdout ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable) 2024-09-13T15:59:48.906 INFO:teuthology.orchestra.run.smithi086.stdout:Ceph version: ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable) 2024-09-13T15:59:48.906 INFO:teuthology.orchestra.run.smithi086.stdout:Extracting ceph user uid/gid from container image... 2024-09-13T15:59:49.953 INFO:teuthology.orchestra.run.smithi086.stdout:stat: stdout 167 167 2024-09-13T15:59:49.953 INFO:teuthology.orchestra.run.smithi086.stdout:Creating initial keys... 2024-09-13T15:59:50.992 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph-authtool: stdout AQB2YeRm25x7EhAArTtPnYiNzzqtNSErdGAb1A== 2024-09-13T16:00:02.314 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph-authtool: stdout AQB9YeRmh5flGBAA/gMRu7DqzioV/EVDH8M+2Q== 2024-09-13T16:00:03.477 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph-authtool: stdout AQCCYeRmjEDZKhAA4FMHZv0/rUJsTN0GAy89pw== 2024-09-13T16:00:03.478 INFO:teuthology.orchestra.run.smithi086.stdout:Creating initial monmap... 2024-09-13T16:00:04.550 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T16:00:04.550 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-13T16:00:04.550 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:00:04.550 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T16:00:04.550 INFO:teuthology.orchestra.run.smithi086.stdout:monmaptool for a [v2:172.21.15.86:3300,v1:172.21.15.86:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T16:00:04.551 INFO:teuthology.orchestra.run.smithi086.stdout:setting min_mon_release = pacific 2024-09-13T16:00:04.551 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/monmaptool: set fsid to 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:00:04.551 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T16:00:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:00:04.551 INFO:teuthology.orchestra.run.smithi086.stdout:Creating mon... 2024-09-13T16:00:05.590 INFO:teuthology.orchestra.run.smithi086.stdout:create mon.a on 2024-09-13T16:00:05.912 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-13T16:00:06.128 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-13T16:00:06.380 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968.target. 2024-09-13T16:00:06.380 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968.target. 2024-09-13T16:00:06.716 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mon.a 2024-09-13T16:00:06.716 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-13T16:00:07.116 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968.target.wants/ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@.service. 2024-09-13T16:00:07.741 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:07 smithi086 podman[30003]: 2024-09-13 16:00:07.677653772 +0000 UTC m=+0.346663234 container start b69f93f69b4ee8b33a6c717ff6eb4a2fb7ac51c731eb7d3ff09274e98d94a5b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-13T16:00:07.789 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T16:00:07.790 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout disabled 2024-09-13T16:00:07.803 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T16:00:07.803 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout inactive 2024-09-13T16:00:07.803 INFO:teuthology.orchestra.run.smithi086.stdout:firewalld.service is not enabled 2024-09-13T16:00:07.803 INFO:teuthology.orchestra.run.smithi086.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T16:00:07.804 INFO:teuthology.orchestra.run.smithi086.stdout:Waiting for mon to start... 2024-09-13T16:00:07.804 INFO:teuthology.orchestra.run.smithi086.stdout:Waiting for mon... 2024-09-13T16:00:08.059 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:07 smithi086 ceph-mon[30022]: mkfs 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:00:08.059 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:07 smithi086 ceph-mon[30022]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T16:00:08.059 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:07 smithi086 bash[30003]: b69f93f69b4ee8b33a6c717ff6eb4a2fb7ac51c731eb7d3ff09274e98d94a5b2 2024-09-13T16:00:08.059 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:07 smithi086 systemd[1]: Started Ceph mon.a for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:00:09.019 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:08 smithi086 ceph-mon[30022]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T16:00:09.019 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:08 smithi086 ceph-mon[30022]: monmap e1: 1 mons at {a=[v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:00:09.019 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:08 smithi086 ceph-mon[30022]: fsmap 2024-09-13T16:00:09.019 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:08 smithi086 ceph-mon[30022]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T16:00:09.019 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:08 smithi086 ceph-mon[30022]: mgrmap e1: no daemons active 2024-09-13T16:00:09.019 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:08 smithi086 ceph-mon[30022]: from='client.? 172.21.15.86:0/2380848123' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-13T16:00:09.024 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout cluster: 2024-09-13T16:00:09.031 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout id: 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:00:09.031 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-13T16:00:09.031 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-09-13T16:00:09.031 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout services: 2024-09-13T16:00:09.031 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.691751s) 2024-09-13T16:00:09.032 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-13T16:00:09.032 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-13T16:00:09.032 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-09-13T16:00:09.032 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout data: 2024-09-13T16:00:09.032 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-13T16:00:09.032 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-13T16:00:09.032 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-13T16:00:09.032 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout pgs: 2024-09-13T16:00:09.032 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-09-13T16:00:09.032 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.353+0000 7fdd2a200640 1 Processor -- start 2024-09-13T16:00:09.032 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.354+0000 7fdd2a200640 1 -- start start 2024-09-13T16:00:09.032 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.354+0000 7fdd2a200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd241057b0 0x7fdd24105bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:09.033 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.354+0000 7fdd2a200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd24106180 con 0x7fdd241057b0 2024-09-13T16:00:09.033 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.355+0000 7fdd23400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd241057b0 0x7fdd24105bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:09.033 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.355+0000 7fdd23400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd241057b0 0x7fdd24105bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48552/0 (socket says 172.21.15.86:48552) 2024-09-13T16:00:09.033 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.355+0000 7fdd23400640 1 -- 172.21.15.86:0/2501629107 learned_addr learned my addr 172.21.15.86:0/2501629107 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:09.033 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.355+0000 7fdd23400640 1 -- 172.21.15.86:0/2501629107 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd241069b0 con 0x7fdd241057b0 2024-09-13T16:00:09.033 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.358+0000 7fdd23400640 1 --2- 172.21.15.86:0/2501629107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd241057b0 0x7fdd24105bb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009e80 tx=0x7fdd1402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa3c49392f21515 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:09.033 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.358+0000 7fdd22000640 1 -- 172.21.15.86:0/2501629107 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd14031400 con 0x7fdd241057b0 2024-09-13T16:00:09.033 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.358+0000 7fdd22000640 1 -- 172.21.15.86:0/2501629107 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1402d050 con 0x7fdd241057b0 2024-09-13T16:00:09.033 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.358+0000 7fdd22000640 1 -- 172.21.15.86:0/2501629107 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd140316b0 con 0x7fdd241057b0 2024-09-13T16:00:09.033 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.359+0000 7fdd2a200640 1 -- 172.21.15.86:0/2501629107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd241057b0 msgr2=0x7fdd24105bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:09.033 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.359+0000 7fdd2a200640 1 --2- 172.21.15.86:0/2501629107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd241057b0 0x7fdd24105bb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009e80 tx=0x7fdd1402a7a0 comp rx=0 tx=0).stop 2024-09-13T16:00:09.033 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.359+0000 7fdd2a200640 1 -- 172.21.15.86:0/2501629107 shutdown_connections 2024-09-13T16:00:09.033 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.359+0000 7fdd2a200640 1 --2- 172.21.15.86:0/2501629107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd241057b0 0x7fdd24105bb0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:09.034 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.359+0000 7fdd2a200640 1 -- 172.21.15.86:0/2501629107 >> 172.21.15.86:0/2501629107 conn(0x7fdd24100fe0 msgr2=0x7fdd24103400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:09.034 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.359+0000 7fdd2a200640 1 -- 172.21.15.86:0/2501629107 shutdown_connections 2024-09-13T16:00:09.034 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.359+0000 7fdd2a200640 1 -- 172.21.15.86:0/2501629107 wait complete. 2024-09-13T16:00:09.034 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.360+0000 7fdd2a200640 1 Processor -- start 2024-09-13T16:00:09.034 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.360+0000 7fdd2a200640 1 -- start start 2024-09-13T16:00:09.034 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.360+0000 7fdd2a200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd241057b0 0x7fdd2419af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:09.034 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.360+0000 7fdd2a200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2419b480 con 0x7fdd241057b0 2024-09-13T16:00:09.034 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.360+0000 7fdd23400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd241057b0 0x7fdd2419af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:09.034 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.361+0000 7fdd23400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd241057b0 0x7fdd2419af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48562/0 (socket says 172.21.15.86:48562) 2024-09-13T16:00:09.034 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.361+0000 7fdd23400640 1 -- 172.21.15.86:0/2380848123 learned_addr learned my addr 172.21.15.86:0/2380848123 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:09.035 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.361+0000 7fdd23400640 1 -- 172.21.15.86:0/2380848123 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd14009b30 con 0x7fdd241057b0 2024-09-13T16:00:09.035 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.361+0000 7fdd23400640 1 --2- 172.21.15.86:0/2380848123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd241057b0 0x7fdd2419af40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdd14034040 tx=0x7fdd14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:09.035 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.361+0000 7fdd1be00640 1 -- 172.21.15.86:0/2380848123 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd1403c690 con 0x7fdd241057b0 2024-09-13T16:00:09.035 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.361+0000 7fdd1be00640 1 -- 172.21.15.86:0/2380848123 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1403c7f0 con 0x7fdd241057b0 2024-09-13T16:00:09.035 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.361+0000 7fdd1be00640 1 -- 172.21.15.86:0/2380848123 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd1403cab0 con 0x7fdd241057b0 2024-09-13T16:00:09.035 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.361+0000 7fdd2a200640 1 -- 172.21.15.86:0/2380848123 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd2419b680 con 0x7fdd241057b0 2024-09-13T16:00:09.035 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.362+0000 7fdd2a200640 1 -- 172.21.15.86:0/2380848123 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2419bb20 con 0x7fdd241057b0 2024-09-13T16:00:09.035 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.362+0000 7fdd1be00640 1 -- 172.21.15.86:0/2380848123 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fdd14038040 con 0x7fdd241057b0 2024-09-13T16:00:09.035 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.362+0000 7fdd1be00640 1 -- 172.21.15.86:0/2380848123 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdd1403b720 con 0x7fdd241057b0 2024-09-13T16:00:09.035 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.363+0000 7fdd2a200640 1 -- 172.21.15.86:0/2380848123 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd24106d90 con 0x7fdd241057b0 2024-09-13T16:00:09.035 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.366+0000 7fdd1be00640 1 -- 172.21.15.86:0/2380848123 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fdd1404c060 con 0x7fdd241057b0 2024-09-13T16:00:09.035 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.426+0000 7fdd2a200640 1 -- 172.21.15.86:0/2380848123 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fdd2419e400 con 0x7fdd241057b0 2024-09-13T16:00:09.035 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.426+0000 7fdd1be00640 1 -- 172.21.15.86:0/2380848123 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7fdd14042070 con 0x7fdd241057b0 2024-09-13T16:00:09.036 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.427+0000 7fdd2a200640 1 -- 172.21.15.86:0/2380848123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd241057b0 msgr2=0x7fdd2419af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:09.036 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.427+0000 7fdd2a200640 1 --2- 172.21.15.86:0/2380848123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd241057b0 0x7fdd2419af40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdd14034040 tx=0x7fdd14004a40 comp rx=0 tx=0).stop 2024-09-13T16:00:09.036 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.427+0000 7fdd2a200640 1 -- 172.21.15.86:0/2380848123 shutdown_connections 2024-09-13T16:00:09.036 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.427+0000 7fdd2a200640 1 --2- 172.21.15.86:0/2380848123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd241057b0 0x7fdd2419af40 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:09.036 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.427+0000 7fdd2a200640 1 -- 172.21.15.86:0/2380848123 >> 172.21.15.86:0/2380848123 conn(0x7fdd24100fe0 msgr2=0x7fdd2407a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:09.036 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.427+0000 7fdd2a200640 1 -- 172.21.15.86:0/2380848123 shutdown_connections 2024-09-13T16:00:09.036 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:08.427+0000 7fdd2a200640 1 -- 172.21.15.86:0/2380848123 wait complete. 2024-09-13T16:00:09.036 INFO:teuthology.orchestra.run.smithi086.stdout:mon is available 2024-09-13T16:00:09.036 INFO:teuthology.orchestra.run.smithi086.stdout:Assimilating anything we can from ceph.conf... 2024-09-13T16:00:09.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:09 smithi086 ceph-mon[30022]: from='client.? 172.21.15.86:0/3420204215' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T16:00:09.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:09 smithi086 ceph-mon[30022]: from='client.? 172.21.15.86:0/3420204215' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T16:00:10.202 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-09-13T16:00:10.202 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T16:00:10.203 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout fsid = 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:00:10.203 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.86:3300,v1:172.21.15.86:6789] 2024-09-13T16:00:10.203 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T16:00:10.203 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T16:00:10.203 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T16:00:10.203 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T16:00:10.203 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-09-13T16:00:10.203 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T16:00:10.203 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T16:00:10.203 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-09-13T16:00:10.203 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T16:00:10.203 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T16:00:10.203 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T16:00:10.203 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T16:00:10.204 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T16:00:10.204 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T16:00:10.204 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.490+0000 7f38fe800640 1 Processor -- start 2024-09-13T16:00:10.204 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.491+0000 7f38fe800640 1 -- start start 2024-09-13T16:00:10.204 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.491+0000 7f38fe800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f8107880 0x7f38f8107c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:10.204 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.491+0000 7f38fe800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f8108250 con 0x7f38f8107880 2024-09-13T16:00:10.204 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.491+0000 7f38fd400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f8107880 0x7f38f8107c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:10.204 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.491+0000 7f38fd400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f8107880 0x7f38f8107c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48578/0 (socket says 172.21.15.86:48578) 2024-09-13T16:00:10.204 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.491+0000 7f38fd400640 1 -- 172.21.15.86:0/2507685531 learned_addr learned my addr 172.21.15.86:0/2507685531 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:10.204 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.492+0000 7f38fd400640 1 -- 172.21.15.86:0/2507685531 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f8108a80 con 0x7f38f8107880 2024-09-13T16:00:10.204 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.493+0000 7f38fd400640 1 --2- 172.21.15.86:0/2507685531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f8107880 0x7f38f8107c80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009820 tx=0x7f38ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a4f71e16278764 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:10.204 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.493+0000 7f38f7e00640 1 -- 172.21.15.86:0/2507685531 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38ec02ae70 con 0x7f38f8107880 2024-09-13T16:00:10.204 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.493+0000 7f38f7e00640 1 -- 172.21.15.86:0/2507685531 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec032440 con 0x7f38f8107880 2024-09-13T16:00:10.205 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.493+0000 7f38f7e00640 1 -- 172.21.15.86:0/2507685531 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38ec032700 con 0x7f38f8107880 2024-09-13T16:00:10.205 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.494+0000 7f38fe800640 1 -- 172.21.15.86:0/2507685531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f8107880 msgr2=0x7f38f8107c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:10.205 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.494+0000 7f38fe800640 1 --2- 172.21.15.86:0/2507685531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f8107880 0x7f38f8107c80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009820 tx=0x7f38ec02a270 comp rx=0 tx=0).stop 2024-09-13T16:00:10.205 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.494+0000 7f38fe800640 1 -- 172.21.15.86:0/2507685531 shutdown_connections 2024-09-13T16:00:10.205 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.494+0000 7f38fe800640 1 --2- 172.21.15.86:0/2507685531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f8107880 0x7f38f8107c80 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:10.205 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.494+0000 7f38fe800640 1 -- 172.21.15.86:0/2507685531 >> 172.21.15.86:0/2507685531 conn(0x7f38f807ae90 msgr2=0x7f38f807b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:10.205 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.494+0000 7f38fe800640 1 -- 172.21.15.86:0/2507685531 shutdown_connections 2024-09-13T16:00:10.205 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.494+0000 7f38fe800640 1 -- 172.21.15.86:0/2507685531 wait complete. 2024-09-13T16:00:10.205 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.495+0000 7f38fe800640 1 Processor -- start 2024-09-13T16:00:10.205 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.495+0000 7f38fe800640 1 -- start start 2024-09-13T16:00:10.205 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.495+0000 7f38fe800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f8107880 0x7f38f819adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:10.205 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.495+0000 7f38fe800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f819b300 con 0x7f38f8107880 2024-09-13T16:00:10.205 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.495+0000 7f38fd400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f8107880 0x7f38f819adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:10.206 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.495+0000 7f38fd400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f8107880 0x7f38f819adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48586/0 (socket says 172.21.15.86:48586) 2024-09-13T16:00:10.206 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.495+0000 7f38fd400640 1 -- 172.21.15.86:0/3420204215 learned_addr learned my addr 172.21.15.86:0/3420204215 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:10.206 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.496+0000 7f38fd400640 1 -- 172.21.15.86:0/3420204215 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ec0094d0 con 0x7f38f8107880 2024-09-13T16:00:10.206 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.496+0000 7f38fd400640 1 --2- 172.21.15.86:0/3420204215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f8107880 0x7f38f819adc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0090b0 tx=0x7f38ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:10.206 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.496+0000 7f38f6000640 1 -- 172.21.15.86:0/3420204215 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38ec0308d0 con 0x7f38f8107880 2024-09-13T16:00:10.206 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.496+0000 7f38f6000640 1 -- 172.21.15.86:0/3420204215 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec030a30 con 0x7f38f8107880 2024-09-13T16:00:10.206 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.496+0000 7f38fe800640 1 -- 172.21.15.86:0/3420204215 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f819b500 con 0x7f38f8107880 2024-09-13T16:00:10.206 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.496+0000 7f38f6000640 1 -- 172.21.15.86:0/3420204215 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38ec030cf0 con 0x7f38f8107880 2024-09-13T16:00:10.206 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.496+0000 7f38fe800640 1 -- 172.21.15.86:0/3420204215 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f819b9a0 con 0x7f38f8107880 2024-09-13T16:00:10.207 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.496+0000 7f38f6000640 1 -- 172.21.15.86:0/3420204215 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f38ec039040 con 0x7f38f8107880 2024-09-13T16:00:10.207 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.497+0000 7f38f6000640 1 -- 172.21.15.86:0/3420204215 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f38ec0468c0 con 0x7f38f8107880 2024-09-13T16:00:10.207 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.497+0000 7f38fe800640 1 -- 172.21.15.86:0/3420204215 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f8109630 con 0x7f38f8107880 2024-09-13T16:00:10.207 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.500+0000 7f38f6000640 1 -- 172.21.15.86:0/3420204215 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f38ec037070 con 0x7f38f8107880 2024-09-13T16:00:10.207 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.559+0000 7f38fe800640 1 -- 172.21.15.86:0/3420204215 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f38f8109110 con 0x7f38f8107880 2024-09-13T16:00:10.207 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.563+0000 7f38f6000640 1 -- 172.21.15.86:0/3420204215 <== mon.0 v2:172.21.15.86:3300/0 7 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f38ec04f8f0 con 0x7f38f8107880 2024-09-13T16:00:10.207 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.563+0000 7f38f6000640 1 -- 172.21.15.86:0/3420204215 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f38ec046a80 con 0x7f38f8107880 2024-09-13T16:00:10.207 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.564+0000 7f38fe800640 1 -- 172.21.15.86:0/3420204215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f8107880 msgr2=0x7f38f819adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:10.207 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.564+0000 7f38fe800640 1 --2- 172.21.15.86:0/3420204215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f8107880 0x7f38f819adc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0090b0 tx=0x7f38ec0046c0 comp rx=0 tx=0).stop 2024-09-13T16:00:10.207 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.564+0000 7f38fe800640 1 -- 172.21.15.86:0/3420204215 shutdown_connections 2024-09-13T16:00:10.207 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.564+0000 7f38fe800640 1 --2- 172.21.15.86:0/3420204215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f8107880 0x7f38f819adc0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:10.207 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.564+0000 7f38fe800640 1 -- 172.21.15.86:0/3420204215 >> 172.21.15.86:0/3420204215 conn(0x7f38f807ae90 msgr2=0x7f38f818f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:10.207 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.565+0000 7f38fe800640 1 -- 172.21.15.86:0/3420204215 shutdown_connections 2024-09-13T16:00:10.208 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:09.565+0000 7f38fe800640 1 -- 172.21.15.86:0/3420204215 wait complete. 2024-09-13T16:00:10.208 INFO:teuthology.orchestra.run.smithi086.stdout:Generating new minimal ceph.conf... 2024-09-13T16:00:11.070 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:10 smithi086 ceph-mon[30022]: from='client.? 172.21.15.86:0/137237602' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:00:11.402 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.673+0000 7f2318c00640 1 Processor -- start 2024-09-13T16:00:11.402 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.673+0000 7f2318c00640 1 -- start start 2024-09-13T16:00:11.402 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.673+0000 7f2318c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2314108fd0 0x7f23141093d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:11.402 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.673+0000 7f2318c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23141099a0 con 0x7f2314108fd0 2024-09-13T16:00:11.402 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.673+0000 7f2311e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2314108fd0 0x7f23141093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:11.402 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.674+0000 7f2311e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2314108fd0 0x7f23141093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48592/0 (socket says 172.21.15.86:48592) 2024-09-13T16:00:11.402 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.674+0000 7f2311e00640 1 -- 172.21.15.86:0/409090603 learned_addr learned my addr 172.21.15.86:0/409090603 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:11.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.674+0000 7f2311e00640 1 -- 172.21.15.86:0/409090603 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2314109ae0 con 0x7f2314108fd0 2024-09-13T16:00:11.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.675+0000 7f2311e00640 1 --2- 172.21.15.86:0/409090603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2314108fd0 0x7f23141093d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2304009820 tx=0x7f230402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0572fdc96b46d4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:11.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.675+0000 7f2311400640 1 -- 172.21.15.86:0/409090603 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f230402ae70 con 0x7f2314108fd0 2024-09-13T16:00:11.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.675+0000 7f2311400640 1 -- 172.21.15.86:0/409090603 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f2304032900 con 0x7f2314108fd0 2024-09-13T16:00:11.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.675+0000 7f2311400640 1 -- 172.21.15.86:0/409090603 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23040309d0 con 0x7f2314108fd0 2024-09-13T16:00:11.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.676+0000 7f2318c00640 1 -- 172.21.15.86:0/409090603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2314108fd0 msgr2=0x7f23141093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:11.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.676+0000 7f2318c00640 1 --2- 172.21.15.86:0/409090603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2314108fd0 0x7f23141093d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2304009820 tx=0x7f230402a270 comp rx=0 tx=0).stop 2024-09-13T16:00:11.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.676+0000 7f2318c00640 1 -- 172.21.15.86:0/409090603 shutdown_connections 2024-09-13T16:00:11.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.676+0000 7f2318c00640 1 --2- 172.21.15.86:0/409090603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2314108fd0 0x7f23141093d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:11.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.676+0000 7f2318c00640 1 -- 172.21.15.86:0/409090603 >> 172.21.15.86:0/409090603 conn(0x7f231407b060 msgr2=0x7f231407b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:11.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.676+0000 7f2318c00640 1 -- 172.21.15.86:0/409090603 shutdown_connections 2024-09-13T16:00:11.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.676+0000 7f2318c00640 1 -- 172.21.15.86:0/409090603 wait complete. 2024-09-13T16:00:11.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.677+0000 7f2318c00640 1 Processor -- start 2024-09-13T16:00:11.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.677+0000 7f2318c00640 1 -- start start 2024-09-13T16:00:11.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.677+0000 7f2318c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2314108fd0 0x7f231419b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:11.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.677+0000 7f2318c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231419bcc0 con 0x7f2314108fd0 2024-09-13T16:00:11.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.677+0000 7f2311e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2314108fd0 0x7f231419b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:11.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.678+0000 7f2311e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2314108fd0 0x7f231419b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48596/0 (socket says 172.21.15.86:48596) 2024-09-13T16:00:11.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.678+0000 7f2311e00640 1 -- 172.21.15.86:0/137237602 learned_addr learned my addr 172.21.15.86:0/137237602 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:11.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.678+0000 7f2311e00640 1 -- 172.21.15.86:0/137237602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23040094d0 con 0x7f2314108fd0 2024-09-13T16:00:11.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.678+0000 7f2311e00640 1 --2- 172.21.15.86:0/137237602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2314108fd0 0x7f231419b780 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f230402a790 tx=0x7f2304032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:11.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.678+0000 7f230aa00640 1 -- 172.21.15.86:0/137237602 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2304032db0 con 0x7f2314108fd0 2024-09-13T16:00:11.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.678+0000 7f230aa00640 1 -- 172.21.15.86:0/137237602 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f230403b8f0 con 0x7f2314108fd0 2024-09-13T16:00:11.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.678+0000 7f2318c00640 1 -- 172.21.15.86:0/137237602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231419bec0 con 0x7f2314108fd0 2024-09-13T16:00:11.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.678+0000 7f230aa00640 1 -- 172.21.15.86:0/137237602 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f230403a6f0 con 0x7f2314108fd0 2024-09-13T16:00:11.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.679+0000 7f2318c00640 1 -- 172.21.15.86:0/137237602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231419c360 con 0x7f2314108fd0 2024-09-13T16:00:11.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.679+0000 7f230aa00640 1 -- 172.21.15.86:0/137237602 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f2304039040 con 0x7f2314108fd0 2024-09-13T16:00:11.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.679+0000 7f230aa00640 1 -- 172.21.15.86:0/137237602 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2304044c60 con 0x7f2314108fd0 2024-09-13T16:00:11.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.680+0000 7f2318c00640 1 -- 172.21.15.86:0/137237602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2314109450 con 0x7f2314108fd0 2024-09-13T16:00:11.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.682+0000 7f230aa00640 1 -- 172.21.15.86:0/137237602 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f230403f020 con 0x7f2314108fd0 2024-09-13T16:00:11.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.741+0000 7f2318c00640 1 -- 172.21.15.86:0/137237602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f231410bf10 con 0x7f2314108fd0 2024-09-13T16:00:11.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.741+0000 7f230aa00640 1 -- 172.21.15.86:0/137237602 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f2304037070 con 0x7f2314108fd0 2024-09-13T16:00:11.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.742+0000 7f2318c00640 1 -- 172.21.15.86:0/137237602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2314108fd0 msgr2=0x7f231419b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:11.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.742+0000 7f2318c00640 1 --2- 172.21.15.86:0/137237602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2314108fd0 0x7f231419b780 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f230402a790 tx=0x7f2304032670 comp rx=0 tx=0).stop 2024-09-13T16:00:11.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.743+0000 7f2318c00640 1 -- 172.21.15.86:0/137237602 shutdown_connections 2024-09-13T16:00:11.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.743+0000 7f2318c00640 1 --2- 172.21.15.86:0/137237602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2314108fd0 0x7f231419b780 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:11.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.743+0000 7f2318c00640 1 -- 172.21.15.86:0/137237602 >> 172.21.15.86:0/137237602 conn(0x7f231407b060 msgr2=0x7f2314105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:11.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.743+0000 7f2318c00640 1 -- 172.21.15.86:0/137237602 shutdown_connections 2024-09-13T16:00:11.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:10.743+0000 7f2318c00640 1 -- 172.21.15.86:0/137237602 wait complete. 2024-09-13T16:00:11.405 INFO:teuthology.orchestra.run.smithi086.stdout:Restarting the monitor... 2024-09-13T16:00:11.738 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:11 smithi086 systemd[1]: Stopping Ceph mon.a for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:00:12.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:11 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-a[30018]: 2024-09-13T16:00:11.736+0000 7f88fd400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:00:12.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:11 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-a[30018]: 2024-09-13T16:00:11.736+0000 7f88fd400640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-13T16:00:12.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:11 smithi086 podman[30257]: 2024-09-13 16:00:11.942426998 +0000 UTC m=+0.326482289 container died b69f93f69b4ee8b33a6c717ff6eb4a2fb7ac51c731eb7d3ff09274e98d94a5b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T16:00:12.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:12 smithi086 podman[30257]: 2024-09-13 16:00:12.333013589 +0000 UTC m=+0.717068890 container cleanup b69f93f69b4ee8b33a6c717ff6eb4a2fb7ac51c731eb7d3ff09274e98d94a5b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:00:12.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:12 smithi086 bash[30257]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-a 2024-09-13T16:00:13.091 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:12 smithi086 podman[30269]: 2024-09-13 16:00:12.617140426 +0000 UTC m=+0.664812868 container remove b69f93f69b4ee8b33a6c717ff6eb4a2fb7ac51c731eb7d3ff09274e98d94a5b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:00:13.091 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:12 smithi086 systemd[1]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-13T16:00:13.091 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:12 smithi086 systemd[1]: Stopped Ceph mon.a for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:00:13.092 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:12 smithi086 systemd[1]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mon.a.service: Consumed 1.201s CPU time. 2024-09-13T16:00:13.092 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:12 smithi086 systemd[1]: Starting Ceph mon.a for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:00:13.361 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 podman[30360]: 2024-09-13 16:00:12.995761508 +0000 UTC m=+0.027697152 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:00:13.361 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 podman[30360]: 2024-09-13 16:00:13.101286133 +0000 UTC m=+0.133221767 container create 6d473c2d7662a35a6caed15fd9d3cf74f8c8c03d64e870549c5a30afffc9d6dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-a, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-13T16:00:13.361 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 podman[30360]: 2024-09-13 16:00:13.320673752 +0000 UTC m=+0.352609400 container init 6d473c2d7662a35a6caed15fd9d3cf74f8c8c03d64e870549c5a30afffc9d6dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-13T16:00:13.362 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 podman[30360]: 2024-09-13 16:00:13.327339515 +0000 UTC m=+0.359275159 container start 6d473c2d7662a35a6caed15fd9d3cf74f8c8c03d64e870549c5a30afffc9d6dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-13T16:00:13.438 INFO:teuthology.orchestra.run.smithi086.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-13T16:00:13.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T16:00:13.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable), process ceph-mon, pid 2 2024-09-13T16:00:13.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: pidfile_write: ignore empty --pid-file 2024-09-13T16:00:13.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: load: jerasure load: lrc 2024-09-13T16:00:13.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: RocksDB version: 7.9.2 2024-09-13T16:00:13.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Git sha 0 2024-09-13T16:00:13.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Compile date 2024-09-10 11:17:42 2024-09-13T16:00:13.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: DB SUMMARY 2024-09-13T16:00:13.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: DB Session ID: H7XPQ2PHNCS0WILAKZOU 2024-09-13T16:00:13.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: CURRENT file: CURRENT 2024-09-13T16:00:13.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T16:00:13.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-13T16:00:13.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-13T16:00:13.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 100391 ; 2024-09-13T16:00:13.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.error_if_exists: 0 2024-09-13T16:00:13.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.create_if_missing: 0 2024-09-13T16:00:13.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.paranoid_checks: 1 2024-09-13T16:00:13.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T16:00:13.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T16:00:13.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T16:00:13.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.env: 0x56059d16ebc0 2024-09-13T16:00:13.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T16:00:13.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.info_log: 0x5605c4a40b40 2024-09-13T16:00:13.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T16:00:13.618 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.statistics: (nil) 2024-09-13T16:00:13.618 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.use_fsync: 0 2024-09-13T16:00:13.618 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_log_file_size: 0 2024-09-13T16:00:13.618 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T16:00:13.618 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T16:00:13.618 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T16:00:13.618 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T16:00:13.618 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.allow_fallocate: 1 2024-09-13T16:00:13.618 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T16:00:13.618 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T16:00:13.618 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.use_direct_reads: 0 2024-09-13T16:00:13.618 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T16:00:13.618 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T16:00:13.618 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.db_log_dir: 2024-09-13T16:00:13.619 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.wal_dir: 2024-09-13T16:00:13.619 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T16:00:13.619 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T16:00:13.619 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T16:00:13.619 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T16:00:13.619 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T16:00:13.619 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T16:00:13.619 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T16:00:13.619 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T16:00:13.619 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.write_buffer_manager: 0x5605c4a4e320 2024-09-13T16:00:13.619 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T16:00:13.619 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T16:00:13.619 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T16:00:13.620 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T16:00:13.620 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T16:00:13.620 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T16:00:13.620 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T16:00:13.620 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T16:00:13.620 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.unordered_write: 0 2024-09-13T16:00:13.620 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T16:00:13.620 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T16:00:13.620 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T16:00:13.620 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T16:00:13.620 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.row_cache: None 2024-09-13T16:00:13.620 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.wal_filter: None 2024-09-13T16:00:13.620 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T16:00:13.621 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T16:00:13.621 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.two_write_queues: 0 2024-09-13T16:00:13.621 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T16:00:13.621 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.wal_compression: 0 2024-09-13T16:00:13.621 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.atomic_flush: 0 2024-09-13T16:00:13.621 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T16:00:13.621 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T16:00:13.621 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T16:00:13.621 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.log_readahead_size: 0 2024-09-13T16:00:13.621 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T16:00:13.621 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T16:00:13.621 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T16:00:13.621 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T16:00:13.622 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T16:00:13.622 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T16:00:13.622 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T16:00:13.623 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_background_jobs: 2 2024-09-13T16:00:13.623 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_background_compactions: -1 2024-09-13T16:00:13.623 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_subcompactions: 1 2024-09-13T16:00:13.623 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T16:00:13.623 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T16:00:13.623 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T16:00:13.623 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T16:00:13.623 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T16:00:13.624 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T16:00:13.624 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T16:00:13.624 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T16:00:13.624 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_open_files: -1 2024-09-13T16:00:13.624 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T16:00:13.624 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T16:00:13.624 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T16:00:13.624 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T16:00:13.624 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_background_flushes: -1 2024-09-13T16:00:13.624 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Compression algorithms supported: 2024-09-13T16:00:13.624 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: kZSTD supported: 0 2024-09-13T16:00:13.624 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: kXpressCompression supported: 0 2024-09-13T16:00:13.624 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: kBZip2Compression supported: 0 2024-09-13T16:00:13.624 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T16:00:13.625 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: kLZ4Compression supported: 1 2024-09-13T16:00:13.625 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: kZlibCompression supported: 1 2024-09-13T16:00:13.625 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T16:00:13.625 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: kSnappyCompression supported: 1 2024-09-13T16:00:13.625 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T16:00:13.625 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T16:00:13.625 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-13T16:00:13.625 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T16:00:13.625 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T16:00:13.625 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.merge_operator: 2024-09-13T16:00:13.625 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compaction_filter: None 2024-09-13T16:00:13.625 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T16:00:13.625 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T16:00:13.626 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T16:00:13.626 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T16:00:13.626 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5605c4a40760) 2024-09-13T16:00:13.626 INFO:journalctl@ceph.mon.a.smithi086.stdout: cache_index_and_filter_blocks: 1 2024-09-13T16:00:13.626 INFO:journalctl@ceph.mon.a.smithi086.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T16:00:13.626 INFO:journalctl@ceph.mon.a.smithi086.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T16:00:13.626 INFO:journalctl@ceph.mon.a.smithi086.stdout: pin_top_level_index_and_filter: 1 2024-09-13T16:00:13.626 INFO:journalctl@ceph.mon.a.smithi086.stdout: index_type: 0 2024-09-13T16:00:13.626 INFO:journalctl@ceph.mon.a.smithi086.stdout: data_block_index_type: 0 2024-09-13T16:00:13.626 INFO:journalctl@ceph.mon.a.smithi086.stdout: index_shortening: 1 2024-09-13T16:00:13.626 INFO:journalctl@ceph.mon.a.smithi086.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T16:00:13.626 INFO:journalctl@ceph.mon.a.smithi086.stdout: checksum: 4 2024-09-13T16:00:13.626 INFO:journalctl@ceph.mon.a.smithi086.stdout: no_block_cache: 0 2024-09-13T16:00:13.626 INFO:journalctl@ceph.mon.a.smithi086.stdout: block_cache: 0x5605c4a351f0 2024-09-13T16:00:13.627 INFO:journalctl@ceph.mon.a.smithi086.stdout: block_cache_name: BinnedLRUCache 2024-09-13T16:00:13.627 INFO:journalctl@ceph.mon.a.smithi086.stdout: block_cache_options: 2024-09-13T16:00:13.627 INFO:journalctl@ceph.mon.a.smithi086.stdout: capacity : 536870912 2024-09-13T16:00:13.627 INFO:journalctl@ceph.mon.a.smithi086.stdout: num_shard_bits : 4 2024-09-13T16:00:13.627 INFO:journalctl@ceph.mon.a.smithi086.stdout: strict_capacity_limit : 0 2024-09-13T16:00:13.627 INFO:journalctl@ceph.mon.a.smithi086.stdout: high_pri_pool_ratio: 0.000 2024-09-13T16:00:13.627 INFO:journalctl@ceph.mon.a.smithi086.stdout: block_cache_compressed: (nil) 2024-09-13T16:00:13.627 INFO:journalctl@ceph.mon.a.smithi086.stdout: persistent_cache: (nil) 2024-09-13T16:00:13.627 INFO:journalctl@ceph.mon.a.smithi086.stdout: block_size: 4096 2024-09-13T16:00:13.627 INFO:journalctl@ceph.mon.a.smithi086.stdout: block_size_deviation: 10 2024-09-13T16:00:13.627 INFO:journalctl@ceph.mon.a.smithi086.stdout: block_restart_interval: 16 2024-09-13T16:00:13.627 INFO:journalctl@ceph.mon.a.smithi086.stdout: index_block_restart_interval: 1 2024-09-13T16:00:13.627 INFO:journalctl@ceph.mon.a.smithi086.stdout: metadata_block_size: 4096 2024-09-13T16:00:13.628 INFO:journalctl@ceph.mon.a.smithi086.stdout: partition_filters: 0 2024-09-13T16:00:13.628 INFO:journalctl@ceph.mon.a.smithi086.stdout: use_delta_encoding: 1 2024-09-13T16:00:13.628 INFO:journalctl@ceph.mon.a.smithi086.stdout: filter_policy: bloomfilter 2024-09-13T16:00:13.628 INFO:journalctl@ceph.mon.a.smithi086.stdout: whole_key_filtering: 1 2024-09-13T16:00:13.628 INFO:journalctl@ceph.mon.a.smithi086.stdout: verify_compression: 0 2024-09-13T16:00:13.628 INFO:journalctl@ceph.mon.a.smithi086.stdout: read_amp_bytes_per_bit: 0 2024-09-13T16:00:13.628 INFO:journalctl@ceph.mon.a.smithi086.stdout: format_version: 5 2024-09-13T16:00:13.628 INFO:journalctl@ceph.mon.a.smithi086.stdout: enable_index_compression: 1 2024-09-13T16:00:13.628 INFO:journalctl@ceph.mon.a.smithi086.stdout: block_align: 0 2024-09-13T16:00:13.628 INFO:journalctl@ceph.mon.a.smithi086.stdout: max_auto_readahead_size: 262144 2024-09-13T16:00:13.628 INFO:journalctl@ceph.mon.a.smithi086.stdout: prepopulate_block_cache: 0 2024-09-13T16:00:13.628 INFO:journalctl@ceph.mon.a.smithi086.stdout: initial_auto_readahead_size: 8192 2024-09-13T16:00:13.628 INFO:journalctl@ceph.mon.a.smithi086.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T16:00:13.629 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T16:00:13.629 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T16:00:13.629 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compression: NoCompression 2024-09-13T16:00:13.629 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T16:00:13.629 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T16:00:13.629 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T16:00:13.629 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.num_levels: 7 2024-09-13T16:00:13.629 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T16:00:13.629 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T16:00:13.629 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T16:00:13.629 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T16:00:13.629 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T16:00:13.629 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T16:00:13.630 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T16:00:13.630 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T16:00:13.630 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T16:00:13.630 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T16:00:13.630 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T16:00:13.630 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T16:00:13.630 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T16:00:13.630 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T16:00:13.630 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T16:00:13.630 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T16:00:13.630 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T16:00:13.630 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T16:00:13.630 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T16:00:13.631 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T16:00:13.631 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T16:00:13.631 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T16:00:13.631 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T16:00:13.631 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T16:00:13.631 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T16:00:13.631 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T16:00:13.631 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T16:00:13.631 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T16:00:13.631 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T16:00:13.631 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T16:00:13.631 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T16:00:13.632 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T16:00:13.632 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T16:00:13.632 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T16:00:13.632 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T16:00:13.632 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T16:00:13.632 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T16:00:13.632 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T16:00:13.633 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T16:00:13.633 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T16:00:13.633 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T16:00:13.633 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T16:00:13.633 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T16:00:13.633 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T16:00:13.633 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T16:00:13.633 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T16:00:13.633 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T16:00:13.633 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T16:00:13.633 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T16:00:13.634 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T16:00:13.634 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T16:00:13.634 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T16:00:13.634 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T16:00:13.634 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T16:00:13.634 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.inplace_update_support: 0 2024-09-13T16:00:13.634 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T16:00:13.634 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T16:00:13.634 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T16:00:13.634 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T16:00:13.634 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.bloom_locality: 0 2024-09-13T16:00:13.634 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.max_successive_merges: 0 2024-09-13T16:00:13.634 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T16:00:13.635 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T16:00:13.635 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T16:00:13.635 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T16:00:13.635 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.ttl: 2592000 2024-09-13T16:00:13.635 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T16:00:13.635 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T16:00:13.635 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T16:00:13.635 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.enable_blob_files: false 2024-09-13T16:00:13.635 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.min_blob_size: 0 2024-09-13T16:00:13.635 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T16:00:13.635 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T16:00:13.635 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T16:00:13.635 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T16:00:13.636 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T16:00:13.636 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T16:00:13.636 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T16:00:13.636 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T16:00:13.636 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-13T16:00:13.636 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-13T16:00:13.636 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 75c2a2ef-4bb3-4962-91a0-4eb5e8142cf1 2024-09-13T16:00:13.636 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726243213368949, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-13T16:00:13.636 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-13T16:00:13.636 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726243213370979, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 95499, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 320, "table_properties": {"data_size": 93462, "index_size": 293, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 14027, "raw_average_key_size": 50, "raw_value_size": 85845, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 279, "num_filter_entries": 279, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726243213, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "75c2a2ef-4bb3-4962-91a0-4eb5e8142cf1", "db_session_id": "H7XPQ2PHNCS0WILAKZOU", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-13T16:00:13.636 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726243213371194, "job": 1, "event": "recovery_finished"} 2024-09-13T16:00:13.636 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-13T16:00:13.636 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T16:00:13.637 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5605c4a62e00 2024-09-13T16:00:13.637 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: DB pointer 0x5605c4b56000 2024-09-13T16:00:13.637 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T16:00:13.637 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T16:00:13.637 INFO:journalctl@ceph.mon.a.smithi086.stdout: ** DB Stats ** 2024-09-13T16:00:13.637 INFO:journalctl@ceph.mon.a.smithi086.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T16:00:13.637 INFO:journalctl@ceph.mon.a.smithi086.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T16:00:13.637 INFO:journalctl@ceph.mon.a.smithi086.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T16:00:13.637 INFO:journalctl@ceph.mon.a.smithi086.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T16:00:13.637 INFO:journalctl@ceph.mon.a.smithi086.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T16:00:13.637 INFO:journalctl@ceph.mon.a.smithi086.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T16:00:13.637 INFO:journalctl@ceph.mon.a.smithi086.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T16:00:13.638 INFO:journalctl@ceph.mon.a.smithi086.stdout: 2024-09-13T16:00:13.638 INFO:journalctl@ceph.mon.a.smithi086.stdout: ** Compaction Stats [default] ** 2024-09-13T16:00:13.638 INFO:journalctl@ceph.mon.a.smithi086.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T16:00:13.638 INFO:journalctl@ceph.mon.a.smithi086.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T16:00:13.638 INFO:journalctl@ceph.mon.a.smithi086.stdout: L0 2/0 95.12 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 66.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T16:00:13.638 INFO:journalctl@ceph.mon.a.smithi086.stdout: Sum 2/0 95.12 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 66.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T16:00:13.638 INFO:journalctl@ceph.mon.a.smithi086.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 66.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T16:00:13.638 INFO:journalctl@ceph.mon.a.smithi086.stdout: 2024-09-13T16:00:13.638 INFO:journalctl@ceph.mon.a.smithi086.stdout: ** Compaction Stats [default] ** 2024-09-13T16:00:13.638 INFO:journalctl@ceph.mon.a.smithi086.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T16:00:13.638 INFO:journalctl@ceph.mon.a.smithi086.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T16:00:13.638 INFO:journalctl@ceph.mon.a.smithi086.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 66.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T16:00:13.638 INFO:journalctl@ceph.mon.a.smithi086.stdout: 2024-09-13T16:00:13.638 INFO:journalctl@ceph.mon.a.smithi086.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T16:00:13.639 INFO:journalctl@ceph.mon.a.smithi086.stdout: 2024-09-13T16:00:13.639 INFO:journalctl@ceph.mon.a.smithi086.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T16:00:13.639 INFO:journalctl@ceph.mon.a.smithi086.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T16:00:13.639 INFO:journalctl@ceph.mon.a.smithi086.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T16:00:13.639 INFO:journalctl@ceph.mon.a.smithi086.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T16:00:13.639 INFO:journalctl@ceph.mon.a.smithi086.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T16:00:13.639 INFO:journalctl@ceph.mon.a.smithi086.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T16:00:13.639 INFO:journalctl@ceph.mon.a.smithi086.stdout: Cumulative compaction: 0.00 GB write, 15.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T16:00:13.639 INFO:journalctl@ceph.mon.a.smithi086.stdout: Interval compaction: 0.00 GB write, 15.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T16:00:13.639 INFO:journalctl@ceph.mon.a.smithi086.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T16:00:13.639 INFO:journalctl@ceph.mon.a.smithi086.stdout: Block cache BinnedLRUCache@0x5605c4a351f0#2 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.9e-05 secs_since: 0 2024-09-13T16:00:13.639 INFO:journalctl@ceph.mon.a.smithi086.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-13T16:00:13.640 INFO:journalctl@ceph.mon.a.smithi086.stdout: 2024-09-13T16:00:13.640 INFO:journalctl@ceph.mon.a.smithi086.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T16:00:13.640 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: starting mon.a rank 0 at public addrs [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] at bind addrs [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:00:13.640 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: mon.a@-1(???) e1 preinit fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:00:13.640 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: mon.a@-1(???).mds e1 new map 2024-09-13T16:00:13.640 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: mon.a@-1(???).mds e1 print_map 2024-09-13T16:00:13.640 INFO:journalctl@ceph.mon.a.smithi086.stdout: e1 2024-09-13T16:00:13.640 INFO:journalctl@ceph.mon.a.smithi086.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T16:00:13.640 INFO:journalctl@ceph.mon.a.smithi086.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T16:00:13.640 INFO:journalctl@ceph.mon.a.smithi086.stdout: legacy client fscid: -1 2024-09-13T16:00:13.640 INFO:journalctl@ceph.mon.a.smithi086.stdout: 2024-09-13T16:00:13.640 INFO:journalctl@ceph.mon.a.smithi086.stdout: No filesystems configured 2024-09-13T16:00:13.640 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T16:00:13.641 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T16:00:13.641 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T16:00:13.641 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T16:00:13.641 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-13T16:00:13.641 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 bash[30360]: 6d473c2d7662a35a6caed15fd9d3cf74f8c8c03d64e870549c5a30afffc9d6dc 2024-09-13T16:00:13.641 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T16:00:13.641 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: monmap e1: 1 mons at {a=[v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:00:13.641 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: fsmap 2024-09-13T16:00:13.641 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T16:00:13.641 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 ceph-mon[30379]: mgrmap e1: no daemons active 2024-09-13T16:00:13.641 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:13 smithi086 systemd[1]: Started Ceph mon.a for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:00:14.621 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.977+0000 7fb8b1800640 1 Processor -- start 2024-09-13T16:00:14.621 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.978+0000 7fb8b1800640 1 -- start start 2024-09-13T16:00:14.621 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.978+0000 7fb8b1800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8ac105680 0x7fb8ac105a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:14.621 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.978+0000 7fb8b1800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac106050 con 0x7fb8ac105680 2024-09-13T16:00:14.621 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.979+0000 7fb8abe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8ac105680 0x7fb8ac105a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:14.621 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.979+0000 7fb8abe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8ac105680 0x7fb8ac105a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51638/0 (socket says 172.21.15.86:51638) 2024-09-13T16:00:14.621 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.979+0000 7fb8abe00640 1 -- 172.21.15.86:0/1979335782 learned_addr learned my addr 172.21.15.86:0/1979335782 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:14.621 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.979+0000 7fb8abe00640 1 -- 172.21.15.86:0/1979335782 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac106880 con 0x7fb8ac105680 2024-09-13T16:00:14.621 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.982+0000 7fb8abe00640 1 --2- 172.21.15.86:0/1979335782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8ac105680 0x7fb8ac105a80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009820 tx=0x7fb89c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01b7c5af8984bbb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:14.621 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.982+0000 7fb8ab400640 1 -- 172.21.15.86:0/1979335782 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb89c02ae70 con 0x7fb8ac105680 2024-09-13T16:00:14.622 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.983+0000 7fb8ab400640 1 -- 172.21.15.86:0/1979335782 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fb89c032900 con 0x7fb8ac105680 2024-09-13T16:00:14.622 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.983+0000 7fb8ab400640 1 -- 172.21.15.86:0/1979335782 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb89c0309d0 con 0x7fb8ac105680 2024-09-13T16:00:14.622 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.983+0000 7fb8b1800640 1 -- 172.21.15.86:0/1979335782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8ac105680 msgr2=0x7fb8ac105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:14.622 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.983+0000 7fb8b1800640 1 --2- 172.21.15.86:0/1979335782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8ac105680 0x7fb8ac105a80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009820 tx=0x7fb89c02a270 comp rx=0 tx=0).stop 2024-09-13T16:00:14.622 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.983+0000 7fb8b1800640 1 -- 172.21.15.86:0/1979335782 shutdown_connections 2024-09-13T16:00:14.622 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.983+0000 7fb8b1800640 1 --2- 172.21.15.86:0/1979335782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8ac105680 0x7fb8ac105a80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:14.622 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.983+0000 7fb8b1800640 1 -- 172.21.15.86:0/1979335782 >> 172.21.15.86:0/1979335782 conn(0x7fb8ac100e70 msgr2=0x7fb8ac103290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:14.622 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.983+0000 7fb8b1800640 1 -- 172.21.15.86:0/1979335782 shutdown_connections 2024-09-13T16:00:14.622 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.983+0000 7fb8b1800640 1 -- 172.21.15.86:0/1979335782 wait complete. 2024-09-13T16:00:14.622 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.984+0000 7fb8b1800640 1 Processor -- start 2024-09-13T16:00:14.622 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.984+0000 7fb8b1800640 1 -- start start 2024-09-13T16:00:14.622 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.985+0000 7fb8b1800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8ac105680 0x7fb8ac07c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:14.622 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.985+0000 7fb8b1800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac07c8a0 con 0x7fb8ac105680 2024-09-13T16:00:14.622 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.985+0000 7fb8abe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8ac105680 0x7fb8ac07c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:14.623 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.985+0000 7fb8abe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8ac105680 0x7fb8ac07c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51640/0 (socket says 172.21.15.86:51640) 2024-09-13T16:00:14.623 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.985+0000 7fb8abe00640 1 -- 172.21.15.86:0/2197846614 learned_addr learned my addr 172.21.15.86:0/2197846614 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:14.623 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.985+0000 7fb8abe00640 1 -- 172.21.15.86:0/2197846614 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c0094d0 con 0x7fb8ac105680 2024-09-13T16:00:14.623 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.986+0000 7fb8abe00640 1 --2- 172.21.15.86:0/2197846614 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8ac105680 0x7fb8ac07c360 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb89c006f10 tx=0x7fb89c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:14.623 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.986+0000 7fb8a9600640 1 -- 172.21.15.86:0/2197846614 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb89c032c80 con 0x7fb8ac105680 2024-09-13T16:00:14.623 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.986+0000 7fb8a9600640 1 -- 172.21.15.86:0/2197846614 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fb89c032de0 con 0x7fb8ac105680 2024-09-13T16:00:14.623 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.986+0000 7fb8b1800640 1 -- 172.21.15.86:0/2197846614 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ac07aa90 con 0x7fb8ac105680 2024-09-13T16:00:14.623 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.986+0000 7fb8a9600640 1 -- 172.21.15.86:0/2197846614 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb89c03a690 con 0x7fb8ac105680 2024-09-13T16:00:14.623 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.986+0000 7fb8b1800640 1 -- 172.21.15.86:0/2197846614 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac07af30 con 0x7fb8ac105680 2024-09-13T16:00:14.623 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.986+0000 7fb8a9600640 1 -- 172.21.15.86:0/2197846614 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb89c039040 con 0x7fb8ac105680 2024-09-13T16:00:14.623 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.986+0000 7fb8a9600640 1 -- 172.21.15.86:0/2197846614 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb89c044bc0 con 0x7fb8ac105680 2024-09-13T16:00:14.623 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.987+0000 7fb8b1800640 1 -- 172.21.15.86:0/2197846614 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ac109ab0 con 0x7fb8ac105680 2024-09-13T16:00:14.624 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:13.990+0000 7fb8a9600640 1 -- 172.21.15.86:0/2197846614 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fb89c03f020 con 0x7fb8ac105680 2024-09-13T16:00:14.624 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:14.049+0000 7fb8b1800640 1 -- 172.21.15.86:0/2197846614 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fb8ac109ca0 con 0x7fb8ac105680 2024-09-13T16:00:14.624 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:14.052+0000 7fb8a9600640 1 -- 172.21.15.86:0/2197846614 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb89c037070 con 0x7fb8ac105680 2024-09-13T16:00:14.624 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:14.053+0000 7fb8b1800640 1 -- 172.21.15.86:0/2197846614 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8ac105680 msgr2=0x7fb8ac07c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:14.624 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:14.053+0000 7fb8b1800640 1 --2- 172.21.15.86:0/2197846614 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8ac105680 0x7fb8ac07c360 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb89c006f10 tx=0x7fb89c032670 comp rx=0 tx=0).stop 2024-09-13T16:00:14.624 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:14.053+0000 7fb8b1800640 1 -- 172.21.15.86:0/2197846614 shutdown_connections 2024-09-13T16:00:14.624 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:14.053+0000 7fb8b1800640 1 --2- 172.21.15.86:0/2197846614 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8ac105680 0x7fb8ac07c360 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:14.624 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:14.053+0000 7fb8b1800640 1 -- 172.21.15.86:0/2197846614 >> 172.21.15.86:0/2197846614 conn(0x7fb8ac100e70 msgr2=0x7fb8ac101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:14.624 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:14.053+0000 7fb8b1800640 1 -- 172.21.15.86:0/2197846614 shutdown_connections 2024-09-13T16:00:14.625 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:14.053+0000 7fb8b1800640 1 -- 172.21.15.86:0/2197846614 wait complete. 2024-09-13T16:00:14.625 INFO:teuthology.orchestra.run.smithi086.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-13T16:00:14.652 INFO:teuthology.orchestra.run.smithi086.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:00:14.652 INFO:teuthology.orchestra.run.smithi086.stdout:Creating mgr... 2024-09-13T16:00:14.652 INFO:teuthology.orchestra.run.smithi086.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-13T16:00:14.652 INFO:teuthology.orchestra.run.smithi086.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-13T16:00:14.996 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mgr.x 2024-09-13T16:00:14.997 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-13T16:00:15.228 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968.target.wants/ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@.service. 2024-09-13T16:00:15.262 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:15 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2197846614' entity='client.admin' 2024-09-13T16:00:15.262 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:15 smithi086 systemd[1]: Starting Ceph mgr.x for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:00:15.822 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:15 smithi086 podman[30588]: 2024-09-13 16:00:15.472123652 +0000 UTC m=+0.026797599 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:00:15.823 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:15 smithi086 podman[30588]: 2024-09-13 16:00:15.587005004 +0000 UTC m=+0.141678934 container create 9cb9bd6a37a753038db23b6bd513c7d4e2cabac50478a676c6f761dca5b8a5d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-13T16:00:15.823 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:15 smithi086 podman[30588]: 2024-09-13 16:00:15.815498193 +0000 UTC m=+0.370172125 container init 9cb9bd6a37a753038db23b6bd513c7d4e2cabac50478a676c6f761dca5b8a5d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:00:15.823 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:15 smithi086 podman[30588]: 2024-09-13 16:00:15.821441812 +0000 UTC m=+0.376115743 container start 9cb9bd6a37a753038db23b6bd513c7d4e2cabac50478a676c6f761dca5b8a5d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T16:00:15.951 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T16:00:15.951 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout disabled 2024-09-13T16:00:15.964 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T16:00:15.964 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout inactive 2024-09-13T16:00:15.965 INFO:teuthology.orchestra.run.smithi086.stdout:firewalld.service is not enabled 2024-09-13T16:00:15.965 INFO:teuthology.orchestra.run.smithi086.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T16:00:15.981 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T16:00:15.981 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout disabled 2024-09-13T16:00:15.996 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T16:00:15.996 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout inactive 2024-09-13T16:00:15.996 INFO:teuthology.orchestra.run.smithi086.stdout:firewalld.service is not enabled 2024-09-13T16:00:15.996 INFO:teuthology.orchestra.run.smithi086.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-13T16:00:15.996 INFO:teuthology.orchestra.run.smithi086.stdout:Waiting for mgr to start... 2024-09-13T16:00:15.996 INFO:teuthology.orchestra.run.smithi086.stdout:Waiting for mgr... 2024-09-13T16:00:16.115 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:15 smithi086 bash[30588]: 9cb9bd6a37a753038db23b6bd513c7d4e2cabac50478a676c6f761dca5b8a5d2 2024-09-13T16:00:16.115 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:15 smithi086 systemd[1]: Started Ceph mgr.x for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:00:16.115 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:15 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:15.986+0000 7f965e620040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T16:00:16.115 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:16 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:16.069+0000 7f965e620040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T16:00:16.460 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:16 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:16.261+0000 7f965e620040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T16:00:16.460 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:16 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:16.345+0000 7f965e620040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T16:00:16.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:16 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/835866899' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T16:00:16.865 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:16 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:16.526+0000 7f965e620040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:00:16.865 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:16 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:16.701+0000 7f965e620040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T16:00:17.199 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:17 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:17.098+0000 7f965e620040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T16:00:17.199 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:17 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:17.173+0000 7f965e620040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T16:00:17.514 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:17 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:17.388+0000 7f965e620040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T16:00:17.525 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-09-13T16:00:17.525 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:00:17.525 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "fsid": "1ecdfbda-71e9-11ef-bceb-c7b262605968", 2024-09-13T16:00:17.525 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T16:00:17.525 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T16:00:17.525 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T16:00:17.525 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T16:00:17.525 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:17.525 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T16:00:17.525 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T16:00:17.525 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 0 2024-09-13T16:00:17.525 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:00:17.526 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T16:00:17.526 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T16:00:17.526 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:00:17.526 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-13T16:00:17.526 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T16:00:17.526 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:00:17.526 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T16:00:17.526 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T16:00:17.526 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:17.526 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T16:00:17.526 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:00:17.526 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T16:00:17.526 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T16:00:17.534 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T16:00:17.534 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T16:00:17.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T16:00:17.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T16:00:17.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:17.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T16:00:17.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T16:00:17.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T16:00:17.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T16:00:17.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T16:00:17.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T16:00:17.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T16:00:17.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T16:00:17.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T16:00:17.535 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:17.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T16:00:17.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:00:17.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T16:00:17.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T16:00:17.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:17.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T16:00:17.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T16:00:17.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T16:00:17.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T16:00:17.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T16:00:17.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T16:00:17.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T16:00:17.536 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:00:17.537 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T16:00:17.537 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:17.537 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T16:00:17.537 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:00:17.537 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T16:00:07.737486+0000", 2024-09-13T16:00:17.537 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T16:00:17.537 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:17.537 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T16:00:17.537 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:00:17.537 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.492+0000 7f46e9a00640 1 Processor -- start 2024-09-13T16:00:17.537 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.492+0000 7f46e9a00640 1 -- start start 2024-09-13T16:00:17.537 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.492+0000 7f46e9a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46e4108fd0 0x7f46e41093d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:17.538 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.492+0000 7f46e9a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e41099a0 con 0x7f46e4108fd0 2024-09-13T16:00:17.538 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.493+0000 7f46e2a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46e4108fd0 0x7f46e41093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:17.538 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.493+0000 7f46e2a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46e4108fd0 0x7f46e41093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51676/0 (socket says 172.21.15.86:51676) 2024-09-13T16:00:17.538 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.494+0000 7f46e2a00640 1 -- 172.21.15.86:0/21535407 learned_addr learned my addr 172.21.15.86:0/21535407 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:17.538 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.494+0000 7f46e2a00640 1 -- 172.21.15.86:0/21535407 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e4109ae0 con 0x7f46e4108fd0 2024-09-13T16:00:17.538 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.495+0000 7f46e2a00640 1 --2- 172.21.15.86:0/21535407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46e4108fd0 0x7f46e41093d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009820 tx=0x7f46d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12971fa6b50e4d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:17.538 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.495+0000 7f46e1600640 1 -- 172.21.15.86:0/21535407 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46d402ae70 con 0x7f46e4108fd0 2024-09-13T16:00:17.538 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.495+0000 7f46e1600640 1 -- 172.21.15.86:0/21535407 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f46d4032900 con 0x7f46e4108fd0 2024-09-13T16:00:17.538 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.495+0000 7f46e1600640 1 -- 172.21.15.86:0/21535407 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46d40309d0 con 0x7f46e4108fd0 2024-09-13T16:00:17.538 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.496+0000 7f46e9a00640 1 -- 172.21.15.86:0/21535407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46e4108fd0 msgr2=0x7f46e41093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:17.538 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.496+0000 7f46e9a00640 1 --2- 172.21.15.86:0/21535407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46e4108fd0 0x7f46e41093d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009820 tx=0x7f46d402a270 comp rx=0 tx=0).stop 2024-09-13T16:00:17.538 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.496+0000 7f46e9a00640 1 -- 172.21.15.86:0/21535407 shutdown_connections 2024-09-13T16:00:17.539 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.496+0000 7f46e9a00640 1 --2- 172.21.15.86:0/21535407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46e4108fd0 0x7f46e41093d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:17.539 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.496+0000 7f46e9a00640 1 -- 172.21.15.86:0/21535407 >> 172.21.15.86:0/21535407 conn(0x7f46e407b060 msgr2=0x7f46e407b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:17.539 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.496+0000 7f46e9a00640 1 -- 172.21.15.86:0/21535407 shutdown_connections 2024-09-13T16:00:17.539 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.496+0000 7f46e9a00640 1 -- 172.21.15.86:0/21535407 wait complete. 2024-09-13T16:00:17.539 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.497+0000 7f46e9a00640 1 Processor -- start 2024-09-13T16:00:17.539 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.497+0000 7f46e9a00640 1 -- start start 2024-09-13T16:00:17.539 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.498+0000 7f46e9a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46e4108fd0 0x7f46e419b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:17.539 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.498+0000 7f46e9a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e419bcc0 con 0x7f46e4108fd0 2024-09-13T16:00:17.539 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.498+0000 7f46e2a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46e4108fd0 0x7f46e419b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:17.539 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.498+0000 7f46e2a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46e4108fd0 0x7f46e419b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51688/0 (socket says 172.21.15.86:51688) 2024-09-13T16:00:17.539 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.498+0000 7f46e2a00640 1 -- 172.21.15.86:0/835866899 learned_addr learned my addr 172.21.15.86:0/835866899 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:17.539 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.498+0000 7f46e2a00640 1 -- 172.21.15.86:0/835866899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d40094d0 con 0x7f46e4108fd0 2024-09-13T16:00:17.539 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.499+0000 7f46e2a00640 1 --2- 172.21.15.86:0/835866899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46e4108fd0 0x7f46e419b780 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f46d40306e0 tx=0x7f46d4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:17.539 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.499+0000 7f46db400640 1 -- 172.21.15.86:0/835866899 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46d4032c80 con 0x7f46e4108fd0 2024-09-13T16:00:17.540 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.499+0000 7f46db400640 1 -- 172.21.15.86:0/835866899 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f46d4032de0 con 0x7f46e4108fd0 2024-09-13T16:00:17.540 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.499+0000 7f46db400640 1 -- 172.21.15.86:0/835866899 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46d403a780 con 0x7f46e4108fd0 2024-09-13T16:00:17.540 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.499+0000 7f46e9a00640 1 -- 172.21.15.86:0/835866899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e419bec0 con 0x7f46e4108fd0 2024-09-13T16:00:17.540 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.499+0000 7f46e9a00640 1 -- 172.21.15.86:0/835866899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e419c360 con 0x7f46e4108fd0 2024-09-13T16:00:17.540 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.500+0000 7f46db400640 1 -- 172.21.15.86:0/835866899 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f46d4039040 con 0x7f46e4108fd0 2024-09-13T16:00:17.540 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.500+0000 7f46db400640 1 -- 172.21.15.86:0/835866899 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f46d4044c70 con 0x7f46e4108fd0 2024-09-13T16:00:17.540 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.501+0000 7f46e9a00640 1 -- 172.21.15.86:0/835866899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e4109450 con 0x7f46e4108fd0 2024-09-13T16:00:17.540 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.503+0000 7f46db400640 1 -- 172.21.15.86:0/835866899 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f46d403f020 con 0x7f46e4108fd0 2024-09-13T16:00:17.540 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.583+0000 7f46e9a00640 1 -- 172.21.15.86:0/835866899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f46e410bf10 con 0x7f46e4108fd0 2024-09-13T16:00:17.540 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.584+0000 7f46db400640 1 -- 172.21.15.86:0/835866899 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f46d4037070 con 0x7f46e4108fd0 2024-09-13T16:00:17.540 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.585+0000 7f46e9a00640 1 -- 172.21.15.86:0/835866899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46e4108fd0 msgr2=0x7f46e419b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:17.540 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.585+0000 7f46e9a00640 1 --2- 172.21.15.86:0/835866899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46e4108fd0 0x7f46e419b780 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f46d40306e0 tx=0x7f46d4032670 comp rx=0 tx=0).stop 2024-09-13T16:00:17.540 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.585+0000 7f46e9a00640 1 -- 172.21.15.86:0/835866899 shutdown_connections 2024-09-13T16:00:17.541 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.585+0000 7f46e9a00640 1 --2- 172.21.15.86:0/835866899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46e4108fd0 0x7f46e419b780 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:17.541 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.585+0000 7f46e9a00640 1 -- 172.21.15.86:0/835866899 >> 172.21.15.86:0/835866899 conn(0x7f46e407b060 msgr2=0x7f46e4105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:17.541 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.586+0000 7f46e9a00640 1 -- 172.21.15.86:0/835866899 shutdown_connections 2024-09-13T16:00:17.541 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:16.586+0000 7f46e9a00640 1 -- 172.21.15.86:0/835866899 wait complete. 2024-09-13T16:00:17.541 INFO:teuthology.orchestra.run.smithi086.stdout:mgr not available, waiting (1/15)... 2024-09-13T16:00:18.865 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:18 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:18.482+0000 7f965e620040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T16:00:18.865 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:18 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:18.559+0000 7f965e620040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T16:00:19.772 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:19 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:19.470+0000 7f965e620040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T16:00:19.773 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:19 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:19.608+0000 7f965e620040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T16:00:20.050 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:19 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:19.770+0000 7f965e620040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:00:20.050 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:19 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:19.848+0000 7f965e620040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T16:00:20.050 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:20 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:20.018+0000 7f965e620040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T16:00:20.361 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:20 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/4290081447' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T16:00:20.361 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:20 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:20.104+0000 7f965e620040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T16:00:20.361 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:20 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:20.182+0000 7f965e620040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T16:00:20.361 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:20 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:20.359+0000 7f965e620040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T16:00:20.615 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:20 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:20.439+0000 7f965e620040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T16:00:20.615 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:20 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:20.517+0000 7f965e620040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T16:00:20.858 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-09-13T16:00:20.858 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:00:20.858 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "fsid": "1ecdfbda-71e9-11ef-bceb-c7b262605968", 2024-09-13T16:00:20.858 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T16:00:20.858 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T16:00:20.858 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T16:00:20.858 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T16:00:20.858 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:20.858 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T16:00:20.858 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T16:00:20.858 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 0 2024-09-13T16:00:20.858 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:00:20.859 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T16:00:20.859 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T16:00:20.859 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:00:20.859 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-13T16:00:20.859 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T16:00:20.859 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:00:20.859 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T16:00:20.859 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T16:00:20.859 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:20.859 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T16:00:20.859 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:00:20.859 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T16:00:20.859 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T16:00:20.859 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T16:00:20.866 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T16:00:20.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T16:00:20.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T16:00:20.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:20.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T16:00:20.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T16:00:20.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T16:00:20.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T16:00:20.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T16:00:20.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T16:00:20.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T16:00:20.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T16:00:20.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T16:00:20.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:20.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T16:00:20.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:00:20.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T16:00:20.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T16:00:20.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:20.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T16:00:20.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T16:00:20.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T16:00:20.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T16:00:20.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T16:00:20.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T16:00:20.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T16:00:20.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:00:20.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T16:00:20.869 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:20.869 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T16:00:20.869 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:00:20.869 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T16:00:07.737486+0000", 2024-09-13T16:00:20.869 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T16:00:20.869 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:20.869 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T16:00:20.869 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:00:20.869 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.065+0000 7fe5d7600640 1 Processor -- start 2024-09-13T16:00:20.869 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.065+0000 7fe5d7600640 1 -- start start 2024-09-13T16:00:20.869 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.065+0000 7fe5d7600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5d01057c0 0x7fe5d0105bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:20.869 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.065+0000 7fe5d7600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0106190 con 0x7fe5d01057c0 2024-09-13T16:00:20.869 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.065+0000 7fe5d4c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5d01057c0 0x7fe5d0105bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:20.869 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.066+0000 7fe5d4c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5d01057c0 0x7fe5d0105bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51692/0 (socket says 172.21.15.86:51692) 2024-09-13T16:00:20.870 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.066+0000 7fe5d4c00640 1 -- 172.21.15.86:0/1079274498 learned_addr learned my addr 172.21.15.86:0/1079274498 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:20.870 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.066+0000 7fe5d4c00640 1 -- 172.21.15.86:0/1079274498 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d01069c0 con 0x7fe5d01057c0 2024-09-13T16:00:20.870 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.067+0000 7fe5d4c00640 1 --2- 172.21.15.86:0/1079274498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5d01057c0 0x7fe5d0105bc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009820 tx=0x7fe5bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=259ac7e693096600 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:20.870 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.067+0000 7fe5cf400640 1 -- 172.21.15.86:0/1079274498 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5bc02ae70 con 0x7fe5d01057c0 2024-09-13T16:00:20.870 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.067+0000 7fe5cf400640 1 -- 172.21.15.86:0/1079274498 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fe5bc032900 con 0x7fe5d01057c0 2024-09-13T16:00:20.870 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.067+0000 7fe5cf400640 1 -- 172.21.15.86:0/1079274498 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5bc0309d0 con 0x7fe5d01057c0 2024-09-13T16:00:20.870 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.068+0000 7fe5d7600640 1 -- 172.21.15.86:0/1079274498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5d01057c0 msgr2=0x7fe5d0105bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:20.870 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.068+0000 7fe5d7600640 1 --2- 172.21.15.86:0/1079274498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5d01057c0 0x7fe5d0105bc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009820 tx=0x7fe5bc02a270 comp rx=0 tx=0).stop 2024-09-13T16:00:20.870 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.068+0000 7fe5d7600640 1 -- 172.21.15.86:0/1079274498 shutdown_connections 2024-09-13T16:00:20.870 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.068+0000 7fe5d7600640 1 --2- 172.21.15.86:0/1079274498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5d01057c0 0x7fe5d0105bc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:20.870 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.068+0000 7fe5d7600640 1 -- 172.21.15.86:0/1079274498 >> 172.21.15.86:0/1079274498 conn(0x7fe5d0101030 msgr2=0x7fe5d0103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:20.870 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.068+0000 7fe5d7600640 1 -- 172.21.15.86:0/1079274498 shutdown_connections 2024-09-13T16:00:20.870 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.068+0000 7fe5d7600640 1 -- 172.21.15.86:0/1079274498 wait complete. 2024-09-13T16:00:20.870 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.069+0000 7fe5d7600640 1 Processor -- start 2024-09-13T16:00:20.871 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.069+0000 7fe5d7600640 1 -- start start 2024-09-13T16:00:20.871 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.069+0000 7fe5d7600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5d01057c0 0x7fe5d01995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:20.871 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.069+0000 7fe5d7600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0199b10 con 0x7fe5d01057c0 2024-09-13T16:00:20.871 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.070+0000 7fe5d4c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5d01057c0 0x7fe5d01995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:20.871 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.070+0000 7fe5d4c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5d01057c0 0x7fe5d01995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51702/0 (socket says 172.21.15.86:51702) 2024-09-13T16:00:20.871 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.070+0000 7fe5d4c00640 1 -- 172.21.15.86:0/4290081447 learned_addr learned my addr 172.21.15.86:0/4290081447 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:20.871 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.070+0000 7fe5d4c00640 1 -- 172.21.15.86:0/4290081447 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc0094d0 con 0x7fe5d01057c0 2024-09-13T16:00:20.871 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.070+0000 7fe5d4c00640 1 --2- 172.21.15.86:0/4290081447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5d01057c0 0x7fe5d01995d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc02a790 tx=0x7fe5bc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:20.871 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.071+0000 7fe5cd600640 1 -- 172.21.15.86:0/4290081447 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5bc032db0 con 0x7fe5d01057c0 2024-09-13T16:00:20.871 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.071+0000 7fe5cd600640 1 -- 172.21.15.86:0/4290081447 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fe5bc03b8f0 con 0x7fe5d01057c0 2024-09-13T16:00:20.871 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.071+0000 7fe5cd600640 1 -- 172.21.15.86:0/4290081447 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5bc03a6f0 con 0x7fe5d01057c0 2024-09-13T16:00:20.871 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.071+0000 7fe5d7600640 1 -- 172.21.15.86:0/4290081447 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d0199d10 con 0x7fe5d01057c0 2024-09-13T16:00:20.871 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.071+0000 7fe5d7600640 1 -- 172.21.15.86:0/4290081447 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d019a1b0 con 0x7fe5d01057c0 2024-09-13T16:00:20.871 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.071+0000 7fe5cd600640 1 -- 172.21.15.86:0/4290081447 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe5bc039040 con 0x7fe5d01057c0 2024-09-13T16:00:20.872 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.071+0000 7fe5cd600640 1 -- 172.21.15.86:0/4290081447 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe5bc044c10 con 0x7fe5d01057c0 2024-09-13T16:00:20.872 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.072+0000 7fe5d7600640 1 -- 172.21.15.86:0/4290081447 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d0109bf0 con 0x7fe5d01057c0 2024-09-13T16:00:20.872 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.075+0000 7fe5cd600640 1 -- 172.21.15.86:0/4290081447 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fe5bc03f020 con 0x7fe5d01057c0 2024-09-13T16:00:20.872 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.137+0000 7fe5d7600640 1 -- 172.21.15.86:0/4290081447 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe5d0109db0 con 0x7fe5d01057c0 2024-09-13T16:00:20.872 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.137+0000 7fe5cd600640 1 -- 172.21.15.86:0/4290081447 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fe5bc037070 con 0x7fe5d01057c0 2024-09-13T16:00:20.872 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.139+0000 7fe5d7600640 1 -- 172.21.15.86:0/4290081447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5d01057c0 msgr2=0x7fe5d01995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:20.872 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.139+0000 7fe5d7600640 1 --2- 172.21.15.86:0/4290081447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5d01057c0 0x7fe5d01995d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc02a790 tx=0x7fe5bc032670 comp rx=0 tx=0).stop 2024-09-13T16:00:20.872 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.139+0000 7fe5d7600640 1 -- 172.21.15.86:0/4290081447 shutdown_connections 2024-09-13T16:00:20.872 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.139+0000 7fe5d7600640 1 --2- 172.21.15.86:0/4290081447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5d01057c0 0x7fe5d01995d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:20.872 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.139+0000 7fe5d7600640 1 -- 172.21.15.86:0/4290081447 >> 172.21.15.86:0/4290081447 conn(0x7fe5d0101030 msgr2=0x7fe5d0101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:20.872 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.139+0000 7fe5d7600640 1 -- 172.21.15.86:0/4290081447 shutdown_connections 2024-09-13T16:00:20.872 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:20.139+0000 7fe5d7600640 1 -- 172.21.15.86:0/4290081447 wait complete. 2024-09-13T16:00:20.872 INFO:teuthology.orchestra.run.smithi086.stdout:mgr not available, waiting (2/15)... 2024-09-13T16:00:21.115 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:20 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:20.614+0000 7f965e620040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T16:00:21.115 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:20 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:20.686+0000 7f965e620040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T16:00:21.115 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:20 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:20.760+0000 7f965e620040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T16:00:22.115 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:21 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:21.646+0000 7f965e620040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T16:00:22.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:21 smithi086 ceph-mon[30379]: Activating manager daemon x 2024-09-13T16:00:22.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:21 smithi086 ceph-mon[30379]: mgrmap e2: x(active, starting, since 0.00427913s) 2024-09-13T16:00:22.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:21 smithi086 ceph-mon[30379]: from='mgr.14100 172.21.15.86:0/3028434842' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T16:00:22.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:21 smithi086 ceph-mon[30379]: from='mgr.14100 172.21.15.86:0/3028434842' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T16:00:22.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:21 smithi086 ceph-mon[30379]: from='mgr.14100 172.21.15.86:0/3028434842' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T16:00:22.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:21 smithi086 ceph-mon[30379]: from='mgr.14100 172.21.15.86:0/3028434842' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:00:22.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:21 smithi086 ceph-mon[30379]: from='mgr.14100 172.21.15.86:0/3028434842' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T16:00:22.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:21 smithi086 ceph-mon[30379]: Manager daemon x is now available 2024-09-13T16:00:22.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:21 smithi086 ceph-mon[30379]: from='mgr.14100 172.21.15.86:0/3028434842' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T16:00:22.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:21 smithi086 ceph-mon[30379]: from='mgr.14100 172.21.15.86:0/3028434842' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T16:00:22.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:21 smithi086 ceph-mon[30379]: from='mgr.14100 172.21.15.86:0/3028434842' entity='mgr.x' 2024-09-13T16:00:22.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:21 smithi086 ceph-mon[30379]: from='mgr.14100 172.21.15.86:0/3028434842' entity='mgr.x' 2024-09-13T16:00:22.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:21 smithi086 ceph-mon[30379]: from='mgr.14100 172.21.15.86:0/3028434842' entity='mgr.x' 2024-09-13T16:00:24.033 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:23 smithi086 ceph-mon[30379]: mgrmap e3: x(active, since 1.00981s) 2024-09-13T16:00:24.033 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:23 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3737883793' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T16:00:24.392 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-09-13T16:00:24.393 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:00:24.393 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "fsid": "1ecdfbda-71e9-11ef-bceb-c7b262605968", 2024-09-13T16:00:24.393 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T16:00:24.393 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T16:00:24.393 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T16:00:24.393 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T16:00:24.393 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:24.393 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T16:00:24.393 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T16:00:24.393 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 0 2024-09-13T16:00:24.393 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:00:24.393 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T16:00:24.393 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T16:00:24.394 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:00:24.394 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-13T16:00:24.394 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T16:00:24.394 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:00:24.394 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T16:00:24.394 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T16:00:24.394 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:24.394 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T16:00:24.394 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:00:24.394 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T16:00:24.394 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T16:00:24.394 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T16:00:24.402 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T16:00:24.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T16:00:24.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T16:00:24.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:24.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T16:00:24.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T16:00:24.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T16:00:24.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T16:00:24.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T16:00:24.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T16:00:24.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T16:00:24.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T16:00:24.403 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T16:00:24.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:24.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T16:00:24.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:00:24.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T16:00:24.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T16:00:24.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:24.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T16:00:24.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T16:00:24.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T16:00:24.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T16:00:24.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T16:00:24.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T16:00:24.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T16:00:24.404 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:00:24.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T16:00:24.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:24.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T16:00:24.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:00:24.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T16:00:07.737486+0000", 2024-09-13T16:00:24.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T16:00:24.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:00:24.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T16:00:24.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:00:24.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.383+0000 7f87e4600640 1 Processor -- start 2024-09-13T16:00:24.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.384+0000 7f87e4600640 1 -- start start 2024-09-13T16:00:24.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.384+0000 7f87e4600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87dc1057b0 0x7f87dc105bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:24.405 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.384+0000 7f87e4600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc106180 con 0x7f87dc1057b0 2024-09-13T16:00:24.406 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.384+0000 7f87e1c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87dc1057b0 0x7f87dc105bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:24.406 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.384+0000 7f87e1c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87dc1057b0 0x7f87dc105bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48700/0 (socket says 172.21.15.86:48700) 2024-09-13T16:00:24.406 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.384+0000 7f87e1c00640 1 -- 172.21.15.86:0/730437456 learned_addr learned my addr 172.21.15.86:0/730437456 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:24.406 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.385+0000 7f87e1c00640 1 -- 172.21.15.86:0/730437456 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc1069b0 con 0x7f87dc1057b0 2024-09-13T16:00:24.406 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.386+0000 7f87e1c00640 1 --2- 172.21.15.86:0/730437456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87dc1057b0 0x7f87dc105bb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009820 tx=0x7f87d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20119a2fc6fd846c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:24.406 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.386+0000 7f87dbe00640 1 -- 172.21.15.86:0/730437456 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87d002ae70 con 0x7f87dc1057b0 2024-09-13T16:00:24.406 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.386+0000 7f87dbe00640 1 -- 172.21.15.86:0/730437456 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f87d0032900 con 0x7f87dc1057b0 2024-09-13T16:00:24.406 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.386+0000 7f87dbe00640 1 -- 172.21.15.86:0/730437456 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87d00309d0 con 0x7f87dc1057b0 2024-09-13T16:00:24.406 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.386+0000 7f87e4600640 1 -- 172.21.15.86:0/730437456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87dc1057b0 msgr2=0x7f87dc105bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:24.406 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.386+0000 7f87e4600640 1 --2- 172.21.15.86:0/730437456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87dc1057b0 0x7f87dc105bb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009820 tx=0x7f87d002a270 comp rx=0 tx=0).stop 2024-09-13T16:00:24.406 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.387+0000 7f87e4600640 1 -- 172.21.15.86:0/730437456 shutdown_connections 2024-09-13T16:00:24.406 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.387+0000 7f87e4600640 1 --2- 172.21.15.86:0/730437456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87dc1057b0 0x7f87dc105bb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:24.406 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.387+0000 7f87e4600640 1 -- 172.21.15.86:0/730437456 >> 172.21.15.86:0/730437456 conn(0x7f87dc100fe0 msgr2=0x7f87dc103400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:24.406 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.387+0000 7f87e4600640 1 -- 172.21.15.86:0/730437456 shutdown_connections 2024-09-13T16:00:24.407 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.387+0000 7f87e4600640 1 -- 172.21.15.86:0/730437456 wait complete. 2024-09-13T16:00:24.407 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.388+0000 7f87e4600640 1 Processor -- start 2024-09-13T16:00:24.407 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.388+0000 7f87e4600640 1 -- start start 2024-09-13T16:00:24.407 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.388+0000 7f87e4600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87dc1057b0 0x7f87dc07c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:24.407 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.388+0000 7f87e4600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc07c8a0 con 0x7f87dc1057b0 2024-09-13T16:00:24.407 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.388+0000 7f87e1c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87dc1057b0 0x7f87dc07c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:24.407 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.388+0000 7f87e1c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87dc1057b0 0x7f87dc07c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48704/0 (socket says 172.21.15.86:48704) 2024-09-13T16:00:24.407 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.388+0000 7f87e1c00640 1 -- 172.21.15.86:0/3737883793 learned_addr learned my addr 172.21.15.86:0/3737883793 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:24.407 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.389+0000 7f87e1c00640 1 -- 172.21.15.86:0/3737883793 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d00094d0 con 0x7f87dc1057b0 2024-09-13T16:00:24.407 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.389+0000 7f87e1c00640 1 --2- 172.21.15.86:0/3737883793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87dc1057b0 0x7f87dc07c360 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f87d002a790 tx=0x7f87d0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:24.407 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.389+0000 7f87da000640 1 -- 172.21.15.86:0/3737883793 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87d0032db0 con 0x7f87dc1057b0 2024-09-13T16:00:24.407 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.389+0000 7f87da000640 1 -- 172.21.15.86:0/3737883793 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f87d003b8f0 con 0x7f87dc1057b0 2024-09-13T16:00:24.408 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.389+0000 7f87e4600640 1 -- 172.21.15.86:0/3737883793 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87dc07aa90 con 0x7f87dc1057b0 2024-09-13T16:00:24.408 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.389+0000 7f87da000640 1 -- 172.21.15.86:0/3737883793 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87d003a6f0 con 0x7f87dc1057b0 2024-09-13T16:00:24.408 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.389+0000 7f87e4600640 1 -- 172.21.15.86:0/3737883793 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87dc07af30 con 0x7f87dc1057b0 2024-09-13T16:00:24.408 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.390+0000 7f87da000640 1 -- 172.21.15.86:0/3737883793 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 3) v1 ==== 45424+0+0 (secure 0 0 0) 0x7f87d0039040 con 0x7f87dc1057b0 2024-09-13T16:00:24.408 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.390+0000 7f87e4600640 1 -- 172.21.15.86:0/3737883793 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87dc109be0 con 0x7f87dc1057b0 2024-09-13T16:00:24.408 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.391+0000 7f87da000640 1 --2- 172.21.15.86:0/3737883793 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f87c40384b0 0x7f87c403a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:24.408 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.391+0000 7f87da000640 1 -- 172.21.15.86:0/3737883793 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f87d006b460 con 0x7f87dc1057b0 2024-09-13T16:00:24.408 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.391+0000 7f87e1200640 1 --2- 172.21.15.86:0/3737883793 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f87c40384b0 0x7f87c403a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:24.408 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.391+0000 7f87e1200640 1 --2- 172.21.15.86:0/3737883793 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f87c40384b0 0x7f87c403a970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f87c80098c0 tx=0x7f87c8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:24.408 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.396+0000 7f87da000640 1 -- 172.21.15.86:0/3737883793 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f87d00319f0 con 0x7f87dc1057b0 2024-09-13T16:00:24.408 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.630+0000 7f87e4600640 1 -- 172.21.15.86:0/3737883793 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f87dc109e20 con 0x7f87dc1057b0 2024-09-13T16:00:24.408 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.631+0000 7f87da000640 1 -- 172.21.15.86:0/3737883793 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f87d003f030 con 0x7f87dc1057b0 2024-09-13T16:00:24.408 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.633+0000 7f87e4600640 1 -- 172.21.15.86:0/3737883793 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f87c40384b0 msgr2=0x7f87c403a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:24.409 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.633+0000 7f87e4600640 1 --2- 172.21.15.86:0/3737883793 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f87c40384b0 0x7f87c403a970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f87c80098c0 tx=0x7f87c8006db0 comp rx=0 tx=0).stop 2024-09-13T16:00:24.409 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.633+0000 7f87e4600640 1 -- 172.21.15.86:0/3737883793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87dc1057b0 msgr2=0x7f87dc07c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:24.409 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.633+0000 7f87e4600640 1 --2- 172.21.15.86:0/3737883793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87dc1057b0 0x7f87dc07c360 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f87d002a790 tx=0x7f87d0032670 comp rx=0 tx=0).stop 2024-09-13T16:00:24.409 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.633+0000 7f87e4600640 1 -- 172.21.15.86:0/3737883793 shutdown_connections 2024-09-13T16:00:24.409 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.633+0000 7f87e4600640 1 --2- 172.21.15.86:0/3737883793 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f87c40384b0 0x7f87c403a970 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:24.409 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.633+0000 7f87e4600640 1 --2- 172.21.15.86:0/3737883793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87dc1057b0 0x7f87dc07c360 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:24.409 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.633+0000 7f87e4600640 1 -- 172.21.15.86:0/3737883793 >> 172.21.15.86:0/3737883793 conn(0x7f87dc100fe0 msgr2=0x7f87dc101c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:24.409 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.633+0000 7f87e4600640 1 -- 172.21.15.86:0/3737883793 shutdown_connections 2024-09-13T16:00:24.409 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:23.633+0000 7f87e4600640 1 -- 172.21.15.86:0/3737883793 wait complete. 2024-09-13T16:00:24.409 INFO:teuthology.orchestra.run.smithi086.stdout:mgr is available 2024-09-13T16:00:25.054 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:24 smithi086 ceph-mon[30379]: mgrmap e4: x(active, since 2s) 2024-09-13T16:00:25.686 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-09-13T16:00:25.686 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T16:00:25.686 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout fsid = 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:00:25.686 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T16:00:25.686 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T16:00:25.686 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T16:00:25.686 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T16:00:25.686 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-09-13T16:00:25.686 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T16:00:25.686 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T16:00:25.686 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 2024-09-13T16:00:25.687 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T16:00:25.687 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T16:00:25.687 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T16:00:25.687 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T16:00:25.687 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T16:00:25.687 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T16:00:25.687 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.865+0000 7f0d79600640 1 Processor -- start 2024-09-13T16:00:25.687 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.865+0000 7f0d79600640 1 -- start start 2024-09-13T16:00:25.687 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.865+0000 7f0d79600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d74105680 0x7f0d74105a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:25.687 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.865+0000 7f0d79600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d74106050 con 0x7f0d74105680 2024-09-13T16:00:25.687 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.866+0000 7f0d73e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d74105680 0x7f0d74105a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:25.687 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.866+0000 7f0d73e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d74105680 0x7f0d74105a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48710/0 (socket says 172.21.15.86:48710) 2024-09-13T16:00:25.687 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.866+0000 7f0d73e00640 1 -- 172.21.15.86:0/546901828 learned_addr learned my addr 172.21.15.86:0/546901828 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:25.688 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.866+0000 7f0d73e00640 1 -- 172.21.15.86:0/546901828 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d741067e0 con 0x7f0d74105680 2024-09-13T16:00:25.688 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.867+0000 7f0d73e00640 1 --2- 172.21.15.86:0/546901828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d74105680 0x7f0d74105a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009820 tx=0x7f0d6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493ec520cb05ee9f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:25.688 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.867+0000 7f0d72a00640 1 -- 172.21.15.86:0/546901828 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d6402ae70 con 0x7f0d74105680 2024-09-13T16:00:25.688 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.867+0000 7f0d72a00640 1 -- 172.21.15.86:0/546901828 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f0d64032900 con 0x7f0d74105680 2024-09-13T16:00:25.688 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.867+0000 7f0d72a00640 1 -- 172.21.15.86:0/546901828 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d640309d0 con 0x7f0d74105680 2024-09-13T16:00:25.688 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.868+0000 7f0d79600640 1 -- 172.21.15.86:0/546901828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d74105680 msgr2=0x7f0d74105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:25.688 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.868+0000 7f0d79600640 1 --2- 172.21.15.86:0/546901828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d74105680 0x7f0d74105a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009820 tx=0x7f0d6402a270 comp rx=0 tx=0).stop 2024-09-13T16:00:25.688 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.868+0000 7f0d79600640 1 -- 172.21.15.86:0/546901828 shutdown_connections 2024-09-13T16:00:25.688 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.868+0000 7f0d79600640 1 --2- 172.21.15.86:0/546901828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d74105680 0x7f0d74105a80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:25.688 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.868+0000 7f0d79600640 1 -- 172.21.15.86:0/546901828 >> 172.21.15.86:0/546901828 conn(0x7f0d74100e70 msgr2=0x7f0d74103290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:25.688 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.868+0000 7f0d79600640 1 -- 172.21.15.86:0/546901828 shutdown_connections 2024-09-13T16:00:25.689 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.868+0000 7f0d79600640 1 -- 172.21.15.86:0/546901828 wait complete. 2024-09-13T16:00:25.689 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.869+0000 7f0d79600640 1 Processor -- start 2024-09-13T16:00:25.689 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.869+0000 7f0d79600640 1 -- start start 2024-09-13T16:00:25.689 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.870+0000 7f0d79600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d74105680 0x7f0d7419b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:25.689 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.870+0000 7f0d79600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7419bb30 con 0x7f0d74105680 2024-09-13T16:00:25.689 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.870+0000 7f0d73e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d74105680 0x7f0d7419b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:25.689 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.870+0000 7f0d73e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d74105680 0x7f0d7419b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48716/0 (socket says 172.21.15.86:48716) 2024-09-13T16:00:25.689 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.870+0000 7f0d73e00640 1 -- 172.21.15.86:0/1333400122 learned_addr learned my addr 172.21.15.86:0/1333400122 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:25.689 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.870+0000 7f0d73e00640 1 -- 172.21.15.86:0/1333400122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d640094d0 con 0x7f0d74105680 2024-09-13T16:00:25.689 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.870+0000 7f0d73e00640 1 --2- 172.21.15.86:0/1333400122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d74105680 0x7f0d7419b5f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0d640097f0 tx=0x7f0d64032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:25.689 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.871+0000 7f0d70c00640 1 -- 172.21.15.86:0/1333400122 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d64032db0 con 0x7f0d74105680 2024-09-13T16:00:25.689 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.871+0000 7f0d70c00640 1 -- 172.21.15.86:0/1333400122 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f0d6403b8f0 con 0x7f0d74105680 2024-09-13T16:00:25.690 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.871+0000 7f0d70c00640 1 -- 172.21.15.86:0/1333400122 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d6403a6e0 con 0x7f0d74105680 2024-09-13T16:00:25.690 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.871+0000 7f0d79600640 1 -- 172.21.15.86:0/1333400122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7419bd30 con 0x7f0d74105680 2024-09-13T16:00:25.690 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.871+0000 7f0d79600640 1 -- 172.21.15.86:0/1333400122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7419c1d0 con 0x7f0d74105680 2024-09-13T16:00:25.690 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.872+0000 7f0d70c00640 1 -- 172.21.15.86:0/1333400122 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f0d64039040 con 0x7f0d74105680 2024-09-13T16:00:25.690 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.872+0000 7f0d79600640 1 -- 172.21.15.86:0/1333400122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d74109a10 con 0x7f0d74105680 2024-09-13T16:00:25.690 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.872+0000 7f0d70c00640 1 --2- 172.21.15.86:0/1333400122 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f0d580385d0 0x7f0d5803aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:25.690 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.872+0000 7f0d70c00640 1 -- 172.21.15.86:0/1333400122 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0d6406b490 con 0x7f0d74105680 2024-09-13T16:00:25.690 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.873+0000 7f0d73400640 1 --2- 172.21.15.86:0/1333400122 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f0d580385d0 0x7f0d5803aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:25.690 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.873+0000 7f0d73400640 1 --2- 172.21.15.86:0/1333400122 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f0d580385d0 0x7f0d5803aa90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0d600098c0 tx=0x7f0d60006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:25.690 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:24.877+0000 7f0d70c00640 1 -- 172.21.15.86:0/1333400122 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0d640319f0 con 0x7f0d74105680 2024-09-13T16:00:25.690 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:25.052+0000 7f0d79600640 1 -- 172.21.15.86:0/1333400122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f0d74109c50 con 0x7f0d74105680 2024-09-13T16:00:25.690 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:25.053+0000 7f0d70c00640 1 -- 172.21.15.86:0/1333400122 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f0d6403f030 con 0x7f0d74105680 2024-09-13T16:00:25.690 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:25.056+0000 7f0d79600640 1 -- 172.21.15.86:0/1333400122 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f0d580385d0 msgr2=0x7f0d5803aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:25.691 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:25.056+0000 7f0d79600640 1 --2- 172.21.15.86:0/1333400122 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f0d580385d0 0x7f0d5803aa90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0d600098c0 tx=0x7f0d60006db0 comp rx=0 tx=0).stop 2024-09-13T16:00:25.691 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:25.056+0000 7f0d79600640 1 -- 172.21.15.86:0/1333400122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d74105680 msgr2=0x7f0d7419b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:25.691 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:25.056+0000 7f0d79600640 1 --2- 172.21.15.86:0/1333400122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d74105680 0x7f0d7419b5f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0d640097f0 tx=0x7f0d64032670 comp rx=0 tx=0).stop 2024-09-13T16:00:25.691 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:25.056+0000 7f0d79600640 1 -- 172.21.15.86:0/1333400122 shutdown_connections 2024-09-13T16:00:25.691 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:25.056+0000 7f0d79600640 1 --2- 172.21.15.86:0/1333400122 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f0d580385d0 0x7f0d5803aa90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:25.691 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:25.056+0000 7f0d79600640 1 --2- 172.21.15.86:0/1333400122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d74105680 0x7f0d7419b5f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:25.691 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:25.056+0000 7f0d79600640 1 -- 172.21.15.86:0/1333400122 >> 172.21.15.86:0/1333400122 conn(0x7f0d74100e70 msgr2=0x7f0d741019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:25.691 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:25.056+0000 7f0d79600640 1 -- 172.21.15.86:0/1333400122 shutdown_connections 2024-09-13T16:00:25.691 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:25.056+0000 7f0d79600640 1 -- 172.21.15.86:0/1333400122 wait complete. 2024-09-13T16:00:25.691 INFO:teuthology.orchestra.run.smithi086.stdout:Enabling cephadm module... 2024-09-13T16:00:25.967 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:25 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1333400122' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T16:00:26.975 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:26 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1945724153' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-13T16:00:26.975 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:26 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: ignoring --setuser ceph since I am not root 2024-09-13T16:00:26.975 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:26 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: ignoring --setgroup ceph since I am not root 2024-09-13T16:00:26.975 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:26 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:26.903+0000 7fe40bb74040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T16:00:26.975 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:26 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:26.973+0000 7fe40bb74040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T16:00:27.235 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:27 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:27.157+0000 7fe40bb74040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T16:00:27.235 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:27 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:27.233+0000 7fe40bb74040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T16:00:27.382 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.180+0000 7f8e6e000640 1 Processor -- start 2024-09-13T16:00:27.383 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.180+0000 7f8e6e000640 1 -- start start 2024-09-13T16:00:27.383 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.180+0000 7f8e6e000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e68105830 0x7f8e68105c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:27.383 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.180+0000 7f8e6e000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e68106170 con 0x7f8e68105830 2024-09-13T16:00:27.383 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.180+0000 7f8e67400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e68105830 0x7f8e68105c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:27.383 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.180+0000 7f8e67400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e68105830 0x7f8e68105c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48718/0 (socket says 172.21.15.86:48718) 2024-09-13T16:00:27.383 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.180+0000 7f8e67400640 1 -- 172.21.15.86:0/3097025041 learned_addr learned my addr 172.21.15.86:0/3097025041 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:27.383 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.181+0000 7f8e67400640 1 -- 172.21.15.86:0/3097025041 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e681062b0 con 0x7f8e68105830 2024-09-13T16:00:27.383 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.182+0000 7f8e67400640 1 --2- 172.21.15.86:0/3097025041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e68105830 0x7f8e68105c30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009820 tx=0x7f8e5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15c5b636779ccea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:27.383 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.182+0000 7f8e66a00640 1 -- 172.21.15.86:0/3097025041 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e5802ae70 con 0x7f8e68105830 2024-09-13T16:00:27.383 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.182+0000 7f8e66a00640 1 -- 172.21.15.86:0/3097025041 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f8e58032900 con 0x7f8e68105830 2024-09-13T16:00:27.383 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.182+0000 7f8e66a00640 1 -- 172.21.15.86:0/3097025041 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e580309d0 con 0x7f8e68105830 2024-09-13T16:00:27.383 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.183+0000 7f8e6e000640 1 -- 172.21.15.86:0/3097025041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e68105830 msgr2=0x7f8e68105c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:27.384 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.183+0000 7f8e6e000640 1 --2- 172.21.15.86:0/3097025041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e68105830 0x7f8e68105c30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009820 tx=0x7f8e5802a270 comp rx=0 tx=0).stop 2024-09-13T16:00:27.384 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.183+0000 7f8e6e000640 1 -- 172.21.15.86:0/3097025041 shutdown_connections 2024-09-13T16:00:27.384 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.183+0000 7f8e6e000640 1 --2- 172.21.15.86:0/3097025041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e68105830 0x7f8e68105c30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:27.384 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.183+0000 7f8e6e000640 1 -- 172.21.15.86:0/3097025041 >> 172.21.15.86:0/3097025041 conn(0x7f8e68101080 msgr2=0x7f8e681034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:27.384 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.183+0000 7f8e6e000640 1 -- 172.21.15.86:0/3097025041 shutdown_connections 2024-09-13T16:00:27.384 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.183+0000 7f8e6e000640 1 -- 172.21.15.86:0/3097025041 wait complete. 2024-09-13T16:00:27.384 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.184+0000 7f8e6e000640 1 Processor -- start 2024-09-13T16:00:27.384 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.184+0000 7f8e6e000640 1 -- start start 2024-09-13T16:00:27.384 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.184+0000 7f8e6e000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e68105830 0x7f8e6819b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:27.384 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.184+0000 7f8e6e000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6819bc40 con 0x7f8e68105830 2024-09-13T16:00:27.384 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.185+0000 7f8e67400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e68105830 0x7f8e6819b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:27.384 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.185+0000 7f8e67400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e68105830 0x7f8e6819b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48720/0 (socket says 172.21.15.86:48720) 2024-09-13T16:00:27.385 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.185+0000 7f8e67400640 1 -- 172.21.15.86:0/1945724153 learned_addr learned my addr 172.21.15.86:0/1945724153 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:27.385 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.185+0000 7f8e67400640 1 -- 172.21.15.86:0/1945724153 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e580094d0 con 0x7f8e68105830 2024-09-13T16:00:27.385 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.185+0000 7f8e67400640 1 --2- 172.21.15.86:0/1945724153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e68105830 0x7f8e6819b700 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e580097f0 tx=0x7f8e58032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:27.385 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.185+0000 7f8e64c00640 1 -- 172.21.15.86:0/1945724153 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e58032db0 con 0x7f8e68105830 2024-09-13T16:00:27.385 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.185+0000 7f8e64c00640 1 -- 172.21.15.86:0/1945724153 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f8e5803b8f0 con 0x7f8e68105830 2024-09-13T16:00:27.385 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.185+0000 7f8e64c00640 1 -- 172.21.15.86:0/1945724153 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e5803a6f0 con 0x7f8e68105830 2024-09-13T16:00:27.385 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.185+0000 7f8e6e000640 1 -- 172.21.15.86:0/1945724153 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6819be40 con 0x7f8e68105830 2024-09-13T16:00:27.385 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.186+0000 7f8e6e000640 1 -- 172.21.15.86:0/1945724153 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6819c2e0 con 0x7f8e68105830 2024-09-13T16:00:27.385 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.187+0000 7f8e6e000640 1 -- 172.21.15.86:0/1945724153 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e68107670 con 0x7f8e68105830 2024-09-13T16:00:27.385 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.187+0000 7f8e64c00640 1 -- 172.21.15.86:0/1945724153 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f8e58039040 con 0x7f8e68105830 2024-09-13T16:00:27.385 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.187+0000 7f8e64c00640 1 --2- 172.21.15.86:0/1945724153 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f8e4c038620 0x7f8e4c03aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:27.385 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.187+0000 7f8e64c00640 1 -- 172.21.15.86:0/1945724153 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8e5806b4e0 con 0x7f8e68105830 2024-09-13T16:00:27.385 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.188+0000 7f8e5fe00640 1 --2- 172.21.15.86:0/1945724153 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f8e4c038620 0x7f8e4c03aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:27.386 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.188+0000 7f8e5fe00640 1 --2- 172.21.15.86:0/1945724153 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f8e4c038620 0x7f8e4c03aae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e500098c0 tx=0x7f8e50006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:27.386 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.192+0000 7f8e64c00640 1 -- 172.21.15.86:0/1945724153 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8e58031580 con 0x7f8e68105830 2024-09-13T16:00:27.386 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.409+0000 7f8e6e000640 1 -- 172.21.15.86:0/1945724153 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f8e6819ec20 con 0x7f8e68105830 2024-09-13T16:00:27.386 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.665+0000 7f8e64c00640 1 -- 172.21.15.86:0/1945724153 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f8e5803ba60 con 0x7f8e68105830 2024-09-13T16:00:27.386 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.666+0000 7f8e64c00640 1 -- 172.21.15.86:0/1945724153 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f8e5806b240 con 0x7f8e68105830 2024-09-13T16:00:27.386 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.669+0000 7f8e6e000640 1 -- 172.21.15.86:0/1945724153 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f8e4c038620 msgr2=0x7f8e4c03aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:27.386 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.669+0000 7f8e6e000640 1 --2- 172.21.15.86:0/1945724153 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f8e4c038620 0x7f8e4c03aae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e500098c0 tx=0x7f8e50006db0 comp rx=0 tx=0).stop 2024-09-13T16:00:27.386 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.669+0000 7f8e6e000640 1 -- 172.21.15.86:0/1945724153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e68105830 msgr2=0x7f8e6819b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:27.386 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.669+0000 7f8e6e000640 1 --2- 172.21.15.86:0/1945724153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e68105830 0x7f8e6819b700 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e580097f0 tx=0x7f8e58032670 comp rx=0 tx=0).stop 2024-09-13T16:00:27.386 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.669+0000 7f8e6e000640 1 -- 172.21.15.86:0/1945724153 shutdown_connections 2024-09-13T16:00:27.386 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.669+0000 7f8e6e000640 1 --2- 172.21.15.86:0/1945724153 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f8e4c038620 0x7f8e4c03aae0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:27.386 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.669+0000 7f8e6e000640 1 --2- 172.21.15.86:0/1945724153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e68105830 0x7f8e6819b700 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:27.386 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.669+0000 7f8e6e000640 1 -- 172.21.15.86:0/1945724153 >> 172.21.15.86:0/1945724153 conn(0x7f8e68101080 msgr2=0x7f8e68101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:27.386 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.669+0000 7f8e6e000640 1 -- 172.21.15.86:0/1945724153 shutdown_connections 2024-09-13T16:00:27.386 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:26.670+0000 7f8e6e000640 1 -- 172.21.15.86:0/1945724153 wait complete. 2024-09-13T16:00:27.529 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:27 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:27.417+0000 7fe40bb74040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:00:27.822 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:27 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1945724153' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T16:00:27.822 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:27 smithi086 ceph-mon[30379]: mgrmap e5: x(active, since 5s) 2024-09-13T16:00:27.822 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:27 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:27.585+0000 7fe40bb74040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T16:00:28.115 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:27 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:27.964+0000 7fe40bb74040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T16:00:28.115 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:28 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:28.038+0000 7fe40bb74040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T16:00:28.544 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:28 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:28.252+0000 7fe40bb74040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T16:00:28.852 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:28 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3334272305' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T16:00:28.864 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:00:28.864 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-13T16:00:28.864 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T16:00:28.864 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-13T16:00:28.864 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T16:00:28.864 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:00:28.865 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.926+0000 7fc298e00640 1 Processor -- start 2024-09-13T16:00:28.865 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.926+0000 7fc298e00640 1 -- start start 2024-09-13T16:00:28.865 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.926+0000 7fc298e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc294105680 0x7fc294105a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:28.865 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.926+0000 7fc298e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc294106050 con 0x7fc294105680 2024-09-13T16:00:28.865 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.927+0000 7fc293400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc294105680 0x7fc294105a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:28.865 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.927+0000 7fc293400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc294105680 0x7fc294105a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48748/0 (socket says 172.21.15.86:48748) 2024-09-13T16:00:28.865 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.927+0000 7fc293400640 1 -- 172.21.15.86:0/1294158277 learned_addr learned my addr 172.21.15.86:0/1294158277 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:28.865 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.927+0000 7fc293400640 1 -- 172.21.15.86:0/1294158277 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2941067e0 con 0x7fc294105680 2024-09-13T16:00:28.865 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.928+0000 7fc293400640 1 --2- 172.21.15.86:0/1294158277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc294105680 0x7fc294105a80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc284009820 tx=0x7fc28402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68b993613c4aa3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:28.865 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.928+0000 7fc292a00640 1 -- 172.21.15.86:0/1294158277 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc28402ae70 con 0x7fc294105680 2024-09-13T16:00:28.865 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.929+0000 7fc292a00640 1 -- 172.21.15.86:0/1294158277 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fc284032900 con 0x7fc294105680 2024-09-13T16:00:28.865 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.929+0000 7fc292a00640 1 -- 172.21.15.86:0/1294158277 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2840309d0 con 0x7fc294105680 2024-09-13T16:00:28.865 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.929+0000 7fc298e00640 1 -- 172.21.15.86:0/1294158277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc294105680 msgr2=0x7fc294105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:28.866 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.929+0000 7fc298e00640 1 --2- 172.21.15.86:0/1294158277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc294105680 0x7fc294105a80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc284009820 tx=0x7fc28402a270 comp rx=0 tx=0).stop 2024-09-13T16:00:28.866 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.929+0000 7fc298e00640 1 -- 172.21.15.86:0/1294158277 shutdown_connections 2024-09-13T16:00:28.866 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.929+0000 7fc298e00640 1 --2- 172.21.15.86:0/1294158277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc294105680 0x7fc294105a80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:28.866 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.929+0000 7fc298e00640 1 -- 172.21.15.86:0/1294158277 >> 172.21.15.86:0/1294158277 conn(0x7fc294100e70 msgr2=0x7fc294103290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:28.866 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.929+0000 7fc298e00640 1 -- 172.21.15.86:0/1294158277 shutdown_connections 2024-09-13T16:00:28.866 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.929+0000 7fc298e00640 1 -- 172.21.15.86:0/1294158277 wait complete. 2024-09-13T16:00:28.866 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.930+0000 7fc298e00640 1 Processor -- start 2024-09-13T16:00:28.866 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.931+0000 7fc298e00640 1 -- start start 2024-09-13T16:00:28.866 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.931+0000 7fc298e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc294105680 0x7fc29419b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:28.866 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.931+0000 7fc298e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29419bb30 con 0x7fc294105680 2024-09-13T16:00:28.866 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.931+0000 7fc293400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc294105680 0x7fc29419b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:28.866 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.931+0000 7fc293400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc294105680 0x7fc29419b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48762/0 (socket says 172.21.15.86:48762) 2024-09-13T16:00:28.866 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.931+0000 7fc293400640 1 -- 172.21.15.86:0/3334272305 learned_addr learned my addr 172.21.15.86:0/3334272305 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:28.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.931+0000 7fc293400640 1 -- 172.21.15.86:0/3334272305 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2840094d0 con 0x7fc294105680 2024-09-13T16:00:28.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.932+0000 7fc293400640 1 --2- 172.21.15.86:0/3334272305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc294105680 0x7fc29419b5f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc2840097f0 tx=0x7fc284032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:28.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.932+0000 7fc290c00640 1 -- 172.21.15.86:0/3334272305 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc284032db0 con 0x7fc294105680 2024-09-13T16:00:28.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.932+0000 7fc290c00640 1 -- 172.21.15.86:0/3334272305 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fc28403b8f0 con 0x7fc294105680 2024-09-13T16:00:28.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.932+0000 7fc290c00640 1 -- 172.21.15.86:0/3334272305 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc28403a6e0 con 0x7fc294105680 2024-09-13T16:00:28.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.932+0000 7fc298e00640 1 -- 172.21.15.86:0/3334272305 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29419bd30 con 0x7fc294105680 2024-09-13T16:00:28.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.932+0000 7fc298e00640 1 -- 172.21.15.86:0/3334272305 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29419c1d0 con 0x7fc294105680 2024-09-13T16:00:28.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.933+0000 7fc290c00640 1 -- 172.21.15.86:0/3334272305 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fc284039040 con 0x7fc294105680 2024-09-13T16:00:28.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.933+0000 7fc298e00640 1 -- 172.21.15.86:0/3334272305 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc294109a10 con 0x7fc294105680 2024-09-13T16:00:28.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.934+0000 7fc290c00640 1 --2- 172.21.15.86:0/3334272305 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7fc278038620 0x7fc27803aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:28.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.934+0000 7fc290c00640 1 -- 172.21.15.86:0/3334272305 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc28406b4f0 con 0x7fc294105680 2024-09-13T16:00:28.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.934+0000 7fc28aa00640 1 -- 172.21.15.86:0/3334272305 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7fc278038620 msgr2=0x7fc27803aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/2495317297 2024-09-13T16:00:28.867 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.934+0000 7fc28aa00640 1 --2- 172.21.15.86:0/3334272305 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7fc278038620 0x7fc27803aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:00:28.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:27.938+0000 7fc290c00640 1 -- 172.21.15.86:0/3334272305 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc2840313e0 con 0x7fc294105680 2024-09-13T16:00:28.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:28.135+0000 7fc28aa00640 1 -- 172.21.15.86:0/3334272305 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7fc278038620 msgr2=0x7fc27803aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/2495317297 2024-09-13T16:00:28.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:28.135+0000 7fc28aa00640 1 --2- 172.21.15.86:0/3334272305 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7fc278038620 0x7fc27803aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T16:00:28.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:28.161+0000 7fc298e00640 1 -- 172.21.15.86:0/3334272305 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fc29419eeb0 con 0x7fc294105680 2024-09-13T16:00:28.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:28.162+0000 7fc290c00640 1 -- 172.21.15.86:0/3334272305 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fc28403f020 con 0x7fc294105680 2024-09-13T16:00:28.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:28.164+0000 7fc298e00640 1 -- 172.21.15.86:0/3334272305 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7fc278038620 msgr2=0x7fc27803aae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:00:28.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:28.164+0000 7fc298e00640 1 --2- 172.21.15.86:0/3334272305 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7fc278038620 0x7fc27803aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:28.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:28.164+0000 7fc298e00640 1 -- 172.21.15.86:0/3334272305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc294105680 msgr2=0x7fc29419b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:28.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:28.164+0000 7fc298e00640 1 --2- 172.21.15.86:0/3334272305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc294105680 0x7fc29419b5f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc2840097f0 tx=0x7fc284032670 comp rx=0 tx=0).stop 2024-09-13T16:00:28.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:28.164+0000 7fc298e00640 1 -- 172.21.15.86:0/3334272305 shutdown_connections 2024-09-13T16:00:28.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:28.164+0000 7fc298e00640 1 --2- 172.21.15.86:0/3334272305 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7fc278038620 0x7fc27803aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:28.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:28.164+0000 7fc298e00640 1 --2- 172.21.15.86:0/3334272305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc294105680 0x7fc29419b5f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:28.868 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:28.164+0000 7fc298e00640 1 -- 172.21.15.86:0/3334272305 >> 172.21.15.86:0/3334272305 conn(0x7fc294100e70 msgr2=0x7fc2941019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:28.869 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:28.164+0000 7fc298e00640 1 -- 172.21.15.86:0/3334272305 shutdown_connections 2024-09-13T16:00:28.869 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:28.165+0000 7fc298e00640 1 -- 172.21.15.86:0/3334272305 wait complete. 2024-09-13T16:00:28.869 INFO:teuthology.orchestra.run.smithi086.stdout:Waiting for the mgr to restart... 2024-09-13T16:00:28.869 INFO:teuthology.orchestra.run.smithi086.stdout:Waiting for mgr epoch 5... 2024-09-13T16:00:29.414 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:29 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:29.337+0000 7fe40bb74040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T16:00:29.865 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:29 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:29.420+0000 7fe40bb74040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T16:00:30.604 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:30 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:30.313+0000 7fe40bb74040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T16:00:30.604 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:30 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:30.444+0000 7fe40bb74040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T16:00:30.604 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:30 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:30.602+0000 7fe40bb74040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:00:30.865 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:30 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:30.672+0000 7fe40bb74040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T16:00:30.865 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:30 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:30.835+0000 7fe40bb74040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T16:00:31.236 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:30 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:30.915+0000 7fe40bb74040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T16:00:31.236 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:30 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:30.984+0000 7fe40bb74040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T16:00:31.236 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:31 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:31.159+0000 7fe40bb74040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T16:00:31.236 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:31 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:31.234+0000 7fe40bb74040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T16:00:31.542 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:31 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:31.310+0000 7fe40bb74040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T16:00:31.542 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:31 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:31.403+0000 7fe40bb74040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T16:00:31.542 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:31 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:31.472+0000 7fe40bb74040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T16:00:31.542 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:31 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:31.540+0000 7fe40bb74040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T16:00:32.709 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:32 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:32.421+0000 7fe40bb74040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T16:00:32.709 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:32 smithi086 ceph-mon[30379]: Active manager daemon x restarted 2024-09-13T16:00:32.710 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:32 smithi086 ceph-mon[30379]: Activating manager daemon x 2024-09-13T16:00:32.710 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:32 smithi086 ceph-mon[30379]: osdmap e2: 0 total, 0 up, 0 in 2024-09-13T16:00:32.710 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:32 smithi086 ceph-mon[30379]: mgrmap e6: x(active, starting, since 0.00431054s) 2024-09-13T16:00:32.710 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:32 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:00:32.710 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:32 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T16:00:32.710 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:32 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T16:00:32.710 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:32 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T16:00:32.710 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:32 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T16:00:32.710 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:32 smithi086 ceph-mon[30379]: Manager daemon x is now available 2024-09-13T16:00:32.710 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:32 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' 2024-09-13T16:00:32.710 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:32 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' 2024-09-13T16:00:32.710 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:32 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:00:32.710 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:32 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:00:32.711 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:32 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T16:00:33.768 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-mon[30379]: Found migration_current of "None". Setting to last migration. 2024-09-13T16:00:33.768 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T16:00:33.768 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' 2024-09-13T16:00:33.768 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' 2024-09-13T16:00:33.768 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-mon[30379]: mgrmap e7: x(active, since 1.00994s) 2024-09-13T16:00:34.060 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:33.854+0000 7fe36b000640 -1 log_channel(cephadm) log [ERR] : [13/Sep/2024:16:00:33] ENGINE Error in HTTPServer.serve 2024-09-13T16:00:34.060 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: Traceback (most recent call last): 2024-09-13T16:00:34.060 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T16:00:34.060 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: self._connections.run(self.expiration_interval) 2024-09-13T16:00:34.060 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T16:00:34.060 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: self._run(expiration_interval) 2024-09-13T16:00:34.060 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T16:00:34.060 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T16:00:34.060 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T16:00:34.060 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T16:00:34.061 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T16:00:34.061 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: s = self.context.wrap_socket( 2024-09-13T16:00:34.061 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T16:00:34.061 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: return self.sslsocket_class._create( 2024-09-13T16:00:34.061 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T16:00:34.061 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: self.do_handshake() 2024-09-13T16:00:34.061 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T16:00:34.061 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: self._sslobj.do_handshake() 2024-09-13T16:00:34.061 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T16:00:34.061 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:34.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:00:34.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-13T16:00:34.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T16:00:34.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:00:34.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.412+0000 7f7db2a00640 1 Processor -- start 2024-09-13T16:00:34.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.412+0000 7f7db2a00640 1 -- start start 2024-09-13T16:00:34.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.412+0000 7f7db2a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dac108fd0 0x7f7dac1093d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:34.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.412+0000 7f7db2a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac1099a0 con 0x7f7dac108fd0 2024-09-13T16:00:34.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.413+0000 7f7dabe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dac108fd0 0x7f7dac1093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:34.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.413+0000 7f7dabe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dac108fd0 0x7f7dac1093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48764/0 (socket says 172.21.15.86:48764) 2024-09-13T16:00:34.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.413+0000 7f7dabe00640 1 -- 172.21.15.86:0/3358067533 learned_addr learned my addr 172.21.15.86:0/3358067533 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:34.072 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.413+0000 7f7dabe00640 1 -- 172.21.15.86:0/3358067533 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac109ae0 con 0x7f7dac108fd0 2024-09-13T16:00:34.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.414+0000 7f7dabe00640 1 --2- 172.21.15.86:0/3358067533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dac108fd0 0x7f7dac1093d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009820 tx=0x7f7d9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ac12638528f471 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:34.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.415+0000 7f7daaa00640 1 -- 172.21.15.86:0/3358067533 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d9c02ae70 con 0x7f7dac108fd0 2024-09-13T16:00:34.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.415+0000 7f7daaa00640 1 -- 172.21.15.86:0/3358067533 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f7d9c032900 con 0x7f7dac108fd0 2024-09-13T16:00:34.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.415+0000 7f7daaa00640 1 -- 172.21.15.86:0/3358067533 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d9c0309d0 con 0x7f7dac108fd0 2024-09-13T16:00:34.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.416+0000 7f7db2a00640 1 -- 172.21.15.86:0/3358067533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dac108fd0 msgr2=0x7f7dac1093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:34.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.416+0000 7f7db2a00640 1 --2- 172.21.15.86:0/3358067533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dac108fd0 0x7f7dac1093d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009820 tx=0x7f7d9c02a270 comp rx=0 tx=0).stop 2024-09-13T16:00:34.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.416+0000 7f7db2a00640 1 -- 172.21.15.86:0/3358067533 shutdown_connections 2024-09-13T16:00:34.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.416+0000 7f7db2a00640 1 --2- 172.21.15.86:0/3358067533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dac108fd0 0x7f7dac1093d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:34.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.416+0000 7f7db2a00640 1 -- 172.21.15.86:0/3358067533 >> 172.21.15.86:0/3358067533 conn(0x7f7dac07b060 msgr2=0x7f7dac07b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:34.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.416+0000 7f7db2a00640 1 -- 172.21.15.86:0/3358067533 shutdown_connections 2024-09-13T16:00:34.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.416+0000 7f7db2a00640 1 -- 172.21.15.86:0/3358067533 wait complete. 2024-09-13T16:00:34.073 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.417+0000 7f7db2a00640 1 Processor -- start 2024-09-13T16:00:34.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.417+0000 7f7db2a00640 1 -- start start 2024-09-13T16:00:34.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.418+0000 7f7db2a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dac108fd0 0x7f7dac19b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:34.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.418+0000 7f7db2a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac19bcc0 con 0x7f7dac108fd0 2024-09-13T16:00:34.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.418+0000 7f7dabe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dac108fd0 0x7f7dac19b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:34.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.418+0000 7f7dabe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dac108fd0 0x7f7dac19b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48778/0 (socket says 172.21.15.86:48778) 2024-09-13T16:00:34.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.418+0000 7f7dabe00640 1 -- 172.21.15.86:0/339047957 learned_addr learned my addr 172.21.15.86:0/339047957 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:34.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.418+0000 7f7dabe00640 1 -- 172.21.15.86:0/339047957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c0094d0 con 0x7f7dac108fd0 2024-09-13T16:00:34.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.419+0000 7f7dabe00640 1 --2- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dac108fd0 0x7f7dac19b780 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c02a790 tx=0x7f7d9c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:34.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.419+0000 7f7da8c00640 1 -- 172.21.15.86:0/339047957 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d9c032db0 con 0x7f7dac108fd0 2024-09-13T16:00:34.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.419+0000 7f7da8c00640 1 -- 172.21.15.86:0/339047957 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f7d9c03b8f0 con 0x7f7dac108fd0 2024-09-13T16:00:34.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.419+0000 7f7db2a00640 1 -- 172.21.15.86:0/339047957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dac19bec0 con 0x7f7dac108fd0 2024-09-13T16:00:34.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.419+0000 7f7da8c00640 1 -- 172.21.15.86:0/339047957 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d9c03a6f0 con 0x7f7dac108fd0 2024-09-13T16:00:34.074 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.419+0000 7f7db2a00640 1 -- 172.21.15.86:0/339047957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dac19c360 con 0x7f7dac108fd0 2024-09-13T16:00:34.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.420+0000 7f7da8c00640 1 -- 172.21.15.86:0/339047957 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f7d9c039040 con 0x7f7dac108fd0 2024-09-13T16:00:34.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.421+0000 7f7da8c00640 1 --2- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f7d90038620 0x7f7d9003aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:34.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.421+0000 7f7da8c00640 1 -- 172.21.15.86:0/339047957 --> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d9003b1f0 con 0x7f7d90038620 2024-09-13T16:00:34.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.421+0000 7f7da8c00640 1 -- 172.21.15.86:0/339047957 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7d9c06b5c0 con 0x7f7dac108fd0 2024-09-13T16:00:34.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.421+0000 7f7dab400640 1 -- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f7d90038620 msgr2=0x7f7d9003aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/2495317297 2024-09-13T16:00:34.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.421+0000 7f7dab400640 1 --2- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f7d90038620 0x7f7d9003aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:00:34.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.622+0000 7f7dab400640 1 -- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f7d90038620 msgr2=0x7f7d9003aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/2495317297 2024-09-13T16:00:34.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:29.622+0000 7f7dab400640 1 --2- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f7d90038620 0x7f7d9003aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T16:00:34.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:30.023+0000 7f7dab400640 1 -- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f7d90038620 msgr2=0x7f7d9003aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/2495317297 2024-09-13T16:00:34.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:30.023+0000 7f7dab400640 1 --2- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f7d90038620 0x7f7d9003aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T16:00:34.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:30.824+0000 7f7dab400640 1 -- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f7d90038620 msgr2=0x7f7d9003aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/2495317297 2024-09-13T16:00:34.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:30.824+0000 7f7dab400640 1 --2- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f7d90038620 0x7f7d9003aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T16:00:34.075 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:32.425+0000 7f7dab400640 1 -- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f7d90038620 msgr2=0x7f7d9003aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/2495317297 2024-09-13T16:00:34.076 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:32.425+0000 7f7dab400640 1 --2- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f7d90038620 0x7f7d9003aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-13T16:00:34.076 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:32.425+0000 7f7da8c00640 1 -- 172.21.15.86:0/339047957 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mgrmap(e 6) v1 ==== 45308+0+0 (secure 0 0 0) 0x7f7d9c03ba60 con 0x7f7dac108fd0 2024-09-13T16:00:34.076 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:32.426+0000 7f7da8c00640 1 -- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f7d90038620 msgr2=0x7f7d9003aae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:00:34.076 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:32.426+0000 7f7da8c00640 1 --2- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f7d90038620 0x7f7d9003aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:34.076 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.429+0000 7f7da8c00640 1 -- 172.21.15.86:0/339047957 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7f7d9c06d240 con 0x7f7dac108fd0 2024-09-13T16:00:34.076 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.430+0000 7f7da8c00640 1 --2- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f7d9003bf50 0x7f7d9003e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:34.076 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.430+0000 7f7da8c00640 1 -- 172.21.15.86:0/339047957 --> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d9003b1f0 con 0x7f7d9003bf50 2024-09-13T16:00:34.076 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.430+0000 7f7dab400640 1 --2- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f7d9003bf50 0x7f7d9003e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:34.076 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.431+0000 7f7dab400640 1 --2- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f7d9003bf50 0x7f7d9003e340 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7d98003980 tx=0x7f7d98009290 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:34.076 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.432+0000 7f7da8c00640 1 -- 172.21.15.86:0/339047957 <== mgr.14118 v2:172.21.15.86:6800/3020585994 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f7d9003b1f0 con 0x7f7d9003bf50 2024-09-13T16:00:34.076 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.438+0000 7f7db2a00640 1 -- 172.21.15.86:0/339047957 --> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f7dac109450 con 0x7f7d9003bf50 2024-09-13T16:00:34.076 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.439+0000 7f7da8c00640 1 -- 172.21.15.86:0/339047957 <== mgr.14118 v2:172.21.15.86:6800/3020585994 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f7dac109450 con 0x7f7d9003bf50 2024-09-13T16:00:34.076 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.439+0000 7f7db2a00640 1 -- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f7d9003bf50 msgr2=0x7f7d9003e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:34.077 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.439+0000 7f7db2a00640 1 --2- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f7d9003bf50 0x7f7d9003e340 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7d98003980 tx=0x7f7d98009290 comp rx=0 tx=0).stop 2024-09-13T16:00:34.077 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.439+0000 7f7db2a00640 1 -- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dac108fd0 msgr2=0x7f7dac19b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:34.077 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.439+0000 7f7db2a00640 1 --2- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dac108fd0 0x7f7dac19b780 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c02a790 tx=0x7f7d9c032670 comp rx=0 tx=0).stop 2024-09-13T16:00:34.077 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.439+0000 7f7db2a00640 1 -- 172.21.15.86:0/339047957 shutdown_connections 2024-09-13T16:00:34.077 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.439+0000 7f7db2a00640 1 --2- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f7d9003bf50 0x7f7d9003e340 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:34.077 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.439+0000 7f7db2a00640 1 --2- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:6800/2495317297,v1:172.21.15.86:6801/2495317297] conn(0x7f7d90038620 0x7f7d9003aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:34.077 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.439+0000 7f7db2a00640 1 --2- 172.21.15.86:0/339047957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dac108fd0 0x7f7dac19b780 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:34.077 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.439+0000 7f7db2a00640 1 -- 172.21.15.86:0/339047957 >> 172.21.15.86:0/339047957 conn(0x7f7dac07b060 msgr2=0x7f7dac105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:34.077 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.439+0000 7f7db2a00640 1 -- 172.21.15.86:0/339047957 shutdown_connections 2024-09-13T16:00:34.077 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:33.439+0000 7f7db2a00640 1 -- 172.21.15.86:0/339047957 wait complete. 2024-09-13T16:00:34.077 INFO:teuthology.orchestra.run.smithi086.stdout:mgr epoch 5 is available 2024-09-13T16:00:34.077 INFO:teuthology.orchestra.run.smithi086.stdout:Setting orchestrator backend to cephadm... 2024-09-13T16:00:34.618 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:34 smithi086 ceph-mon[30379]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T16:00:34.618 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:34 smithi086 ceph-mon[30379]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T16:00:34.618 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:34 smithi086 ceph-mon[30379]: [13/Sep/2024:16:00:33] ENGINE Bus STARTING 2024-09-13T16:00:34.618 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:34 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:00:35.502 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.615+0000 7f368d000640 1 Processor -- start 2024-09-13T16:00:35.502 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.615+0000 7f368d000640 1 -- start start 2024-09-13T16:00:35.502 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.616+0000 7f368d000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3688105650 0x7f3688105a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:35.502 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.616+0000 7f368d000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3688106020 con 0x7f3688105650 2024-09-13T16:00:35.502 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.616+0000 7f3687400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3688105650 0x7f3688105a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:35.502 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.616+0000 7f3687400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3688105650 0x7f3688105a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45304/0 (socket says 172.21.15.86:45304) 2024-09-13T16:00:35.502 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.616+0000 7f3687400640 1 -- 172.21.15.86:0/3133738236 learned_addr learned my addr 172.21.15.86:0/3133738236 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:35.502 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.617+0000 7f3687400640 1 -- 172.21.15.86:0/3133738236 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3688106850 con 0x7f3688105650 2024-09-13T16:00:35.502 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.618+0000 7f3687400640 1 --2- 172.21.15.86:0/3133738236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3688105650 0x7f3688105a50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3678009820 tx=0x7f367802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc64414482645ddb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:35.502 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.618+0000 7f3686a00640 1 -- 172.21.15.86:0/3133738236 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f367802ae70 con 0x7f3688105650 2024-09-13T16:00:35.503 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.618+0000 7f3686a00640 1 -- 172.21.15.86:0/3133738236 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f3678032900 con 0x7f3688105650 2024-09-13T16:00:35.503 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.618+0000 7f3686a00640 1 -- 172.21.15.86:0/3133738236 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36780309d0 con 0x7f3688105650 2024-09-13T16:00:35.503 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.619+0000 7f368d000640 1 -- 172.21.15.86:0/3133738236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3688105650 msgr2=0x7f3688105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:35.503 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.619+0000 7f368d000640 1 --2- 172.21.15.86:0/3133738236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3688105650 0x7f3688105a50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3678009820 tx=0x7f367802a270 comp rx=0 tx=0).stop 2024-09-13T16:00:35.503 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.619+0000 7f368d000640 1 -- 172.21.15.86:0/3133738236 shutdown_connections 2024-09-13T16:00:35.503 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.619+0000 7f368d000640 1 --2- 172.21.15.86:0/3133738236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3688105650 0x7f3688105a50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:35.503 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.619+0000 7f368d000640 1 -- 172.21.15.86:0/3133738236 >> 172.21.15.86:0/3133738236 conn(0x7f3688100e40 msgr2=0x7f3688103260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:35.503 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.619+0000 7f368d000640 1 -- 172.21.15.86:0/3133738236 shutdown_connections 2024-09-13T16:00:35.503 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.619+0000 7f368d000640 1 -- 172.21.15.86:0/3133738236 wait complete. 2024-09-13T16:00:35.503 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.620+0000 7f368d000640 1 Processor -- start 2024-09-13T16:00:35.503 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.620+0000 7f368d000640 1 -- start start 2024-09-13T16:00:35.503 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.621+0000 7f368d000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3688105650 0x7f368807c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:35.503 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.621+0000 7f368d000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368807c8a0 con 0x7f3688105650 2024-09-13T16:00:35.503 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.621+0000 7f3687400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3688105650 0x7f368807c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:35.504 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.621+0000 7f3687400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3688105650 0x7f368807c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45310/0 (socket says 172.21.15.86:45310) 2024-09-13T16:00:35.504 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.621+0000 7f3687400640 1 -- 172.21.15.86:0/2477326924 learned_addr learned my addr 172.21.15.86:0/2477326924 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:35.504 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.621+0000 7f3687400640 1 -- 172.21.15.86:0/2477326924 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36780094d0 con 0x7f3688105650 2024-09-13T16:00:35.504 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.621+0000 7f3687400640 1 --2- 172.21.15.86:0/2477326924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3688105650 0x7f368807c360 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f36780097f0 tx=0x7f3678032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:35.504 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.622+0000 7f3684c00640 1 -- 172.21.15.86:0/2477326924 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3678032db0 con 0x7f3688105650 2024-09-13T16:00:35.504 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.622+0000 7f3684c00640 1 -- 172.21.15.86:0/2477326924 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f367803b8f0 con 0x7f3688105650 2024-09-13T16:00:35.504 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.622+0000 7f3684c00640 1 -- 172.21.15.86:0/2477326924 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f367803a6e0 con 0x7f3688105650 2024-09-13T16:00:35.504 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.622+0000 7f368d000640 1 -- 172.21.15.86:0/2477326924 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368807aa90 con 0x7f3688105650 2024-09-13T16:00:35.504 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.622+0000 7f368d000640 1 -- 172.21.15.86:0/2477326924 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368807af30 con 0x7f3688105650 2024-09-13T16:00:35.504 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.623+0000 7f3684c00640 1 -- 172.21.15.86:0/2477326924 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f3678039040 con 0x7f3688105650 2024-09-13T16:00:35.504 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.623+0000 7f368d000640 1 -- 172.21.15.86:0/2477326924 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3688105ad0 con 0x7f3688105650 2024-09-13T16:00:35.504 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.624+0000 7f3684c00640 1 --2- 172.21.15.86:0/2477326924 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f366c038670 0x7f366c03ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:35.505 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.624+0000 7f3684c00640 1 -- 172.21.15.86:0/2477326924 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f367806b520 con 0x7f3688105650 2024-09-13T16:00:35.505 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.624+0000 7f367ea00640 1 --2- 172.21.15.86:0/2477326924 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f366c038670 0x7f366c03ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:35.505 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.624+0000 7f367ea00640 1 --2- 172.21.15.86:0/2477326924 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f366c038670 0x7f366c03ab30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f36700098c0 tx=0x7f3670006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:35.505 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.629+0000 7f3684c00640 1 -- 172.21.15.86:0/2477326924 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3678041640 con 0x7f3688105650 2024-09-13T16:00:35.505 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.815+0000 7f368d000640 1 -- 172.21.15.86:0/2477326924 --> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f368807b5a0 con 0x7f366c038670 2024-09-13T16:00:35.505 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.830+0000 7f3684c00640 1 -- 172.21.15.86:0/2477326924 <== mgr.14118 v2:172.21.15.86:6800/3020585994 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f368807b5a0 con 0x7f366c038670 2024-09-13T16:00:35.505 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.832+0000 7f368d000640 1 -- 172.21.15.86:0/2477326924 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f366c038670 msgr2=0x7f366c03ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:35.505 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.832+0000 7f368d000640 1 --2- 172.21.15.86:0/2477326924 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f366c038670 0x7f366c03ab30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f36700098c0 tx=0x7f3670006db0 comp rx=0 tx=0).stop 2024-09-13T16:00:35.505 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.832+0000 7f368d000640 1 -- 172.21.15.86:0/2477326924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3688105650 msgr2=0x7f368807c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:35.505 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.832+0000 7f368d000640 1 --2- 172.21.15.86:0/2477326924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3688105650 0x7f368807c360 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f36780097f0 tx=0x7f3678032670 comp rx=0 tx=0).stop 2024-09-13T16:00:35.506 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.832+0000 7f368d000640 1 -- 172.21.15.86:0/2477326924 shutdown_connections 2024-09-13T16:00:35.506 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.832+0000 7f368d000640 1 --2- 172.21.15.86:0/2477326924 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f366c038670 0x7f366c03ab30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:35.506 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.832+0000 7f368d000640 1 --2- 172.21.15.86:0/2477326924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3688105650 0x7f368807c360 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:35.506 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.832+0000 7f368d000640 1 -- 172.21.15.86:0/2477326924 >> 172.21.15.86:0/2477326924 conn(0x7f3688100e40 msgr2=0x7f3688101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:35.506 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.833+0000 7f368d000640 1 -- 172.21.15.86:0/2477326924 shutdown_connections 2024-09-13T16:00:35.506 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:34.833+0000 7f368d000640 1 -- 172.21.15.86:0/2477326924 wait complete. 2024-09-13T16:00:35.740 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:35 smithi086 ceph-mon[30379]: [13/Sep/2024:16:00:33] ENGINE Serving on https://172.21.15.86:7150 2024-09-13T16:00:35.740 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:35 smithi086 ceph-mon[30379]: [13/Sep/2024:16:00:33] ENGINE Error in HTTPServer.serve 2024-09-13T16:00:35.740 INFO:journalctl@ceph.mon.a.smithi086.stdout: Traceback (most recent call last): 2024-09-13T16:00:35.740 INFO:journalctl@ceph.mon.a.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T16:00:35.740 INFO:journalctl@ceph.mon.a.smithi086.stdout: self._connections.run(self.expiration_interval) 2024-09-13T16:00:35.740 INFO:journalctl@ceph.mon.a.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T16:00:35.740 INFO:journalctl@ceph.mon.a.smithi086.stdout: self._run(expiration_interval) 2024-09-13T16:00:35.741 INFO:journalctl@ceph.mon.a.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T16:00:35.741 INFO:journalctl@ceph.mon.a.smithi086.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T16:00:35.741 INFO:journalctl@ceph.mon.a.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T16:00:35.741 INFO:journalctl@ceph.mon.a.smithi086.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T16:00:35.741 INFO:journalctl@ceph.mon.a.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T16:00:35.741 INFO:journalctl@ceph.mon.a.smithi086.stdout: s = self.context.wrap_socket( 2024-09-13T16:00:35.741 INFO:journalctl@ceph.mon.a.smithi086.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T16:00:35.741 INFO:journalctl@ceph.mon.a.smithi086.stdout: return self.sslsocket_class._create( 2024-09-13T16:00:35.741 INFO:journalctl@ceph.mon.a.smithi086.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T16:00:35.741 INFO:journalctl@ceph.mon.a.smithi086.stdout: self.do_handshake() 2024-09-13T16:00:35.741 INFO:journalctl@ceph.mon.a.smithi086.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T16:00:35.741 INFO:journalctl@ceph.mon.a.smithi086.stdout: self._sslobj.do_handshake() 2024-09-13T16:00:35.741 INFO:journalctl@ceph.mon.a.smithi086.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T16:00:35.741 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:35 smithi086 ceph-mon[30379]: [13/Sep/2024:16:00:33] ENGINE Serving on http://172.21.15.86:8765 2024-09-13T16:00:35.742 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:35 smithi086 ceph-mon[30379]: [13/Sep/2024:16:00:33] ENGINE Bus STARTED 2024-09-13T16:00:35.742 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:35 smithi086 ceph-mon[30379]: mgrmap e8: x(active, since 2s) 2024-09-13T16:00:35.742 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:35 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' 2024-09-13T16:00:35.742 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:35 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:00:36.746 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:36 smithi086 ceph-mon[30379]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:00:36.820 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-13T16:00:36.820 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.936+0000 7f19a2600640 1 Processor -- start 2024-09-13T16:00:36.820 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.936+0000 7f19a2600640 1 -- start start 2024-09-13T16:00:36.820 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.937+0000 7f19a2600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f199c105680 0x7f199c105a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:36.821 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.937+0000 7f19a2600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c106050 con 0x7f199c105680 2024-09-13T16:00:36.821 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.937+0000 7f19a1200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f199c105680 0x7f199c105a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:36.821 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.937+0000 7f19a1200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f199c105680 0x7f199c105a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45318/0 (socket says 172.21.15.86:45318) 2024-09-13T16:00:36.821 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.937+0000 7f19a1200640 1 -- 172.21.15.86:0/3633016435 learned_addr learned my addr 172.21.15.86:0/3633016435 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:36.821 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.937+0000 7f19a1200640 1 -- 172.21.15.86:0/3633016435 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c1067e0 con 0x7f199c105680 2024-09-13T16:00:36.821 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.938+0000 7f19a1200640 1 --2- 172.21.15.86:0/3633016435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f199c105680 0x7f199c105a80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f198c009e80 tx=0x7f198c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a83b973121df99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:36.821 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.939+0000 7f199b400640 1 -- 172.21.15.86:0/3633016435 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f198c031400 con 0x7f199c105680 2024-09-13T16:00:36.821 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.939+0000 7f199b400640 1 -- 172.21.15.86:0/3633016435 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f198c02d050 con 0x7f199c105680 2024-09-13T16:00:36.821 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.939+0000 7f199b400640 1 -- 172.21.15.86:0/3633016435 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f198c007a00 con 0x7f199c105680 2024-09-13T16:00:36.821 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.939+0000 7f19a2600640 1 -- 172.21.15.86:0/3633016435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f199c105680 msgr2=0x7f199c105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:36.821 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.939+0000 7f19a2600640 1 --2- 172.21.15.86:0/3633016435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f199c105680 0x7f199c105a80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f198c009e80 tx=0x7f198c02a7a0 comp rx=0 tx=0).stop 2024-09-13T16:00:36.821 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.939+0000 7f19a2600640 1 -- 172.21.15.86:0/3633016435 shutdown_connections 2024-09-13T16:00:36.822 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.939+0000 7f19a2600640 1 --2- 172.21.15.86:0/3633016435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f199c105680 0x7f199c105a80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:36.822 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.939+0000 7f19a2600640 1 -- 172.21.15.86:0/3633016435 >> 172.21.15.86:0/3633016435 conn(0x7f199c100e70 msgr2=0x7f199c103290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:36.822 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.940+0000 7f19a2600640 1 -- 172.21.15.86:0/3633016435 shutdown_connections 2024-09-13T16:00:36.822 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.940+0000 7f19a2600640 1 -- 172.21.15.86:0/3633016435 wait complete. 2024-09-13T16:00:36.822 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.940+0000 7f19a2600640 1 Processor -- start 2024-09-13T16:00:36.822 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.941+0000 7f19a2600640 1 -- start start 2024-09-13T16:00:36.822 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.941+0000 7f19a2600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f199c105680 0x7f199c19b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:36.822 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.941+0000 7f19a2600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c19bb30 con 0x7f199c105680 2024-09-13T16:00:36.822 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.941+0000 7f19a1200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f199c105680 0x7f199c19b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:36.822 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.941+0000 7f19a1200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f199c105680 0x7f199c19b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45322/0 (socket says 172.21.15.86:45322) 2024-09-13T16:00:36.822 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.941+0000 7f19a1200640 1 -- 172.21.15.86:0/1328838698 learned_addr learned my addr 172.21.15.86:0/1328838698 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:36.822 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.941+0000 7f19a1200640 1 -- 172.21.15.86:0/1328838698 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c009b30 con 0x7f199c105680 2024-09-13T16:00:36.822 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.942+0000 7f19a1200640 1 --2- 172.21.15.86:0/1328838698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f199c105680 0x7f199c19b5f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f198c02acc0 tx=0x7f198c031930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:36.822 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.942+0000 7f1999600640 1 -- 172.21.15.86:0/1328838698 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f198c031d80 con 0x7f199c105680 2024-09-13T16:00:36.823 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.942+0000 7f1999600640 1 -- 172.21.15.86:0/1328838698 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f198c03d910 con 0x7f199c105680 2024-09-13T16:00:36.823 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.942+0000 7f1999600640 1 -- 172.21.15.86:0/1328838698 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f198c03b990 con 0x7f199c105680 2024-09-13T16:00:36.823 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.942+0000 7f19a2600640 1 -- 172.21.15.86:0/1328838698 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c19bd30 con 0x7f199c105680 2024-09-13T16:00:36.823 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.942+0000 7f19a2600640 1 -- 172.21.15.86:0/1328838698 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c19c230 con 0x7f199c105680 2024-09-13T16:00:36.823 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.943+0000 7f1999600640 1 -- 172.21.15.86:0/1328838698 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f198c03da80 con 0x7f199c105680 2024-09-13T16:00:36.823 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.943+0000 7f19a2600640 1 -- 172.21.15.86:0/1328838698 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199c109a10 con 0x7f199c105680 2024-09-13T16:00:36.823 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.943+0000 7f1999600640 1 --2- 172.21.15.86:0/1328838698 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f1980038670 0x7f198003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:36.823 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.944+0000 7f1999600640 1 -- 172.21.15.86:0/1328838698 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f198c06c1f0 con 0x7f199c105680 2024-09-13T16:00:36.823 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.944+0000 7f199be00640 1 --2- 172.21.15.86:0/1328838698 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f1980038670 0x7f198003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:36.823 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.944+0000 7f199be00640 1 --2- 172.21.15.86:0/1328838698 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f1980038670 0x7f198003ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f19880098c0 tx=0x7f1988006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:36.823 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:35.948+0000 7f1999600640 1 -- 172.21.15.86:0/1328838698 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f198c030540 con 0x7f199c105680 2024-09-13T16:00:36.823 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:36.119+0000 7f19a2600640 1 -- 172.21.15.86:0/1328838698 --> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f199c1020c0 con 0x7f1980038670 2024-09-13T16:00:36.823 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:36.120+0000 7f1999600640 1 -- 172.21.15.86:0/1328838698 <== mgr.14118 v2:172.21.15.86:6800/3020585994 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f199c1020c0 con 0x7f1980038670 2024-09-13T16:00:36.824 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:36.123+0000 7f19a2600640 1 -- 172.21.15.86:0/1328838698 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f1980038670 msgr2=0x7f198003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:36.824 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:36.123+0000 7f19a2600640 1 --2- 172.21.15.86:0/1328838698 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f1980038670 0x7f198003ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f19880098c0 tx=0x7f1988006db0 comp rx=0 tx=0).stop 2024-09-13T16:00:36.824 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:36.123+0000 7f19a2600640 1 -- 172.21.15.86:0/1328838698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f199c105680 msgr2=0x7f199c19b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:36.824 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:36.123+0000 7f19a2600640 1 --2- 172.21.15.86:0/1328838698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f199c105680 0x7f199c19b5f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f198c02acc0 tx=0x7f198c031930 comp rx=0 tx=0).stop 2024-09-13T16:00:36.824 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:36.123+0000 7f19a2600640 1 -- 172.21.15.86:0/1328838698 shutdown_connections 2024-09-13T16:00:36.824 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:36.123+0000 7f19a2600640 1 --2- 172.21.15.86:0/1328838698 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f1980038670 0x7f198003ab30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:36.824 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:36.123+0000 7f19a2600640 1 --2- 172.21.15.86:0/1328838698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f199c105680 0x7f199c19b5f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:36.824 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:36.123+0000 7f19a2600640 1 -- 172.21.15.86:0/1328838698 >> 172.21.15.86:0/1328838698 conn(0x7f199c100e70 msgr2=0x7f199c1019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:36.824 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:36.123+0000 7f19a2600640 1 -- 172.21.15.86:0/1328838698 shutdown_connections 2024-09-13T16:00:36.824 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:36.123+0000 7f19a2600640 1 -- 172.21.15.86:0/1328838698 wait complete. 2024-09-13T16:00:36.824 INFO:teuthology.orchestra.run.smithi086.stdout:Generating ssh key... 2024-09-13T16:00:37.734 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:37 smithi086 ceph-mon[30379]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:00:37.734 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: Generating public/private rsa key pair. 2024-09-13T16:00:37.735 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: Your identification has been saved in /tmp/tmp4zjrxy4t/key 2024-09-13T16:00:37.735 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: Your public key has been saved in /tmp/tmp4zjrxy4t/key.pub 2024-09-13T16:00:37.735 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: The key fingerprint is: 2024-09-13T16:00:37.735 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: SHA256:+bOyiO+tICm7ftfoz5UQpiglND+ibbnpZ7oRsmr7O5Y ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:00:37.735 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: The key's randomart image is: 2024-09-13T16:00:37.735 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: +---[RSA 3072]----+ 2024-09-13T16:00:37.735 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: | o | 2024-09-13T16:00:37.735 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: |. o | 2024-09-13T16:00:37.735 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: | o + o | 2024-09-13T16:00:37.735 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: |..+.o o .. | 2024-09-13T16:00:37.735 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: |o.=. . .S | 2024-09-13T16:00:37.735 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: | +.= ... | 2024-09-13T16:00:37.735 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: |o * o o oo | 2024-09-13T16:00:37.735 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: |.= Eo=.+o o | 2024-09-13T16:00:37.735 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: |*+OB*+*+oo. | 2024-09-13T16:00:37.736 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: +----[SHA256]-----+ 2024-09-13T16:00:38.314 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.275+0000 7f4944a00640 1 Processor -- start 2024-09-13T16:00:38.314 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.275+0000 7f4944a00640 1 -- start start 2024-09-13T16:00:38.314 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.276+0000 7f4944a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49401057b0 0x7f4940105bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:38.314 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.276+0000 7f4944a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4940106180 con 0x7f49401057b0 2024-09-13T16:00:38.314 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.276+0000 7f493de00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49401057b0 0x7f4940105bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:38.314 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.276+0000 7f493de00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49401057b0 0x7f4940105bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45324/0 (socket says 172.21.15.86:45324) 2024-09-13T16:00:38.314 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.276+0000 7f493de00640 1 -- 172.21.15.86:0/698123143 learned_addr learned my addr 172.21.15.86:0/698123143 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:38.314 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.277+0000 7f493de00640 1 -- 172.21.15.86:0/698123143 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49401069b0 con 0x7f49401057b0 2024-09-13T16:00:38.314 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.277+0000 7f493de00640 1 --2- 172.21.15.86:0/698123143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49401057b0 0x7f4940105bb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4930009e80 tx=0x7f493002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f477e70d85e87f4d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:38.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.278+0000 7f493ca00640 1 -- 172.21.15.86:0/698123143 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4930031400 con 0x7f49401057b0 2024-09-13T16:00:38.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.278+0000 7f493ca00640 1 -- 172.21.15.86:0/698123143 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f493002d050 con 0x7f49401057b0 2024-09-13T16:00:38.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.278+0000 7f493ca00640 1 -- 172.21.15.86:0/698123143 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4930007a00 con 0x7f49401057b0 2024-09-13T16:00:38.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.278+0000 7f4944a00640 1 -- 172.21.15.86:0/698123143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49401057b0 msgr2=0x7f4940105bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:38.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.278+0000 7f4944a00640 1 --2- 172.21.15.86:0/698123143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49401057b0 0x7f4940105bb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4930009e80 tx=0x7f493002a7a0 comp rx=0 tx=0).stop 2024-09-13T16:00:38.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.278+0000 7f4944a00640 1 -- 172.21.15.86:0/698123143 shutdown_connections 2024-09-13T16:00:38.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.278+0000 7f4944a00640 1 --2- 172.21.15.86:0/698123143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49401057b0 0x7f4940105bb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:38.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.278+0000 7f4944a00640 1 -- 172.21.15.86:0/698123143 >> 172.21.15.86:0/698123143 conn(0x7f4940100fe0 msgr2=0x7f4940103400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:38.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.279+0000 7f4944a00640 1 -- 172.21.15.86:0/698123143 shutdown_connections 2024-09-13T16:00:38.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.279+0000 7f4944a00640 1 -- 172.21.15.86:0/698123143 wait complete. 2024-09-13T16:00:38.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.279+0000 7f4944a00640 1 Processor -- start 2024-09-13T16:00:38.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.280+0000 7f4944a00640 1 -- start start 2024-09-13T16:00:38.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.280+0000 7f4944a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49401057b0 0x7f49401995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:38.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.280+0000 7f4944a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4940199b30 con 0x7f49401057b0 2024-09-13T16:00:38.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.280+0000 7f493de00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49401057b0 0x7f49401995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:38.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.280+0000 7f493de00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49401057b0 0x7f49401995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45328/0 (socket says 172.21.15.86:45328) 2024-09-13T16:00:38.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.280+0000 7f493de00640 1 -- 172.21.15.86:0/2022797300 learned_addr learned my addr 172.21.15.86:0/2022797300 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:38.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.280+0000 7f493de00640 1 -- 172.21.15.86:0/2022797300 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4930009b30 con 0x7f49401057b0 2024-09-13T16:00:38.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.281+0000 7f493de00640 1 --2- 172.21.15.86:0/2022797300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49401057b0 0x7f49401995f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f49300319a0 tx=0x7f49300319d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:38.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.281+0000 7f4936a00640 1 -- 172.21.15.86:0/2022797300 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4930031e20 con 0x7f49401057b0 2024-09-13T16:00:38.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.281+0000 7f4936a00640 1 -- 172.21.15.86:0/2022797300 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f493003d910 con 0x7f49401057b0 2024-09-13T16:00:38.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.281+0000 7f4936a00640 1 -- 172.21.15.86:0/2022797300 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f493003ba30 con 0x7f49401057b0 2024-09-13T16:00:38.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.281+0000 7f4944a00640 1 -- 172.21.15.86:0/2022797300 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4940199d30 con 0x7f49401057b0 2024-09-13T16:00:38.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.281+0000 7f4944a00640 1 -- 172.21.15.86:0/2022797300 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494019a230 con 0x7f49401057b0 2024-09-13T16:00:38.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.282+0000 7f4936a00640 1 -- 172.21.15.86:0/2022797300 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f493003d450 con 0x7f49401057b0 2024-09-13T16:00:38.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.282+0000 7f4944a00640 1 -- 172.21.15.86:0/2022797300 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4940109be0 con 0x7f49401057b0 2024-09-13T16:00:38.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.282+0000 7f4936a00640 1 --2- 172.21.15.86:0/2022797300 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f4924038670 0x7f492403ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:38.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.283+0000 7f4936a00640 1 -- 172.21.15.86:0/2022797300 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f493006c840 con 0x7f49401057b0 2024-09-13T16:00:38.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.283+0000 7f493d400640 1 --2- 172.21.15.86:0/2022797300 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f4924038670 0x7f492403ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:38.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.283+0000 7f493d400640 1 --2- 172.21.15.86:0/2022797300 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f4924038670 0x7f492403ab30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f492c0098c0 tx=0x7f492c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:38.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.287+0000 7f4936a00640 1 -- 172.21.15.86:0/2022797300 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f493004d4e0 con 0x7f49401057b0 2024-09-13T16:00:38.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.461+0000 7f4944a00640 1 -- 172.21.15.86:0/2022797300 --> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f4940102310 con 0x7f4924038670 2024-09-13T16:00:38.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.678+0000 7f4936a00640 1 -- 172.21.15.86:0/2022797300 <== mgr.14118 v2:172.21.15.86:6800/3020585994 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4940102310 con 0x7f4924038670 2024-09-13T16:00:38.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.680+0000 7f4944a00640 1 -- 172.21.15.86:0/2022797300 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f4924038670 msgr2=0x7f492403ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:38.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.680+0000 7f4944a00640 1 --2- 172.21.15.86:0/2022797300 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f4924038670 0x7f492403ab30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f492c0098c0 tx=0x7f492c006db0 comp rx=0 tx=0).stop 2024-09-13T16:00:38.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.680+0000 7f4944a00640 1 -- 172.21.15.86:0/2022797300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49401057b0 msgr2=0x7f49401995f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:38.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.680+0000 7f4944a00640 1 --2- 172.21.15.86:0/2022797300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49401057b0 0x7f49401995f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f49300319a0 tx=0x7f49300319d0 comp rx=0 tx=0).stop 2024-09-13T16:00:38.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.680+0000 7f4944a00640 1 -- 172.21.15.86:0/2022797300 shutdown_connections 2024-09-13T16:00:38.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.680+0000 7f4944a00640 1 --2- 172.21.15.86:0/2022797300 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f4924038670 0x7f492403ab30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:38.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.680+0000 7f4944a00640 1 --2- 172.21.15.86:0/2022797300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49401057b0 0x7f49401995f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:38.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.680+0000 7f4944a00640 1 -- 172.21.15.86:0/2022797300 >> 172.21.15.86:0/2022797300 conn(0x7f4940100fe0 msgr2=0x7f4940101c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:38.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.681+0000 7f4944a00640 1 -- 172.21.15.86:0/2022797300 shutdown_connections 2024-09-13T16:00:38.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:37.681+0000 7f4944a00640 1 -- 172.21.15.86:0/2022797300 wait complete. 2024-09-13T16:00:38.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:38 smithi086 ceph-mon[30379]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:00:38.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:38 smithi086 ceph-mon[30379]: Generating ssh key... 2024-09-13T16:00:38.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:38 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' 2024-09-13T16:00:38.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:38 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' 2024-09-13T16:00:39.678 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9RDwkh1cWYKAHNWys/3smK+D5N80VOJeCpP3jsThLHmHseriW2rbGjnpQ1DgprNDA7O0zHn5YCbXQSAlqmbbE3NnejLcmGjMFllBb2FE9b4HhLWagnwegL6tOtBYcpcBAFamnryQ/+Vsz//rMJ+8jfEvMfhiRXQnG6ElMSr7gntclp8t2nzgWw6pCxfvrqPr9VBMAxk01mPHG63w4MltUiLJeg/lz3yjf81jLx7eX2MTnxkFBUeqltmXGMeS3YVkrIMZjV+IG9K5XSysXgLPu6+KXCEjU0X1JjdV1McacDBqqRJ2fqyFMiog+EtU2caRe0vJ0wDm3xIqAssN9zkZATTy514aNKHVZ5DMgax6SS0XUYtH2SE9cGLv1bwEcPAk2LGapGC6dDDt5vVSunASqQSqNjyKu22/PrVN26b7PxSWvRgqK9W/RVf35utmSlu9beVg/V47oYhTvrFfMz24QMKs3pkTvgY+u7lFi4rjfero0CC/Y9VpHu4lgJPjCp28= ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:00:39.678 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.883+0000 7f284b200640 1 Processor -- start 2024-09-13T16:00:39.678 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.883+0000 7f284b200640 1 -- start start 2024-09-13T16:00:39.678 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.883+0000 7f284b200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c103ee0 0x7f284c1042e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:39.678 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.883+0000 7f284b200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c079d20 con 0x7f284c103ee0 2024-09-13T16:00:39.678 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.883+0000 7f2849e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c103ee0 0x7f284c1042e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:39.678 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.884+0000 7f2849e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c103ee0 0x7f284c1042e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45334/0 (socket says 172.21.15.86:45334) 2024-09-13T16:00:39.678 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.884+0000 7f2849e00640 1 -- 172.21.15.86:0/1479664188 learned_addr learned my addr 172.21.15.86:0/1479664188 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:39.679 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.884+0000 7f2849e00640 1 -- 172.21.15.86:0/1479664188 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c079e60 con 0x7f284c103ee0 2024-09-13T16:00:39.679 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.885+0000 7f2849e00640 1 --2- 172.21.15.86:0/1479664188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c103ee0 0x7f284c1042e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f283c009820 tx=0x7f283c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0e0ab4d78d37e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:39.679 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.885+0000 7f2849400640 1 -- 172.21.15.86:0/1479664188 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f283c02ae70 con 0x7f284c103ee0 2024-09-13T16:00:39.679 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.885+0000 7f2849400640 1 -- 172.21.15.86:0/1479664188 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f283c032900 con 0x7f284c103ee0 2024-09-13T16:00:39.679 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.885+0000 7f2849400640 1 -- 172.21.15.86:0/1479664188 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f283c0309d0 con 0x7f284c103ee0 2024-09-13T16:00:39.679 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.886+0000 7f284b200640 1 -- 172.21.15.86:0/1479664188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c103ee0 msgr2=0x7f284c1042e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:39.679 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.886+0000 7f284b200640 1 --2- 172.21.15.86:0/1479664188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c103ee0 0x7f284c1042e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f283c009820 tx=0x7f283c02a270 comp rx=0 tx=0).stop 2024-09-13T16:00:39.679 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.886+0000 7f284b200640 1 -- 172.21.15.86:0/1479664188 shutdown_connections 2024-09-13T16:00:39.679 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.886+0000 7f284b200640 1 --2- 172.21.15.86:0/1479664188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c103ee0 0x7f284c1042e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:39.679 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.886+0000 7f284b200640 1 -- 172.21.15.86:0/1479664188 >> 172.21.15.86:0/1479664188 conn(0x7f284c0ffcd0 msgr2=0x7f284c1020f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:39.679 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.886+0000 7f284b200640 1 -- 172.21.15.86:0/1479664188 shutdown_connections 2024-09-13T16:00:39.679 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.886+0000 7f284b200640 1 -- 172.21.15.86:0/1479664188 wait complete. 2024-09-13T16:00:39.679 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.887+0000 7f284b200640 1 Processor -- start 2024-09-13T16:00:39.680 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.887+0000 7f284b200640 1 -- start start 2024-09-13T16:00:39.680 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.887+0000 7f284b200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c103ee0 0x7f284c19b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:39.680 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.887+0000 7f284b200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c19baa0 con 0x7f284c103ee0 2024-09-13T16:00:39.680 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.887+0000 7f2849e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c103ee0 0x7f284c19b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:39.680 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.888+0000 7f2849e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c103ee0 0x7f284c19b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45336/0 (socket says 172.21.15.86:45336) 2024-09-13T16:00:39.680 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.888+0000 7f2849e00640 1 -- 172.21.15.86:0/4253220835 learned_addr learned my addr 172.21.15.86:0/4253220835 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:39.680 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.888+0000 7f2849e00640 1 -- 172.21.15.86:0/4253220835 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c0094d0 con 0x7f284c103ee0 2024-09-13T16:00:39.680 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.888+0000 7f2849e00640 1 --2- 172.21.15.86:0/4253220835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c103ee0 0x7f284c19b560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f283c02a790 tx=0x7f283c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:39.680 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.888+0000 7f2842a00640 1 -- 172.21.15.86:0/4253220835 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f283c032db0 con 0x7f284c103ee0 2024-09-13T16:00:39.680 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.888+0000 7f2842a00640 1 -- 172.21.15.86:0/4253220835 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f283c03b8f0 con 0x7f284c103ee0 2024-09-13T16:00:39.680 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.888+0000 7f2842a00640 1 -- 172.21.15.86:0/4253220835 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f283c03a6f0 con 0x7f284c103ee0 2024-09-13T16:00:39.680 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.888+0000 7f284b200640 1 -- 172.21.15.86:0/4253220835 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284c19bca0 con 0x7f284c103ee0 2024-09-13T16:00:39.681 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.889+0000 7f284b200640 1 -- 172.21.15.86:0/4253220835 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c19c140 con 0x7f284c103ee0 2024-09-13T16:00:39.681 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.889+0000 7f2842a00640 1 -- 172.21.15.86:0/4253220835 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f283c039040 con 0x7f284c103ee0 2024-09-13T16:00:39.681 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.890+0000 7f284b200640 1 -- 172.21.15.86:0/4253220835 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284c1055d0 con 0x7f284c103ee0 2024-09-13T16:00:39.681 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.890+0000 7f2842a00640 1 --2- 172.21.15.86:0/4253220835 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f28300386c0 0x7f283003ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:39.681 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.890+0000 7f2842a00640 1 -- 172.21.15.86:0/4253220835 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f283c06b9a0 con 0x7f284c103ee0 2024-09-13T16:00:39.681 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.890+0000 7f2843e00640 1 --2- 172.21.15.86:0/4253220835 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f28300386c0 0x7f283003ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:39.681 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.891+0000 7f2843e00640 1 --2- 172.21.15.86:0/4253220835 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f28300386c0 0x7f283003ab80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f28340098c0 tx=0x7f2834006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:39.681 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:38.896+0000 7f2842a00640 1 -- 172.21.15.86:0/4253220835 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f283c031580 con 0x7f284c103ee0 2024-09-13T16:00:39.681 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:39.065+0000 7f284b200640 1 -- 172.21.15.86:0/4253220835 --> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f284c0608f0 con 0x7f28300386c0 2024-09-13T16:00:39.681 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:39.066+0000 7f2842a00640 1 -- 172.21.15.86:0/4253220835 <== mgr.14118 v2:172.21.15.86:6800/3020585994 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f284c0608f0 con 0x7f28300386c0 2024-09-13T16:00:39.681 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:39.068+0000 7f284b200640 1 -- 172.21.15.86:0/4253220835 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f28300386c0 msgr2=0x7f283003ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:39.681 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:39.068+0000 7f284b200640 1 --2- 172.21.15.86:0/4253220835 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f28300386c0 0x7f283003ab80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f28340098c0 tx=0x7f2834006db0 comp rx=0 tx=0).stop 2024-09-13T16:00:39.681 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:39.068+0000 7f284b200640 1 -- 172.21.15.86:0/4253220835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c103ee0 msgr2=0x7f284c19b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:39.682 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:39.068+0000 7f284b200640 1 --2- 172.21.15.86:0/4253220835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c103ee0 0x7f284c19b560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f283c02a790 tx=0x7f283c032670 comp rx=0 tx=0).stop 2024-09-13T16:00:39.682 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:39.069+0000 7f284b200640 1 -- 172.21.15.86:0/4253220835 shutdown_connections 2024-09-13T16:00:39.682 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:39.069+0000 7f284b200640 1 --2- 172.21.15.86:0/4253220835 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f28300386c0 0x7f283003ab80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:39.682 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:39.069+0000 7f284b200640 1 --2- 172.21.15.86:0/4253220835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c103ee0 0x7f284c19b560 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:39.682 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:39.069+0000 7f284b200640 1 -- 172.21.15.86:0/4253220835 >> 172.21.15.86:0/4253220835 conn(0x7f284c0ffcd0 msgr2=0x7f284c18fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:39.682 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:39.069+0000 7f284b200640 1 -- 172.21.15.86:0/4253220835 shutdown_connections 2024-09-13T16:00:39.682 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:39.069+0000 7f284b200640 1 -- 172.21.15.86:0/4253220835 wait complete. 2024-09-13T16:00:39.682 INFO:teuthology.orchestra.run.smithi086.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-13T16:00:39.682 INFO:teuthology.orchestra.run.smithi086.stdout:Adding key to root@localhost authorized_keys... 2024-09-13T16:00:39.686 INFO:teuthology.orchestra.run.smithi086.stdout:Adding host smithi086... 2024-09-13T16:00:40.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:39 smithi086 ceph-mon[30379]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:00:41.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:40 smithi086 ceph-mon[30379]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi086", "addr": "172.21.15.86", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:00:42.045 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:41 smithi086 ceph-mon[30379]: Deploying cephadm binary to smithi086 2024-09-13T16:00:44.545 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout Added host 'smithi086' with addr '172.21.15.86' 2024-09-13T16:00:44.545 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.258+0000 7ff003e00640 1 Processor -- start 2024-09-13T16:00:44.545 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.258+0000 7ff003e00640 1 -- start start 2024-09-13T16:00:44.545 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.259+0000 7ff003e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feffc108f80 0x7feffc109380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:44.545 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.259+0000 7ff003e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc109950 con 0x7feffc108f80 2024-09-13T16:00:44.545 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.259+0000 7ff001400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feffc108f80 0x7feffc109380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:44.546 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.259+0000 7ff001400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feffc108f80 0x7feffc109380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45338/0 (socket says 172.21.15.86:45338) 2024-09-13T16:00:44.546 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.259+0000 7ff001400640 1 -- 172.21.15.86:0/1466775457 learned_addr learned my addr 172.21.15.86:0/1466775457 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:44.546 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.259+0000 7ff001400640 1 -- 172.21.15.86:0/1466775457 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc109a90 con 0x7feffc108f80 2024-09-13T16:00:44.546 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.260+0000 7ff001400640 1 --2- 172.21.15.86:0/1466775457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feffc108f80 0x7feffc109380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feff0009820 tx=0x7feff002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5e896b47a98238 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:44.546 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.261+0000 7feffbe00640 1 -- 172.21.15.86:0/1466775457 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feff002ae70 con 0x7feffc108f80 2024-09-13T16:00:44.546 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.261+0000 7feffbe00640 1 -- 172.21.15.86:0/1466775457 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7feff0032900 con 0x7feffc108f80 2024-09-13T16:00:44.546 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.261+0000 7feffbe00640 1 -- 172.21.15.86:0/1466775457 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feff00309d0 con 0x7feffc108f80 2024-09-13T16:00:44.547 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.261+0000 7ff003e00640 1 -- 172.21.15.86:0/1466775457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feffc108f80 msgr2=0x7feffc109380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:44.547 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.261+0000 7ff003e00640 1 --2- 172.21.15.86:0/1466775457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feffc108f80 0x7feffc109380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feff0009820 tx=0x7feff002a270 comp rx=0 tx=0).stop 2024-09-13T16:00:44.547 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.261+0000 7ff003e00640 1 -- 172.21.15.86:0/1466775457 shutdown_connections 2024-09-13T16:00:44.547 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.261+0000 7ff003e00640 1 --2- 172.21.15.86:0/1466775457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feffc108f80 0x7feffc109380 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:44.547 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.261+0000 7ff003e00640 1 -- 172.21.15.86:0/1466775457 >> 172.21.15.86:0/1466775457 conn(0x7feffc07af70 msgr2=0x7feffc07b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:44.547 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.261+0000 7ff003e00640 1 -- 172.21.15.86:0/1466775457 shutdown_connections 2024-09-13T16:00:44.547 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.261+0000 7ff003e00640 1 -- 172.21.15.86:0/1466775457 wait complete. 2024-09-13T16:00:44.547 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.262+0000 7ff003e00640 1 Processor -- start 2024-09-13T16:00:44.548 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.262+0000 7ff003e00640 1 -- start start 2024-09-13T16:00:44.548 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.263+0000 7ff003e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feffc108f80 0x7feffc19b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:44.548 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.263+0000 7ff003e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc19bc90 con 0x7feffc108f80 2024-09-13T16:00:44.548 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.263+0000 7ff001400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feffc108f80 0x7feffc19b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:44.548 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.263+0000 7ff001400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feffc108f80 0x7feffc19b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45354/0 (socket says 172.21.15.86:45354) 2024-09-13T16:00:44.548 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.263+0000 7ff001400640 1 -- 172.21.15.86:0/2664211537 learned_addr learned my addr 172.21.15.86:0/2664211537 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:44.548 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.263+0000 7ff001400640 1 -- 172.21.15.86:0/2664211537 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff00094d0 con 0x7feffc108f80 2024-09-13T16:00:44.549 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.263+0000 7ff001400640 1 --2- 172.21.15.86:0/2664211537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feffc108f80 0x7feffc19b750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feff00097f0 tx=0x7feff0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:44.549 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.264+0000 7feffa000640 1 -- 172.21.15.86:0/2664211537 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feff0032db0 con 0x7feffc108f80 2024-09-13T16:00:44.549 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.264+0000 7feffa000640 1 -- 172.21.15.86:0/2664211537 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7feff003b8f0 con 0x7feffc108f80 2024-09-13T16:00:44.549 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.264+0000 7ff003e00640 1 -- 172.21.15.86:0/2664211537 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feffc19be90 con 0x7feffc108f80 2024-09-13T16:00:44.549 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.264+0000 7feffa000640 1 -- 172.21.15.86:0/2664211537 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feff003a6e0 con 0x7feffc108f80 2024-09-13T16:00:44.549 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.264+0000 7ff003e00640 1 -- 172.21.15.86:0/2664211537 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feffc19c330 con 0x7feffc108f80 2024-09-13T16:00:44.549 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.265+0000 7feffa000640 1 -- 172.21.15.86:0/2664211537 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7feff0039040 con 0x7feffc108f80 2024-09-13T16:00:44.549 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.265+0000 7ff003e00640 1 -- 172.21.15.86:0/2664211537 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feffc1089b0 con 0x7feffc108f80 2024-09-13T16:00:44.550 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.265+0000 7feffa000640 1 --2- 172.21.15.86:0/2664211537 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fefe4038670 0x7fefe403ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:44.550 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.265+0000 7feffa000640 1 -- 172.21.15.86:0/2664211537 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7feff006b950 con 0x7feffc108f80 2024-09-13T16:00:44.550 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.266+0000 7ff000a00640 1 --2- 172.21.15.86:0/2664211537 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fefe4038670 0x7fefe403ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:44.550 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.266+0000 7ff000a00640 1 --2- 172.21.15.86:0/2664211537 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fefe4038670 0x7fefe403ab30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fefe80098c0 tx=0x7fefe8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:44.550 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.270+0000 7feffa000640 1 -- 172.21.15.86:0/2664211537 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feff00318f0 con 0x7feffc108f80 2024-09-13T16:00:44.550 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:40.447+0000 7ff003e00640 1 -- 172.21.15.86:0/2664211537 --> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi086", "addr": "172.21.15.86", "target": ["mon-mgr", ""]}) v1 -- 0x7feffc1064e0 con 0x7fefe4038670 2024-09-13T16:00:44.550 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:43.816+0000 7feffa000640 1 -- 172.21.15.86:0/2664211537 <== mgr.14118 v2:172.21.15.86:6800/3020585994 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7feffc1064e0 con 0x7fefe4038670 2024-09-13T16:00:44.551 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:43.819+0000 7ff003e00640 1 -- 172.21.15.86:0/2664211537 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fefe4038670 msgr2=0x7fefe403ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:44.551 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:43.819+0000 7ff003e00640 1 --2- 172.21.15.86:0/2664211537 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fefe4038670 0x7fefe403ab30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fefe80098c0 tx=0x7fefe8006db0 comp rx=0 tx=0).stop 2024-09-13T16:00:44.551 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:43.819+0000 7ff003e00640 1 -- 172.21.15.86:0/2664211537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feffc108f80 msgr2=0x7feffc19b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:44.551 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:43.819+0000 7ff003e00640 1 --2- 172.21.15.86:0/2664211537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feffc108f80 0x7feffc19b750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feff00097f0 tx=0x7feff0032670 comp rx=0 tx=0).stop 2024-09-13T16:00:44.551 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:43.819+0000 7ff003e00640 1 -- 172.21.15.86:0/2664211537 shutdown_connections 2024-09-13T16:00:44.551 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:43.819+0000 7ff003e00640 1 --2- 172.21.15.86:0/2664211537 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fefe4038670 0x7fefe403ab30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:44.551 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:43.819+0000 7ff003e00640 1 --2- 172.21.15.86:0/2664211537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feffc108f80 0x7feffc19b750 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:44.551 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:43.819+0000 7ff003e00640 1 -- 172.21.15.86:0/2664211537 >> 172.21.15.86:0/2664211537 conn(0x7feffc07af70 msgr2=0x7feffc105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:44.551 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:43.819+0000 7ff003e00640 1 -- 172.21.15.86:0/2664211537 shutdown_connections 2024-09-13T16:00:44.552 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:43.819+0000 7ff003e00640 1 -- 172.21.15.86:0/2664211537 wait complete. 2024-09-13T16:00:44.552 INFO:teuthology.orchestra.run.smithi086.stdout:Deploying unmanaged mon service... 2024-09-13T16:00:45.104 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:44 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' 2024-09-13T16:00:45.105 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:44 smithi086 ceph-mon[30379]: Added host smithi086 2024-09-13T16:00:45.105 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:44 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:00:46.897 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-13T16:00:46.897 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.625+0000 7ffb77e00640 1 Processor -- start 2024-09-13T16:00:46.897 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.625+0000 7ffb77e00640 1 -- start start 2024-09-13T16:00:46.897 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.625+0000 7ffb77e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb781055e0 0x7ffb781059e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:46.897 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.626+0000 7ffb77e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78105f20 con 0x7ffb781055e0 2024-09-13T16:00:46.898 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.626+0000 7ffb76a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb781055e0 0x7ffb781059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:46.898 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.626+0000 7ffb76a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb781055e0 0x7ffb781059e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59222/0 (socket says 172.21.15.86:59222) 2024-09-13T16:00:46.898 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.626+0000 7ffb76a00640 1 -- 172.21.15.86:0/590218536 learned_addr learned my addr 172.21.15.86:0/590218536 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:46.898 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.626+0000 7ffb76a00640 1 -- 172.21.15.86:0/590218536 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb78106060 con 0x7ffb781055e0 2024-09-13T16:00:46.898 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.627+0000 7ffb76a00640 1 --2- 172.21.15.86:0/590218536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb781055e0 0x7ffb781059e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009820 tx=0x7ffb6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0403e05b28c6ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:46.898 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.628+0000 7ffb75600640 1 -- 172.21.15.86:0/590218536 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb6802ae70 con 0x7ffb781055e0 2024-09-13T16:00:46.898 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.628+0000 7ffb75600640 1 -- 172.21.15.86:0/590218536 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7ffb68032900 con 0x7ffb781055e0 2024-09-13T16:00:46.898 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.628+0000 7ffb75600640 1 -- 172.21.15.86:0/590218536 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb680309d0 con 0x7ffb781055e0 2024-09-13T16:00:46.898 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.628+0000 7ffb77e00640 1 -- 172.21.15.86:0/590218536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb781055e0 msgr2=0x7ffb781059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:46.898 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.628+0000 7ffb77e00640 1 --2- 172.21.15.86:0/590218536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb781055e0 0x7ffb781059e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009820 tx=0x7ffb6802a270 comp rx=0 tx=0).stop 2024-09-13T16:00:46.898 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.629+0000 7ffb77e00640 1 -- 172.21.15.86:0/590218536 shutdown_connections 2024-09-13T16:00:46.898 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.629+0000 7ffb77e00640 1 --2- 172.21.15.86:0/590218536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb781055e0 0x7ffb781059e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:46.898 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.629+0000 7ffb77e00640 1 -- 172.21.15.86:0/590218536 >> 172.21.15.86:0/590218536 conn(0x7ffb78100e10 msgr2=0x7ffb78103250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:46.899 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.629+0000 7ffb77e00640 1 -- 172.21.15.86:0/590218536 shutdown_connections 2024-09-13T16:00:46.899 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.629+0000 7ffb77e00640 1 -- 172.21.15.86:0/590218536 wait complete. 2024-09-13T16:00:46.899 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.630+0000 7ffb77e00640 1 Processor -- start 2024-09-13T16:00:46.899 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.630+0000 7ffb77e00640 1 -- start start 2024-09-13T16:00:46.899 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.630+0000 7ffb77e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb781055e0 0x7ffb781992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:46.899 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.630+0000 7ffb77e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78199830 con 0x7ffb781055e0 2024-09-13T16:00:46.899 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.630+0000 7ffb76a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb781055e0 0x7ffb781992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:46.899 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.630+0000 7ffb76a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb781055e0 0x7ffb781992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59228/0 (socket says 172.21.15.86:59228) 2024-09-13T16:00:46.899 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.630+0000 7ffb76a00640 1 -- 172.21.15.86:0/605019603 learned_addr learned my addr 172.21.15.86:0/605019603 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:46.899 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.631+0000 7ffb76a00640 1 -- 172.21.15.86:0/605019603 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb680094d0 con 0x7ffb781055e0 2024-09-13T16:00:46.899 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.631+0000 7ffb76a00640 1 --2- 172.21.15.86:0/605019603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb781055e0 0x7ffb781992f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffb68006f10 tx=0x7ffb68032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:46.899 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.631+0000 7ffb6f400640 1 -- 172.21.15.86:0/605019603 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb68032c80 con 0x7ffb781055e0 2024-09-13T16:00:46.899 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.631+0000 7ffb6f400640 1 -- 172.21.15.86:0/605019603 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7ffb68032de0 con 0x7ffb781055e0 2024-09-13T16:00:46.900 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.631+0000 7ffb77e00640 1 -- 172.21.15.86:0/605019603 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb78199a30 con 0x7ffb781055e0 2024-09-13T16:00:46.900 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.631+0000 7ffb6f400640 1 -- 172.21.15.86:0/605019603 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb6803a6d0 con 0x7ffb781055e0 2024-09-13T16:00:46.900 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.631+0000 7ffb77e00640 1 -- 172.21.15.86:0/605019603 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb78199ed0 con 0x7ffb781055e0 2024-09-13T16:00:46.900 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.632+0000 7ffb77e00640 1 -- 172.21.15.86:0/605019603 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb78107470 con 0x7ffb781055e0 2024-09-13T16:00:46.900 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.633+0000 7ffb6f400640 1 -- 172.21.15.86:0/605019603 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7ffb68039040 con 0x7ffb781055e0 2024-09-13T16:00:46.900 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.633+0000 7ffb6f400640 1 --2- 172.21.15.86:0/605019603 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7ffb5c038670 0x7ffb5c03ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:46.900 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.633+0000 7ffb6f400640 1 -- 172.21.15.86:0/605019603 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ffb6806b990 con 0x7ffb781055e0 2024-09-13T16:00:46.901 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.633+0000 7ffb76000640 1 --2- 172.21.15.86:0/605019603 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7ffb5c038670 0x7ffb5c03ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:46.901 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.634+0000 7ffb76000640 1 --2- 172.21.15.86:0/605019603 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7ffb5c038670 0x7ffb5c03ab30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffb640098c0 tx=0x7ffb64006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:46.901 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.638+0000 7ffb6f400640 1 -- 172.21.15.86:0/605019603 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffb68031580 con 0x7ffb781055e0 2024-09-13T16:00:46.901 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.831+0000 7ffb77e00640 1 -- 172.21.15.86:0/605019603 --> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7ffb78102100 con 0x7ffb5c038670 2024-09-13T16:00:46.901 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.837+0000 7ffb6f400640 1 -- 172.21.15.86:0/605019603 <== mgr.14118 v2:172.21.15.86:6800/3020585994 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ffb78102100 con 0x7ffb5c038670 2024-09-13T16:00:46.901 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.839+0000 7ffb77e00640 1 -- 172.21.15.86:0/605019603 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7ffb5c038670 msgr2=0x7ffb5c03ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:46.901 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.839+0000 7ffb77e00640 1 --2- 172.21.15.86:0/605019603 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7ffb5c038670 0x7ffb5c03ab30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffb640098c0 tx=0x7ffb64006db0 comp rx=0 tx=0).stop 2024-09-13T16:00:46.901 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.839+0000 7ffb77e00640 1 -- 172.21.15.86:0/605019603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb781055e0 msgr2=0x7ffb781992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:46.901 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.839+0000 7ffb77e00640 1 --2- 172.21.15.86:0/605019603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb781055e0 0x7ffb781992f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffb68006f10 tx=0x7ffb68032670 comp rx=0 tx=0).stop 2024-09-13T16:00:46.901 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.839+0000 7ffb77e00640 1 -- 172.21.15.86:0/605019603 shutdown_connections 2024-09-13T16:00:46.901 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.839+0000 7ffb77e00640 1 --2- 172.21.15.86:0/605019603 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7ffb5c038670 0x7ffb5c03ab30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:46.901 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.839+0000 7ffb77e00640 1 --2- 172.21.15.86:0/605019603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb781055e0 0x7ffb781992f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:46.901 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.839+0000 7ffb77e00640 1 -- 172.21.15.86:0/605019603 >> 172.21.15.86:0/605019603 conn(0x7ffb78100e10 msgr2=0x7ffb781019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:46.902 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.839+0000 7ffb77e00640 1 -- 172.21.15.86:0/605019603 shutdown_connections 2024-09-13T16:00:46.902 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:45.839+0000 7ffb77e00640 1 -- 172.21.15.86:0/605019603 wait complete. 2024-09-13T16:00:46.902 INFO:teuthology.orchestra.run.smithi086.stdout:Deploying unmanaged mgr service... 2024-09-13T16:00:47.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:46 smithi086 ceph-mon[30379]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:00:47.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:46 smithi086 ceph-mon[30379]: Saving service mon spec with placement count:5 2024-09-13T16:00:47.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:46 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' 2024-09-13T16:00:47.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:46 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' 2024-09-13T16:00:47.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:46 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' 2024-09-13T16:00:48.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:48 smithi086 ceph-mon[30379]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:00:48.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:48 smithi086 ceph-mon[30379]: Saving service mgr spec with placement count:2 2024-09-13T16:00:48.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:48 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' 2024-09-13T16:00:48.946 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-13T16:00:48.946 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.406+0000 7f5fd1e00640 1 Processor -- start 2024-09-13T16:00:48.946 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.406+0000 7f5fd1e00640 1 -- start start 2024-09-13T16:00:48.946 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.407+0000 7f5fd1e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc105680 0x7f5fcc105a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:48.946 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.407+0000 7f5fd1e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc106050 con 0x7f5fcc105680 2024-09-13T16:00:48.947 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.407+0000 7f5fd0a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc105680 0x7f5fcc105a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:48.947 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.407+0000 7f5fd0a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc105680 0x7f5fcc105a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59240/0 (socket says 172.21.15.86:59240) 2024-09-13T16:00:48.947 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.407+0000 7f5fd0a00640 1 -- 172.21.15.86:0/2571001181 learned_addr learned my addr 172.21.15.86:0/2571001181 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:48.947 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.408+0000 7f5fd0a00640 1 -- 172.21.15.86:0/2571001181 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc106880 con 0x7f5fcc105680 2024-09-13T16:00:48.947 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.409+0000 7f5fd0a00640 1 --2- 172.21.15.86:0/2571001181 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc105680 0x7f5fcc105a80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009820 tx=0x7f5fbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca1c88d3067e49e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:48.947 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.409+0000 7f5fcb400640 1 -- 172.21.15.86:0/2571001181 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fbc02ae70 con 0x7f5fcc105680 2024-09-13T16:00:48.947 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.409+0000 7f5fcb400640 1 -- 172.21.15.86:0/2571001181 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5fbc032920 con 0x7f5fcc105680 2024-09-13T16:00:48.947 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.409+0000 7f5fcb400640 1 -- 172.21.15.86:0/2571001181 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fbc030920 con 0x7f5fcc105680 2024-09-13T16:00:48.948 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.409+0000 7f5fd1e00640 1 -- 172.21.15.86:0/2571001181 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc105680 msgr2=0x7f5fcc105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:48.948 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.409+0000 7f5fd1e00640 1 --2- 172.21.15.86:0/2571001181 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc105680 0x7f5fcc105a80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009820 tx=0x7f5fbc02a270 comp rx=0 tx=0).stop 2024-09-13T16:00:48.948 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.410+0000 7f5fd1e00640 1 -- 172.21.15.86:0/2571001181 shutdown_connections 2024-09-13T16:00:48.948 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.410+0000 7f5fd1e00640 1 --2- 172.21.15.86:0/2571001181 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc105680 0x7f5fcc105a80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:48.948 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.410+0000 7f5fd1e00640 1 -- 172.21.15.86:0/2571001181 >> 172.21.15.86:0/2571001181 conn(0x7f5fcc100e70 msgr2=0x7f5fcc103290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:48.948 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.410+0000 7f5fd1e00640 1 -- 172.21.15.86:0/2571001181 shutdown_connections 2024-09-13T16:00:48.948 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.410+0000 7f5fd1e00640 1 -- 172.21.15.86:0/2571001181 wait complete. 2024-09-13T16:00:48.948 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.411+0000 7f5fd1e00640 1 Processor -- start 2024-09-13T16:00:48.948 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.411+0000 7f5fd1e00640 1 -- start start 2024-09-13T16:00:48.948 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.411+0000 7f5fd1e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc105680 0x7f5fcc19b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:48.948 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.411+0000 7f5fd1e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc19bbb0 con 0x7f5fcc105680 2024-09-13T16:00:48.948 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.411+0000 7f5fd0a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc105680 0x7f5fcc19b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:48.949 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.411+0000 7f5fd0a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc105680 0x7f5fcc19b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59248/0 (socket says 172.21.15.86:59248) 2024-09-13T16:00:48.949 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.411+0000 7f5fd0a00640 1 -- 172.21.15.86:0/953651715 learned_addr learned my addr 172.21.15.86:0/953651715 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:48.949 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.412+0000 7f5fd0a00640 1 -- 172.21.15.86:0/953651715 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fbc0094d0 con 0x7f5fcc105680 2024-09-13T16:00:48.949 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.412+0000 7f5fd0a00640 1 --2- 172.21.15.86:0/953651715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc105680 0x7f5fcc19b670 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc030460 tx=0x7f5fbc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:48.949 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.412+0000 7f5fc9600640 1 -- 172.21.15.86:0/953651715 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fbc032dd0 con 0x7f5fcc105680 2024-09-13T16:00:48.949 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.412+0000 7f5fc9600640 1 -- 172.21.15.86:0/953651715 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5fbc03b910 con 0x7f5fcc105680 2024-09-13T16:00:48.949 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.412+0000 7f5fc9600640 1 -- 172.21.15.86:0/953651715 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fbc03a820 con 0x7f5fcc105680 2024-09-13T16:00:48.949 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.412+0000 7f5fd1e00640 1 -- 172.21.15.86:0/953651715 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fcc19bdb0 con 0x7f5fcc105680 2024-09-13T16:00:48.949 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.413+0000 7f5fd1e00640 1 -- 172.21.15.86:0/953651715 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fcc19c250 con 0x7f5fcc105680 2024-09-13T16:00:48.949 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.414+0000 7f5fc9600640 1 -- 172.21.15.86:0/953651715 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f5fbc039040 con 0x7f5fcc105680 2024-09-13T16:00:48.949 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.414+0000 7f5fc9600640 1 --2- 172.21.15.86:0/953651715 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f5fb0038670 0x7f5fb003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:48.949 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.414+0000 7f5fd1e00640 1 -- 172.21.15.86:0/953651715 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fcc109ab0 con 0x7f5fcc105680 2024-09-13T16:00:48.949 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.414+0000 7f5fc9600640 1 -- 172.21.15.86:0/953651715 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5fbc06b8f0 con 0x7f5fcc105680 2024-09-13T16:00:48.950 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.415+0000 7f5fcbe00640 1 --2- 172.21.15.86:0/953651715 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f5fb0038670 0x7f5fb003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:48.950 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.415+0000 7f5fcbe00640 1 --2- 172.21.15.86:0/953651715 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f5fb0038670 0x7f5fb003ab30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5fb80098c0 tx=0x7f5fb8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:48.950 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.419+0000 7f5fc9600640 1 -- 172.21.15.86:0/953651715 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5fbc0313a0 con 0x7f5fcc105680 2024-09-13T16:00:48.950 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.627+0000 7f5fd1e00640 1 -- 172.21.15.86:0/953651715 --> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f5fcc19eb30 con 0x7f5fb0038670 2024-09-13T16:00:48.950 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.632+0000 7f5fc9600640 1 -- 172.21.15.86:0/953651715 <== mgr.14118 v2:172.21.15.86:6800/3020585994 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f5fcc19eb30 con 0x7f5fb0038670 2024-09-13T16:00:48.950 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.634+0000 7f5fd1e00640 1 -- 172.21.15.86:0/953651715 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f5fb0038670 msgr2=0x7f5fb003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:48.950 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.634+0000 7f5fd1e00640 1 --2- 172.21.15.86:0/953651715 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f5fb0038670 0x7f5fb003ab30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5fb80098c0 tx=0x7f5fb8006db0 comp rx=0 tx=0).stop 2024-09-13T16:00:48.950 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.634+0000 7f5fd1e00640 1 -- 172.21.15.86:0/953651715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc105680 msgr2=0x7f5fcc19b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:48.950 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.634+0000 7f5fd1e00640 1 --2- 172.21.15.86:0/953651715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc105680 0x7f5fcc19b670 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc030460 tx=0x7f5fbc032670 comp rx=0 tx=0).stop 2024-09-13T16:00:48.950 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.634+0000 7f5fd1e00640 1 -- 172.21.15.86:0/953651715 shutdown_connections 2024-09-13T16:00:48.950 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.634+0000 7f5fd1e00640 1 --2- 172.21.15.86:0/953651715 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f5fb0038670 0x7f5fb003ab30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:48.950 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.634+0000 7f5fd1e00640 1 --2- 172.21.15.86:0/953651715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc105680 0x7f5fcc19b670 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:48.950 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.634+0000 7f5fd1e00640 1 -- 172.21.15.86:0/953651715 >> 172.21.15.86:0/953651715 conn(0x7f5fcc100e70 msgr2=0x7f5fcc101950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:48.951 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.635+0000 7f5fd1e00640 1 -- 172.21.15.86:0/953651715 shutdown_connections 2024-09-13T16:00:48.951 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:47.635+0000 7f5fd1e00640 1 -- 172.21.15.86:0/953651715 wait complete. 2024-09-13T16:00:50.045 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:49 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' 2024-09-13T16:00:50.388 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.480+0000 7fbd4ca00640 1 Processor -- start 2024-09-13T16:00:50.388 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.480+0000 7fbd4ca00640 1 -- start start 2024-09-13T16:00:50.389 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.481+0000 7fbd4ca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd48108fd0 0x7fbd481093d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:50.389 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.481+0000 7fbd4ca00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd481099a0 con 0x7fbd48108fd0 2024-09-13T16:00:50.389 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.481+0000 7fbd45e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd48108fd0 0x7fbd481093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:50.389 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.481+0000 7fbd45e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd48108fd0 0x7fbd481093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59256/0 (socket says 172.21.15.86:59256) 2024-09-13T16:00:50.389 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.481+0000 7fbd45e00640 1 -- 172.21.15.86:0/3280456795 learned_addr learned my addr 172.21.15.86:0/3280456795 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:50.389 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.482+0000 7fbd45e00640 1 -- 172.21.15.86:0/3280456795 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd48109ae0 con 0x7fbd48108fd0 2024-09-13T16:00:50.389 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.482+0000 7fbd45e00640 1 --2- 172.21.15.86:0/3280456795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd48108fd0 0x7fbd481093d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009e80 tx=0x7fbd4002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d658b99f5ca5b2f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:50.389 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.483+0000 7fbd44a00640 1 -- 172.21.15.86:0/3280456795 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd40031400 con 0x7fbd48108fd0 2024-09-13T16:00:50.389 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.483+0000 7fbd44a00640 1 -- 172.21.15.86:0/3280456795 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbd4002d050 con 0x7fbd48108fd0 2024-09-13T16:00:50.389 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.483+0000 7fbd44a00640 1 -- 172.21.15.86:0/3280456795 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd400079b0 con 0x7fbd48108fd0 2024-09-13T16:00:50.389 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.484+0000 7fbd4ca00640 1 -- 172.21.15.86:0/3280456795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd48108fd0 msgr2=0x7fbd481093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:50.389 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.484+0000 7fbd4ca00640 1 --2- 172.21.15.86:0/3280456795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd48108fd0 0x7fbd481093d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009e80 tx=0x7fbd4002a7a0 comp rx=0 tx=0).stop 2024-09-13T16:00:50.389 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.484+0000 7fbd4ca00640 1 -- 172.21.15.86:0/3280456795 shutdown_connections 2024-09-13T16:00:50.390 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.484+0000 7fbd4ca00640 1 --2- 172.21.15.86:0/3280456795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd48108fd0 0x7fbd481093d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:50.390 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.484+0000 7fbd4ca00640 1 -- 172.21.15.86:0/3280456795 >> 172.21.15.86:0/3280456795 conn(0x7fbd4807b060 msgr2=0x7fbd4807b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:50.390 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.484+0000 7fbd4ca00640 1 -- 172.21.15.86:0/3280456795 shutdown_connections 2024-09-13T16:00:50.390 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.484+0000 7fbd4ca00640 1 -- 172.21.15.86:0/3280456795 wait complete. 2024-09-13T16:00:50.390 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.485+0000 7fbd4ca00640 1 Processor -- start 2024-09-13T16:00:50.390 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.485+0000 7fbd4ca00640 1 -- start start 2024-09-13T16:00:50.390 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.485+0000 7fbd4ca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd48108fd0 0x7fbd4819b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:50.390 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.485+0000 7fbd4ca00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4819bcf0 con 0x7fbd48108fd0 2024-09-13T16:00:50.390 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.485+0000 7fbd45e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd48108fd0 0x7fbd4819b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:50.390 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.486+0000 7fbd45e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd48108fd0 0x7fbd4819b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59268/0 (socket says 172.21.15.86:59268) 2024-09-13T16:00:50.390 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.486+0000 7fbd45e00640 1 -- 172.21.15.86:0/843441545 learned_addr learned my addr 172.21.15.86:0/843441545 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:50.390 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.486+0000 7fbd45e00640 1 -- 172.21.15.86:0/843441545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd40009b30 con 0x7fbd48108fd0 2024-09-13T16:00:50.391 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.486+0000 7fbd45e00640 1 --2- 172.21.15.86:0/843441545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd48108fd0 0x7fbd4819b7b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbd400319a0 tx=0x7fbd400319d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:50.391 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.487+0000 7fbd3ea00640 1 -- 172.21.15.86:0/843441545 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd40031e50 con 0x7fbd48108fd0 2024-09-13T16:00:50.391 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.487+0000 7fbd3ea00640 1 -- 172.21.15.86:0/843441545 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbd4003b8f0 con 0x7fbd48108fd0 2024-09-13T16:00:50.391 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.487+0000 7fbd3ea00640 1 -- 172.21.15.86:0/843441545 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd4003a9a0 con 0x7fbd48108fd0 2024-09-13T16:00:50.391 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.487+0000 7fbd4ca00640 1 -- 172.21.15.86:0/843441545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4819bef0 con 0x7fbd48108fd0 2024-09-13T16:00:50.391 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.487+0000 7fbd4ca00640 1 -- 172.21.15.86:0/843441545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4819c390 con 0x7fbd48108fd0 2024-09-13T16:00:50.391 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.488+0000 7fbd3ea00640 1 -- 172.21.15.86:0/843441545 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fbd40038050 con 0x7fbd48108fd0 2024-09-13T16:00:50.391 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.488+0000 7fbd4ca00640 1 -- 172.21.15.86:0/843441545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4810bf10 con 0x7fbd48108fd0 2024-09-13T16:00:50.391 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.488+0000 7fbd3ea00640 1 --2- 172.21.15.86:0/843441545 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fbd2c038670 0x7fbd2c03ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:50.391 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.488+0000 7fbd3ea00640 1 -- 172.21.15.86:0/843441545 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbd4006c010 con 0x7fbd48108fd0 2024-09-13T16:00:50.391 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.489+0000 7fbd45400640 1 --2- 172.21.15.86:0/843441545 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fbd2c038670 0x7fbd2c03ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:50.391 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.490+0000 7fbd45400640 1 --2- 172.21.15.86:0/843441545 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fbd2c038670 0x7fbd2c03ab30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbd340098c0 tx=0x7fbd34006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:50.391 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.494+0000 7fbd3ea00640 1 -- 172.21.15.86:0/843441545 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbd400384e0 con 0x7fbd48108fd0 2024-09-13T16:00:50.392 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.673+0000 7fbd4ca00640 1 -- 172.21.15.86:0/843441545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fbd4819ec70 con 0x7fbd48108fd0 2024-09-13T16:00:50.392 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.678+0000 7fbd3ea00640 1 -- 172.21.15.86:0/843441545 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fbd40041020 con 0x7fbd48108fd0 2024-09-13T16:00:50.392 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.680+0000 7fbd4ca00640 1 -- 172.21.15.86:0/843441545 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fbd2c038670 msgr2=0x7fbd2c03ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:50.392 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.680+0000 7fbd4ca00640 1 --2- 172.21.15.86:0/843441545 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fbd2c038670 0x7fbd2c03ab30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbd340098c0 tx=0x7fbd34006db0 comp rx=0 tx=0).stop 2024-09-13T16:00:50.392 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.680+0000 7fbd4ca00640 1 -- 172.21.15.86:0/843441545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd48108fd0 msgr2=0x7fbd4819b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:50.392 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.680+0000 7fbd4ca00640 1 --2- 172.21.15.86:0/843441545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd48108fd0 0x7fbd4819b7b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbd400319a0 tx=0x7fbd400319d0 comp rx=0 tx=0).stop 2024-09-13T16:00:50.392 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.681+0000 7fbd4ca00640 1 -- 172.21.15.86:0/843441545 shutdown_connections 2024-09-13T16:00:50.392 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.681+0000 7fbd4ca00640 1 --2- 172.21.15.86:0/843441545 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fbd2c038670 0x7fbd2c03ab30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:50.392 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.681+0000 7fbd4ca00640 1 --2- 172.21.15.86:0/843441545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd48108fd0 0x7fbd4819b7b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:50.392 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.681+0000 7fbd4ca00640 1 -- 172.21.15.86:0/843441545 >> 172.21.15.86:0/843441545 conn(0x7fbd4807b060 msgr2=0x7fbd48105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:50.392 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.681+0000 7fbd4ca00640 1 -- 172.21.15.86:0/843441545 shutdown_connections 2024-09-13T16:00:50.392 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:49.681+0000 7fbd4ca00640 1 -- 172.21.15.86:0/843441545 wait complete. 2024-09-13T16:00:50.927 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:50 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/843441545' entity='client.admin' 2024-09-13T16:00:50.927 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:50 smithi086 ceph-mon[30379]: from='mgr.14118 172.21.15.86:0/1152155267' entity='mgr.x' 2024-09-13T16:00:52.324 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:52 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/365073175' entity='client.admin' 2024-09-13T16:00:52.334 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.920+0000 7fd039a00640 1 Processor -- start 2024-09-13T16:00:52.335 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.920+0000 7fd039a00640 1 -- start start 2024-09-13T16:00:52.335 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.920+0000 7fd039a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd034108f80 0x7fd034109380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:52.335 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.920+0000 7fd039a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0341098c0 con 0x7fd034108f80 2024-09-13T16:00:52.335 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.920+0000 7fd032a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd034108f80 0x7fd034109380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:52.335 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.921+0000 7fd032a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd034108f80 0x7fd034109380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59272/0 (socket says 172.21.15.86:59272) 2024-09-13T16:00:52.335 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.921+0000 7fd032a00640 1 -- 172.21.15.86:0/1614354037 learned_addr learned my addr 172.21.15.86:0/1614354037 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:52.335 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.921+0000 7fd032a00640 1 -- 172.21.15.86:0/1614354037 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd034109a00 con 0x7fd034108f80 2024-09-13T16:00:52.335 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.922+0000 7fd032a00640 1 --2- 172.21.15.86:0/1614354037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd034108f80 0x7fd034109380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd024009820 tx=0x7fd02402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d89e1617843d79 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:52.335 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.922+0000 7fd031600640 1 -- 172.21.15.86:0/1614354037 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd02402ae70 con 0x7fd034108f80 2024-09-13T16:00:52.335 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.922+0000 7fd031600640 1 -- 172.21.15.86:0/1614354037 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd024032920 con 0x7fd034108f80 2024-09-13T16:00:52.335 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.922+0000 7fd031600640 1 -- 172.21.15.86:0/1614354037 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd024030920 con 0x7fd034108f80 2024-09-13T16:00:52.336 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.923+0000 7fd039a00640 1 -- 172.21.15.86:0/1614354037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd034108f80 msgr2=0x7fd034109380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:52.336 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.923+0000 7fd039a00640 1 --2- 172.21.15.86:0/1614354037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd034108f80 0x7fd034109380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd024009820 tx=0x7fd02402a270 comp rx=0 tx=0).stop 2024-09-13T16:00:52.336 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.923+0000 7fd039a00640 1 -- 172.21.15.86:0/1614354037 shutdown_connections 2024-09-13T16:00:52.336 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.923+0000 7fd039a00640 1 --2- 172.21.15.86:0/1614354037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd034108f80 0x7fd034109380 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:52.336 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.923+0000 7fd039a00640 1 -- 172.21.15.86:0/1614354037 >> 172.21.15.86:0/1614354037 conn(0x7fd03407b090 msgr2=0x7fd03407b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:52.336 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.923+0000 7fd039a00640 1 -- 172.21.15.86:0/1614354037 shutdown_connections 2024-09-13T16:00:52.336 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.923+0000 7fd039a00640 1 -- 172.21.15.86:0/1614354037 wait complete. 2024-09-13T16:00:52.336 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.924+0000 7fd039a00640 1 Processor -- start 2024-09-13T16:00:52.336 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.924+0000 7fd039a00640 1 -- start start 2024-09-13T16:00:52.336 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.924+0000 7fd039a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd034108f80 0x7fd03419b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:52.336 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.924+0000 7fd039a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03419bc70 con 0x7fd034108f80 2024-09-13T16:00:52.336 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.925+0000 7fd032a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd034108f80 0x7fd03419b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:52.336 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.925+0000 7fd032a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd034108f80 0x7fd03419b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59274/0 (socket says 172.21.15.86:59274) 2024-09-13T16:00:52.337 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.925+0000 7fd032a00640 1 -- 172.21.15.86:0/365073175 learned_addr learned my addr 172.21.15.86:0/365073175 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:52.337 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.925+0000 7fd032a00640 1 -- 172.21.15.86:0/365073175 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0240094d0 con 0x7fd034108f80 2024-09-13T16:00:52.337 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.925+0000 7fd032a00640 1 --2- 172.21.15.86:0/365073175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd034108f80 0x7fd03419b730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd024030460 tx=0x7fd024032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:52.337 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.925+0000 7fd02b400640 1 -- 172.21.15.86:0/365073175 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd024032dd0 con 0x7fd034108f80 2024-09-13T16:00:52.337 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.926+0000 7fd02b400640 1 -- 172.21.15.86:0/365073175 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd02403b910 con 0x7fd034108f80 2024-09-13T16:00:52.337 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.926+0000 7fd02b400640 1 -- 172.21.15.86:0/365073175 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd02403a820 con 0x7fd034108f80 2024-09-13T16:00:52.337 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.926+0000 7fd039a00640 1 -- 172.21.15.86:0/365073175 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd03419be70 con 0x7fd034108f80 2024-09-13T16:00:52.337 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.926+0000 7fd039a00640 1 -- 172.21.15.86:0/365073175 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd03419c310 con 0x7fd034108f80 2024-09-13T16:00:52.337 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.927+0000 7fd02b400640 1 -- 172.21.15.86:0/365073175 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fd024039040 con 0x7fd034108f80 2024-09-13T16:00:52.337 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.927+0000 7fd039a00640 1 -- 172.21.15.86:0/365073175 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd034108930 con 0x7fd034108f80 2024-09-13T16:00:52.337 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.927+0000 7fd02b400640 1 --2- 172.21.15.86:0/365073175 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fd018038670 0x7fd01803ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:52.337 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.927+0000 7fd02b400640 1 -- 172.21.15.86:0/365073175 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd02406b8f0 con 0x7fd034108f80 2024-09-13T16:00:52.338 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.928+0000 7fd032000640 1 --2- 172.21.15.86:0/365073175 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fd018038670 0x7fd01803ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:52.338 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.928+0000 7fd032000640 1 --2- 172.21.15.86:0/365073175 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fd018038670 0x7fd01803ab30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd0200098c0 tx=0x7fd020006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:52.338 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:50.932+0000 7fd02b400640 1 -- 172.21.15.86:0/365073175 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd024031580 con 0x7fd034108f80 2024-09-13T16:00:52.338 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:51.124+0000 7fd039a00640 1 -- 172.21.15.86:0/365073175 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fd03419ebf0 con 0x7fd034108f80 2024-09-13T16:00:52.338 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:51.128+0000 7fd02b400640 1 -- 172.21.15.86:0/365073175 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fd02403f030 con 0x7fd034108f80 2024-09-13T16:00:52.338 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:51.130+0000 7fd039a00640 1 -- 172.21.15.86:0/365073175 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fd018038670 msgr2=0x7fd01803ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:52.338 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:51.130+0000 7fd039a00640 1 --2- 172.21.15.86:0/365073175 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fd018038670 0x7fd01803ab30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd0200098c0 tx=0x7fd020006db0 comp rx=0 tx=0).stop 2024-09-13T16:00:52.338 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:51.130+0000 7fd039a00640 1 -- 172.21.15.86:0/365073175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd034108f80 msgr2=0x7fd03419b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:52.338 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:51.130+0000 7fd039a00640 1 --2- 172.21.15.86:0/365073175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd034108f80 0x7fd03419b730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd024030460 tx=0x7fd024032670 comp rx=0 tx=0).stop 2024-09-13T16:00:52.338 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:51.131+0000 7fd039a00640 1 -- 172.21.15.86:0/365073175 shutdown_connections 2024-09-13T16:00:52.338 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:51.131+0000 7fd039a00640 1 --2- 172.21.15.86:0/365073175 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fd018038670 0x7fd01803ab30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:52.338 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:51.131+0000 7fd039a00640 1 --2- 172.21.15.86:0/365073175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd034108f80 0x7fd03419b730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:52.338 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:51.131+0000 7fd039a00640 1 -- 172.21.15.86:0/365073175 >> 172.21.15.86:0/365073175 conn(0x7fd03407b090 msgr2=0x7fd034105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:52.339 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:51.131+0000 7fd039a00640 1 -- 172.21.15.86:0/365073175 shutdown_connections 2024-09-13T16:00:52.339 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:51.131+0000 7fd039a00640 1 -- 172.21.15.86:0/365073175 wait complete. 2024-09-13T16:00:52.339 INFO:teuthology.orchestra.run.smithi086.stdout:Enabling the dashboard module... 2024-09-13T16:00:53.458 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:53 smithi086 ceph-mon[30379]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:00:53.458 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:53 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/36120180' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-13T16:00:53.761 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:53 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: ignoring --setuser ceph since I am not root 2024-09-13T16:00:53.762 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:53 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: ignoring --setgroup ceph since I am not root 2024-09-13T16:00:53.762 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:53 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:53.689+0000 7f4c0e43a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T16:00:53.762 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:53 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:53.759+0000 7f4c0e43a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T16:00:54.027 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:53 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:53.946+0000 7f4c0e43a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T16:00:54.027 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:54 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:54.025+0000 7f4c0e43a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T16:00:54.152 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.964+0000 7fc577e00640 1 Processor -- start 2024-09-13T16:00:54.152 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.965+0000 7fc577e00640 1 -- start start 2024-09-13T16:00:54.152 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.965+0000 7fc577e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc578105680 0x7fc578105a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.152 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.965+0000 7fc577e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc578106050 con 0x7fc578105680 2024-09-13T16:00:54.152 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.965+0000 7fc576a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc578105680 0x7fc578105a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.152 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.965+0000 7fc576a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc578105680 0x7fc578105a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51750/0 (socket says 172.21.15.86:51750) 2024-09-13T16:00:54.152 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.965+0000 7fc576a00640 1 -- 172.21.15.86:0/2319853368 learned_addr learned my addr 172.21.15.86:0/2319853368 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:54.153 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.966+0000 7fc576a00640 1 -- 172.21.15.86:0/2319853368 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc578106880 con 0x7fc578105680 2024-09-13T16:00:54.153 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.967+0000 7fc576a00640 1 --2- 172.21.15.86:0/2319853368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc578105680 0x7fc578105a80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc568009820 tx=0x7fc56802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7604594a571d34d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:54.153 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.967+0000 7fc575600640 1 -- 172.21.15.86:0/2319853368 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc56802ae70 con 0x7fc578105680 2024-09-13T16:00:54.153 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.967+0000 7fc575600640 1 -- 172.21.15.86:0/2319853368 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc568032920 con 0x7fc578105680 2024-09-13T16:00:54.153 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.967+0000 7fc575600640 1 -- 172.21.15.86:0/2319853368 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc568030920 con 0x7fc578105680 2024-09-13T16:00:54.153 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.968+0000 7fc577e00640 1 -- 172.21.15.86:0/2319853368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc578105680 msgr2=0x7fc578105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:54.153 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.968+0000 7fc577e00640 1 --2- 172.21.15.86:0/2319853368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc578105680 0x7fc578105a80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc568009820 tx=0x7fc56802a270 comp rx=0 tx=0).stop 2024-09-13T16:00:54.153 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.968+0000 7fc577e00640 1 -- 172.21.15.86:0/2319853368 shutdown_connections 2024-09-13T16:00:54.153 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.968+0000 7fc577e00640 1 --2- 172.21.15.86:0/2319853368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc578105680 0x7fc578105a80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.153 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.968+0000 7fc577e00640 1 -- 172.21.15.86:0/2319853368 >> 172.21.15.86:0/2319853368 conn(0x7fc578100e70 msgr2=0x7fc578103290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:54.153 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.968+0000 7fc577e00640 1 -- 172.21.15.86:0/2319853368 shutdown_connections 2024-09-13T16:00:54.154 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.968+0000 7fc577e00640 1 -- 172.21.15.86:0/2319853368 wait complete. 2024-09-13T16:00:54.154 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.969+0000 7fc577e00640 1 Processor -- start 2024-09-13T16:00:54.154 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.969+0000 7fc577e00640 1 -- start start 2024-09-13T16:00:54.154 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.969+0000 7fc577e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc578105680 0x7fc57819b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.154 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.969+0000 7fc577e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57819bbb0 con 0x7fc578105680 2024-09-13T16:00:54.154 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.969+0000 7fc576a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc578105680 0x7fc57819b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.154 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.969+0000 7fc576a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc578105680 0x7fc57819b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51762/0 (socket says 172.21.15.86:51762) 2024-09-13T16:00:54.154 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.969+0000 7fc576a00640 1 -- 172.21.15.86:0/36120180 learned_addr learned my addr 172.21.15.86:0/36120180 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:54.154 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.970+0000 7fc576a00640 1 -- 172.21.15.86:0/36120180 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680094d0 con 0x7fc578105680 2024-09-13T16:00:54.154 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.970+0000 7fc576a00640 1 --2- 172.21.15.86:0/36120180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc578105680 0x7fc57819b670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc568030460 tx=0x7fc568032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:54.154 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.970+0000 7fc56f400640 1 -- 172.21.15.86:0/36120180 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc568032dd0 con 0x7fc578105680 2024-09-13T16:00:54.154 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.970+0000 7fc56f400640 1 -- 172.21.15.86:0/36120180 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc56803b910 con 0x7fc578105680 2024-09-13T16:00:54.154 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.970+0000 7fc56f400640 1 -- 172.21.15.86:0/36120180 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc56803a820 con 0x7fc578105680 2024-09-13T16:00:54.155 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.970+0000 7fc577e00640 1 -- 172.21.15.86:0/36120180 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57819bdb0 con 0x7fc578105680 2024-09-13T16:00:54.155 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.971+0000 7fc577e00640 1 -- 172.21.15.86:0/36120180 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57819c250 con 0x7fc578105680 2024-09-13T16:00:54.155 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.971+0000 7fc56f400640 1 -- 172.21.15.86:0/36120180 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fc568039040 con 0x7fc578105680 2024-09-13T16:00:54.155 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.971+0000 7fc577e00640 1 -- 172.21.15.86:0/36120180 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc578109ab0 con 0x7fc578105680 2024-09-13T16:00:54.155 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.972+0000 7fc56f400640 1 --2- 172.21.15.86:0/36120180 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fc55c038670 0x7fc55c03ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:54.155 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.972+0000 7fc56f400640 1 -- 172.21.15.86:0/36120180 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc56806b8f0 con 0x7fc578105680 2024-09-13T16:00:54.155 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.972+0000 7fc576000640 1 --2- 172.21.15.86:0/36120180 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fc55c038670 0x7fc55c03ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:54.155 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.973+0000 7fc576000640 1 --2- 172.21.15.86:0/36120180 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fc55c038670 0x7fc55c03ab30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc5640098c0 tx=0x7fc564006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:54.155 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:52.977+0000 7fc56f400640 1 -- 172.21.15.86:0/36120180 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc56803be10 con 0x7fc578105680 2024-09-13T16:00:54.155 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:53.193+0000 7fc577e00640 1 -- 172.21.15.86:0/36120180 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fc578109d20 con 0x7fc578105680 2024-09-13T16:00:54.155 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:53.435+0000 7fc56f400640 1 -- 172.21.15.86:0/36120180 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fc56806dcf0 con 0x7fc578105680 2024-09-13T16:00:54.155 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:53.437+0000 7fc56f400640 1 -- 172.21.15.86:0/36120180 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fc56804c350 con 0x7fc578105680 2024-09-13T16:00:54.156 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:53.439+0000 7fc577e00640 1 -- 172.21.15.86:0/36120180 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fc55c038670 msgr2=0x7fc55c03ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:54.156 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:53.439+0000 7fc577e00640 1 --2- 172.21.15.86:0/36120180 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fc55c038670 0x7fc55c03ab30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc5640098c0 tx=0x7fc564006db0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.156 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:53.439+0000 7fc577e00640 1 -- 172.21.15.86:0/36120180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc578105680 msgr2=0x7fc57819b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:54.156 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:53.439+0000 7fc577e00640 1 --2- 172.21.15.86:0/36120180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc578105680 0x7fc57819b670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc568030460 tx=0x7fc568032670 comp rx=0 tx=0).stop 2024-09-13T16:00:54.156 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:53.440+0000 7fc577e00640 1 -- 172.21.15.86:0/36120180 shutdown_connections 2024-09-13T16:00:54.156 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:53.440+0000 7fc577e00640 1 --2- 172.21.15.86:0/36120180 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fc55c038670 0x7fc55c03ab30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.156 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:53.440+0000 7fc577e00640 1 --2- 172.21.15.86:0/36120180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc578105680 0x7fc57819b670 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:54.156 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:53.440+0000 7fc577e00640 1 -- 172.21.15.86:0/36120180 >> 172.21.15.86:0/36120180 conn(0x7fc578100e70 msgr2=0x7fc578101950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:54.156 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:53.440+0000 7fc577e00640 1 -- 172.21.15.86:0/36120180 shutdown_connections 2024-09-13T16:00:54.156 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:53.440+0000 7fc577e00640 1 -- 172.21.15.86:0/36120180 wait complete. 2024-09-13T16:00:54.288 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:54 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:54.203+0000 7f4c0e43a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:00:54.599 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:54 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/36120180' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T16:00:54.599 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:54 smithi086 ceph-mon[30379]: mgrmap e9: x(active, since 21s) 2024-09-13T16:00:54.600 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:54 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:54.368+0000 7f4c0e43a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T16:00:54.865 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:54 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:54.748+0000 7f4c0e43a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T16:00:54.865 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:54 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:54.820+0000 7f4c0e43a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T16:00:55.311 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:55 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:55.041+0000 7f4c0e43a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T16:00:55.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:55 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/308145582' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T16:00:55.637 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:00:55.645 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-13T16:00:55.645 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T16:00:55.645 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-13T16:00:55.645 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T16:00:55.645 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:00:55.645 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.704+0000 7f8f4fe00640 1 Processor -- start 2024-09-13T16:00:55.645 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.705+0000 7f8f4fe00640 1 -- start start 2024-09-13T16:00:55.645 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.705+0000 7f8f4fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f501044e0 0x7f8f501048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.645 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.705+0000 7f8f4fe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f50104eb0 con 0x7f8f501044e0 2024-09-13T16:00:55.646 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.705+0000 7f8f4ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f501044e0 0x7f8f501048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.646 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.705+0000 7f8f4ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f501044e0 0x7f8f501048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51788/0 (socket says 172.21.15.86:51788) 2024-09-13T16:00:55.646 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.705+0000 7f8f4ea00640 1 -- 172.21.15.86:0/1020378974 learned_addr learned my addr 172.21.15.86:0/1020378974 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:55.646 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.706+0000 7f8f4ea00640 1 -- 172.21.15.86:0/1020378974 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f50105690 con 0x7f8f501044e0 2024-09-13T16:00:55.646 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.707+0000 7f8f4ea00640 1 --2- 172.21.15.86:0/1020378974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f501044e0 0x7f8f501048e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009820 tx=0x7f8f4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8c1d49df7db246 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:55.646 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.707+0000 7f8f4d600640 1 -- 172.21.15.86:0/1020378974 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f4002ae70 con 0x7f8f501044e0 2024-09-13T16:00:55.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.707+0000 7f8f4d600640 1 -- 172.21.15.86:0/1020378974 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8f40032920 con 0x7f8f501044e0 2024-09-13T16:00:55.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.707+0000 7f8f4d600640 1 -- 172.21.15.86:0/1020378974 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f40030920 con 0x7f8f501044e0 2024-09-13T16:00:55.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.708+0000 7f8f4fe00640 1 -- 172.21.15.86:0/1020378974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f501044e0 msgr2=0x7f8f501048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.708+0000 7f8f4fe00640 1 --2- 172.21.15.86:0/1020378974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f501044e0 0x7f8f501048e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009820 tx=0x7f8f4002a270 comp rx=0 tx=0).stop 2024-09-13T16:00:55.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.708+0000 7f8f4fe00640 1 -- 172.21.15.86:0/1020378974 shutdown_connections 2024-09-13T16:00:55.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.708+0000 7f8f4fe00640 1 --2- 172.21.15.86:0/1020378974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f501044e0 0x7f8f501048e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.708+0000 7f8f4fe00640 1 -- 172.21.15.86:0/1020378974 >> 172.21.15.86:0/1020378974 conn(0x7f8f500ffcd0 msgr2=0x7f8f501020f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.708+0000 7f8f4fe00640 1 -- 172.21.15.86:0/1020378974 shutdown_connections 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.708+0000 7f8f4fe00640 1 -- 172.21.15.86:0/1020378974 wait complete. 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.710+0000 7f8f4fe00640 1 Processor -- start 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.710+0000 7f8f4fe00640 1 -- start start 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.710+0000 7f8f4fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f501044e0 0x7f8f50199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.710+0000 7f8f4fe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f50199940 con 0x7f8f501044e0 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.710+0000 7f8f4ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f501044e0 0x7f8f50199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.710+0000 7f8f4ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f501044e0 0x7f8f50199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51798/0 (socket says 172.21.15.86:51798) 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.710+0000 7f8f4ea00640 1 -- 172.21.15.86:0/308145582 learned_addr learned my addr 172.21.15.86:0/308145582 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.711+0000 7f8f4ea00640 1 -- 172.21.15.86:0/308145582 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f400094d0 con 0x7f8f501044e0 2024-09-13T16:00:55.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.711+0000 7f8f4ea00640 1 --2- 172.21.15.86:0/308145582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f501044e0 0x7f8f50199400 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f400097f0 tx=0x7f8f40032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:55.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.711+0000 7f8f47400640 1 -- 172.21.15.86:0/308145582 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f40032dd0 con 0x7f8f501044e0 2024-09-13T16:00:55.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.711+0000 7f8f47400640 1 -- 172.21.15.86:0/308145582 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8f4003b910 con 0x7f8f501044e0 2024-09-13T16:00:55.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.711+0000 7f8f47400640 1 -- 172.21.15.86:0/308145582 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f4003a890 con 0x7f8f501044e0 2024-09-13T16:00:55.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.711+0000 7f8f4fe00640 1 -- 172.21.15.86:0/308145582 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f50199b40 con 0x7f8f501044e0 2024-09-13T16:00:55.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.712+0000 7f8f4fe00640 1 -- 172.21.15.86:0/308145582 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f50199fe0 con 0x7f8f501044e0 2024-09-13T16:00:55.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.713+0000 7f8f4fe00640 1 -- 172.21.15.86:0/308145582 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f50193560 con 0x7f8f501044e0 2024-09-13T16:00:55.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.713+0000 7f8f47400640 1 -- 172.21.15.86:0/308145582 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f8f40039040 con 0x7f8f501044e0 2024-09-13T16:00:55.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.713+0000 7f8f47400640 1 --2- 172.21.15.86:0/308145582 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f8f340386c0 0x7f8f3403ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:55.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.714+0000 7f8f47400640 1 -- 172.21.15.86:0/308145582 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8f4006b9f0 con 0x7f8f501044e0 2024-09-13T16:00:55.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.714+0000 7f8f4e000640 1 -- 172.21.15.86:0/308145582 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f8f340386c0 msgr2=0x7f8f3403ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/3020585994 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.714+0000 7f8f4e000640 1 --2- 172.21.15.86:0/308145582 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f8f340386c0 0x7f8f3403ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.718+0000 7f8f47400640 1 -- 172.21.15.86:0/308145582 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8f4003be10 con 0x7f8f501044e0 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.915+0000 7f8f4e000640 1 -- 172.21.15.86:0/308145582 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f8f340386c0 msgr2=0x7f8f3403ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/3020585994 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.915+0000 7f8f4e000640 1 --2- 172.21.15.86:0/308145582 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f8f340386c0 0x7f8f3403ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.941+0000 7f8f4fe00640 1 -- 172.21.15.86:0/308145582 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f8f5002c530 con 0x7f8f501044e0 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.942+0000 7f8f47400640 1 -- 172.21.15.86:0/308145582 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f8f4003f070 con 0x7f8f501044e0 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.944+0000 7f8f4fe00640 1 -- 172.21.15.86:0/308145582 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f8f340386c0 msgr2=0x7f8f3403ab80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.944+0000 7f8f4fe00640 1 --2- 172.21.15.86:0/308145582 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f8f340386c0 0x7f8f3403ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.944+0000 7f8f4fe00640 1 -- 172.21.15.86:0/308145582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f501044e0 msgr2=0x7f8f50199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.944+0000 7f8f4fe00640 1 --2- 172.21.15.86:0/308145582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f501044e0 0x7f8f50199400 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f400097f0 tx=0x7f8f40032670 comp rx=0 tx=0).stop 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.944+0000 7f8f4fe00640 1 -- 172.21.15.86:0/308145582 shutdown_connections 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.944+0000 7f8f4fe00640 1 --2- 172.21.15.86:0/308145582 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7f8f340386c0 0x7f8f3403ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.944+0000 7f8f4fe00640 1 --2- 172.21.15.86:0/308145582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f501044e0 0x7f8f50199400 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:55.650 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.944+0000 7f8f4fe00640 1 -- 172.21.15.86:0/308145582 >> 172.21.15.86:0/308145582 conn(0x7f8f500ffcd0 msgr2=0x7f8f50100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:55.651 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.944+0000 7f8f4fe00640 1 -- 172.21.15.86:0/308145582 shutdown_connections 2024-09-13T16:00:55.651 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:54.944+0000 7f8f4fe00640 1 -- 172.21.15.86:0/308145582 wait complete. 2024-09-13T16:00:55.651 INFO:teuthology.orchestra.run.smithi086.stdout:Waiting for the mgr to restart... 2024-09-13T16:00:55.651 INFO:teuthology.orchestra.run.smithi086.stdout:Waiting for mgr epoch 9... 2024-09-13T16:00:56.211 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:56 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:56.145+0000 7f4c0e43a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T16:00:56.615 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:56 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:56.229+0000 7f4c0e43a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T16:00:57.421 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:57 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:57.126+0000 7f4c0e43a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T16:00:57.421 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:57 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:57.259+0000 7f4c0e43a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T16:00:57.421 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:57 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:57.419+0000 7f4c0e43a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:00:57.737 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:57 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:57.491+0000 7f4c0e43a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T16:00:57.737 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:57 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:57.656+0000 7f4c0e43a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T16:00:57.737 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:57 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:57.735+0000 7f4c0e43a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T16:00:58.056 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:57 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:57.805+0000 7f4c0e43a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T16:00:58.056 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:57 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:57.979+0000 7f4c0e43a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T16:00:58.056 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:58 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:58.054+0000 7f4c0e43a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T16:00:58.364 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:58 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:58.130+0000 7f4c0e43a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T16:00:58.364 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:58 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:58.226+0000 7f4c0e43a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T16:00:58.364 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:58 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:58.294+0000 7f4c0e43a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T16:00:58.364 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:58 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:58.362+0000 7f4c0e43a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T16:00:59.480 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:00:59 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:00:59.242+0000 7f4c0e43a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T16:00:59.480 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:59 smithi086 ceph-mon[30379]: Active manager daemon x restarted 2024-09-13T16:00:59.480 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:59 smithi086 ceph-mon[30379]: Activating manager daemon x 2024-09-13T16:00:59.480 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:59 smithi086 ceph-mon[30379]: osdmap e3: 0 total, 0 up, 0 in 2024-09-13T16:00:59.480 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:59 smithi086 ceph-mon[30379]: mgrmap e10: x(active, starting, since 0.00415108s) 2024-09-13T16:00:59.480 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:00:59.480 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T16:00:59.480 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T16:00:59.481 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T16:00:59.481 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T16:00:59.481 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:59 smithi086 ceph-mon[30379]: Manager daemon x is now available 2024-09-13T16:00:59.481 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:00:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:01:00.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T16:01:00.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T16:01:00.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-mon[30379]: mgrmap e11: x(active, since 1.00831s) 2024-09-13T16:01:00.615 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:01:00.488+0000 7f4b6c400640 -1 log_channel(cephadm) log [ERR] : [13/Sep/2024:16:01:00] ENGINE Error in HTTPServer.serve 2024-09-13T16:01:00.616 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: Traceback (most recent call last): 2024-09-13T16:01:00.616 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T16:01:00.616 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: self._connections.run(self.expiration_interval) 2024-09-13T16:01:00.616 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T16:01:00.616 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: self._run(expiration_interval) 2024-09-13T16:01:00.616 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T16:01:00.616 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T16:01:00.616 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T16:01:00.616 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T16:01:00.616 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T16:01:00.616 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: s = self.context.wrap_socket( 2024-09-13T16:01:00.616 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T16:01:00.616 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: return self.sslsocket_class._create( 2024-09-13T16:01:00.617 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T16:01:00.617 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: self.do_handshake() 2024-09-13T16:01:00.617 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T16:01:00.617 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: self._sslobj.do_handshake() 2024-09-13T16:01:00.617 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T16:01:00.617 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:01:01.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:01 smithi086 ceph-mon[30379]: [13/Sep/2024:16:01:00] ENGINE Bus STARTING 2024-09-13T16:01:01.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:01 smithi086 ceph-mon[30379]: [13/Sep/2024:16:01:00] ENGINE Serving on https://172.21.15.86:7150 2024-09-13T16:01:01.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:01 smithi086 ceph-mon[30379]: [13/Sep/2024:16:01:00] ENGINE Error in HTTPServer.serve 2024-09-13T16:01:01.615 INFO:journalctl@ceph.mon.a.smithi086.stdout: Traceback (most recent call last): 2024-09-13T16:01:01.615 INFO:journalctl@ceph.mon.a.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T16:01:01.615 INFO:journalctl@ceph.mon.a.smithi086.stdout: self._connections.run(self.expiration_interval) 2024-09-13T16:01:01.615 INFO:journalctl@ceph.mon.a.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T16:01:01.615 INFO:journalctl@ceph.mon.a.smithi086.stdout: self._run(expiration_interval) 2024-09-13T16:01:01.616 INFO:journalctl@ceph.mon.a.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T16:01:01.616 INFO:journalctl@ceph.mon.a.smithi086.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T16:01:01.616 INFO:journalctl@ceph.mon.a.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T16:01:01.616 INFO:journalctl@ceph.mon.a.smithi086.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T16:01:01.616 INFO:journalctl@ceph.mon.a.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T16:01:01.616 INFO:journalctl@ceph.mon.a.smithi086.stdout: s = self.context.wrap_socket( 2024-09-13T16:01:01.616 INFO:journalctl@ceph.mon.a.smithi086.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T16:01:01.616 INFO:journalctl@ceph.mon.a.smithi086.stdout: return self.sslsocket_class._create( 2024-09-13T16:01:01.616 INFO:journalctl@ceph.mon.a.smithi086.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T16:01:01.616 INFO:journalctl@ceph.mon.a.smithi086.stdout: self.do_handshake() 2024-09-13T16:01:01.616 INFO:journalctl@ceph.mon.a.smithi086.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T16:01:01.616 INFO:journalctl@ceph.mon.a.smithi086.stdout: self._sslobj.do_handshake() 2024-09-13T16:01:01.616 INFO:journalctl@ceph.mon.a.smithi086.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T16:01:01.669 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:01:01.669 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-13T16:01:01.669 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T16:01:01.669 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:01:01.670 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.209+0000 7fad97400640 1 Processor -- start 2024-09-13T16:01:01.670 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.209+0000 7fad97400640 1 -- start start 2024-09-13T16:01:01.670 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.209+0000 7fad97400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad90108fd0 0x7fad901093d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:01.670 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.209+0000 7fad97400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad901099a0 con 0x7fad90108fd0 2024-09-13T16:01:01.670 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.210+0000 7fad94a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad90108fd0 0x7fad901093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:01.670 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.210+0000 7fad94a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad90108fd0 0x7fad901093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51804/0 (socket says 172.21.15.86:51804) 2024-09-13T16:01:01.670 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.210+0000 7fad94a00640 1 -- 172.21.15.86:0/581181111 learned_addr learned my addr 172.21.15.86:0/581181111 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:01.670 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.210+0000 7fad94a00640 1 -- 172.21.15.86:0/581181111 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad90109ae0 con 0x7fad90108fd0 2024-09-13T16:01:01.670 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.212+0000 7fad94a00640 1 --2- 172.21.15.86:0/581181111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad90108fd0 0x7fad901093d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad84009820 tx=0x7fad8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a880b90693ef832 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:01.670 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.212+0000 7fad8f400640 1 -- 172.21.15.86:0/581181111 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad8402ae70 con 0x7fad90108fd0 2024-09-13T16:01:01.670 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.212+0000 7fad8f400640 1 -- 172.21.15.86:0/581181111 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fad84032920 con 0x7fad90108fd0 2024-09-13T16:01:01.670 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.212+0000 7fad8f400640 1 -- 172.21.15.86:0/581181111 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad84030920 con 0x7fad90108fd0 2024-09-13T16:01:01.670 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.213+0000 7fad97400640 1 -- 172.21.15.86:0/581181111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad90108fd0 msgr2=0x7fad901093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:01.671 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.213+0000 7fad97400640 1 --2- 172.21.15.86:0/581181111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad90108fd0 0x7fad901093d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad84009820 tx=0x7fad8402a270 comp rx=0 tx=0).stop 2024-09-13T16:01:01.671 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.213+0000 7fad97400640 1 -- 172.21.15.86:0/581181111 shutdown_connections 2024-09-13T16:01:01.671 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.213+0000 7fad97400640 1 --2- 172.21.15.86:0/581181111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad90108fd0 0x7fad901093d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:01.671 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.213+0000 7fad97400640 1 -- 172.21.15.86:0/581181111 >> 172.21.15.86:0/581181111 conn(0x7fad9007b060 msgr2=0x7fad9007b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:01.671 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.213+0000 7fad97400640 1 -- 172.21.15.86:0/581181111 shutdown_connections 2024-09-13T16:01:01.671 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.213+0000 7fad97400640 1 -- 172.21.15.86:0/581181111 wait complete. 2024-09-13T16:01:01.671 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.214+0000 7fad97400640 1 Processor -- start 2024-09-13T16:01:01.671 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.214+0000 7fad97400640 1 -- start start 2024-09-13T16:01:01.671 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.214+0000 7fad97400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad90108fd0 0x7fad9019b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:01.671 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.215+0000 7fad97400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9019bcf0 con 0x7fad90108fd0 2024-09-13T16:01:01.671 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.215+0000 7fad94a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad90108fd0 0x7fad9019b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:01.671 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.215+0000 7fad94a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad90108fd0 0x7fad9019b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51810/0 (socket says 172.21.15.86:51810) 2024-09-13T16:01:01.671 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.215+0000 7fad94a00640 1 -- 172.21.15.86:0/3930699246 learned_addr learned my addr 172.21.15.86:0/3930699246 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:01.672 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.215+0000 7fad94a00640 1 -- 172.21.15.86:0/3930699246 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad840094d0 con 0x7fad90108fd0 2024-09-13T16:01:01.672 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.215+0000 7fad94a00640 1 --2- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad90108fd0 0x7fad9019b7b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad840097f0 tx=0x7fad84032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:01.672 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.216+0000 7fad8d600640 1 -- 172.21.15.86:0/3930699246 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad84032dd0 con 0x7fad90108fd0 2024-09-13T16:01:01.672 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.216+0000 7fad97400640 1 -- 172.21.15.86:0/3930699246 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9019bef0 con 0x7fad90108fd0 2024-09-13T16:01:01.672 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.216+0000 7fad8d600640 1 -- 172.21.15.86:0/3930699246 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fad8403b910 con 0x7fad90108fd0 2024-09-13T16:01:01.672 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.216+0000 7fad8d600640 1 -- 172.21.15.86:0/3930699246 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad8403a890 con 0x7fad90108fd0 2024-09-13T16:01:01.672 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.216+0000 7fad97400640 1 -- 172.21.15.86:0/3930699246 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9019c390 con 0x7fad90108fd0 2024-09-13T16:01:01.672 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.217+0000 7fad8d600640 1 -- 172.21.15.86:0/3930699246 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fad84039040 con 0x7fad90108fd0 2024-09-13T16:01:01.672 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.217+0000 7fad8d600640 1 --2- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fad78038670 0x7fad7803ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:01.672 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.217+0000 7fad8d600640 1 -- 172.21.15.86:0/3930699246 --> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad7803b240 con 0x7fad78038670 2024-09-13T16:01:01.672 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.217+0000 7fad8d600640 1 -- 172.21.15.86:0/3930699246 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fad8406ba10 con 0x7fad90108fd0 2024-09-13T16:01:01.673 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.218+0000 7fad8fe00640 1 -- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fad78038670 msgr2=0x7fad7803ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/3020585994 2024-09-13T16:01:01.673 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.218+0000 7fad8fe00640 1 --2- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fad78038670 0x7fad7803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:01:01.673 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.419+0000 7fad8fe00640 1 -- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fad78038670 msgr2=0x7fad7803ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/3020585994 2024-09-13T16:01:01.673 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.419+0000 7fad8fe00640 1 --2- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fad78038670 0x7fad7803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T16:01:01.673 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.820+0000 7fad8fe00640 1 -- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fad78038670 msgr2=0x7fad7803ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/3020585994 2024-09-13T16:01:01.673 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:56.820+0000 7fad8fe00640 1 --2- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fad78038670 0x7fad7803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T16:01:01.673 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:57.621+0000 7fad8fe00640 1 -- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fad78038670 msgr2=0x7fad7803ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/3020585994 2024-09-13T16:01:01.673 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:57.621+0000 7fad8fe00640 1 --2- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fad78038670 0x7fad7803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T16:01:01.673 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:59.223+0000 7fad8fe00640 1 -- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fad78038670 msgr2=0x7fad7803ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6800/3020585994 2024-09-13T16:01:01.673 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:59.223+0000 7fad8fe00640 1 --2- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fad78038670 0x7fad7803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-13T16:01:01.673 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:59.247+0000 7fad8d600640 1 -- 172.21.15.86:0/3930699246 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mgrmap(e 10) v1 ==== 45321+0+0 (secure 0 0 0) 0x7fad8403b430 con 0x7fad90108fd0 2024-09-13T16:01:01.673 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:59.247+0000 7fad8d600640 1 -- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fad78038670 msgr2=0x7fad7803ab30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:01:01.673 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:00:59.247+0000 7fad8d600640 1 --2- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fad78038670 0x7fad7803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:01.673 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.250+0000 7fad8d600640 1 -- 172.21.15.86:0/3930699246 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7fad8406d160 con 0x7fad90108fd0 2024-09-13T16:01:01.674 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.250+0000 7fad8d600640 1 --2- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fad7803bff0 0x7fad7803e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:01.674 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.250+0000 7fad8d600640 1 -- 172.21.15.86:0/3930699246 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad7803b240 con 0x7fad7803bff0 2024-09-13T16:01:01.674 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.251+0000 7fad8fe00640 1 --2- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fad7803bff0 0x7fad7803e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:01.674 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.252+0000 7fad8fe00640 1 --2- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fad7803bff0 0x7fad7803e3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fad7c003980 tx=0x7fad7c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:01.674 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.253+0000 7fad8d600640 1 -- 172.21.15.86:0/3930699246 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7fad7803b240 con 0x7fad7803bff0 2024-09-13T16:01:01.674 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.258+0000 7fad97400640 1 -- 172.21.15.86:0/3930699246 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fad90109450 con 0x7fad7803bff0 2024-09-13T16:01:01.674 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.259+0000 7fad8d600640 1 -- 172.21.15.86:0/3930699246 <== mgr.14150 v2:172.21.15.86:6800/1239909622 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fad90109450 con 0x7fad7803bff0 2024-09-13T16:01:01.674 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.259+0000 7fad97400640 1 -- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fad7803bff0 msgr2=0x7fad7803e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:01.675 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.259+0000 7fad97400640 1 --2- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fad7803bff0 0x7fad7803e3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fad7c003980 tx=0x7fad7c009290 comp rx=0 tx=0).stop 2024-09-13T16:01:01.675 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.259+0000 7fad97400640 1 -- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad90108fd0 msgr2=0x7fad9019b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:01.675 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.259+0000 7fad97400640 1 --2- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad90108fd0 0x7fad9019b7b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad840097f0 tx=0x7fad84032670 comp rx=0 tx=0).stop 2024-09-13T16:01:01.675 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.259+0000 7fad97400640 1 -- 172.21.15.86:0/3930699246 shutdown_connections 2024-09-13T16:01:01.675 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.259+0000 7fad97400640 1 --2- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fad7803bff0 0x7fad7803e3e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:01.675 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.259+0000 7fad97400640 1 --2- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:6800/3020585994,v1:172.21.15.86:6801/3020585994] conn(0x7fad78038670 0x7fad7803ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:01.675 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.259+0000 7fad97400640 1 --2- 172.21.15.86:0/3930699246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad90108fd0 0x7fad9019b7b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:01.675 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.259+0000 7fad97400640 1 -- 172.21.15.86:0/3930699246 >> 172.21.15.86:0/3930699246 conn(0x7fad9007b060 msgr2=0x7fad90105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:01.675 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.259+0000 7fad97400640 1 -- 172.21.15.86:0/3930699246 shutdown_connections 2024-09-13T16:01:01.676 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:00.260+0000 7fad97400640 1 -- 172.21.15.86:0/3930699246 wait complete. 2024-09-13T16:01:01.676 INFO:teuthology.orchestra.run.smithi086.stdout:mgr epoch 9 is available 2024-09-13T16:01:01.676 INFO:teuthology.orchestra.run.smithi086.stdout:Generating a dashboard self-signed certificate... 2024-09-13T16:01:02.515 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:02 smithi086 ceph-mon[30379]: [13/Sep/2024:16:01:00] ENGINE Serving on http://172.21.15.86:8765 2024-09-13T16:01:02.515 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:02 smithi086 ceph-mon[30379]: [13/Sep/2024:16:01:00] ENGINE Bus STARTED 2024-09-13T16:01:02.515 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:02 smithi086 ceph-mon[30379]: mgrmap e12: x(active, since 2s) 2024-09-13T16:01:02.515 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:02 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:03.190 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-13T16:01:03.190 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.248+0000 7f9902400640 1 Processor -- start 2024-09-13T16:01:03.190 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.248+0000 7f9902400640 1 -- start start 2024-09-13T16:01:03.190 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.248+0000 7f9902400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98fc07c690 0x7f98fc07aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:03.190 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.248+0000 7f9902400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc07b0c0 con 0x7f98fc07c690 2024-09-13T16:01:03.190 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.249+0000 7f98fb400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98fc07c690 0x7f98fc07aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:03.190 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.249+0000 7f98fb400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98fc07c690 0x7f98fc07aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51896/0 (socket says 172.21.15.86:51896) 2024-09-13T16:01:03.190 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.249+0000 7f98fb400640 1 -- 172.21.15.86:0/3401426426 learned_addr learned my addr 172.21.15.86:0/3401426426 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:03.190 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.249+0000 7f98fb400640 1 -- 172.21.15.86:0/3401426426 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc07b200 con 0x7f98fc07c690 2024-09-13T16:01:03.190 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.250+0000 7f98fb400640 1 --2- 172.21.15.86:0/3401426426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98fc07c690 0x7f98fc07aaf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f98ec009820 tx=0x7f98ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb626341833e02d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:03.190 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.250+0000 7f98faa00640 1 -- 172.21.15.86:0/3401426426 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98ec02ae70 con 0x7f98fc07c690 2024-09-13T16:01:03.191 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.250+0000 7f98faa00640 1 -- 172.21.15.86:0/3401426426 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f98ec032920 con 0x7f98fc07c690 2024-09-13T16:01:03.191 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.250+0000 7f98faa00640 1 -- 172.21.15.86:0/3401426426 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98ec030920 con 0x7f98fc07c690 2024-09-13T16:01:03.191 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.251+0000 7f9902400640 1 -- 172.21.15.86:0/3401426426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98fc07c690 msgr2=0x7f98fc07aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:03.191 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.251+0000 7f9902400640 1 --2- 172.21.15.86:0/3401426426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98fc07c690 0x7f98fc07aaf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f98ec009820 tx=0x7f98ec02a270 comp rx=0 tx=0).stop 2024-09-13T16:01:03.191 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.251+0000 7f9902400640 1 -- 172.21.15.86:0/3401426426 shutdown_connections 2024-09-13T16:01:03.191 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.251+0000 7f9902400640 1 --2- 172.21.15.86:0/3401426426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98fc07c690 0x7f98fc07aaf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:03.191 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.251+0000 7f9902400640 1 -- 172.21.15.86:0/3401426426 >> 172.21.15.86:0/3401426426 conn(0x7f98fc101030 msgr2=0x7f98fc103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:03.191 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.251+0000 7f9902400640 1 -- 172.21.15.86:0/3401426426 shutdown_connections 2024-09-13T16:01:03.191 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.251+0000 7f9902400640 1 -- 172.21.15.86:0/3401426426 wait complete. 2024-09-13T16:01:03.191 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.252+0000 7f9902400640 1 Processor -- start 2024-09-13T16:01:03.191 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.252+0000 7f9902400640 1 -- start start 2024-09-13T16:01:03.191 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.253+0000 7f9902400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98fc07c690 0x7f98fc19b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:03.191 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.253+0000 7f9902400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc19bd10 con 0x7f98fc07c690 2024-09-13T16:01:03.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.253+0000 7f98fb400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98fc07c690 0x7f98fc19b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:03.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.253+0000 7f98fb400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98fc07c690 0x7f98fc19b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51902/0 (socket says 172.21.15.86:51902) 2024-09-13T16:01:03.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.253+0000 7f98fb400640 1 -- 172.21.15.86:0/539433067 learned_addr learned my addr 172.21.15.86:0/539433067 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:03.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.253+0000 7f98fb400640 1 -- 172.21.15.86:0/539433067 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec0094d0 con 0x7f98fc07c690 2024-09-13T16:01:03.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.254+0000 7f98fb400640 1 --2- 172.21.15.86:0/539433067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98fc07c690 0x7f98fc19b7d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f98ec035040 tx=0x7f98ec032650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:03.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.254+0000 7f98f8c00640 1 -- 172.21.15.86:0/539433067 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98ec032dd0 con 0x7f98fc07c690 2024-09-13T16:01:03.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.254+0000 7f98f8c00640 1 -- 172.21.15.86:0/539433067 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f98ec03c8e0 con 0x7f98fc07c690 2024-09-13T16:01:03.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.254+0000 7f9902400640 1 -- 172.21.15.86:0/539433067 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98fc19bf10 con 0x7f98fc07c690 2024-09-13T16:01:03.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.254+0000 7f98f8c00640 1 -- 172.21.15.86:0/539433067 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98ec03a8a0 con 0x7f98fc07c690 2024-09-13T16:01:03.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.254+0000 7f9902400640 1 -- 172.21.15.86:0/539433067 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc19c3b0 con 0x7f98fc07c690 2024-09-13T16:01:03.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.255+0000 7f98f8c00640 1 -- 172.21.15.86:0/539433067 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f98ec03c400 con 0x7f98fc07c690 2024-09-13T16:01:03.192 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.255+0000 7f9902400640 1 -- 172.21.15.86:0/539433067 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98fc10bcb0 con 0x7f98fc07c690 2024-09-13T16:01:03.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.255+0000 7f98f8c00640 1 --2- 172.21.15.86:0/539433067 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f98e0038670 0x7f98e003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:03.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.255+0000 7f98f8c00640 1 -- 172.21.15.86:0/539433067 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f98ec06bdc0 con 0x7f98fc07c690 2024-09-13T16:01:03.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.256+0000 7f98f2a00640 1 --2- 172.21.15.86:0/539433067 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f98e0038670 0x7f98e003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:03.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.256+0000 7f98f2a00640 1 --2- 172.21.15.86:0/539433067 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f98e0038670 0x7f98e003ab30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f98e40098c0 tx=0x7f98e4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:03.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.260+0000 7f98f8c00640 1 -- 172.21.15.86:0/539433067 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f98ec0434f0 con 0x7f98fc07c690 2024-09-13T16:01:03.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.438+0000 7f9902400640 1 -- 172.21.15.86:0/539433067 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f98fc102360 con 0x7f98e0038670 2024-09-13T16:01:03.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.512+0000 7f98f8c00640 1 -- 172.21.15.86:0/539433067 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f98fc102360 con 0x7f98e0038670 2024-09-13T16:01:03.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.515+0000 7f9902400640 1 -- 172.21.15.86:0/539433067 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f98e0038670 msgr2=0x7f98e003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:03.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.515+0000 7f9902400640 1 --2- 172.21.15.86:0/539433067 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f98e0038670 0x7f98e003ab30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f98e40098c0 tx=0x7f98e4006db0 comp rx=0 tx=0).stop 2024-09-13T16:01:03.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.515+0000 7f9902400640 1 -- 172.21.15.86:0/539433067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98fc07c690 msgr2=0x7f98fc19b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:03.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.515+0000 7f9902400640 1 --2- 172.21.15.86:0/539433067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98fc07c690 0x7f98fc19b7d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f98ec035040 tx=0x7f98ec032650 comp rx=0 tx=0).stop 2024-09-13T16:01:03.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.515+0000 7f9902400640 1 -- 172.21.15.86:0/539433067 shutdown_connections 2024-09-13T16:01:03.193 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.515+0000 7f9902400640 1 --2- 172.21.15.86:0/539433067 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f98e0038670 0x7f98e003ab30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:03.194 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.515+0000 7f9902400640 1 --2- 172.21.15.86:0/539433067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98fc07c690 0x7f98fc19b7d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:03.194 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.515+0000 7f9902400640 1 -- 172.21.15.86:0/539433067 >> 172.21.15.86:0/539433067 conn(0x7f98fc101030 msgr2=0x7f98fc101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:03.194 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.516+0000 7f9902400640 1 -- 172.21.15.86:0/539433067 shutdown_connections 2024-09-13T16:01:03.194 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:02.516+0000 7f9902400640 1 -- 172.21.15.86:0/539433067 wait complete. 2024-09-13T16:01:03.194 INFO:teuthology.orchestra.run.smithi086.stdout:Creating initial admin user... 2024-09-13T16:01:03.775 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:03 smithi086 ceph-mon[30379]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:01:03.775 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:03 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:03.775 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:03 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:03.776 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:03 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:05.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:05 smithi086 ceph-mon[30379]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:01:05.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:05.645 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$6nUYAPcFcnQ7TOXm7D6oHeyX/iTsQnWjocqWcG8Sv8kMLQLXxchh6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726243264, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-13T16:01:05.646 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.773+0000 7fb1dc000640 1 Processor -- start 2024-09-13T16:01:05.646 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.774+0000 7fb1dc000640 1 -- start start 2024-09-13T16:01:05.646 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.774+0000 7fb1dc000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1d407f660 0x7fb1d407fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:05.646 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.774+0000 7fb1dc000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d407ffa0 con 0x7fb1d407f660 2024-09-13T16:01:05.646 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.774+0000 7fb1d9600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1d407f660 0x7fb1d407fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:05.646 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.774+0000 7fb1d9600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1d407f660 0x7fb1d407fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37324/0 (socket says 172.21.15.86:37324) 2024-09-13T16:01:05.646 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.774+0000 7fb1d9600640 1 -- 172.21.15.86:0/2352421041 learned_addr learned my addr 172.21.15.86:0/2352421041 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:05.646 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.775+0000 7fb1d9600640 1 -- 172.21.15.86:0/2352421041 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d40800e0 con 0x7fb1d407f660 2024-09-13T16:01:05.646 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.776+0000 7fb1d9600640 1 --2- 172.21.15.86:0/2352421041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1d407f660 0x7fb1d407fa60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8009820 tx=0x7fb1c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db35132d862f1dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:05.646 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.776+0000 7fb1d3e00640 1 -- 172.21.15.86:0/2352421041 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1c802ae70 con 0x7fb1d407f660 2024-09-13T16:01:05.646 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.776+0000 7fb1d3e00640 1 -- 172.21.15.86:0/2352421041 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb1c8032920 con 0x7fb1d407f660 2024-09-13T16:01:05.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.776+0000 7fb1d3e00640 1 -- 172.21.15.86:0/2352421041 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1c8030920 con 0x7fb1d407f660 2024-09-13T16:01:05.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.777+0000 7fb1dc000640 1 -- 172.21.15.86:0/2352421041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1d407f660 msgr2=0x7fb1d407fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:05.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.777+0000 7fb1dc000640 1 --2- 172.21.15.86:0/2352421041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1d407f660 0x7fb1d407fa60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8009820 tx=0x7fb1c802a270 comp rx=0 tx=0).stop 2024-09-13T16:01:05.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.777+0000 7fb1dc000640 1 -- 172.21.15.86:0/2352421041 shutdown_connections 2024-09-13T16:01:05.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.777+0000 7fb1dc000640 1 --2- 172.21.15.86:0/2352421041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1d407f660 0x7fb1d407fa60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:05.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.777+0000 7fb1dc000640 1 -- 172.21.15.86:0/2352421041 >> 172.21.15.86:0/2352421041 conn(0x7fb1d407b010 msgr2=0x7fb1d407d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:05.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.777+0000 7fb1dc000640 1 -- 172.21.15.86:0/2352421041 shutdown_connections 2024-09-13T16:01:05.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.777+0000 7fb1dc000640 1 -- 172.21.15.86:0/2352421041 wait complete. 2024-09-13T16:01:05.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.778+0000 7fb1dc000640 1 Processor -- start 2024-09-13T16:01:05.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.778+0000 7fb1dc000640 1 -- start start 2024-09-13T16:01:05.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.778+0000 7fb1dc000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1d407f660 0x7fb1d419fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:05.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.778+0000 7fb1dc000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d41a00c0 con 0x7fb1d407f660 2024-09-13T16:01:05.647 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.778+0000 7fb1d9600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1d407f660 0x7fb1d419fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:05.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.779+0000 7fb1d9600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1d407f660 0x7fb1d419fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37334/0 (socket says 172.21.15.86:37334) 2024-09-13T16:01:05.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.779+0000 7fb1d9600640 1 -- 172.21.15.86:0/2768322551 learned_addr learned my addr 172.21.15.86:0/2768322551 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:05.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.779+0000 7fb1d9600640 1 -- 172.21.15.86:0/2768322551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c80094d0 con 0x7fb1d407f660 2024-09-13T16:01:05.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.779+0000 7fb1d9600640 1 --2- 172.21.15.86:0/2768322551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1d407f660 0x7fb1d419fb80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8030670 tx=0x7fb1c8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:05.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.779+0000 7fb1d2000640 1 -- 172.21.15.86:0/2768322551 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1c8032e90 con 0x7fb1d407f660 2024-09-13T16:01:05.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.779+0000 7fb1dc000640 1 -- 172.21.15.86:0/2768322551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d41a02c0 con 0x7fb1d407f660 2024-09-13T16:01:05.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.779+0000 7fb1d2000640 1 -- 172.21.15.86:0/2768322551 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb1c803b910 con 0x7fb1d407f660 2024-09-13T16:01:05.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.779+0000 7fb1d2000640 1 -- 172.21.15.86:0/2768322551 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1c803a7d0 con 0x7fb1d407f660 2024-09-13T16:01:05.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.780+0000 7fb1dc000640 1 -- 172.21.15.86:0/2768322551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d41a0760 con 0x7fb1d407f660 2024-09-13T16:01:05.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.781+0000 7fb1d2000640 1 -- 172.21.15.86:0/2768322551 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fb1c8039040 con 0x7fb1d407f660 2024-09-13T16:01:05.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.781+0000 7fb1dc000640 1 -- 172.21.15.86:0/2768322551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d4110050 con 0x7fb1d407f660 2024-09-13T16:01:05.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.781+0000 7fb1d2000640 1 --2- 172.21.15.86:0/2768322551 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb1bc0386c0 0x7fb1bc03ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:05.648 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.781+0000 7fb1d2000640 1 -- 172.21.15.86:0/2768322551 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb1c806ba80 con 0x7fb1d407f660 2024-09-13T16:01:05.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.781+0000 7fb1d8c00640 1 --2- 172.21.15.86:0/2768322551 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb1bc0386c0 0x7fb1bc03ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:05.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.782+0000 7fb1d8c00640 1 --2- 172.21.15.86:0/2768322551 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb1bc0386c0 0x7fb1bc03ab80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00098c0 tx=0x7fb1c0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:05.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.786+0000 7fb1d2000640 1 -- 172.21.15.86:0/2768322551 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb1c8031580 con 0x7fb1d407f660 2024-09-13T16:01:05.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:03.994+0000 7fb1dc000640 1 -- 172.21.15.86:0/2768322551 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fb1d41a3100 con 0x7fb1bc0386c0 2024-09-13T16:01:05.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:04.221+0000 7fb1d2000640 1 -- 172.21.15.86:0/2768322551 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fb1d41a3100 con 0x7fb1bc0386c0 2024-09-13T16:01:05.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:04.223+0000 7fb1dc000640 1 -- 172.21.15.86:0/2768322551 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb1bc0386c0 msgr2=0x7fb1bc03ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:05.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:04.223+0000 7fb1dc000640 1 --2- 172.21.15.86:0/2768322551 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb1bc0386c0 0x7fb1bc03ab80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00098c0 tx=0x7fb1c0006db0 comp rx=0 tx=0).stop 2024-09-13T16:01:05.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:04.223+0000 7fb1dc000640 1 -- 172.21.15.86:0/2768322551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1d407f660 msgr2=0x7fb1d419fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:05.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:04.223+0000 7fb1dc000640 1 --2- 172.21.15.86:0/2768322551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1d407f660 0x7fb1d419fb80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8030670 tx=0x7fb1c8032670 comp rx=0 tx=0).stop 2024-09-13T16:01:05.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:04.223+0000 7fb1dc000640 1 -- 172.21.15.86:0/2768322551 shutdown_connections 2024-09-13T16:01:05.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:04.223+0000 7fb1dc000640 1 --2- 172.21.15.86:0/2768322551 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb1bc0386c0 0x7fb1bc03ab80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:05.649 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:04.223+0000 7fb1dc000640 1 --2- 172.21.15.86:0/2768322551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1d407f660 0x7fb1d419fb80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:05.650 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:04.223+0000 7fb1dc000640 1 -- 172.21.15.86:0/2768322551 >> 172.21.15.86:0/2768322551 conn(0x7fb1d407b010 msgr2=0x7fb1d407bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:05.650 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:04.223+0000 7fb1dc000640 1 -- 172.21.15.86:0/2768322551 shutdown_connections 2024-09-13T16:01:05.650 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:04.223+0000 7fb1dc000640 1 -- 172.21.15.86:0/2768322551 wait complete. 2024-09-13T16:01:05.650 INFO:teuthology.orchestra.run.smithi086.stdout:Fetching dashboard port number... 2024-09-13T16:01:06.942 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stdout 8443 2024-09-13T16:01:06.942 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.133+0000 7f964fe00640 1 Processor -- start 2024-09-13T16:01:06.942 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.133+0000 7f964fe00640 1 -- start start 2024-09-13T16:01:06.942 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.133+0000 7f964fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9648071ee0 0x7f9648070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:06.942 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.133+0000 7f964fe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96480722e0 con 0x7f9648071ee0 2024-09-13T16:01:06.942 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.134+0000 7f964d400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9648071ee0 0x7f9648070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:06.942 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.134+0000 7f964d400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9648071ee0 0x7f9648070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37350/0 (socket says 172.21.15.86:37350) 2024-09-13T16:01:06.942 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.134+0000 7f964d400640 1 -- 172.21.15.86:0/922363224 learned_addr learned my addr 172.21.15.86:0/922363224 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:06.942 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.134+0000 7f964d400640 1 -- 172.21.15.86:0/922363224 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9648072420 con 0x7f9648071ee0 2024-09-13T16:01:06.942 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.135+0000 7f964d400640 1 --2- 172.21.15.86:0/922363224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9648071ee0 0x7f9648070500 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f963c009820 tx=0x7f963c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df26284907b9e5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:06.942 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.136+0000 7f9647e00640 1 -- 172.21.15.86:0/922363224 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f963c032440 con 0x7f9648071ee0 2024-09-13T16:01:06.943 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.136+0000 7f9647e00640 1 -- 172.21.15.86:0/922363224 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f963c032a80 con 0x7f9648071ee0 2024-09-13T16:01:06.943 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.136+0000 7f9647e00640 1 -- 172.21.15.86:0/922363224 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f963c0309b0 con 0x7f9648071ee0 2024-09-13T16:01:06.943 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.136+0000 7f964fe00640 1 -- 172.21.15.86:0/922363224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9648071ee0 msgr2=0x7f9648070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:06.943 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.136+0000 7f964fe00640 1 --2- 172.21.15.86:0/922363224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9648071ee0 0x7f9648070500 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f963c009820 tx=0x7f963c02a300 comp rx=0 tx=0).stop 2024-09-13T16:01:06.943 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.136+0000 7f964fe00640 1 -- 172.21.15.86:0/922363224 shutdown_connections 2024-09-13T16:01:06.943 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.136+0000 7f964fe00640 1 --2- 172.21.15.86:0/922363224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9648071ee0 0x7f9648070500 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:06.943 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.136+0000 7f964fe00640 1 -- 172.21.15.86:0/922363224 >> 172.21.15.86:0/922363224 conn(0x7f964806c5c0 msgr2=0x7f964806e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:06.943 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.136+0000 7f964fe00640 1 -- 172.21.15.86:0/922363224 shutdown_connections 2024-09-13T16:01:06.943 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.137+0000 7f964fe00640 1 -- 172.21.15.86:0/922363224 wait complete. 2024-09-13T16:01:06.943 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.138+0000 7f964fe00640 1 Processor -- start 2024-09-13T16:01:06.943 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.138+0000 7f964fe00640 1 -- start start 2024-09-13T16:01:06.943 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.138+0000 7f964fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9648071ee0 0x7f96481a8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:06.943 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.138+0000 7f964fe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96481a88d0 con 0x7f9648071ee0 2024-09-13T16:01:06.943 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.139+0000 7f964d400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9648071ee0 0x7f96481a8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:06.944 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.139+0000 7f964d400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9648071ee0 0x7f96481a8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37354/0 (socket says 172.21.15.86:37354) 2024-09-13T16:01:06.944 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.139+0000 7f964d400640 1 -- 172.21.15.86:0/3163018131 learned_addr learned my addr 172.21.15.86:0/3163018131 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:06.944 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.139+0000 7f964d400640 1 -- 172.21.15.86:0/3163018131 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963c0094d0 con 0x7f9648071ee0 2024-09-13T16:01:06.944 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.139+0000 7f964d400640 1 --2- 172.21.15.86:0/3163018131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9648071ee0 0x7f96481a8390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f963c0097f0 tx=0x7f963c0307a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:06.944 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.139+0000 7f9646000640 1 -- 172.21.15.86:0/3163018131 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f963c030c70 con 0x7f9648071ee0 2024-09-13T16:01:06.944 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.140+0000 7f9646000640 1 -- 172.21.15.86:0/3163018131 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f963c030dd0 con 0x7f9648071ee0 2024-09-13T16:01:06.944 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.140+0000 7f9646000640 1 -- 172.21.15.86:0/3163018131 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f963c03a760 con 0x7f9648071ee0 2024-09-13T16:01:06.944 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.140+0000 7f964fe00640 1 -- 172.21.15.86:0/3163018131 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96481a8ad0 con 0x7f9648071ee0 2024-09-13T16:01:06.944 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.140+0000 7f964fe00640 1 -- 172.21.15.86:0/3163018131 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96481a8f70 con 0x7f9648071ee0 2024-09-13T16:01:06.944 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.141+0000 7f964fe00640 1 -- 172.21.15.86:0/3163018131 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f964810ff60 con 0x7f9648071ee0 2024-09-13T16:01:06.944 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.141+0000 7f9646000640 1 -- 172.21.15.86:0/3163018131 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f963c039040 con 0x7f9648071ee0 2024-09-13T16:01:06.944 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.141+0000 7f9646000640 1 --2- 172.21.15.86:0/3163018131 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f96300386c0 0x7f963003ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:06.945 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.141+0000 7f9646000640 1 -- 172.21.15.86:0/3163018131 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f963c06b950 con 0x7f9648071ee0 2024-09-13T16:01:06.945 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.142+0000 7f964ca00640 1 --2- 172.21.15.86:0/3163018131 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f96300386c0 0x7f963003ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:06.945 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.142+0000 7f964ca00640 1 --2- 172.21.15.86:0/3163018131 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f96300386c0 0x7f963003ab80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f96340098c0 tx=0x7f9634006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:06.945 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.146+0000 7f9646000640 1 -- 172.21.15.86:0/3163018131 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f963c0313a0 con 0x7f9648071ee0 2024-09-13T16:01:06.945 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.222+0000 7f9646000640 1 -- 172.21.15.86:0/3163018131 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f963c03b480 con 0x7f9648071ee0 2024-09-13T16:01:06.945 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.320+0000 7f964fe00640 1 -- 172.21.15.86:0/3163018131 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f96481101a0 con 0x7f9648071ee0 2024-09-13T16:01:06.945 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.320+0000 7f9646000640 1 -- 172.21.15.86:0/3163018131 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f963c03f020 con 0x7f9648071ee0 2024-09-13T16:01:06.945 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.322+0000 7f964fe00640 1 -- 172.21.15.86:0/3163018131 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f96300386c0 msgr2=0x7f963003ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:06.945 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.322+0000 7f964fe00640 1 --2- 172.21.15.86:0/3163018131 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f96300386c0 0x7f963003ab80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f96340098c0 tx=0x7f9634006db0 comp rx=0 tx=0).stop 2024-09-13T16:01:06.945 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.322+0000 7f964fe00640 1 -- 172.21.15.86:0/3163018131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9648071ee0 msgr2=0x7f96481a8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:06.945 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.322+0000 7f964fe00640 1 --2- 172.21.15.86:0/3163018131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9648071ee0 0x7f96481a8390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f963c0097f0 tx=0x7f963c0307a0 comp rx=0 tx=0).stop 2024-09-13T16:01:06.945 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.322+0000 7f964fe00640 1 -- 172.21.15.86:0/3163018131 shutdown_connections 2024-09-13T16:01:06.946 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.322+0000 7f964fe00640 1 --2- 172.21.15.86:0/3163018131 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f96300386c0 0x7f963003ab80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:06.946 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.322+0000 7f964fe00640 1 --2- 172.21.15.86:0/3163018131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9648071ee0 0x7f96481a8390 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:06.946 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.322+0000 7f964fe00640 1 -- 172.21.15.86:0/3163018131 >> 172.21.15.86:0/3163018131 conn(0x7f964806c5c0 msgr2=0x7f964806e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:06.946 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.323+0000 7f964fe00640 1 -- 172.21.15.86:0/3163018131 shutdown_connections 2024-09-13T16:01:06.946 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:06.323+0000 7f964fe00640 1 -- 172.21.15.86:0/3163018131 wait complete. 2024-09-13T16:01:06.958 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T16:01:06.958 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout disabled 2024-09-13T16:01:06.971 INFO:teuthology.orchestra.run.smithi086.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T16:01:06.971 INFO:teuthology.orchestra.run.smithi086.stdout:systemctl: stdout inactive 2024-09-13T16:01:06.971 INFO:teuthology.orchestra.run.smithi086.stdout:firewalld.service is not enabled 2024-09-13T16:01:06.971 INFO:teuthology.orchestra.run.smithi086.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-13T16:01:06.974 INFO:teuthology.orchestra.run.smithi086.stdout:Ceph Dashboard is now available at: 2024-09-13T16:01:06.974 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:01:06.974 INFO:teuthology.orchestra.run.smithi086.stdout: URL: https://smithi086.front.sepia.ceph.com:8443/ 2024-09-13T16:01:06.974 INFO:teuthology.orchestra.run.smithi086.stdout: User: admin 2024-09-13T16:01:06.974 INFO:teuthology.orchestra.run.smithi086.stdout: Password: i7sw4w0zxv 2024-09-13T16:01:06.975 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:01:06.975 INFO:teuthology.orchestra.run.smithi086.stdout:Saving cluster configuration to /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config directory 2024-09-13T16:01:06.975 INFO:teuthology.orchestra.run.smithi086.stdout:Enabling autotune for osd_memory_target 2024-09-13T16:01:07.492 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:07 smithi086 ceph-mon[30379]: mgrmap e13: x(active, since 6s) 2024-09-13T16:01:07.493 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:07 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3163018131' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-13T16:01:08.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.507+0000 7f4fcb200640 1 Processor -- start 2024-09-13T16:01:08.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.508+0000 7f4fcb200640 1 -- start start 2024-09-13T16:01:08.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.508+0000 7f4fcb200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fcc107880 0x7f4fcc107c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:08.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.508+0000 7f4fcb200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc108250 con 0x7f4fcc107880 2024-09-13T16:01:08.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.508+0000 7f4fc9e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fcc107880 0x7f4fcc107c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:08.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.508+0000 7f4fc9e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fcc107880 0x7f4fcc107c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37370/0 (socket says 172.21.15.86:37370) 2024-09-13T16:01:08.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.508+0000 7f4fc9e00640 1 -- 172.21.15.86:0/254971856 learned_addr learned my addr 172.21.15.86:0/254971856 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:08.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.509+0000 7f4fc9e00640 1 -- 172.21.15.86:0/254971856 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc108a80 con 0x7f4fcc107880 2024-09-13T16:01:08.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.510+0000 7f4fc9e00640 1 --2- 172.21.15.86:0/254971856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fcc107880 0x7f4fcc107c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009820 tx=0x7f4fbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32272b230a6617dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:08.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.510+0000 7f4fc9400640 1 -- 172.21.15.86:0/254971856 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4fbc02ae70 con 0x7f4fcc107880 2024-09-13T16:01:08.315 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.510+0000 7f4fc9400640 1 -- 172.21.15.86:0/254971856 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4fbc032920 con 0x7f4fcc107880 2024-09-13T16:01:08.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.510+0000 7f4fc9400640 1 -- 172.21.15.86:0/254971856 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4fbc030920 con 0x7f4fcc107880 2024-09-13T16:01:08.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.510+0000 7f4fcb200640 1 -- 172.21.15.86:0/254971856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fcc107880 msgr2=0x7f4fcc107c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:08.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.510+0000 7f4fcb200640 1 --2- 172.21.15.86:0/254971856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fcc107880 0x7f4fcc107c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009820 tx=0x7f4fbc02a270 comp rx=0 tx=0).stop 2024-09-13T16:01:08.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.511+0000 7f4fcb200640 1 -- 172.21.15.86:0/254971856 shutdown_connections 2024-09-13T16:01:08.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.511+0000 7f4fcb200640 1 --2- 172.21.15.86:0/254971856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fcc107880 0x7f4fcc107c80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:08.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.511+0000 7f4fcb200640 1 -- 172.21.15.86:0/254971856 >> 172.21.15.86:0/254971856 conn(0x7f4fcc07ae90 msgr2=0x7f4fcc07b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:08.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.511+0000 7f4fcb200640 1 -- 172.21.15.86:0/254971856 shutdown_connections 2024-09-13T16:01:08.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.511+0000 7f4fcb200640 1 -- 172.21.15.86:0/254971856 wait complete. 2024-09-13T16:01:08.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.512+0000 7f4fcb200640 1 Processor -- start 2024-09-13T16:01:08.316 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.512+0000 7f4fcb200640 1 -- start start 2024-09-13T16:01:08.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.512+0000 7f4fcb200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fcc107880 0x7f4fcc19b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:08.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.512+0000 7f4fcb200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc19bb50 con 0x7f4fcc107880 2024-09-13T16:01:08.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.512+0000 7f4fc9e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fcc107880 0x7f4fcc19b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:08.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.512+0000 7f4fc9e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fcc107880 0x7f4fcc19b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37374/0 (socket says 172.21.15.86:37374) 2024-09-13T16:01:08.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.512+0000 7f4fc9e00640 1 -- 172.21.15.86:0/2392958997 learned_addr learned my addr 172.21.15.86:0/2392958997 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:08.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.513+0000 7f4fc9e00640 1 -- 172.21.15.86:0/2392958997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc0094d0 con 0x7f4fcc107880 2024-09-13T16:01:08.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.513+0000 7f4fc9e00640 1 --2- 172.21.15.86:0/2392958997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fcc107880 0x7f4fcc19b610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc030670 tx=0x7f4fbc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:08.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.513+0000 7f4fc3400640 1 -- 172.21.15.86:0/2392958997 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4fbc032dd0 con 0x7f4fcc107880 2024-09-13T16:01:08.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.513+0000 7f4fc3400640 1 -- 172.21.15.86:0/2392958997 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4fbc03b910 con 0x7f4fcc107880 2024-09-13T16:01:08.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.513+0000 7f4fc3400640 1 -- 172.21.15.86:0/2392958997 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4fbc03a830 con 0x7f4fcc107880 2024-09-13T16:01:08.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.513+0000 7f4fcb200640 1 -- 172.21.15.86:0/2392958997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fcc19bd50 con 0x7f4fcc107880 2024-09-13T16:01:08.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.513+0000 7f4fcb200640 1 -- 172.21.15.86:0/2392958997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fcc19c1f0 con 0x7f4fcc107880 2024-09-13T16:01:08.317 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.514+0000 7f4fc3400640 1 -- 172.21.15.86:0/2392958997 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f4fbc039040 con 0x7f4fcc107880 2024-09-13T16:01:08.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.514+0000 7f4fcb200640 1 -- 172.21.15.86:0/2392958997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fcc10bcb0 con 0x7f4fcc107880 2024-09-13T16:01:08.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.515+0000 7f4fc3400640 1 --2- 172.21.15.86:0/2392958997 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4fb0038760 0x7f4fb003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:08.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.515+0000 7f4fc3400640 1 -- 172.21.15.86:0/2392958997 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4fbc06bbd0 con 0x7f4fcc107880 2024-09-13T16:01:08.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.515+0000 7f4fc1400640 1 --2- 172.21.15.86:0/2392958997 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4fb0038760 0x7f4fb003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:08.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.516+0000 7f4fc1400640 1 --2- 172.21.15.86:0/2392958997 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4fb0038760 0x7f4fb003ac20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40098c0 tx=0x7f4fb4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:08.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.520+0000 7f4fc3400640 1 -- 172.21.15.86:0/2392958997 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4fbc03be10 con 0x7f4fcc107880 2024-09-13T16:01:08.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.688+0000 7f4fcb200640 1 -- 172.21.15.86:0/2392958997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f4fcc19ead0 con 0x7f4fcc107880 2024-09-13T16:01:08.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.689+0000 7f4fc3400640 1 -- 172.21.15.86:0/2392958997 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f4fbc03f030 con 0x7f4fcc107880 2024-09-13T16:01:08.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.691+0000 7f4fcb200640 1 -- 172.21.15.86:0/2392958997 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4fb0038760 msgr2=0x7f4fb003ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:08.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.691+0000 7f4fcb200640 1 --2- 172.21.15.86:0/2392958997 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4fb0038760 0x7f4fb003ac20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40098c0 tx=0x7f4fb4006db0 comp rx=0 tx=0).stop 2024-09-13T16:01:08.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.691+0000 7f4fcb200640 1 -- 172.21.15.86:0/2392958997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fcc107880 msgr2=0x7f4fcc19b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:08.318 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.691+0000 7f4fcb200640 1 --2- 172.21.15.86:0/2392958997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fcc107880 0x7f4fcc19b610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc030670 tx=0x7f4fbc032670 comp rx=0 tx=0).stop 2024-09-13T16:01:08.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.691+0000 7f4fcb200640 1 -- 172.21.15.86:0/2392958997 shutdown_connections 2024-09-13T16:01:08.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.691+0000 7f4fcb200640 1 --2- 172.21.15.86:0/2392958997 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4fb0038760 0x7f4fb003ac20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:08.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.691+0000 7f4fcb200640 1 --2- 172.21.15.86:0/2392958997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fcc107880 0x7f4fcc19b610 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:08.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.691+0000 7f4fcb200640 1 -- 172.21.15.86:0/2392958997 >> 172.21.15.86:0/2392958997 conn(0x7f4fcc07ae90 msgr2=0x7f4fcc104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:08.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.691+0000 7f4fcb200640 1 -- 172.21.15.86:0/2392958997 shutdown_connections 2024-09-13T16:01:08.319 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:07.691+0000 7f4fcb200640 1 -- 172.21.15.86:0/2392958997 wait complete. 2024-09-13T16:01:09.806 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.845+0000 7f77a3200640 1 Processor -- start 2024-09-13T16:01:09.806 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.845+0000 7f77a3200640 1 -- start start 2024-09-13T16:01:09.806 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.845+0000 7f77a3200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77a41055e0 0x7f77a41059e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:09.806 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.845+0000 7f77a3200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a4105f20 con 0x7f77a41055e0 2024-09-13T16:01:09.806 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.845+0000 7f77a1e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77a41055e0 0x7f77a41059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:09.806 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.845+0000 7f77a1e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77a41055e0 0x7f77a41059e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37378/0 (socket says 172.21.15.86:37378) 2024-09-13T16:01:09.806 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.845+0000 7f77a1e00640 1 -- 172.21.15.86:0/759308343 learned_addr learned my addr 172.21.15.86:0/759308343 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:09.807 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.846+0000 7f77a1e00640 1 -- 172.21.15.86:0/759308343 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a4106060 con 0x7f77a41055e0 2024-09-13T16:01:09.807 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.847+0000 7f77a1e00640 1 --2- 172.21.15.86:0/759308343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77a41055e0 0x7f77a41059e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7794009820 tx=0x7f779402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894d3db3b6e908c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:09.807 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.847+0000 7f77a1400640 1 -- 172.21.15.86:0/759308343 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f779402ae70 con 0x7f77a41055e0 2024-09-13T16:01:09.807 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.847+0000 7f77a1400640 1 -- 172.21.15.86:0/759308343 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7794032920 con 0x7f77a41055e0 2024-09-13T16:01:09.807 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.847+0000 7f77a1400640 1 -- 172.21.15.86:0/759308343 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7794030920 con 0x7f77a41055e0 2024-09-13T16:01:09.807 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.848+0000 7f77a3200640 1 -- 172.21.15.86:0/759308343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77a41055e0 msgr2=0x7f77a41059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:09.807 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.848+0000 7f77a3200640 1 --2- 172.21.15.86:0/759308343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77a41055e0 0x7f77a41059e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7794009820 tx=0x7f779402a270 comp rx=0 tx=0).stop 2024-09-13T16:01:09.807 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.848+0000 7f77a3200640 1 -- 172.21.15.86:0/759308343 shutdown_connections 2024-09-13T16:01:09.807 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.848+0000 7f77a3200640 1 --2- 172.21.15.86:0/759308343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77a41055e0 0x7f77a41059e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:09.807 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.848+0000 7f77a3200640 1 -- 172.21.15.86:0/759308343 >> 172.21.15.86:0/759308343 conn(0x7f77a4100e10 msgr2=0x7f77a4103250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:09.807 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.848+0000 7f77a3200640 1 -- 172.21.15.86:0/759308343 shutdown_connections 2024-09-13T16:01:09.807 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.848+0000 7f77a3200640 1 -- 172.21.15.86:0/759308343 wait complete. 2024-09-13T16:01:09.807 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.849+0000 7f77a3200640 1 Processor -- start 2024-09-13T16:01:09.808 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.849+0000 7f77a3200640 1 -- start start 2024-09-13T16:01:09.808 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.849+0000 7f77a3200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77a41055e0 0x7f77a419b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:09.808 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.849+0000 7f77a3200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a419bac0 con 0x7f77a41055e0 2024-09-13T16:01:09.808 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.849+0000 7f77a1e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77a41055e0 0x7f77a419b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:09.808 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.849+0000 7f77a1e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77a41055e0 0x7f77a419b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37394/0 (socket says 172.21.15.86:37394) 2024-09-13T16:01:09.808 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.849+0000 7f77a1e00640 1 -- 172.21.15.86:0/3439922169 learned_addr learned my addr 172.21.15.86:0/3439922169 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:09.808 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.850+0000 7f77a1e00640 1 -- 172.21.15.86:0/3439922169 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77940094d0 con 0x7f77a41055e0 2024-09-13T16:01:09.808 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.850+0000 7f77a1e00640 1 --2- 172.21.15.86:0/3439922169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77a41055e0 0x7f77a419b580 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7794030460 tx=0x7f7794032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:09.808 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.850+0000 7f779aa00640 1 -- 172.21.15.86:0/3439922169 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7794032dd0 con 0x7f77a41055e0 2024-09-13T16:01:09.808 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.850+0000 7f779aa00640 1 -- 172.21.15.86:0/3439922169 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f779403b910 con 0x7f77a41055e0 2024-09-13T16:01:09.808 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.850+0000 7f77a3200640 1 -- 172.21.15.86:0/3439922169 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a419bcc0 con 0x7f77a41055e0 2024-09-13T16:01:09.808 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.850+0000 7f77a3200640 1 -- 172.21.15.86:0/3439922169 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a419c160 con 0x7f77a41055e0 2024-09-13T16:01:09.808 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.851+0000 7f779aa00640 1 -- 172.21.15.86:0/3439922169 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f779403a820 con 0x7f77a41055e0 2024-09-13T16:01:09.808 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.851+0000 7f77a3200640 1 -- 172.21.15.86:0/3439922169 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a4109a50 con 0x7f77a41055e0 2024-09-13T16:01:09.809 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.852+0000 7f779aa00640 1 -- 172.21.15.86:0/3439922169 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f7794039040 con 0x7f77a41055e0 2024-09-13T16:01:09.809 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.852+0000 7f779aa00640 1 --2- 172.21.15.86:0/3439922169 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7788038710 0x7f778803abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:09.809 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.852+0000 7f779aa00640 1 -- 172.21.15.86:0/3439922169 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f779406bbb0 con 0x7f77a41055e0 2024-09-13T16:01:09.809 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.852+0000 7f779be00640 1 --2- 172.21.15.86:0/3439922169 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7788038710 0x7f778803abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:09.809 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.853+0000 7f779be00640 1 --2- 172.21.15.86:0/3439922169 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7788038710 0x7f778803abd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f778c0098c0 tx=0x7f778c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:09.809 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:08.857+0000 7f779aa00640 1 -- 172.21.15.86:0/3439922169 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f779403be10 con 0x7f77a41055e0 2024-09-13T16:01:09.809 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:09.111+0000 7f77a3200640 1 -- 172.21.15.86:0/3439922169 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f77a419ea40 con 0x7f77a41055e0 2024-09-13T16:01:09.809 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:09.114+0000 7f779aa00640 1 -- 172.21.15.86:0/3439922169 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f779403f070 con 0x7f77a41055e0 2024-09-13T16:01:09.809 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-13T16:01:09.809 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:09.116+0000 7f77a3200640 1 -- 172.21.15.86:0/3439922169 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7788038710 msgr2=0x7f778803abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:09.809 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:09.116+0000 7f77a3200640 1 --2- 172.21.15.86:0/3439922169 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7788038710 0x7f778803abd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f778c0098c0 tx=0x7f778c006db0 comp rx=0 tx=0).stop 2024-09-13T16:01:09.809 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:09.116+0000 7f77a3200640 1 -- 172.21.15.86:0/3439922169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77a41055e0 msgr2=0x7f77a419b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:09.809 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:09.116+0000 7f77a3200640 1 --2- 172.21.15.86:0/3439922169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77a41055e0 0x7f77a419b580 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7794030460 tx=0x7f7794032670 comp rx=0 tx=0).stop 2024-09-13T16:01:09.810 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:09.116+0000 7f77a3200640 1 -- 172.21.15.86:0/3439922169 shutdown_connections 2024-09-13T16:01:09.810 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:09.116+0000 7f77a3200640 1 --2- 172.21.15.86:0/3439922169 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7788038710 0x7f778803abd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:09.810 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:09.116+0000 7f77a3200640 1 --2- 172.21.15.86:0/3439922169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77a41055e0 0x7f77a419b580 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:09.810 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:09.116+0000 7f77a3200640 1 -- 172.21.15.86:0/3439922169 >> 172.21.15.86:0/3439922169 conn(0x7f77a4100e10 msgr2=0x7f77a4101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:09.810 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:09.117+0000 7f77a3200640 1 -- 172.21.15.86:0/3439922169 shutdown_connections 2024-09-13T16:01:09.810 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/bin/ceph: stderr 2024-09-13T16:01:09.117+0000 7f77a3200640 1 -- 172.21.15.86:0/3439922169 wait complete. 2024-09-13T16:01:09.810 INFO:teuthology.orchestra.run.smithi086.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-13T16:01:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:01:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:01:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:01:09.810 INFO:teuthology.orchestra.run.smithi086.stdout:Or, if you are only running a single cluster on this host: 2024-09-13T16:01:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:01:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-13T16:01:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:01:09.811 INFO:teuthology.orchestra.run.smithi086.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-13T16:01:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:01:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: ceph telemetry on 2024-09-13T16:01:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:01:09.811 INFO:teuthology.orchestra.run.smithi086.stdout:For more information see: 2024-09-13T16:01:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:01:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-13T16:01:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:01:09.811 INFO:teuthology.orchestra.run.smithi086.stdout:Bootstrap complete. 2024-09-13T16:01:09.855 INFO:tasks.cephadm:Fetching config... 2024-09-13T16:01:09.855 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T16:01:09.855 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-13T16:01:09.890 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-13T16:01:09.890 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T16:01:09.890 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-13T16:01:09.968 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-13T16:01:09.969 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T16:01:09.969 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-13T16:01:10.065 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-13T16:01:10.065 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T16:01:10.065 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-13T16:01:10.140 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-13T16:01:10.140 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9RDwkh1cWYKAHNWys/3smK+D5N80VOJeCpP3jsThLHmHseriW2rbGjnpQ1DgprNDA7O0zHn5YCbXQSAlqmbbE3NnejLcmGjMFllBb2FE9b4HhLWagnwegL6tOtBYcpcBAFamnryQ/+Vsz//rMJ+8jfEvMfhiRXQnG6ElMSr7gntclp8t2nzgWw6pCxfvrqPr9VBMAxk01mPHG63w4MltUiLJeg/lz3yjf81jLx7eX2MTnxkFBUeqltmXGMeS3YVkrIMZjV+IG9K5XSysXgLPu6+KXCEjU0X1JjdV1McacDBqqRJ2fqyFMiog+EtU2caRe0vJ0wDm3xIqAssN9zkZATTy514aNKHVZ5DMgax6SS0XUYtH2SE9cGLv1bwEcPAk2LGapGC6dDDt5vVSunASqQSqNjyKu22/PrVN26b7PxSWvRgqK9W/RVf35utmSlu9beVg/V47oYhTvrFfMz24QMKs3pkTvgY+u7lFi4rjfero0CC/Y9VpHu4lgJPjCp28= ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T16:01:10.262 INFO:teuthology.orchestra.run.smithi086.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9RDwkh1cWYKAHNWys/3smK+D5N80VOJeCpP3jsThLHmHseriW2rbGjnpQ1DgprNDA7O0zHn5YCbXQSAlqmbbE3NnejLcmGjMFllBb2FE9b4HhLWagnwegL6tOtBYcpcBAFamnryQ/+Vsz//rMJ+8jfEvMfhiRXQnG6ElMSr7gntclp8t2nzgWw6pCxfvrqPr9VBMAxk01mPHG63w4MltUiLJeg/lz3yjf81jLx7eX2MTnxkFBUeqltmXGMeS3YVkrIMZjV+IG9K5XSysXgLPu6+KXCEjU0X1JjdV1McacDBqqRJ2fqyFMiog+EtU2caRe0vJ0wDm3xIqAssN9zkZATTy514aNKHVZ5DMgax6SS0XUYtH2SE9cGLv1bwEcPAk2LGapGC6dDDt5vVSunASqQSqNjyKu22/PrVN26b7PxSWvRgqK9W/RVf35utmSlu9beVg/V47oYhTvrFfMz24QMKs3pkTvgY+u7lFi4rjfero0CC/Y9VpHu4lgJPjCp28= ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:01:10.286 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9RDwkh1cWYKAHNWys/3smK+D5N80VOJeCpP3jsThLHmHseriW2rbGjnpQ1DgprNDA7O0zHn5YCbXQSAlqmbbE3NnejLcmGjMFllBb2FE9b4HhLWagnwegL6tOtBYcpcBAFamnryQ/+Vsz//rMJ+8jfEvMfhiRXQnG6ElMSr7gntclp8t2nzgWw6pCxfvrqPr9VBMAxk01mPHG63w4MltUiLJeg/lz3yjf81jLx7eX2MTnxkFBUeqltmXGMeS3YVkrIMZjV+IG9K5XSysXgLPu6+KXCEjU0X1JjdV1McacDBqqRJ2fqyFMiog+EtU2caRe0vJ0wDm3xIqAssN9zkZATTy514aNKHVZ5DMgax6SS0XUYtH2SE9cGLv1bwEcPAk2LGapGC6dDDt5vVSunASqQSqNjyKu22/PrVN26b7PxSWvRgqK9W/RVf35utmSlu9beVg/V47oYhTvrFfMz24QMKs3pkTvgY+u7lFi4rjfero0CC/Y9VpHu4lgJPjCp28= ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T16:01:10.330 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:10 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3439922169' entity='client.admin' 2024-09-13T16:01:10.331 INFO:teuthology.orchestra.run.smithi139.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9RDwkh1cWYKAHNWys/3smK+D5N80VOJeCpP3jsThLHmHseriW2rbGjnpQ1DgprNDA7O0zHn5YCbXQSAlqmbbE3NnejLcmGjMFllBb2FE9b4HhLWagnwegL6tOtBYcpcBAFamnryQ/+Vsz//rMJ+8jfEvMfhiRXQnG6ElMSr7gntclp8t2nzgWw6pCxfvrqPr9VBMAxk01mPHG63w4MltUiLJeg/lz3yjf81jLx7eX2MTnxkFBUeqltmXGMeS3YVkrIMZjV+IG9K5XSysXgLPu6+KXCEjU0X1JjdV1McacDBqqRJ2fqyFMiog+EtU2caRe0vJ0wDm3xIqAssN9zkZATTy514aNKHVZ5DMgax6SS0XUYtH2SE9cGLv1bwEcPAk2LGapGC6dDDt5vVSunASqQSqNjyKu22/PrVN26b7PxSWvRgqK9W/RVf35utmSlu9beVg/V47oYhTvrFfMz24QMKs3pkTvgY+u7lFi4rjfero0CC/Y9VpHu4lgJPjCp28= ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:01:10.343 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9RDwkh1cWYKAHNWys/3smK+D5N80VOJeCpP3jsThLHmHseriW2rbGjnpQ1DgprNDA7O0zHn5YCbXQSAlqmbbE3NnejLcmGjMFllBb2FE9b4HhLWagnwegL6tOtBYcpcBAFamnryQ/+Vsz//rMJ+8jfEvMfhiRXQnG6ElMSr7gntclp8t2nzgWw6pCxfvrqPr9VBMAxk01mPHG63w4MltUiLJeg/lz3yjf81jLx7eX2MTnxkFBUeqltmXGMeS3YVkrIMZjV+IG9K5XSysXgLPu6+KXCEjU0X1JjdV1McacDBqqRJ2fqyFMiog+EtU2caRe0vJ0wDm3xIqAssN9zkZATTy514aNKHVZ5DMgax6SS0XUYtH2SE9cGLv1bwEcPAk2LGapGC6dDDt5vVSunASqQSqNjyKu22/PrVN26b7PxSWvRgqK9W/RVf35utmSlu9beVg/V47oYhTvrFfMz24QMKs3pkTvgY+u7lFi4rjfero0CC/Y9VpHu4lgJPjCp28= ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T16:01:10.388 INFO:teuthology.orchestra.run.smithi194.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9RDwkh1cWYKAHNWys/3smK+D5N80VOJeCpP3jsThLHmHseriW2rbGjnpQ1DgprNDA7O0zHn5YCbXQSAlqmbbE3NnejLcmGjMFllBb2FE9b4HhLWagnwegL6tOtBYcpcBAFamnryQ/+Vsz//rMJ+8jfEvMfhiRXQnG6ElMSr7gntclp8t2nzgWw6pCxfvrqPr9VBMAxk01mPHG63w4MltUiLJeg/lz3yjf81jLx7eX2MTnxkFBUeqltmXGMeS3YVkrIMZjV+IG9K5XSysXgLPu6+KXCEjU0X1JjdV1McacDBqqRJ2fqyFMiog+EtU2caRe0vJ0wDm3xIqAssN9zkZATTy514aNKHVZ5DMgax6SS0XUYtH2SE9cGLv1bwEcPAk2LGapGC6dDDt5vVSunASqQSqNjyKu22/PrVN26b7PxSWvRgqK9W/RVf35utmSlu9beVg/V47oYhTvrFfMz24QMKs3pkTvgY+u7lFi4rjfero0CC/Y9VpHu4lgJPjCp28= ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:01:10.401 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-13T16:01:10.711 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:01:13.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.281+0000 7fa595a00640 1 -- 172.21.15.86:0/1414832997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5900ff7e0 msgr2=0x7fa5900ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:13.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.281+0000 7fa595a00640 1 --2- 172.21.15.86:0/1414832997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5900ff7e0 0x7fa5900ffbe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa580009880 tx=0x7fa58002a5d0 comp rx=0 tx=0).stop 2024-09-13T16:01:13.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.282+0000 7fa595a00640 1 -- 172.21.15.86:0/1414832997 shutdown_connections 2024-09-13T16:01:13.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.282+0000 7fa595a00640 1 --2- 172.21.15.86:0/1414832997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5900ff7e0 0x7fa5900ffbe0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:13.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.282+0000 7fa595a00640 1 -- 172.21.15.86:0/1414832997 >> 172.21.15.86:0/1414832997 conn(0x7fa5900faf90 msgr2=0x7fa5900fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:13.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.282+0000 7fa595a00640 1 -- 172.21.15.86:0/1414832997 shutdown_connections 2024-09-13T16:01:13.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.282+0000 7fa595a00640 1 -- 172.21.15.86:0/1414832997 wait complete. 2024-09-13T16:01:13.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.283+0000 7fa595a00640 1 Processor -- start 2024-09-13T16:01:13.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.283+0000 7fa595a00640 1 -- start start 2024-09-13T16:01:13.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.283+0000 7fa595a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5900ff7e0 0x7fa590196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:13.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.283+0000 7fa595a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa590197480 con 0x7fa5900ff7e0 2024-09-13T16:01:13.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.284+0000 7fa58ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5900ff7e0 0x7fa590196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.284+0000 7fa58ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5900ff7e0 0x7fa590196f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47936/0 (socket says 172.21.15.86:47936) 2024-09-13T16:01:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.284+0000 7fa58ea00640 1 -- 172.21.15.86:0/560734233 learned_addr learned my addr 172.21.15.86:0/560734233 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.284+0000 7fa58ea00640 1 -- 172.21.15.86:0/560734233 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa580009560 con 0x7fa5900ff7e0 2024-09-13T16:01:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.284+0000 7fa58ea00640 1 --2- 172.21.15.86:0/560734233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5900ff7e0 0x7fa590196f40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa5800057c0 tx=0x7fa5800056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.285+0000 7fa587400640 1 -- 172.21.15.86:0/560734233 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa580004ba0 con 0x7fa5900ff7e0 2024-09-13T16:01:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.285+0000 7fa587400640 1 -- 172.21.15.86:0/560734233 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa580004d00 con 0x7fa5900ff7e0 2024-09-13T16:01:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.285+0000 7fa587400640 1 -- 172.21.15.86:0/560734233 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa580031b00 con 0x7fa5900ff7e0 2024-09-13T16:01:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.285+0000 7fa595a00640 1 -- 172.21.15.86:0/560734233 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa590197680 con 0x7fa5900ff7e0 2024-09-13T16:01:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.285+0000 7fa595a00640 1 -- 172.21.15.86:0/560734233 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa590197ac0 con 0x7fa5900ff7e0 2024-09-13T16:01:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.286+0000 7fa595a00640 1 -- 172.21.15.86:0/560734233 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5900ffc60 con 0x7fa5900ff7e0 2024-09-13T16:01:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.286+0000 7fa587400640 1 -- 172.21.15.86:0/560734233 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fa580031d30 con 0x7fa5900ff7e0 2024-09-13T16:01:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.287+0000 7fa587400640 1 --2- 172.21.15.86:0/560734233 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa574038760 0x7fa57403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:13.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.287+0000 7fa587400640 1 -- 172.21.15.86:0/560734233 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa58006c530 con 0x7fa5900ff7e0 2024-09-13T16:01:13.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.287+0000 7fa58e000640 1 --2- 172.21.15.86:0/560734233 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa574038760 0x7fa57403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:13.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.288+0000 7fa58e000640 1 --2- 172.21.15.86:0/560734233 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa574038760 0x7fa57403ac20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0098c0 tx=0x7fa57c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:13.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.292+0000 7fa587400640 1 -- 172.21.15.86:0/560734233 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa58004d9a0 con 0x7fa5900ff7e0 2024-09-13T16:01:13.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.470+0000 7fa595a00640 1 -- 172.21.15.86:0/560734233 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fa590190a40 con 0x7fa5900ff7e0 2024-09-13T16:01:13.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.476+0000 7fa587400640 1 -- 172.21.15.86:0/560734233 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fa580035030 con 0x7fa5900ff7e0 2024-09-13T16:01:13.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.478+0000 7fa595a00640 1 -- 172.21.15.86:0/560734233 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa574038760 msgr2=0x7fa57403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:13.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.478+0000 7fa595a00640 1 --2- 172.21.15.86:0/560734233 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa574038760 0x7fa57403ac20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0098c0 tx=0x7fa57c006db0 comp rx=0 tx=0).stop 2024-09-13T16:01:13.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.478+0000 7fa595a00640 1 -- 172.21.15.86:0/560734233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5900ff7e0 msgr2=0x7fa590196f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:13.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.478+0000 7fa595a00640 1 --2- 172.21.15.86:0/560734233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5900ff7e0 0x7fa590196f40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa5800057c0 tx=0x7fa5800056e0 comp rx=0 tx=0).stop 2024-09-13T16:01:13.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.478+0000 7fa595a00640 1 -- 172.21.15.86:0/560734233 shutdown_connections 2024-09-13T16:01:13.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.478+0000 7fa595a00640 1 --2- 172.21.15.86:0/560734233 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa574038760 0x7fa57403ac20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:13.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.478+0000 7fa595a00640 1 --2- 172.21.15.86:0/560734233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5900ff7e0 0x7fa590196f40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:13.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.478+0000 7fa595a00640 1 -- 172.21.15.86:0/560734233 >> 172.21.15.86:0/560734233 conn(0x7fa5900faf90 msgr2=0x7fa5900fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:13.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.479+0000 7fa595a00640 1 -- 172.21.15.86:0/560734233 shutdown_connections 2024-09-13T16:01:13.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:13.479+0000 7fa595a00640 1 -- 172.21.15.86:0/560734233 wait complete. 2024-09-13T16:01:14.251 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-13T16:01:14.251 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-13T16:01:14.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:14 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/560734233' entity='client.admin' 2024-09-13T16:01:15.073 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:01:16.351 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:16.351 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:16.351 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi086", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:01:16.352 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:16.352 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:01:16.352 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:16.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.990+0000 7f9aa2600640 1 -- 172.21.15.86:0/3901316027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a9c0ff620 msgr2=0x7f9a9c0ffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:16.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.990+0000 7f9aa2600640 1 --2- 172.21.15.86:0/3901316027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a9c0ff620 0x7f9a9c0ffa20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9a90009880 tx=0x7f9a9002a5d0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.991+0000 7f9aa2600640 1 -- 172.21.15.86:0/3901316027 shutdown_connections 2024-09-13T16:01:16.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.991+0000 7f9aa2600640 1 --2- 172.21.15.86:0/3901316027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a9c0ff620 0x7f9a9c0ffa20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:16.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.991+0000 7f9aa2600640 1 -- 172.21.15.86:0/3901316027 >> 172.21.15.86:0/3901316027 conn(0x7f9a9c0fad90 msgr2=0x7f9a9c0fd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:16.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.991+0000 7f9aa2600640 1 -- 172.21.15.86:0/3901316027 shutdown_connections 2024-09-13T16:01:16.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.991+0000 7f9aa2600640 1 -- 172.21.15.86:0/3901316027 wait complete. 2024-09-13T16:01:16.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.992+0000 7f9aa2600640 1 Processor -- start 2024-09-13T16:01:16.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.992+0000 7f9aa2600640 1 -- start start 2024-09-13T16:01:16.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.992+0000 7f9aa2600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a9c0ff620 0x7f9a9c074170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:16.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.992+0000 7f9aa2600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c0746b0 con 0x7f9a9c0ff620 2024-09-13T16:01:16.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.992+0000 7f9aa1200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a9c0ff620 0x7f9a9c074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:16.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.992+0000 7f9aa1200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a9c0ff620 0x7f9a9c074170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47956/0 (socket says 172.21.15.86:47956) 2024-09-13T16:01:16.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.992+0000 7f9aa1200640 1 -- 172.21.15.86:0/594304713 learned_addr learned my addr 172.21.15.86:0/594304713 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:16.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.993+0000 7f9aa1200640 1 -- 172.21.15.86:0/594304713 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a90009560 con 0x7f9a9c0ff620 2024-09-13T16:01:16.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.993+0000 7f9aa1200640 1 --2- 172.21.15.86:0/594304713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a9c0ff620 0x7f9a9c074170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a900057c0 tx=0x7f9a900056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:16.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.993+0000 7f9a99600640 1 -- 172.21.15.86:0/594304713 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a90004ba0 con 0x7f9a9c0ff620 2024-09-13T16:01:16.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.993+0000 7f9a99600640 1 -- 172.21.15.86:0/594304713 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9a90004d00 con 0x7f9a9c0ff620 2024-09-13T16:01:16.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.993+0000 7f9aa2600640 1 -- 172.21.15.86:0/594304713 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a9c0728a0 con 0x7f9a9c0ff620 2024-09-13T16:01:16.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.993+0000 7f9a99600640 1 -- 172.21.15.86:0/594304713 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a90031b00 con 0x7f9a9c0ff620 2024-09-13T16:01:16.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.993+0000 7f9aa2600640 1 -- 172.21.15.86:0/594304713 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9c072ce0 con 0x7f9a9c0ff620 2024-09-13T16:01:16.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.995+0000 7f9aa2600640 1 -- 172.21.15.86:0/594304713 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a9c105e40 con 0x7f9a9c0ff620 2024-09-13T16:01:16.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.995+0000 7f9a99600640 1 -- 172.21.15.86:0/594304713 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f9a900035f0 con 0x7f9a9c0ff620 2024-09-13T16:01:16.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.995+0000 7f9a99600640 1 --2- 172.21.15.86:0/594304713 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9a84038710 0x7f9a8403abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:16.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.995+0000 7f9a99600640 1 -- 172.21.15.86:0/594304713 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9a9006c560 con 0x7f9a9c0ff620 2024-09-13T16:01:16.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.995+0000 7f9a9be00640 1 --2- 172.21.15.86:0/594304713 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9a84038710 0x7f9a8403abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:16.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:16.996+0000 7f9a9be00640 1 --2- 172.21.15.86:0/594304713 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9a84038710 0x7f9a8403abd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9a880098c0 tx=0x7f9a88006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:17.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:17.000+0000 7f9a99600640 1 -- 172.21.15.86:0/594304713 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9a90003dd0 con 0x7f9a9c0ff620 2024-09-13T16:01:17.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:17.172+0000 7f9aa2600640 1 -- 172.21.15.86:0/594304713 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a9c072fe0 con 0x7f9a84038710 2024-09-13T16:01:17.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:17.176+0000 7f9a99600640 1 -- 172.21.15.86:0/594304713 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9a9c072fe0 con 0x7f9a84038710 2024-09-13T16:01:17.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:17.178+0000 7f9aa2600640 1 -- 172.21.15.86:0/594304713 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9a84038710 msgr2=0x7f9a8403abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:17.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:17.178+0000 7f9aa2600640 1 --2- 172.21.15.86:0/594304713 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9a84038710 0x7f9a8403abd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9a880098c0 tx=0x7f9a88006db0 comp rx=0 tx=0).stop 2024-09-13T16:01:17.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:17.178+0000 7f9aa2600640 1 -- 172.21.15.86:0/594304713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a9c0ff620 msgr2=0x7f9a9c074170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:17.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:17.178+0000 7f9aa2600640 1 --2- 172.21.15.86:0/594304713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a9c0ff620 0x7f9a9c074170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a900057c0 tx=0x7f9a900056e0 comp rx=0 tx=0).stop 2024-09-13T16:01:17.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:17.178+0000 7f9aa2600640 1 -- 172.21.15.86:0/594304713 shutdown_connections 2024-09-13T16:01:17.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:17.178+0000 7f9aa2600640 1 --2- 172.21.15.86:0/594304713 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9a84038710 0x7f9a8403abd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:17.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:17.178+0000 7f9aa2600640 1 --2- 172.21.15.86:0/594304713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a9c0ff620 0x7f9a9c074170 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:17.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:17.178+0000 7f9aa2600640 1 -- 172.21.15.86:0/594304713 >> 172.21.15.86:0/594304713 conn(0x7f9a9c0fad90 msgr2=0x7f9a9c0fb840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:17.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:17.178+0000 7f9aa2600640 1 -- 172.21.15.86:0/594304713 shutdown_connections 2024-09-13T16:01:17.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:17.179+0000 7f9aa2600640 1 -- 172.21.15.86:0/594304713 wait complete. 2024-09-13T16:01:17.899 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi139 2024-09-13T16:01:17.899 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T16:01:17.899 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/etc/ceph/ceph.conf 2024-09-13T16:01:17.918 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T16:01:17.918 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:01:17.975 INFO:tasks.cephadm:Adding host smithi139 to orchestrator... 2024-09-13T16:01:17.976 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch host add smithi139 2024-09-13T16:01:18.292 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:01:18.433 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:18 smithi086 ceph-mon[30379]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:01:18.433 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:18 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:18.433 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:18 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:01:18.434 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:18 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:18.434 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:18 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:01:18.434 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:18 smithi086 ceph-mon[30379]: Updating smithi086:/etc/ceph/ceph.conf 2024-09-13T16:01:19.456 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:19 smithi086 ceph-mon[30379]: Updating smithi086:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:01:19.457 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:19 smithi086 ceph-mon[30379]: Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:01:19.457 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:19 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:19.457 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:19 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:19.457 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:19 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:20.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.229+0000 7f4406200640 1 -- 172.21.15.86:0/1674109169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4400106540 msgr2=0x7f4400106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:20.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.229+0000 7f4406200640 1 --2- 172.21.15.86:0/1674109169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4400106540 0x7f4400106920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f43f0009880 tx=0x7f43f002a5d0 comp rx=0 tx=0).stop 2024-09-13T16:01:20.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.229+0000 7f4406200640 1 -- 172.21.15.86:0/1674109169 shutdown_connections 2024-09-13T16:01:20.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.229+0000 7f4406200640 1 --2- 172.21.15.86:0/1674109169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4400106540 0x7f4400106920 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:20.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.229+0000 7f4406200640 1 -- 172.21.15.86:0/1674109169 >> 172.21.15.86:0/1674109169 conn(0x7f44000784f0 msgr2=0x7f44000747f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:20.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.230+0000 7f4406200640 1 -- 172.21.15.86:0/1674109169 shutdown_connections 2024-09-13T16:01:20.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.230+0000 7f4406200640 1 -- 172.21.15.86:0/1674109169 wait complete. 2024-09-13T16:01:20.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.230+0000 7f4406200640 1 Processor -- start 2024-09-13T16:01:20.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.231+0000 7f4406200640 1 -- start start 2024-09-13T16:01:20.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.231+0000 7f4406200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4400106540 0x7f440019b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:20.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.231+0000 7f4406200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440019bca0 con 0x7f4400106540 2024-09-13T16:01:20.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.231+0000 7f43ff400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4400106540 0x7f440019b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:20.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.231+0000 7f43ff400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4400106540 0x7f440019b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47974/0 (socket says 172.21.15.86:47974) 2024-09-13T16:01:20.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.231+0000 7f43ff400640 1 -- 172.21.15.86:0/1928244694 learned_addr learned my addr 172.21.15.86:0/1928244694 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:20.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.231+0000 7f43ff400640 1 -- 172.21.15.86:0/1928244694 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f0009560 con 0x7f4400106540 2024-09-13T16:01:20.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.232+0000 7f43ff400640 1 --2- 172.21.15.86:0/1928244694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4400106540 0x7f440019b760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f43f0005ab0 tx=0x7f43f0003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:20.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.232+0000 7f43fcc00640 1 -- 172.21.15.86:0/1928244694 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43f0005160 con 0x7f4400106540 2024-09-13T16:01:20.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.232+0000 7f43fcc00640 1 -- 172.21.15.86:0/1928244694 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f43f0004ba0 con 0x7f4400106540 2024-09-13T16:01:20.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.232+0000 7f4406200640 1 -- 172.21.15.86:0/1928244694 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f440019bea0 con 0x7f4400106540 2024-09-13T16:01:20.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.232+0000 7f43fcc00640 1 -- 172.21.15.86:0/1928244694 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43f003ba00 con 0x7f4400106540 2024-09-13T16:01:20.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.232+0000 7f4406200640 1 -- 172.21.15.86:0/1928244694 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440019c2c0 con 0x7f4400106540 2024-09-13T16:01:20.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.233+0000 7f4406200640 1 -- 172.21.15.86:0/1928244694 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4400107500 con 0x7f4400106540 2024-09-13T16:01:20.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.233+0000 7f43fcc00640 1 -- 172.21.15.86:0/1928244694 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f43f00052c0 con 0x7f4400106540 2024-09-13T16:01:20.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.234+0000 7f43fcc00640 1 --2- 172.21.15.86:0/1928244694 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f43e4038760 0x7f43e403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:20.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.234+0000 7f43fcc00640 1 -- 172.21.15.86:0/1928244694 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f43f006c120 con 0x7f4400106540 2024-09-13T16:01:20.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.234+0000 7f43f6a00640 1 --2- 172.21.15.86:0/1928244694 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f43e4038760 0x7f43e403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:20.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.235+0000 7f43f6a00640 1 --2- 172.21.15.86:0/1928244694 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f43e4038760 0x7f43e403ac20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f43e80098c0 tx=0x7f43e8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:20.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.239+0000 7f43fcc00640 1 -- 172.21.15.86:0/1928244694 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f43f003aa10 con 0x7f4400106540 2024-09-13T16:01:20.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:20.416+0000 7f4406200640 1 -- 172.21.15.86:0/1928244694 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}) v1 -- 0x7f440019cc30 con 0x7f43e4038760 2024-09-13T16:01:20.418 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:20 smithi086 ceph-mon[30379]: Updating smithi086:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T16:01:20.418 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:20 smithi086 ceph-mon[30379]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:21.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:21 smithi086 ceph-mon[30379]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:01:22.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:22 smithi086 ceph-mon[30379]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:22.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:22 smithi086 ceph-mon[30379]: Deploying cephadm binary to smithi139 2024-09-13T16:01:23.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:23.151+0000 7f43fcc00640 1 -- 172.21.15.86:0/1928244694 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f440019cc30 con 0x7f43e4038760 2024-09-13T16:01:23.153 INFO:teuthology.orchestra.run.smithi086.stdout:Added host 'smithi139' with addr '172.21.15.139' 2024-09-13T16:01:23.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:23.153+0000 7f4406200640 1 -- 172.21.15.86:0/1928244694 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f43e4038760 msgr2=0x7f43e403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:23.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:23.153+0000 7f4406200640 1 --2- 172.21.15.86:0/1928244694 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f43e4038760 0x7f43e403ac20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f43e80098c0 tx=0x7f43e8006db0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:23.153+0000 7f4406200640 1 -- 172.21.15.86:0/1928244694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4400106540 msgr2=0x7f440019b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:23.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:23.153+0000 7f4406200640 1 --2- 172.21.15.86:0/1928244694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4400106540 0x7f440019b760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f43f0005ab0 tx=0x7f43f0003cd0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:23.154+0000 7f4406200640 1 -- 172.21.15.86:0/1928244694 shutdown_connections 2024-09-13T16:01:23.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:23.154+0000 7f4406200640 1 --2- 172.21.15.86:0/1928244694 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f43e4038760 0x7f43e403ac20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:23.154+0000 7f4406200640 1 --2- 172.21.15.86:0/1928244694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4400106540 0x7f440019b760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:23.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:23.154+0000 7f4406200640 1 -- 172.21.15.86:0/1928244694 >> 172.21.15.86:0/1928244694 conn(0x7f44000784f0 msgr2=0x7f440010da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:23.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:23.154+0000 7f4406200640 1 -- 172.21.15.86:0/1928244694 shutdown_connections 2024-09-13T16:01:23.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:23.154+0000 7f4406200640 1 -- 172.21.15.86:0/1928244694 wait complete. 2024-09-13T16:01:24.092 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T16:01:24.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:24 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:24.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:24 smithi086 ceph-mon[30379]: Added host smithi139 2024-09-13T16:01:24.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:24 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:01:24.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:24 smithi086 ceph-mon[30379]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:24.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:24 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:24.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:24 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:24.408 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:01:25.595 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:25 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:26.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.180+0000 7f3fba400640 1 -- 172.21.15.86:0/664233378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fb40fe500 msgr2=0x7f3fb40fe8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.180+0000 7f3fba400640 1 --2- 172.21.15.86:0/664233378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fb40fe500 0x7f3fb40fe8e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009880 tx=0x7f3fa802a670 comp rx=0 tx=0).stop 2024-09-13T16:01:26.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.180+0000 7f3fba400640 1 -- 172.21.15.86:0/664233378 shutdown_connections 2024-09-13T16:01:26.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.180+0000 7f3fba400640 1 --2- 172.21.15.86:0/664233378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fb40fe500 0x7f3fb40fe8e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.180+0000 7f3fba400640 1 -- 172.21.15.86:0/664233378 >> 172.21.15.86:0/664233378 conn(0x7f3fb40fa130 msgr2=0x7f3fb40fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:26.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.180+0000 7f3fba400640 1 -- 172.21.15.86:0/664233378 shutdown_connections 2024-09-13T16:01:26.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.180+0000 7f3fba400640 1 -- 172.21.15.86:0/664233378 wait complete. 2024-09-13T16:01:26.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.182+0000 7f3fba400640 1 Processor -- start 2024-09-13T16:01:26.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.182+0000 7f3fba400640 1 -- start start 2024-09-13T16:01:26.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.182+0000 7f3fba400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fb40fe500 0x7f3fb419b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.182+0000 7f3fba400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb419baf0 con 0x7f3fb40fe500 2024-09-13T16:01:26.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.182+0000 7f3fb9000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fb40fe500 0x7f3fb419b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.182+0000 7f3fb9000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fb40fe500 0x7f3fb419b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38326/0 (socket says 172.21.15.86:38326) 2024-09-13T16:01:26.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.182+0000 7f3fb9000640 1 -- 172.21.15.86:0/3953044898 learned_addr learned my addr 172.21.15.86:0/3953044898 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:26.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.183+0000 7f3fb9000640 1 -- 172.21.15.86:0/3953044898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa8009560 con 0x7f3fb40fe500 2024-09-13T16:01:26.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.183+0000 7f3fb9000640 1 --2- 172.21.15.86:0/3953044898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fb40fe500 0x7f3fb419b5b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8005ab0 tx=0x7f3fa8003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.183+0000 7f3fb1600640 1 -- 172.21.15.86:0/3953044898 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3fa8005160 con 0x7f3fb40fe500 2024-09-13T16:01:26.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.183+0000 7f3fb1600640 1 -- 172.21.15.86:0/3953044898 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3fa8004ba0 con 0x7f3fb40fe500 2024-09-13T16:01:26.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.183+0000 7f3fba400640 1 -- 172.21.15.86:0/3953044898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb419bcf0 con 0x7f3fb40fe500 2024-09-13T16:01:26.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.183+0000 7f3fb1600640 1 -- 172.21.15.86:0/3953044898 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3fa803ba00 con 0x7f3fb40fe500 2024-09-13T16:01:26.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.184+0000 7f3fba400640 1 -- 172.21.15.86:0/3953044898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb419c110 con 0x7f3fb40fe500 2024-09-13T16:01:26.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.184+0000 7f3fb1600640 1 -- 172.21.15.86:0/3953044898 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f3fa803bcc0 con 0x7f3fb40fe500 2024-09-13T16:01:26.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.184+0000 7f3fba400640 1 -- 172.21.15.86:0/3953044898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb40687a0 con 0x7f3fb40fe500 2024-09-13T16:01:26.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.185+0000 7f3fb1600640 1 --2- 172.21.15.86:0/3953044898 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f3f9c038710 0x7f3f9c03abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:26.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.185+0000 7f3fb1600640 1 -- 172.21.15.86:0/3953044898 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3fa806c140 con 0x7f3fb40fe500 2024-09-13T16:01:26.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.185+0000 7f3fb3e00640 1 --2- 172.21.15.86:0/3953044898 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f3f9c038710 0x7f3f9c03abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:26.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.186+0000 7f3fb3e00640 1 --2- 172.21.15.86:0/3953044898 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f3f9c038710 0x7f3f9c03abd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00098c0 tx=0x7f3fa0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:26.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.191+0000 7f3fb1600640 1 -- 172.21.15.86:0/3953044898 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3fa8004d10 con 0x7f3fb40fe500 2024-09-13T16:01:26.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.366+0000 7f3fba400640 1 -- 172.21.15.86:0/3953044898 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3fb4110080 con 0x7f3f9c038710 2024-09-13T16:01:26.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.367+0000 7f3fb1600640 1 -- 172.21.15.86:0/3953044898 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f3fb4110080 con 0x7f3f9c038710 2024-09-13T16:01:26.369 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:01:26.369 INFO:teuthology.orchestra.run.smithi086.stdout:[{"addr": "172.21.15.86", "hostname": "smithi086", "labels": [], "status": ""}, {"addr": "172.21.15.139", "hostname": "smithi139", "labels": [], "status": ""}] 2024-09-13T16:01:26.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.369+0000 7f3fba400640 1 -- 172.21.15.86:0/3953044898 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f3f9c038710 msgr2=0x7f3f9c03abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.369+0000 7f3fba400640 1 --2- 172.21.15.86:0/3953044898 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f3f9c038710 0x7f3f9c03abd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00098c0 tx=0x7f3fa0006db0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.369+0000 7f3fba400640 1 -- 172.21.15.86:0/3953044898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fb40fe500 msgr2=0x7f3fb419b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:26.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.369+0000 7f3fba400640 1 --2- 172.21.15.86:0/3953044898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fb40fe500 0x7f3fb419b5b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8005ab0 tx=0x7f3fa8003cd0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.369+0000 7f3fba400640 1 -- 172.21.15.86:0/3953044898 shutdown_connections 2024-09-13T16:01:26.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.369+0000 7f3fba400640 1 --2- 172.21.15.86:0/3953044898 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f3f9c038710 0x7f3f9c03abd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.369+0000 7f3fba400640 1 --2- 172.21.15.86:0/3953044898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fb40fe500 0x7f3fb419b5b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:26.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.369+0000 7f3fba400640 1 -- 172.21.15.86:0/3953044898 >> 172.21.15.86:0/3953044898 conn(0x7f3fb40fa130 msgr2=0x7f3fb40fbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:26.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.370+0000 7f3fba400640 1 -- 172.21.15.86:0/3953044898 shutdown_connections 2024-09-13T16:01:26.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:26.370+0000 7f3fba400640 1 -- 172.21.15.86:0/3953044898 wait complete. 2024-09-13T16:01:26.743 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:26 smithi086 ceph-mon[30379]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:27.066 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi194 2024-09-13T16:01:27.066 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T16:01:27.066 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/etc/ceph/ceph.conf 2024-09-13T16:01:27.085 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T16:01:27.085 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:01:27.144 INFO:tasks.cephadm:Adding host smithi194 to orchestrator... 2024-09-13T16:01:27.144 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch host add smithi194 2024-09-13T16:01:27.452 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:01:27.749 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:27 smithi086 ceph-mon[30379]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:01:27.749 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:27 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:27.749 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:27 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:27.749 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:27 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:27.749 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:27 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:27.749 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:27 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:01:27.749 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:27 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:27.749 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:27 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:01:28.658 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:28 smithi086 ceph-mon[30379]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:28.658 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:28 smithi086 ceph-mon[30379]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-13T16:01:28.658 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:28 smithi086 ceph-mon[30379]: Updating smithi139:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:01:28.658 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:28 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:28.658 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:28 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:28.658 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:28 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:29.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.254+0000 7f80bce00640 1 -- 172.21.15.86:0/1050010813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80b8107970 msgr2=0x7f80b8107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:29.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.254+0000 7f80bce00640 1 --2- 172.21.15.86:0/1050010813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80b8107970 0x7f80b8107d50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009880 tx=0x7f80a802a5d0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.254+0000 7f80bce00640 1 -- 172.21.15.86:0/1050010813 shutdown_connections 2024-09-13T16:01:29.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.254+0000 7f80bce00640 1 --2- 172.21.15.86:0/1050010813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80b8107970 0x7f80b8107d50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:29.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.254+0000 7f80bce00640 1 -- 172.21.15.86:0/1050010813 >> 172.21.15.86:0/1050010813 conn(0x7f80b80fd630 msgr2=0x7f80b80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:29.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.254+0000 7f80bce00640 1 -- 172.21.15.86:0/1050010813 shutdown_connections 2024-09-13T16:01:29.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.254+0000 7f80bce00640 1 -- 172.21.15.86:0/1050010813 wait complete. 2024-09-13T16:01:29.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.255+0000 7f80bce00640 1 Processor -- start 2024-09-13T16:01:29.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.256+0000 7f80bce00640 1 -- start start 2024-09-13T16:01:29.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.256+0000 7f80bce00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80b8107970 0x7f80b8197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.256+0000 7f80bce00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b8197870 con 0x7f80b8107970 2024-09-13T16:01:29.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.256+0000 7f80b5e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80b8107970 0x7f80b8197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.256+0000 7f80b5e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80b8107970 0x7f80b8197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38348/0 (socket says 172.21.15.86:38348) 2024-09-13T16:01:29.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.256+0000 7f80b5e00640 1 -- 172.21.15.86:0/3956233099 learned_addr learned my addr 172.21.15.86:0/3956233099 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:29.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.257+0000 7f80b5e00640 1 -- 172.21.15.86:0/3956233099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a8009560 con 0x7f80b8107970 2024-09-13T16:01:29.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.257+0000 7f80b5e00640 1 --2- 172.21.15.86:0/3956233099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80b8107970 0x7f80b8197330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f80a8005ab0 tx=0x7f80a8003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:29.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.257+0000 7f80aea00640 1 -- 172.21.15.86:0/3956233099 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80a8005160 con 0x7f80b8107970 2024-09-13T16:01:29.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.257+0000 7f80aea00640 1 -- 172.21.15.86:0/3956233099 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f80a8004ba0 con 0x7f80b8107970 2024-09-13T16:01:29.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.257+0000 7f80bce00640 1 -- 172.21.15.86:0/3956233099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b8197a70 con 0x7f80b8107970 2024-09-13T16:01:29.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.257+0000 7f80aea00640 1 -- 172.21.15.86:0/3956233099 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80a803ba00 con 0x7f80b8107970 2024-09-13T16:01:29.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.258+0000 7f80bce00640 1 -- 172.21.15.86:0/3956233099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b8197ef0 con 0x7f80b8107970 2024-09-13T16:01:29.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.259+0000 7f80bce00640 1 -- 172.21.15.86:0/3956233099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b81030b0 con 0x7f80b8107970 2024-09-13T16:01:29.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.259+0000 7f80aea00640 1 -- 172.21.15.86:0/3956233099 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f80a803bc70 con 0x7f80b8107970 2024-09-13T16:01:29.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.259+0000 7f80aea00640 1 --2- 172.21.15.86:0/3956233099 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f809c038760 0x7f809c03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:29.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.259+0000 7f80aea00640 1 -- 172.21.15.86:0/3956233099 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f80a806c0e0 con 0x7f80b8107970 2024-09-13T16:01:29.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.260+0000 7f80b5400640 1 --2- 172.21.15.86:0/3956233099 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f809c038760 0x7f809c03ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:29.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.260+0000 7f80b5400640 1 --2- 172.21.15.86:0/3956233099 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f809c038760 0x7f809c03ac20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f80a40098c0 tx=0x7f80a4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:29.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.264+0000 7f80aea00640 1 -- 172.21.15.86:0/3956233099 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f80a809fe20 con 0x7f80b8107970 2024-09-13T16:01:29.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:29.438+0000 7f80bce00640 1 -- 172.21.15.86:0/3956233099 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}) v1 -- 0x7f80b810be20 con 0x7f809c038760 2024-09-13T16:01:29.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:29 smithi086 ceph-mon[30379]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:01:29.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:29 smithi086 ceph-mon[30379]: Updating smithi139:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T16:01:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:30 smithi086 ceph-mon[30379]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:30 smithi086 ceph-mon[30379]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:01:31.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:31 smithi086 ceph-mon[30379]: Deploying cephadm binary to smithi194 2024-09-13T16:01:32.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:32.123+0000 7f80aea00640 1 -- 172.21.15.86:0/3956233099 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f80b810be20 con 0x7f809c038760 2024-09-13T16:01:32.124 INFO:teuthology.orchestra.run.smithi086.stdout:Added host 'smithi194' with addr '172.21.15.194' 2024-09-13T16:01:32.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:32.125+0000 7f80bce00640 1 -- 172.21.15.86:0/3956233099 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f809c038760 msgr2=0x7f809c03ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:32.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:32.125+0000 7f80bce00640 1 --2- 172.21.15.86:0/3956233099 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f809c038760 0x7f809c03ac20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f80a40098c0 tx=0x7f80a4006db0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:32.125+0000 7f80bce00640 1 -- 172.21.15.86:0/3956233099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80b8107970 msgr2=0x7f80b8197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:32.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:32.125+0000 7f80bce00640 1 --2- 172.21.15.86:0/3956233099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80b8107970 0x7f80b8197330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f80a8005ab0 tx=0x7f80a8003cd0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:32.125+0000 7f80bce00640 1 -- 172.21.15.86:0/3956233099 shutdown_connections 2024-09-13T16:01:32.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:32.125+0000 7f80bce00640 1 --2- 172.21.15.86:0/3956233099 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f809c038760 0x7f809c03ac20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:32.126+0000 7f80bce00640 1 --2- 172.21.15.86:0/3956233099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80b8107970 0x7f80b8197330 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:32.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:32.126+0000 7f80bce00640 1 -- 172.21.15.86:0/3956233099 >> 172.21.15.86:0/3956233099 conn(0x7f80b80fd630 msgr2=0x7f80b8105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:32.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:32.126+0000 7f80bce00640 1 -- 172.21.15.86:0/3956233099 shutdown_connections 2024-09-13T16:01:32.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:32.126+0000 7f80bce00640 1 -- 172.21.15.86:0/3956233099 wait complete. 2024-09-13T16:01:32.793 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:32 smithi086 ceph-mon[30379]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:32.793 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:32 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:32.793 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:32 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:01:32.793 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:32 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:32.824 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T16:01:33.126 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:01:33.609 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:33 smithi086 ceph-mon[30379]: Added host smithi194 2024-09-13T16:01:33.609 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:33.609 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:34.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:34 smithi086 ceph-mon[30379]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:34.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.833+0000 7f6bb1800640 1 -- 172.21.15.86:0/4128987982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bac107970 msgr2=0x7f6bac107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:34.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.833+0000 7f6bb1800640 1 --2- 172.21.15.86:0/4128987982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bac107970 0x7f6bac107d50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009880 tx=0x7f6b9c02a5d0 comp rx=0 tx=0).stop 2024-09-13T16:01:34.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.833+0000 7f6bb1800640 1 -- 172.21.15.86:0/4128987982 shutdown_connections 2024-09-13T16:01:34.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.833+0000 7f6bb1800640 1 --2- 172.21.15.86:0/4128987982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bac107970 0x7f6bac107d50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:34.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.833+0000 7f6bb1800640 1 -- 172.21.15.86:0/4128987982 >> 172.21.15.86:0/4128987982 conn(0x7f6bac0fd690 msgr2=0x7f6bac0ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:34.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.833+0000 7f6bb1800640 1 -- 172.21.15.86:0/4128987982 shutdown_connections 2024-09-13T16:01:34.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.833+0000 7f6bb1800640 1 -- 172.21.15.86:0/4128987982 wait complete. 2024-09-13T16:01:34.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.834+0000 7f6bb1800640 1 Processor -- start 2024-09-13T16:01:34.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.834+0000 7f6bb1800640 1 -- start start 2024-09-13T16:01:34.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.835+0000 7f6bb1800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bac107970 0x7f6bac197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:34.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.835+0000 7f6bb1800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac197840 con 0x7f6bac107970 2024-09-13T16:01:34.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.835+0000 7f6baaa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bac107970 0x7f6bac197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:34.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.835+0000 7f6baaa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bac107970 0x7f6bac197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58822/0 (socket says 172.21.15.86:58822) 2024-09-13T16:01:34.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.835+0000 7f6baaa00640 1 -- 172.21.15.86:0/1326603482 learned_addr learned my addr 172.21.15.86:0/1326603482 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:34.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.835+0000 7f6baaa00640 1 -- 172.21.15.86:0/1326603482 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c009560 con 0x7f6bac107970 2024-09-13T16:01:34.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.835+0000 7f6baaa00640 1 --2- 172.21.15.86:0/1326603482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bac107970 0x7f6bac197300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c005ab0 tx=0x7f6b9c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:34.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.836+0000 7f6ba3400640 1 -- 172.21.15.86:0/1326603482 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b9c005160 con 0x7f6bac107970 2024-09-13T16:01:34.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.836+0000 7f6ba3400640 1 -- 172.21.15.86:0/1326603482 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6b9c004ba0 con 0x7f6bac107970 2024-09-13T16:01:34.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.836+0000 7f6ba3400640 1 -- 172.21.15.86:0/1326603482 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b9c03ba00 con 0x7f6bac107970 2024-09-13T16:01:34.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.836+0000 7f6bb1800640 1 -- 172.21.15.86:0/1326603482 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bac197a40 con 0x7f6bac107970 2024-09-13T16:01:34.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.836+0000 7f6bb1800640 1 -- 172.21.15.86:0/1326603482 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bac197ec0 con 0x7f6bac107970 2024-09-13T16:01:34.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.837+0000 7f6ba3400640 1 -- 172.21.15.86:0/1326603482 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f6b9c03bc70 con 0x7f6bac107970 2024-09-13T16:01:34.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.837+0000 7f6bb1800640 1 -- 172.21.15.86:0/1326603482 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bac1030b0 con 0x7f6bac107970 2024-09-13T16:01:34.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.838+0000 7f6ba3400640 1 --2- 172.21.15.86:0/1326603482 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6b90038760 0x7f6b9003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:34.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.838+0000 7f6ba3400640 1 -- 172.21.15.86:0/1326603482 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6b9c06c0a0 con 0x7f6bac107970 2024-09-13T16:01:34.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.838+0000 7f6ba3e00640 1 --2- 172.21.15.86:0/1326603482 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6b90038760 0x7f6b9003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:34.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.838+0000 7f6ba3e00640 1 --2- 172.21.15.86:0/1326603482 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6b90038760 0x7f6b9003ac20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6b940098c0 tx=0x7f6b94006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:34.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:34.843+0000 7f6ba3400640 1 -- 172.21.15.86:0/1326603482 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6b9c09fe20 con 0x7f6bac107970 2024-09-13T16:01:35.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:35.018+0000 7f6bb1800640 1 -- 172.21.15.86:0/1326603482 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6bac10be20 con 0x7f6b90038760 2024-09-13T16:01:35.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:35.019+0000 7f6ba3400640 1 -- 172.21.15.86:0/1326603482 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+240 (secure 0 0 0) 0x7f6bac10be20 con 0x7f6b90038760 2024-09-13T16:01:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:01:35.021 INFO:teuthology.orchestra.run.smithi086.stdout:[{"addr": "172.21.15.86", "hostname": "smithi086", "labels": [], "status": ""}, {"addr": "172.21.15.139", "hostname": "smithi139", "labels": [], "status": ""}, {"addr": "172.21.15.194", "hostname": "smithi194", "labels": [], "status": ""}] 2024-09-13T16:01:35.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:35.021+0000 7f6bb1800640 1 -- 172.21.15.86:0/1326603482 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6b90038760 msgr2=0x7f6b9003ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:35.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:35.021+0000 7f6bb1800640 1 --2- 172.21.15.86:0/1326603482 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6b90038760 0x7f6b9003ac20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6b940098c0 tx=0x7f6b94006db0 comp rx=0 tx=0).stop 2024-09-13T16:01:35.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:35.021+0000 7f6bb1800640 1 -- 172.21.15.86:0/1326603482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bac107970 msgr2=0x7f6bac197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:35.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:35.021+0000 7f6bb1800640 1 --2- 172.21.15.86:0/1326603482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bac107970 0x7f6bac197300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c005ab0 tx=0x7f6b9c003cd0 comp rx=0 tx=0).stop 2024-09-13T16:01:35.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:35.021+0000 7f6bb1800640 1 -- 172.21.15.86:0/1326603482 shutdown_connections 2024-09-13T16:01:35.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:35.021+0000 7f6bb1800640 1 --2- 172.21.15.86:0/1326603482 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6b90038760 0x7f6b9003ac20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:35.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:35.021+0000 7f6bb1800640 1 --2- 172.21.15.86:0/1326603482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bac107970 0x7f6bac197300 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:35.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:35.021+0000 7f6bb1800640 1 -- 172.21.15.86:0/1326603482 >> 172.21.15.86:0/1326603482 conn(0x7f6bac0fd690 msgr2=0x7f6bac0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:35.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:35.021+0000 7f6bb1800640 1 -- 172.21.15.86:0/1326603482 shutdown_connections 2024-09-13T16:01:35.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:35.021+0000 7f6bb1800640 1 -- 172.21.15.86:0/1326603482 wait complete. 2024-09-13T16:01:35.682 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-13T16:01:35.683 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-13T16:01:35.997 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:01:36.537 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:36 smithi086 ceph-mon[30379]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:01:36.538 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:36 smithi086 ceph-mon[30379]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:36.538 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:36.538 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:36.538 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:36.538 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:36.538 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:01:36.538 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:36.538 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:01:37.589 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:37 smithi086 ceph-mon[30379]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-13T16:01:37.589 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:37 smithi086 ceph-mon[30379]: Updating smithi194:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:01:37.589 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:37 smithi086 ceph-mon[30379]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:01:37.589 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:37 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:37.589 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:37 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:37.590 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:37 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:37.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.802+0000 7fbfe7000640 1 -- 172.21.15.86:0/1722742522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfe0106540 msgr2=0x7fbfe0106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:37.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.802+0000 7fbfe7000640 1 --2- 172.21.15.86:0/1722742522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfe0106540 0x7fbfe0106920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0009c20 tx=0x7fbfd002aa90 comp rx=0 tx=0).stop 2024-09-13T16:01:37.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.802+0000 7fbfe7000640 1 -- 172.21.15.86:0/1722742522 shutdown_connections 2024-09-13T16:01:37.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.802+0000 7fbfe7000640 1 --2- 172.21.15.86:0/1722742522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfe0106540 0x7fbfe0106920 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:37.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.802+0000 7fbfe7000640 1 -- 172.21.15.86:0/1722742522 >> 172.21.15.86:0/1722742522 conn(0x7fbfe00784f0 msgr2=0x7fbfe00747f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:37.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.803+0000 7fbfe7000640 1 -- 172.21.15.86:0/1722742522 shutdown_connections 2024-09-13T16:01:37.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.803+0000 7fbfe7000640 1 -- 172.21.15.86:0/1722742522 wait complete. 2024-09-13T16:01:37.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.803+0000 7fbfe7000640 1 Processor -- start 2024-09-13T16:01:37.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.804+0000 7fbfe7000640 1 -- start start 2024-09-13T16:01:37.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.804+0000 7fbfe7000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfe0106540 0x7fbfe019b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:37.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.804+0000 7fbfe7000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe019bca0 con 0x7fbfe0106540 2024-09-13T16:01:37.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.804+0000 7fbfdfe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfe0106540 0x7fbfe019b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:37.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.804+0000 7fbfdfe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfe0106540 0x7fbfe019b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58834/0 (socket says 172.21.15.86:58834) 2024-09-13T16:01:37.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.804+0000 7fbfdfe00640 1 -- 172.21.15.86:0/3948880759 learned_addr learned my addr 172.21.15.86:0/3948880759 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:01:37.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.804+0000 7fbfdfe00640 1 -- 172.21.15.86:0/3948880759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd0009900 con 0x7fbfe0106540 2024-09-13T16:01:37.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.805+0000 7fbfdfe00640 1 --2- 172.21.15.86:0/3948880759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfe0106540 0x7fbfe019b760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0009d40 tx=0x7fbfd002f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:37.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.805+0000 7fbfdd600640 1 -- 172.21.15.86:0/3948880759 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfd003e070 con 0x7fbfe0106540 2024-09-13T16:01:37.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.805+0000 7fbfdd600640 1 -- 172.21.15.86:0/3948880759 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbfd002fbf0 con 0x7fbfe0106540 2024-09-13T16:01:37.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.805+0000 7fbfe7000640 1 -- 172.21.15.86:0/3948880759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe019bea0 con 0x7fbfe0106540 2024-09-13T16:01:37.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.805+0000 7fbfdd600640 1 -- 172.21.15.86:0/3948880759 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfd00047d0 con 0x7fbfe0106540 2024-09-13T16:01:37.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.805+0000 7fbfe7000640 1 -- 172.21.15.86:0/3948880759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe019c2c0 con 0x7fbfe0106540 2024-09-13T16:01:37.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.806+0000 7fbfdd600640 1 -- 172.21.15.86:0/3948880759 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fbfd000a040 con 0x7fbfe0106540 2024-09-13T16:01:37.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.806+0000 7fbfe7000640 1 -- 172.21.15.86:0/3948880759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe0107500 con 0x7fbfe0106540 2024-09-13T16:01:37.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.807+0000 7fbfdd600640 1 --2- 172.21.15.86:0/3948880759 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbfc4038710 0x7fbfc403abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:37.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.807+0000 7fbfdd600640 1 -- 172.21.15.86:0/3948880759 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbfd006c610 con 0x7fbfe0106540 2024-09-13T16:01:37.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.807+0000 7fbfd7400640 1 --2- 172.21.15.86:0/3948880759 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbfc4038710 0x7fbfc403abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:37.809 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.808+0000 7fbfd7400640 1 --2- 172.21.15.86:0/3948880759 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbfc4038710 0x7fbfc403abd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80098c0 tx=0x7fbfc8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:37.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.811+0000 7fbfdd600640 1 -- 172.21.15.86:0/3948880759 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbfd002e3c0 con 0x7fbfe0106540 2024-09-13T16:01:37.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:37.986+0000 7fbfe7000640 1 -- 172.21.15.86:0/3948880759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fbfe0110320 con 0x7fbfe0106540 2024-09-13T16:01:38.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:38 smithi086 ceph-mon[30379]: Updating smithi194:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T16:01:38.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:38 smithi086 ceph-mon[30379]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:38.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:38 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3948880759' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T16:01:38.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:38.978+0000 7fbfdd600640 1 -- 172.21.15.86:0/3948880759 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fbfd0033020 con 0x7fbfe0106540 2024-09-13T16:01:38.980 INFO:teuthology.orchestra.run.smithi086.stderr:adjusted tunables profile to default 2024-09-13T16:01:38.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:38.981+0000 7fbfe7000640 1 -- 172.21.15.86:0/3948880759 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbfc4038710 msgr2=0x7fbfc403abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:38.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:38.981+0000 7fbfe7000640 1 --2- 172.21.15.86:0/3948880759 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbfc4038710 0x7fbfc403abd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80098c0 tx=0x7fbfc8006db0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:38.981+0000 7fbfe7000640 1 -- 172.21.15.86:0/3948880759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfe0106540 msgr2=0x7fbfe019b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:38.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:38.981+0000 7fbfe7000640 1 --2- 172.21.15.86:0/3948880759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfe0106540 0x7fbfe019b760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0009d40 tx=0x7fbfd002f8a0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:38.981+0000 7fbfe7000640 1 -- 172.21.15.86:0/3948880759 shutdown_connections 2024-09-13T16:01:38.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:38.981+0000 7fbfe7000640 1 --2- 172.21.15.86:0/3948880759 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbfc4038710 0x7fbfc403abd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:38.981+0000 7fbfe7000640 1 --2- 172.21.15.86:0/3948880759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfe0106540 0x7fbfe019b760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:38.981+0000 7fbfe7000640 1 -- 172.21.15.86:0/3948880759 >> 172.21.15.86:0/3948880759 conn(0x7fbfe00784f0 msgr2=0x7fbfe010da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:38.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:38.982+0000 7fbfe7000640 1 -- 172.21.15.86:0/3948880759 shutdown_connections 2024-09-13T16:01:38.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:01:38.982+0000 7fbfe7000640 1 -- 172.21.15.86:0/3948880759 wait complete. 2024-09-13T16:01:39.676 INFO:tasks.cephadm:Adding mon.a on smithi086 2024-09-13T16:01:39.676 INFO:tasks.cephadm:Adding mon.b on smithi139 2024-09-13T16:01:39.676 INFO:tasks.cephadm:Adding mon.c on smithi194 2024-09-13T16:01:39.676 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi086:172.21.15.86=a;smithi139:172.21.15.139=b;smithi194:172.21.15.194=c' 2024-09-13T16:01:39.875 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:01:40.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:39 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3948880759' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T16:01:40.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:39 smithi086 ceph-mon[30379]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:01:40.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:39 smithi086 ceph-mon[30379]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:41.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.286+0000 7f129e22e640 1 -- 172.21.15.194:0/4117810288 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1298104650 msgr2=0x7f1298104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:41.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.286+0000 7f129e22e640 1 --2- 172.21.15.194:0/4117810288 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1298104650 0x7f1298104a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1288009880 tx=0x7f128802a5d0 comp rx=0 tx=0).stop 2024-09-13T16:01:41.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.286+0000 7f129e22e640 1 -- 172.21.15.194:0/4117810288 shutdown_connections 2024-09-13T16:01:41.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.286+0000 7f129e22e640 1 --2- 172.21.15.194:0/4117810288 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1298104650 0x7f1298104a30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:41.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.286+0000 7f129e22e640 1 -- 172.21.15.194:0/4117810288 >> 172.21.15.194:0/4117810288 conn(0x7f1298075490 msgr2=0x7f12980fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:41.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.286+0000 7f129e22e640 1 -- 172.21.15.194:0/4117810288 shutdown_connections 2024-09-13T16:01:41.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.286+0000 7f129e22e640 1 -- 172.21.15.194:0/4117810288 wait complete. 2024-09-13T16:01:41.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.287+0000 7f129e22e640 1 Processor -- start 2024-09-13T16:01:41.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.287+0000 7f129e22e640 1 -- start start 2024-09-13T16:01:41.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.287+0000 7f129e22e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1298104650 0x7f1298197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:41.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.287+0000 7f129e22e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1298197860 con 0x7f1298104650 2024-09-13T16:01:41.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.288+0000 7f12977fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1298104650 0x7f1298197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:41.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.288+0000 7f12977fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1298104650 0x7f1298197320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.194:58382/0 (socket says 172.21.15.194:58382) 2024-09-13T16:01:41.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.288+0000 7f12977fe640 1 -- 172.21.15.194:0/2293904965 learned_addr learned my addr 172.21.15.194:0/2293904965 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T16:01:41.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.288+0000 7f12977fe640 1 -- 172.21.15.194:0/2293904965 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1288009560 con 0x7f1298104650 2024-09-13T16:01:41.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.288+0000 7f12977fe640 1 --2- 172.21.15.194:0/2293904965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1298104650 0x7f1298197320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1288005ab0 tx=0x7f1288003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:41.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.288+0000 7f1294ff9640 1 -- 172.21.15.194:0/2293904965 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1288005160 con 0x7f1298104650 2024-09-13T16:01:41.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.289+0000 7f129e22e640 1 -- 172.21.15.194:0/2293904965 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1298197a60 con 0x7f1298104650 2024-09-13T16:01:41.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.289+0000 7f129e22e640 1 -- 172.21.15.194:0/2293904965 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1298197ee0 con 0x7f1298104650 2024-09-13T16:01:41.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.289+0000 7f1294ff9640 1 -- 172.21.15.194:0/2293904965 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1288004ba0 con 0x7f1298104650 2024-09-13T16:01:41.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.289+0000 7f1294ff9640 1 -- 172.21.15.194:0/2293904965 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f128803ba00 con 0x7f1298104650 2024-09-13T16:01:41.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.289+0000 7f129e22e640 1 -- 172.21.15.194:0/2293904965 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12980ffd90 con 0x7f1298104650 2024-09-13T16:01:41.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.290+0000 7f1294ff9640 1 -- 172.21.15.194:0/2293904965 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f128803bcc0 con 0x7f1298104650 2024-09-13T16:01:41.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.290+0000 7f1294ff9640 1 --2- 172.21.15.194:0/2293904965 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1280038700 0x7f128003abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:41.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.290+0000 7f1294ff9640 1 -- 172.21.15.194:0/2293904965 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f128806c310 con 0x7f1298104650 2024-09-13T16:01:41.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.291+0000 7f1296ffd640 1 --2- 172.21.15.194:0/2293904965 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1280038700 0x7f128003abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:41.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.291+0000 7f1296ffd640 1 --2- 172.21.15.194:0/2293904965 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1280038700 0x7f128003abc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f128c0098c0 tx=0x7f128c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:41.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.295+0000 7f1294ff9640 1 -- 172.21.15.194:0/2293904965 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1288030d70 con 0x7f1298104650 2024-09-13T16:01:41.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.467+0000 7f129e22e640 1 -- 172.21.15.194:0/2293904965 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi086:172.21.15.86=a;smithi139:172.21.15.139=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f12981079f0 con 0x7f1280038700 2024-09-13T16:01:41.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.474+0000 7f1294ff9640 1 -- 172.21.15.194:0/2293904965 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f12981079f0 con 0x7f1280038700 2024-09-13T16:01:41.476 INFO:teuthology.orchestra.run.smithi194.stdout:Scheduled mon update... 2024-09-13T16:01:41.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.476+0000 7f129e22e640 1 -- 172.21.15.194:0/2293904965 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1280038700 msgr2=0x7f128003abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:41.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.476+0000 7f129e22e640 1 --2- 172.21.15.194:0/2293904965 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1280038700 0x7f128003abc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f128c0098c0 tx=0x7f128c006db0 comp rx=0 tx=0).stop 2024-09-13T16:01:41.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.476+0000 7f129e22e640 1 -- 172.21.15.194:0/2293904965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1298104650 msgr2=0x7f1298197320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:41.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.476+0000 7f129e22e640 1 --2- 172.21.15.194:0/2293904965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1298104650 0x7f1298197320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1288005ab0 tx=0x7f1288003cd0 comp rx=0 tx=0).stop 2024-09-13T16:01:41.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.476+0000 7f129e22e640 1 -- 172.21.15.194:0/2293904965 shutdown_connections 2024-09-13T16:01:41.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.476+0000 7f129e22e640 1 --2- 172.21.15.194:0/2293904965 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1280038700 0x7f128003abc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:41.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.476+0000 7f129e22e640 1 --2- 172.21.15.194:0/2293904965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1298104650 0x7f1298197320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:41.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.476+0000 7f129e22e640 1 -- 172.21.15.194:0/2293904965 >> 172.21.15.194:0/2293904965 conn(0x7f1298075490 msgr2=0x7f12980fb750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:41.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.476+0000 7f129e22e640 1 -- 172.21.15.194:0/2293904965 shutdown_connections 2024-09-13T16:01:41.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:41.477+0000 7f129e22e640 1 -- 172.21.15.194:0/2293904965 wait complete. 2024-09-13T16:01:42.088 DEBUG:teuthology.orchestra.run.smithi139:mon.b> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mon.b.service 2024-09-13T16:01:42.091 DEBUG:teuthology.orchestra.run.smithi194:mon.c> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mon.c.service 2024-09-13T16:01:42.093 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T16:01:42.093 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:01:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:42 smithi086 ceph-mon[30379]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:42 smithi086 ceph-mon[30379]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi086:172.21.15.86=a;smithi139:172.21.15.139=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:01:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:42 smithi086 ceph-mon[30379]: Saving service mon spec with placement smithi086:172.21.15.86=a;smithi139:172.21.15.139=b;smithi194:172.21.15.194=c;count:3 2024-09-13T16:01:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:01:42.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:42.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:01:42.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:42.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:01:42.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:42.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:42 smithi086 ceph-mon[30379]: Deploying daemon mon.c on smithi194 2024-09-13T16:01:43.520 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:01:44.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:44 smithi086 ceph-mon[30379]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:45.102 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:44 smithi194 systemd[1]: Starting Ceph mon.c for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:01:45.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.528+0000 7f776d18e640 1 -- 172.21.15.194:0/1859648930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7768104670 msgr2=0x7f7768104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:45.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.528+0000 7f776d18e640 1 --2- 172.21.15.194:0/1859648930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7768104670 0x7f7768104a50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7750009880 tx=0x7f775002a5d0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.528+0000 7f776d18e640 1 -- 172.21.15.194:0/1859648930 shutdown_connections 2024-09-13T16:01:45.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.528+0000 7f776d18e640 1 --2- 172.21.15.194:0/1859648930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7768104670 0x7f7768104a50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.528+0000 7f776d18e640 1 -- 172.21.15.194:0/1859648930 >> 172.21.15.194:0/1859648930 conn(0x7f77680fa3b0 msgr2=0x7f77680fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:45.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.528+0000 7f776d18e640 1 -- 172.21.15.194:0/1859648930 shutdown_connections 2024-09-13T16:01:45.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.528+0000 7f776d18e640 1 -- 172.21.15.194:0/1859648930 wait complete. 2024-09-13T16:01:45.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.529+0000 7f776d18e640 1 Processor -- start 2024-09-13T16:01:45.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.529+0000 7f776d18e640 1 -- start start 2024-09-13T16:01:45.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.529+0000 7f776d18e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7768104670 0x7f7768195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:45.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.529+0000 7f776d18e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7768068e90 con 0x7f7768104670 2024-09-13T16:01:45.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.530+0000 7f7766d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7768104670 0x7f7768195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:45.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.530+0000 7f7766d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7768104670 0x7f7768195f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.194:35668/0 (socket says 172.21.15.194:35668) 2024-09-13T16:01:45.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.530+0000 7f7766d9d640 1 -- 172.21.15.194:0/2885840676 learned_addr learned my addr 172.21.15.194:0/2885840676 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T16:01:45.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.530+0000 7f7766d9d640 1 -- 172.21.15.194:0/2885840676 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7750009560 con 0x7f7768104670 2024-09-13T16:01:45.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.531+0000 7f7766d9d640 1 --2- 172.21.15.194:0/2885840676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7768104670 0x7f7768195f50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7750005ab0 tx=0x7f7750003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:45.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.531+0000 7f775ffff640 1 -- 172.21.15.194:0/2885840676 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7750005160 con 0x7f7768104670 2024-09-13T16:01:45.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.531+0000 7f776d18e640 1 -- 172.21.15.194:0/2885840676 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77681964f0 con 0x7f7768104670 2024-09-13T16:01:45.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.531+0000 7f775ffff640 1 -- 172.21.15.194:0/2885840676 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7750004ba0 con 0x7f7768104670 2024-09-13T16:01:45.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.531+0000 7f775ffff640 1 -- 172.21.15.194:0/2885840676 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f775003ba00 con 0x7f7768104670 2024-09-13T16:01:45.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.531+0000 7f776d18e640 1 -- 172.21.15.194:0/2885840676 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7768196970 con 0x7f7768104670 2024-09-13T16:01:45.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.532+0000 7f775ffff640 1 -- 172.21.15.194:0/2885840676 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f775003bcc0 con 0x7f7768104670 2024-09-13T16:01:45.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.532+0000 7f776d18e640 1 -- 172.21.15.194:0/2885840676 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77680ffdb0 con 0x7f7768104670 2024-09-13T16:01:45.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.532+0000 7f775ffff640 1 --2- 172.21.15.194:0/2885840676 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7754038710 0x7f775403abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:45.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.532+0000 7f775ffff640 1 -- 172.21.15.194:0/2885840676 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f775006c0f0 con 0x7f7768104670 2024-09-13T16:01:45.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.532+0000 7f776659c640 1 --2- 172.21.15.194:0/2885840676 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7754038710 0x7f775403abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:45.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.533+0000 7f776659c640 1 --2- 172.21.15.194:0/2885840676 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7754038710 0x7f775403abd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f77580098c0 tx=0x7f7758006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:45.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.537+0000 7f775ffff640 1 -- 172.21.15.194:0/2885840676 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f775009fe20 con 0x7f7768104670 2024-09-13T16:01:45.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.771+0000 7f776d18e640 1 -- 172.21.15.194:0/2885840676 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7768196c10 con 0x7f7768104670 2024-09-13T16:01:45.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.771+0000 7f775ffff640 1 -- 172.21.15.194:0/2885840676 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7f7750035070 con 0x7f7768104670 2024-09-13T16:01:45.774 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T16:01:45.774 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","modified":"2024-09-13T16:00:03.871460Z","created":"2024-09-13T16:00:03.871460Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:3300","nonce":0},{"type":"v1","addr":"172.21.15.86:6789","nonce":0}]},"addr":"172.21.15.86:6789/0","public_addr":"172.21.15.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T16:01:45.774 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-09-13T16:01:45.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.773+0000 7f776d18e640 1 -- 172.21.15.194:0/2885840676 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7754038710 msgr2=0x7f775403abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:45.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.773+0000 7f776d18e640 1 --2- 172.21.15.194:0/2885840676 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7754038710 0x7f775403abd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f77580098c0 tx=0x7f7758006db0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.773+0000 7f776d18e640 1 -- 172.21.15.194:0/2885840676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7768104670 msgr2=0x7f7768195f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:45.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.773+0000 7f776d18e640 1 --2- 172.21.15.194:0/2885840676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7768104670 0x7f7768195f50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7750005ab0 tx=0x7f7750003cd0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.773+0000 7f776d18e640 1 -- 172.21.15.194:0/2885840676 shutdown_connections 2024-09-13T16:01:45.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.773+0000 7f776d18e640 1 --2- 172.21.15.194:0/2885840676 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7754038710 0x7f775403abd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.773+0000 7f776d18e640 1 --2- 172.21.15.194:0/2885840676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7768104670 0x7f7768195f50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:45.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.773+0000 7f776d18e640 1 -- 172.21.15.194:0/2885840676 >> 172.21.15.194:0/2885840676 conn(0x7f77680fa3b0 msgr2=0x7f77680fa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:45.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.774+0000 7f776d18e640 1 -- 172.21.15.194:0/2885840676 shutdown_connections 2024-09-13T16:01:45.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:45.774+0000 7f776d18e640 1 -- 172.21.15.194:0/2885840676 wait complete. 2024-09-13T16:01:45.900 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 podman[35642]: 2024-09-13 16:01:45.630925904 +0000 UTC m=+0.173460371 container create aff0ed55faf9bbf89b194b054d4034ae160e30e671231fc1d6dd8878c49cbe8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-13T16:01:45.900 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 podman[35642]: 2024-09-13 16:01:45.552325064 +0000 UTC m=+0.094859543 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:01:45.901 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 podman[35642]: 2024-09-13 16:01:45.875120577 +0000 UTC m=+0.417655046 container init aff0ed55faf9bbf89b194b054d4034ae160e30e671231fc1d6dd8878c49cbe8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-c, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-13T16:01:45.901 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 podman[35642]: 2024-09-13 16:01:45.878669622 +0000 UTC m=+0.421204094 container start aff0ed55faf9bbf89b194b054d4034ae160e30e671231fc1d6dd8878c49cbe8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-c, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-13T16:01:46.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T16:01:46.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable), process ceph-mon, pid 2 2024-09-13T16:01:46.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: pidfile_write: ignore empty --pid-file 2024-09-13T16:01:46.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: load: jerasure load: lrc 2024-09-13T16:01:46.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: RocksDB version: 7.9.2 2024-09-13T16:01:46.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Git sha 0 2024-09-13T16:01:46.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Compile date 2024-09-10 11:17:42 2024-09-13T16:01:46.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: DB SUMMARY 2024-09-13T16:01:46.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: DB Session ID: ITCRRH5G9R1K0MQ13LOK 2024-09-13T16:01:46.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: CURRENT file: CURRENT 2024-09-13T16:01:46.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T16:01:46.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-13T16:01:46.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-13T16:01:46.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-13T16:01:46.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.error_if_exists: 0 2024-09-13T16:01:46.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.create_if_missing: 0 2024-09-13T16:01:46.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.paranoid_checks: 1 2024-09-13T16:01:46.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T16:01:46.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T16:01:46.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T16:01:46.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.env: 0x55bcecef2bc0 2024-09-13T16:01:46.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T16:01:46.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.info_log: 0x55bced766be0 2024-09-13T16:01:46.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T16:01:46.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.statistics: (nil) 2024-09-13T16:01:46.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.use_fsync: 0 2024-09-13T16:01:46.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_log_file_size: 0 2024-09-13T16:01:46.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T16:01:46.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T16:01:46.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T16:01:46.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T16:01:46.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.allow_fallocate: 1 2024-09-13T16:01:46.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T16:01:46.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T16:01:46.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.use_direct_reads: 0 2024-09-13T16:01:46.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T16:01:46.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T16:01:46.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.db_log_dir: 2024-09-13T16:01:46.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.wal_dir: 2024-09-13T16:01:46.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T16:01:46.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T16:01:46.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T16:01:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T16:01:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T16:01:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T16:01:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T16:01:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T16:01:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.write_buffer_manager: 0x55bced774320 2024-09-13T16:01:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T16:01:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T16:01:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T16:01:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T16:01:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T16:01:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T16:01:46.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T16:01:46.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T16:01:46.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.unordered_write: 0 2024-09-13T16:01:46.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T16:01:46.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T16:01:46.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T16:01:46.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T16:01:46.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.row_cache: None 2024-09-13T16:01:46.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.wal_filter: None 2024-09-13T16:01:46.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T16:01:46.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T16:01:46.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.two_write_queues: 0 2024-09-13T16:01:46.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T16:01:46.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.wal_compression: 0 2024-09-13T16:01:46.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.atomic_flush: 0 2024-09-13T16:01:46.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T16:01:46.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T16:01:46.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T16:01:46.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.log_readahead_size: 0 2024-09-13T16:01:46.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T16:01:46.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T16:01:46.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T16:01:46.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T16:01:46.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T16:01:46.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T16:01:46.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T16:01:46.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_background_jobs: 2 2024-09-13T16:01:46.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_background_compactions: -1 2024-09-13T16:01:46.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_subcompactions: 1 2024-09-13T16:01:46.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T16:01:46.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T16:01:46.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T16:01:46.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T16:01:46.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T16:01:46.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T16:01:46.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T16:01:46.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T16:01:46.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_open_files: -1 2024-09-13T16:01:46.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T16:01:46.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T16:01:46.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T16:01:46.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T16:01:46.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_background_flushes: -1 2024-09-13T16:01:46.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Compression algorithms supported: 2024-09-13T16:01:46.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: kZSTD supported: 0 2024-09-13T16:01:46.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: kXpressCompression supported: 0 2024-09-13T16:01:46.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: kBZip2Compression supported: 0 2024-09-13T16:01:46.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T16:01:46.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: kLZ4Compression supported: 1 2024-09-13T16:01:46.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: kZlibCompression supported: 1 2024-09-13T16:01:46.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T16:01:46.266 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: kSnappyCompression supported: 1 2024-09-13T16:01:46.266 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T16:01:46.266 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T16:01:46.266 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-13T16:01:46.266 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T16:01:46.266 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T16:01:46.266 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.merge_operator: 2024-09-13T16:01:46.266 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compaction_filter: None 2024-09-13T16:01:46.266 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T16:01:46.266 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T16:01:46.266 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T16:01:46.266 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T16:01:46.266 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55bced7667e0) 2024-09-13T16:01:46.266 INFO:journalctl@ceph.mon.c.smithi194.stdout: cache_index_and_filter_blocks: 1 2024-09-13T16:01:46.267 INFO:journalctl@ceph.mon.c.smithi194.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T16:01:46.267 INFO:journalctl@ceph.mon.c.smithi194.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T16:01:46.267 INFO:journalctl@ceph.mon.c.smithi194.stdout: pin_top_level_index_and_filter: 1 2024-09-13T16:01:46.267 INFO:journalctl@ceph.mon.c.smithi194.stdout: index_type: 0 2024-09-13T16:01:46.267 INFO:journalctl@ceph.mon.c.smithi194.stdout: data_block_index_type: 0 2024-09-13T16:01:46.267 INFO:journalctl@ceph.mon.c.smithi194.stdout: index_shortening: 1 2024-09-13T16:01:46.267 INFO:journalctl@ceph.mon.c.smithi194.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T16:01:46.267 INFO:journalctl@ceph.mon.c.smithi194.stdout: checksum: 4 2024-09-13T16:01:46.267 INFO:journalctl@ceph.mon.c.smithi194.stdout: no_block_cache: 0 2024-09-13T16:01:46.267 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache: 0x55bced75b350 2024-09-13T16:01:46.267 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache_name: BinnedLRUCache 2024-09-13T16:01:46.267 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache_options: 2024-09-13T16:01:46.267 INFO:journalctl@ceph.mon.c.smithi194.stdout: capacity : 536870912 2024-09-13T16:01:46.268 INFO:journalctl@ceph.mon.c.smithi194.stdout: num_shard_bits : 4 2024-09-13T16:01:46.268 INFO:journalctl@ceph.mon.c.smithi194.stdout: strict_capacity_limit : 0 2024-09-13T16:01:46.268 INFO:journalctl@ceph.mon.c.smithi194.stdout: high_pri_pool_ratio: 0.000 2024-09-13T16:01:46.268 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache_compressed: (nil) 2024-09-13T16:01:46.268 INFO:journalctl@ceph.mon.c.smithi194.stdout: persistent_cache: (nil) 2024-09-13T16:01:46.268 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_size: 4096 2024-09-13T16:01:46.268 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_size_deviation: 10 2024-09-13T16:01:46.268 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_restart_interval: 16 2024-09-13T16:01:46.268 INFO:journalctl@ceph.mon.c.smithi194.stdout: index_block_restart_interval: 1 2024-09-13T16:01:46.268 INFO:journalctl@ceph.mon.c.smithi194.stdout: metadata_block_size: 4096 2024-09-13T16:01:46.268 INFO:journalctl@ceph.mon.c.smithi194.stdout: partition_filters: 0 2024-09-13T16:01:46.268 INFO:journalctl@ceph.mon.c.smithi194.stdout: use_delta_encoding: 1 2024-09-13T16:01:46.268 INFO:journalctl@ceph.mon.c.smithi194.stdout: filter_policy: bloomfilter 2024-09-13T16:01:46.268 INFO:journalctl@ceph.mon.c.smithi194.stdout: whole_key_filtering: 1 2024-09-13T16:01:46.269 INFO:journalctl@ceph.mon.c.smithi194.stdout: verify_compression: 0 2024-09-13T16:01:46.269 INFO:journalctl@ceph.mon.c.smithi194.stdout: read_amp_bytes_per_bit: 0 2024-09-13T16:01:46.269 INFO:journalctl@ceph.mon.c.smithi194.stdout: format_version: 5 2024-09-13T16:01:46.269 INFO:journalctl@ceph.mon.c.smithi194.stdout: enable_index_compression: 1 2024-09-13T16:01:46.269 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_align: 0 2024-09-13T16:01:46.269 INFO:journalctl@ceph.mon.c.smithi194.stdout: max_auto_readahead_size: 262144 2024-09-13T16:01:46.269 INFO:journalctl@ceph.mon.c.smithi194.stdout: prepopulate_block_cache: 0 2024-09-13T16:01:46.269 INFO:journalctl@ceph.mon.c.smithi194.stdout: initial_auto_readahead_size: 8192 2024-09-13T16:01:46.269 INFO:journalctl@ceph.mon.c.smithi194.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T16:01:46.269 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T16:01:46.269 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T16:01:46.269 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compression: NoCompression 2024-09-13T16:01:46.269 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T16:01:46.270 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T16:01:46.270 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T16:01:46.270 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.num_levels: 7 2024-09-13T16:01:46.270 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T16:01:46.270 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T16:01:46.270 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T16:01:46.270 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T16:01:46.270 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T16:01:46.270 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T16:01:46.270 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T16:01:46.270 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T16:01:46.270 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T16:01:46.270 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T16:01:46.271 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T16:01:46.271 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T16:01:46.271 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T16:01:46.271 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T16:01:46.271 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T16:01:46.271 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T16:01:46.271 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T16:01:46.271 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T16:01:46.271 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T16:01:46.271 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T16:01:46.271 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T16:01:46.271 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T16:01:46.271 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T16:01:46.271 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T16:01:46.272 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T16:01:46.272 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T16:01:46.272 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T16:01:46.272 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T16:01:46.272 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T16:01:46.272 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T16:01:46.272 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T16:01:46.272 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T16:01:46.272 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T16:01:46.272 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T16:01:46.272 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T16:01:46.272 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T16:01:46.272 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T16:01:46.272 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T16:01:46.273 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T16:01:46.273 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T16:01:46.273 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T16:01:46.273 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T16:01:46.273 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T16:01:46.273 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T16:01:46.273 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T16:01:46.273 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T16:01:46.273 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T16:01:46.273 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T16:01:46.273 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T16:01:46.273 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T16:01:46.273 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T16:01:46.274 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T16:01:46.274 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T16:01:46.274 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T16:01:46.274 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.inplace_update_support: 0 2024-09-13T16:01:46.274 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T16:01:46.274 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T16:01:46.274 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T16:01:46.274 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T16:01:46.274 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.bloom_locality: 0 2024-09-13T16:01:46.274 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.max_successive_merges: 0 2024-09-13T16:01:46.274 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T16:01:46.274 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T16:01:46.274 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T16:01:46.274 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T16:01:46.275 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.ttl: 2592000 2024-09-13T16:01:46.275 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T16:01:46.275 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T16:01:46.275 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T16:01:46.275 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.enable_blob_files: false 2024-09-13T16:01:46.275 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.min_blob_size: 0 2024-09-13T16:01:46.275 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T16:01:46.275 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T16:01:46.275 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T16:01:46.275 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T16:01:46.275 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T16:01:46.275 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T16:01:46.275 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T16:01:46.275 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T16:01:46.275 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T16:01:46.276 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-13T16:01:46.276 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e39d48b1-9c0f-40a2-8dea-ab3917491a76 2024-09-13T16:01:46.276 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726243305905396, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-13T16:01:46.276 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-13T16:01:46.276 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726243305905792, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726243305, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e39d48b1-9c0f-40a2-8dea-ab3917491a76", "db_session_id": "ITCRRH5G9R1K0MQ13LOK", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-13T16:01:46.276 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726243305905885, "job": 1, "event": "recovery_finished"} 2024-09-13T16:01:46.276 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-13T16:01:46.276 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T16:01:46.276 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55bced786e00 2024-09-13T16:01:46.276 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: DB pointer 0x55bced87a000 2024-09-13T16:01:46.276 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T16:01:46.276 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T16:01:46.277 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** DB Stats ** 2024-09-13T16:01:46.277 INFO:journalctl@ceph.mon.c.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T16:01:46.277 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T16:01:46.277 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T16:01:46.277 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T16:01:46.277 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T16:01:46.277 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T16:01:46.277 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T16:01:46.277 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-09-13T16:01:46.277 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** Compaction Stats [default] ** 2024-09-13T16:01:46.277 INFO:journalctl@ceph.mon.c.smithi194.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T16:01:46.277 INFO:journalctl@ceph.mon.c.smithi194.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T16:01:46.277 INFO:journalctl@ceph.mon.c.smithi194.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T16:01:46.278 INFO:journalctl@ceph.mon.c.smithi194.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T16:01:46.278 INFO:journalctl@ceph.mon.c.smithi194.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T16:01:46.278 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-09-13T16:01:46.278 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** Compaction Stats [default] ** 2024-09-13T16:01:46.278 INFO:journalctl@ceph.mon.c.smithi194.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T16:01:46.278 INFO:journalctl@ceph.mon.c.smithi194.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T16:01:46.278 INFO:journalctl@ceph.mon.c.smithi194.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T16:01:46.278 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-09-13T16:01:46.278 INFO:journalctl@ceph.mon.c.smithi194.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T16:01:46.278 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-09-13T16:01:46.278 INFO:journalctl@ceph.mon.c.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T16:01:46.278 INFO:journalctl@ceph.mon.c.smithi194.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T16:01:46.278 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T16:01:46.278 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T16:01:46.279 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T16:01:46.279 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T16:01:46.279 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T16:01:46.279 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T16:01:46.279 INFO:journalctl@ceph.mon.c.smithi194.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T16:01:46.279 INFO:journalctl@ceph.mon.c.smithi194.stdout: Block cache BinnedLRUCache@0x55bced75b350#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-13T16:01:46.279 INFO:journalctl@ceph.mon.c.smithi194.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-13T16:01:46.279 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-09-13T16:01:46.279 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T16:01:46.279 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-13T16:01:46.279 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: using public_addr v2:172.21.15.194:0/0 -> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-13T16:01:46.279 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: starting mon.c rank -1 at public addrs [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] at bind addrs [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:01:46.279 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: mon.c@-1(???) e0 preinit fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:01:46.279 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: mon.c@-1(synchronizing).mds e1 new map 2024-09-13T16:01:46.280 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-13T16:01:46.280 INFO:journalctl@ceph.mon.c.smithi194.stdout: e1 2024-09-13T16:01:46.280 INFO:journalctl@ceph.mon.c.smithi194.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T16:01:46.280 INFO:journalctl@ceph.mon.c.smithi194.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T16:01:46.280 INFO:journalctl@ceph.mon.c.smithi194.stdout: legacy client fscid: -1 2024-09-13T16:01:46.280 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-09-13T16:01:46.280 INFO:journalctl@ceph.mon.c.smithi194.stdout: No filesystems configured 2024-09-13T16:01:46.280 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-13T16:01:46.280 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-13T16:01:46.280 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-13T16:01:46.280 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-13T16:01:46.280 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-13T16:01:46.280 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-13T16:01:46.281 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T16:01:46.281 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T16:01:46.281 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T16:01:46.281 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T16:01:46.281 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.281 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:46.281 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:01:46.281 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.281 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.281 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.281 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.281 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:01:46.281 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:46.281 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:01:46.282 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:46.282 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-13T16:01:46.282 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: Updating smithi139:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:01:46.282 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.282 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.282 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.282 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:01:46.282 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: Updating smithi139:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T16:01:46.282 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:46.282 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:01:46.282 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: Deploying cephadm binary to smithi194 2024-09-13T16:01:46.282 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:46.282 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.283 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:01:46.283 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.283 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: Added host smithi194 2024-09-13T16:01:46.283 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.283 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.283 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:46.283 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:01:46.283 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:46.283 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.283 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.283 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.283 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.283 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:01:46.284 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:46.284 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:01:46.284 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-13T16:01:46.284 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: Updating smithi194:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:01:46.284 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:01:46.284 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.284 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.284 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.284 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: Updating smithi194:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T16:01:46.284 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:46.284 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3948880759' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T16:01:46.284 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3948880759' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T16:01:46.284 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:01:46.284 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:46.285 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:46.285 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi086:172.21.15.86=a;smithi139:172.21.15.139=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:01:46.285 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: Saving service mon spec with placement smithi086:172.21.15.86=a;smithi139:172.21.15.139=b;smithi194:172.21.15.194=c;count:3 2024-09-13T16:01:46.285 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.285 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:01:46.285 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:46.285 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:01:46.285 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:46.285 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:01:46.285 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:46.285 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: Deploying daemon mon.c on smithi194 2024-09-13T16:01:46.285 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:46.285 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 ceph-mon[35694]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-13T16:01:46.285 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 bash[35642]: aff0ed55faf9bbf89b194b054d4034ae160e30e671231fc1d6dd8878c49cbe8d 2024-09-13T16:01:46.286 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:45 smithi194 systemd[1]: Started Ceph mon.c for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:01:47.594 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T16:01:47.594 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:01:47.803 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:01:51.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:01:51.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:51.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: mon.a calling monitor election 2024-09-13T16:01:51.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:51.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:51.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:51.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: mon.c calling monitor election 2024-09-13T16:01:51.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:51.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:51.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:51.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:51.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T16:01:51.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: monmap e2: 2 mons at {a=[v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0],c=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:01:51.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: fsmap 2024-09-13T16:01:51.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:01:51.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: mgrmap e13: x(active, since 51s) 2024-09-13T16:01:51.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: overall HEALTH_OK 2024-09-13T16:01:51.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:51.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:51.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:51.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:01:51.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:51.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:01:51.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:51.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: mon.a calling monitor election 2024-09-13T16:01:51.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:51.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:51.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:51.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: mon.c calling monitor election 2024-09-13T16:01:51.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:51.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:51.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:51.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:51.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T16:01:51.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: monmap e2: 2 mons at {a=[v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0],c=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:01:51.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: fsmap 2024-09-13T16:01:51.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:01:51.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: mgrmap e13: x(active, since 51s) 2024-09-13T16:01:51.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: overall HEALTH_OK 2024-09-13T16:01:51.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:51.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:51.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:51.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:01:51.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:52.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.215+0000 7f6699d98640 1 -- 172.21.15.194:0/985247978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f667c005740 msgr2=0x7f667c007bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.215+0000 7f6699d98640 1 --2- 172.21.15.194:0/985247978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f667c005740 0x7f667c007bd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f66940ffc20 tx=0x7f668402bce0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.216+0000 7f6699d98640 1 -- 172.21.15.194:0/985247978 shutdown_connections 2024-09-13T16:01:52.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.216+0000 7f6699d98640 1 --2- 172.21.15.194:0/985247978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f667c005740 0x7f667c007bd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.216+0000 7f6699d98640 1 -- 172.21.15.194:0/985247978 >> 172.21.15.194:0/985247978 conn(0x7f66940fa490 msgr2=0x7f66940fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:52.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.216+0000 7f6699d98640 1 -- 172.21.15.194:0/985247978 shutdown_connections 2024-09-13T16:01:52.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.216+0000 7f6699d98640 1 -- 172.21.15.194:0/985247978 wait complete. 2024-09-13T16:01:52.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.216+0000 7f6699d98640 1 Processor -- start 2024-09-13T16:01:52.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.217+0000 7f6699d98640 1 -- start start 2024-09-13T16:01:52.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.217+0000 7f6699d98640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f667c005740 0x7f6694197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.217+0000 7f6699d98640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6694197960 0x7f669419bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.217+0000 7f6699d98640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6694197ed0 con 0x7f6694197960 2024-09-13T16:01:52.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.217+0000 7f6699d98640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6694198040 con 0x7f667c005740 2024-09-13T16:01:52.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.217+0000 7f66937fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f667c005740 0x7f6694197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.217+0000 7f66937fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f667c005740 0x7f6694197420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:47676/0 (socket says 172.21.15.194:47676) 2024-09-13T16:01:52.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.217+0000 7f66937fe640 1 -- 172.21.15.194:0/1271050569 learned_addr learned my addr 172.21.15.194:0/1271050569 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T16:01:52.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.217+0000 7f66937fe640 1 -- 172.21.15.194:0/1271050569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f667c005740 msgr2=0x7f6694197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-13T16:01:52.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.217+0000 7f66937fe640 1 -- 172.21.15.194:0/1271050569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f667c005740 msgr2=0x7f6694197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T16:01:52.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.217+0000 7f66937fe640 1 --2- 172.21.15.194:0/1271050569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f667c005740 0x7f6694197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T16:01:52.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.217+0000 7f66937fe640 1 --2- 172.21.15.194:0/1271050569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f667c005740 0x7f6694197420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:01:52.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.217+0000 7f6692ffd640 1 --2- 172.21.15.194:0/1271050569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6694197960 0x7f669419bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.218+0000 7f6692ffd640 1 -- 172.21.15.194:0/1271050569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f667c005740 msgr2=0x7f6694197420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:01:52.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.218+0000 7f6692ffd640 1 --2- 172.21.15.194:0/1271050569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f667c005740 0x7f6694197420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.218+0000 7f6692ffd640 1 -- 172.21.15.194:0/1271050569 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6684011870 con 0x7f6694197960 2024-09-13T16:01:52.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.218+0000 7f6692ffd640 1 --2- 172.21.15.194:0/1271050569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6694197960 0x7f669419bcf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f668800b3d0 tx=0x7f668800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:52.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.219+0000 7f6690ff9640 1 -- 172.21.15.194:0/1271050569 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f6688011630 con 0x7f6694197960 2024-09-13T16:01:52.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.219+0000 7f6690ff9640 1 -- 172.21.15.194:0/1271050569 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6688011c70 con 0x7f6694197960 2024-09-13T16:01:52.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.219+0000 7f6699d98640 1 -- 172.21.15.194:0/1271050569 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669419c230 con 0x7f6694197960 2024-09-13T16:01:52.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.219+0000 7f6690ff9640 1 -- 172.21.15.194:0/1271050569 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f6688010dc0 con 0x7f6694197960 2024-09-13T16:01:52.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.219+0000 7f6699d98640 1 -- 172.21.15.194:0/1271050569 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669419c780 con 0x7f6694197960 2024-09-13T16:01:52.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.220+0000 7f6690ff9640 1 -- 172.21.15.194:0/1271050569 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f668801a400 con 0x7f6694197960 2024-09-13T16:01:52.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.220+0000 7f6690ff9640 1 --2- 172.21.15.194:0/1271050569 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6680038550 0x7f668003aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.220+0000 7f6690ff9640 1 -- 172.21.15.194:0/1271050569 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f668804afb0 con 0x7f6694197960 2024-09-13T16:01:52.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.220+0000 7f6699d98640 1 -- 172.21.15.194:0/1271050569 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66940ffed0 con 0x7f6694197960 2024-09-13T16:01:52.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.221+0000 7f66937fe640 1 --2- 172.21.15.194:0/1271050569 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6680038550 0x7f668003aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.221+0000 7f66937fe640 1 --2- 172.21.15.194:0/1271050569 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6680038550 0x7f668003aa10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6684005940 tx=0x7f66840058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:52.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.226+0000 7f6690ff9640 1 -- 172.21.15.194:0/1271050569 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f66880193b0 con 0x7f6694197960 2024-09-13T16:01:52.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:52 smithi086 ceph-mon[30379]: Deploying daemon mon.b on smithi139 2024-09-13T16:01:52.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:52 smithi086 ceph-mon[30379]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:52.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:52.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.452+0000 7f6699d98640 1 -- 172.21.15.194:0/1271050569 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6694191300 con 0x7f6694197960 2024-09-13T16:01:52.454 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:52 smithi194 ceph-mon[35694]: Deploying daemon mon.b on smithi139 2024-09-13T16:01:52.454 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:52 smithi194 ceph-mon[35694]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:52.454 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:52.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.453+0000 7f6690ff9640 1 -- 172.21.15.194:0/1271050569 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7f668803d020 con 0x7f6694197960 2024-09-13T16:01:52.455 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T16:01:52.455 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":2,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","modified":"2024-09-13T16:01:45.933524Z","created":"2024-09-13T16:00:03.871460Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:3300","nonce":0},{"type":"v1","addr":"172.21.15.86:6789","nonce":0}]},"addr":"172.21.15.86:6789/0","public_addr":"172.21.15.86:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T16:01:52.456 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 2 2024-09-13T16:01:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.455+0000 7f6699d98640 1 -- 172.21.15.194:0/1271050569 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6680038550 msgr2=0x7f668003aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.455+0000 7f6699d98640 1 --2- 172.21.15.194:0/1271050569 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6680038550 0x7f668003aa10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6684005940 tx=0x7f66840058b0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.455+0000 7f6699d98640 1 -- 172.21.15.194:0/1271050569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6694197960 msgr2=0x7f669419bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.455+0000 7f6699d98640 1 --2- 172.21.15.194:0/1271050569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6694197960 0x7f669419bcf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f668800b3d0 tx=0x7f668800b890 comp rx=0 tx=0).stop 2024-09-13T16:01:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.455+0000 7f6699d98640 1 -- 172.21.15.194:0/1271050569 shutdown_connections 2024-09-13T16:01:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.455+0000 7f6699d98640 1 --2- 172.21.15.194:0/1271050569 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6680038550 0x7f668003aa10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.455+0000 7f6699d98640 1 --2- 172.21.15.194:0/1271050569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6694197960 0x7f669419bcf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.455+0000 7f6699d98640 1 --2- 172.21.15.194:0/1271050569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f667c005740 0x7f6694197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.455+0000 7f6699d98640 1 -- 172.21.15.194:0/1271050569 >> 172.21.15.194:0/1271050569 conn(0x7f66940fa490 msgr2=0x7f66940fc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:52.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.456+0000 7f6699d98640 1 -- 172.21.15.194:0/1271050569 shutdown_connections 2024-09-13T16:01:52.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:01:52.456+0000 7f6699d98640 1 -- 172.21.15.194:0/1271050569 wait complete. 2024-09-13T16:01:53.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:53 smithi194 ceph-mon[35694]: from='client.? 172.21.15.194:0/1271050569' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:01:53.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:53 smithi086 ceph-mon[30379]: from='client.? 172.21.15.194:0/1271050569' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:01:53.365 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:01:52 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:01:52.933+0000 7f4baca00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T16:01:54.297 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T16:01:54.297 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:01:54.326 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:54 smithi194 ceph-mon[35694]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:54.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:54 smithi086 ceph-mon[30379]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:54.501 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:01:54.554 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-13T16:01:54.554 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-13T16:01:54.554 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-13T16:01:54.554 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-13T16:01:54.554 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-13T16:01:54.554 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-13T16:01:54.554 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T16:01:54.554 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T16:01:54.555 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T16:01:54.555 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T16:01:54.555 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:54.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:54.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:01:54.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:54.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:54.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:54.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:01:55.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:55.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:01:55.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:55.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-13T16:01:55.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: Updating smithi139:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:01:55.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:01:55.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: Updating smithi139:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T16:01:55.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:55.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:01:55.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: Deploying cephadm binary to smithi194 2024-09-13T16:01:55.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:55.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:01:55.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: Added host smithi194 2024-09-13T16:01:55.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:55.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:01:55.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:55.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.002 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:01:55.002 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:55.002 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:01:55.002 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-13T16:01:55.002 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: Updating smithi194:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:01:55.002 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:01:55.003 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.003 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.003 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.003 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: Updating smithi194:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T16:01:55.003 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:55.003 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3948880759' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T16:01:55.003 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3948880759' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T16:01:55.003 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:01:55.003 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:55.003 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:55.003 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi086:172.21.15.86=a;smithi139:172.21.15.139=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:01:55.003 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: Saving service mon spec with placement smithi086:172.21.15.86=a;smithi139:172.21.15.139=b;smithi194:172.21.15.194=c;count:3 2024-09-13T16:01:55.003 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.004 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:01:55.004 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:55.004 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:01:55.004 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.004 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:01:55.004 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:55.004 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: Deploying daemon mon.c on smithi194 2024-09-13T16:01:55.004 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:55.004 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:01:55.004 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:55.004 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: mon.a calling monitor election 2024-09-13T16:01:55.004 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:55.005 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:55.005 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:55.005 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: mon.c calling monitor election 2024-09-13T16:01:55.005 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:55.005 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:55.005 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:55.005 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:55.005 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T16:01:55.005 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: monmap e2: 2 mons at {a=[v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0],c=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:01:55.005 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: fsmap 2024-09-13T16:01:55.005 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:01:55.005 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: mgrmap e13: x(active, since 51s) 2024-09-13T16:01:55.005 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: overall HEALTH_OK 2024-09-13T16:01:55.006 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.006 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.006 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:55.006 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:01:55.006 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:55.006 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: Deploying daemon mon.b on smithi139 2024-09-13T16:01:55.006 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:55.006 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:55.006 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: from='client.? 172.21.15.194:0/1271050569' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:01:55.006 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:55.006 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 ceph-mon[35320]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-13T16:01:55.006 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 bash[35299]: 6542dd8d5c00ca320c8bad5d223662dce36d3a439c8451ac9d0168232865b4fa 2024-09-13T16:01:55.006 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:01:54 smithi139 systemd[1]: Started Ceph mon.b for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:01:59.958 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:01:59.958 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: mon.a calling monitor election 2024-09-13T16:01:59.958 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: mon.c calling monitor election 2024-09-13T16:01:59.958 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:01:59.958 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:01:59.958 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:59.959 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:01:59.959 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:01:59.959 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:59.959 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:01:59.959 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:01:59.959 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:01:59.959 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:01:59.959 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T16:01:59.959 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: monmap e3: 3 mons at {a=[v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0],b=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0],c=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:01:59.959 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: fsmap 2024-09-13T16:01:59.959 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:01:59.959 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: mgrmap e13: x(active, since 60s) 2024-09-13T16:01:59.959 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T16:01:59.960 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T16:01:59.960 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T16:01:59.960 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: mon.b (rank 2) addr [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] is down (out of quorum) 2024-09-13T16:01:59.960 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:59.960 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:59.960 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:01:59.960 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:01:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:00.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:02:00.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: mon.a calling monitor election 2024-09-13T16:02:00.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: mon.c calling monitor election 2024-09-13T16:02:00.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:02:00.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:02:00.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:00.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:02:00.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:02:00.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:00.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:02:00.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:02:00.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:00.118 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:02:00.118 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T16:02:00.118 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: monmap e3: 3 mons at {a=[v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0],b=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0],c=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:02:00.118 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: fsmap 2024-09-13T16:02:00.118 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:02:00.118 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: mgrmap e13: x(active, since 60s) 2024-09-13T16:02:00.119 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T16:02:00.119 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T16:02:00.119 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T16:02:00.119 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: mon.b (rank 2) addr [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] is down (out of quorum) 2024-09-13T16:02:00.119 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:00.120 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:00.120 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:00.120 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:01:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:00.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.264+0000 7f1357a19640 1 -- 172.21.15.194:0/2570874500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f133c003530 msgr2=0x7f133c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:00.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.264+0000 7f1357a19640 1 --2- 172.21.15.194:0/2570874500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f133c003530 0x7f133c0059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f13500ffc10 tx=0x7f134c02c490 comp rx=0 tx=0).stop 2024-09-13T16:02:00.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.264+0000 7f1357a19640 1 -- 172.21.15.194:0/2570874500 shutdown_connections 2024-09-13T16:02:00.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.264+0000 7f1357a19640 1 --2- 172.21.15.194:0/2570874500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f133c003530 0x7f133c0059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.264+0000 7f1357a19640 1 -- 172.21.15.194:0/2570874500 >> 172.21.15.194:0/2570874500 conn(0x7f13500fa440 msgr2=0x7f13500fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:00.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.264+0000 7f1357a19640 1 -- 172.21.15.194:0/2570874500 shutdown_connections 2024-09-13T16:02:00.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.264+0000 7f1357a19640 1 -- 172.21.15.194:0/2570874500 wait complete. 2024-09-13T16:02:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.265+0000 7f1357a19640 1 Processor -- start 2024-09-13T16:02:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.265+0000 7f1357a19640 1 -- start start 2024-09-13T16:02:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1357a19640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c003530 0x7f13501952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1357a19640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1350195830 0x7f1350199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1357a19640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f135019a170 0x7f135019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1357a19640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1350195f00 con 0x7f1350195830 2024-09-13T16:02:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1357a19640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13501a1ee0 con 0x7f133c003530 2024-09-13T16:02:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1357a19640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13501a2020 con 0x7f135019a170 2024-09-13T16:02:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1355fb6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f135019a170 0x7f135019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1355fb6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f135019a170 0x7f135019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:57788/0 (socket says 172.21.15.194:57788) 2024-09-13T16:02:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1355fb6640 1 -- 172.21.15.194:0/1205629786 learned_addr learned my addr 172.21.15.194:0/1205629786 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T16:02:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f13557b5640 1 --2- 172.21.15.194:0/1205629786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c003530 0x7f13501952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1355fb6640 1 -- 172.21.15.194:0/1205629786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f135019a170 msgr2=0x7f135019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-13T16:02:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1355fb6640 1 -- 172.21.15.194:0/1205629786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f135019a170 msgr2=0x7f135019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T16:02:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1355fb6640 1 --2- 172.21.15.194:0/1205629786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f135019a170 0x7f135019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T16:02:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1355fb6640 1 --2- 172.21.15.194:0/1205629786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f135019a170 0x7f135019a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:02:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f13557b5640 1 -- 172.21.15.194:0/1205629786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c003530 msgr2=0x7f13501952f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-13T16:02:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f13557b5640 1 -- 172.21.15.194:0/1205629786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c003530 msgr2=0x7f13501952f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T16:02:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f13557b5640 1 --2- 172.21.15.194:0/1205629786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c003530 0x7f13501952f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T16:02:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f13557b5640 1 --2- 172.21.15.194:0/1205629786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c003530 0x7f13501952f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:02:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1354fb4640 1 --2- 172.21.15.194:0/1205629786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1350195830 0x7f1350199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1354fb4640 1 -- 172.21.15.194:0/1205629786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f135019a170 msgr2=0x7f135019a620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:02:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1354fb4640 1 --2- 172.21.15.194:0/1205629786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f135019a170 0x7f135019a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1354fb4640 1 -- 172.21.15.194:0/1205629786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c003530 msgr2=0x7f13501952f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:02:00.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1354fb4640 1 --2- 172.21.15.194:0/1205629786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c003530 0x7f13501952f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.266+0000 7f1354fb4640 1 -- 172.21.15.194:0/1205629786 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c012880 con 0x7f1350195830 2024-09-13T16:02:00.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.267+0000 7f1354fb4640 1 --2- 172.21.15.194:0/1205629786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1350195830 0x7f1350199c30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f134000b480 tx=0x7f134000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:00.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.267+0000 7f13467fc640 1 -- 172.21.15.194:0/1205629786 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340004230 con 0x7f1350195830 2024-09-13T16:02:00.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.267+0000 7f13467fc640 1 -- 172.21.15.194:0/1205629786 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1340004390 con 0x7f1350195830 2024-09-13T16:02:00.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.267+0000 7f1357a19640 1 -- 172.21.15.194:0/1205629786 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13501a22d0 con 0x7f1350195830 2024-09-13T16:02:00.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.267+0000 7f13467fc640 1 -- 172.21.15.194:0/1205629786 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340003c10 con 0x7f1350195830 2024-09-13T16:02:00.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.267+0000 7f1357a19640 1 -- 172.21.15.194:0/1205629786 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13501a27a0 con 0x7f1350195830 2024-09-13T16:02:00.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.268+0000 7f1357a19640 1 -- 172.21.15.194:0/1205629786 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13500ffec0 con 0x7f1350195830 2024-09-13T16:02:00.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.268+0000 7f13467fc640 1 -- 172.21.15.194:0/1205629786 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f1340010670 con 0x7f1350195830 2024-09-13T16:02:00.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.268+0000 7f13467fc640 1 --2- 172.21.15.194:0/1205629786 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1334038be0 0x7f133403b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:00.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.268+0000 7f13467fc640 1 -- 172.21.15.194:0/1205629786 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f134004abe0 con 0x7f1350195830 2024-09-13T16:02:00.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.269+0000 7f13557b5640 1 --2- 172.21.15.194:0/1205629786 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1334038be0 0x7f133403b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:00.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.269+0000 7f13557b5640 1 --2- 172.21.15.194:0/1205629786 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1334038be0 0x7f133403b0a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f134c02ca00 tx=0x7f134c02c990 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:00.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.274+0000 7f13467fc640 1 -- 172.21.15.194:0/1205629786 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1340003db0 con 0x7f1350195830 2024-09-13T16:02:00.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.508+0000 7f1357a19640 1 -- 172.21.15.194:0/1205629786 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1350106650 con 0x7f1350195830 2024-09-13T16:02:00.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.508+0000 7f13467fc640 1 -- 172.21.15.194:0/1205629786 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1274 (secure 0 0 0) 0x7f134001d020 con 0x7f1350195830 2024-09-13T16:02:00.509 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T16:02:00.509 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":3,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","modified":"2024-09-13T16:01:54.558308Z","created":"2024-09-13T16:00:03.871460Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:3300","nonce":0},{"type":"v1","addr":"172.21.15.86:6789","nonce":0}]},"addr":"172.21.15.86:6789/0","public_addr":"172.21.15.86:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T16:02:00.509 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 3 2024-09-13T16:02:00.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.510+0000 7f1357a19640 1 -- 172.21.15.194:0/1205629786 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1334038be0 msgr2=0x7f133403b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:00.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.510+0000 7f1357a19640 1 --2- 172.21.15.194:0/1205629786 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1334038be0 0x7f133403b0a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f134c02ca00 tx=0x7f134c02c990 comp rx=0 tx=0).stop 2024-09-13T16:02:00.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.510+0000 7f1357a19640 1 -- 172.21.15.194:0/1205629786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1350195830 msgr2=0x7f1350199c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:00.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.510+0000 7f1357a19640 1 --2- 172.21.15.194:0/1205629786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1350195830 0x7f1350199c30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f134000b480 tx=0x7f134000b940 comp rx=0 tx=0).stop 2024-09-13T16:02:00.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.511+0000 7f1357a19640 1 -- 172.21.15.194:0/1205629786 shutdown_connections 2024-09-13T16:02:00.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.511+0000 7f1357a19640 1 --2- 172.21.15.194:0/1205629786 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1334038be0 0x7f133403b0a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.511+0000 7f1357a19640 1 --2- 172.21.15.194:0/1205629786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f135019a170 0x7f135019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.511+0000 7f1357a19640 1 --2- 172.21.15.194:0/1205629786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1350195830 0x7f1350199c30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.511+0000 7f1357a19640 1 --2- 172.21.15.194:0/1205629786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c003530 0x7f13501952f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:00.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.511+0000 7f1357a19640 1 -- 172.21.15.194:0/1205629786 >> 172.21.15.194:0/1205629786 conn(0x7f13500fa440 msgr2=0x7f1350103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:00.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.511+0000 7f1357a19640 1 -- 172.21.15.194:0/1205629786 shutdown_connections 2024-09-13T16:02:00.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:00.511+0000 7f1357a19640 1 -- 172.21.15.194:0/1205629786 wait complete. 2024-09-13T16:02:00.802 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:00.802 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:00 smithi194 ceph-mon[35694]: from='client.? 172.21.15.194:0/1205629786' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:02:00.803 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:02:01.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:01.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:00 smithi086 ceph-mon[30379]: from='client.? 172.21.15.194:0/1205629786' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:02:01.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:02:01.298 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-13T16:02:01.298 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-13T16:02:01.631 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:02:01.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:02:01.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: mon.a calling monitor election 2024-09-13T16:02:01.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: mon.c calling monitor election 2024-09-13T16:02:01.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:02:01.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:02:01.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:01.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:02:01.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:02:01.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:01.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:02:01.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:02:02.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:02.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:02:02.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T16:02:02.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: monmap e3: 3 mons at {a=[v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0],b=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0],c=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:02:02.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: fsmap 2024-09-13T16:02:02.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:02:02.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: mgrmap e13: x(active, since 60s) 2024-09-13T16:02:02.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T16:02:02.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T16:02:02.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T16:02:02.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: mon.b (rank 2) addr [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] is down (out of quorum) 2024-09-13T16:02:02.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:02.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: from='client.? 172.21.15.194:0/1205629786' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:02:02.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:02:02.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: mon.b calling monitor election 2024-09-13T16:02:02.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: Updating smithi086:/etc/ceph/ceph.conf 2024-09-13T16:02:02.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-13T16:02:02.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-13T16:02:02.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: Updating smithi139:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:02:02.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: Updating smithi194:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:02:02.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: Updating smithi086:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:02:02.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:02.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: mon.b calling monitor election 2024-09-13T16:02:02.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: mon.c calling monitor election 2024-09-13T16:02:02.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: mon.a calling monitor election 2024-09-13T16:02:02.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T16:02:02.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: monmap e3: 3 mons at {a=[v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0],b=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0],c=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:02:02.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: fsmap 2024-09-13T16:02:02.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:02:02.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: mgrmap e13: x(active, since 62s) 2024-09-13T16:02:02.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T16:02:02.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: Cluster is now healthy 2024-09-13T16:02:02.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: overall HEALTH_OK 2024-09-13T16:02:02.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.368 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.368 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.368 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:02:02.368 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:02:02.368 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:02 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:02.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: mon.b calling monitor election 2024-09-13T16:02:02.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: Updating smithi086:/etc/ceph/ceph.conf 2024-09-13T16:02:02.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-13T16:02:02.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-13T16:02:02.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: Updating smithi139:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:02:02.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: Updating smithi194:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:02:02.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: Updating smithi086:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:02:02.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:02.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: mon.b calling monitor election 2024-09-13T16:02:02.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: mon.c calling monitor election 2024-09-13T16:02:02.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: mon.a calling monitor election 2024-09-13T16:02:02.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T16:02:02.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: monmap e3: 3 mons at {a=[v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0],b=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0],c=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:02:02.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: fsmap 2024-09-13T16:02:02.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:02:02.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: mgrmap e13: x(active, since 62s) 2024-09-13T16:02:02.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T16:02:02.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: Cluster is now healthy 2024-09-13T16:02:02.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: overall HEALTH_OK 2024-09-13T16:02:02.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.501 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:02:02.501 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:02:02.501 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:02 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:02.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: mon.b calling monitor election 2024-09-13T16:02:02.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: Updating smithi086:/etc/ceph/ceph.conf 2024-09-13T16:02:02.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-13T16:02:02.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-13T16:02:02.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: Updating smithi139:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:02:02.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: Updating smithi194:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:02:02.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: Updating smithi086:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:02:02.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:02.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: mon.b calling monitor election 2024-09-13T16:02:02.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: mon.c calling monitor election 2024-09-13T16:02:02.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: mon.a calling monitor election 2024-09-13T16:02:02.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T16:02:02.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: monmap e3: 3 mons at {a=[v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0],b=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0],c=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:02:02.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: fsmap 2024-09-13T16:02:02.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:02:02.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: mgrmap e13: x(active, since 62s) 2024-09-13T16:02:02.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T16:02:02.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: Cluster is now healthy 2024-09-13T16:02:02.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: overall HEALTH_OK 2024-09-13T16:02:02.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:02.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:02:02.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:02:02.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:02 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:03.358 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:03 smithi086 ceph-mon[30379]: Reconfiguring mon.a (unknown last config time)... 2024-09-13T16:02:03.359 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:03 smithi086 ceph-mon[30379]: Reconfiguring daemon mon.a on smithi086 2024-09-13T16:02:03.359 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:03 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:02:03.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:03 smithi139 ceph-mon[35320]: Reconfiguring mon.a (unknown last config time)... 2024-09-13T16:02:03.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:03 smithi139 ceph-mon[35320]: Reconfiguring daemon mon.a on smithi086 2024-09-13T16:02:03.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:03 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:02:03.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:03 smithi194 ceph-mon[35694]: Reconfiguring mon.a (unknown last config time)... 2024-09-13T16:02:03.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:03 smithi194 ceph-mon[35694]: Reconfiguring daemon mon.a on smithi086 2024-09-13T16:02:03.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:03 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:02:03.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.910+0000 7f1fa9200640 1 -- 172.21.15.86:0/3296050930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fa41006e0 msgr2=0x7f1fa4100ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.910+0000 7f1fa9200640 1 --2- 172.21.15.86:0/3296050930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fa41006e0 0x7f1fa4100ac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009c20 tx=0x7f1f9402aa90 comp rx=0 tx=0).stop 2024-09-13T16:02:03.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.910+0000 7f1fa9200640 1 -- 172.21.15.86:0/3296050930 shutdown_connections 2024-09-13T16:02:03.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.910+0000 7f1fa9200640 1 --2- 172.21.15.86:0/3296050930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fa41006e0 0x7f1fa4100ac0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.910+0000 7f1fa9200640 1 -- 172.21.15.86:0/3296050930 >> 172.21.15.86:0/3296050930 conn(0x7f1fa40fa190 msgr2=0x7f1fa40fc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:03.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.910+0000 7f1fa9200640 1 -- 172.21.15.86:0/3296050930 shutdown_connections 2024-09-13T16:02:03.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.910+0000 7f1fa9200640 1 -- 172.21.15.86:0/3296050930 wait complete. 2024-09-13T16:02:03.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.911+0000 7f1fa9200640 1 Processor -- start 2024-09-13T16:02:03.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.911+0000 7f1fa9200640 1 -- start start 2024-09-13T16:02:03.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.911+0000 7f1fa9200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fa41006e0 0x7f1fa41972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.911+0000 7f1fa9200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fa4197820 0x7f1fa419bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.911+0000 7f1fa9200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa419c160 0x7f1fa419c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.911+0000 7f1fa9200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa4197ef0 con 0x7f1fa41006e0 2024-09-13T16:02:03.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.911+0000 7f1fa9200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa41a3ed0 con 0x7f1fa4197820 2024-09-13T16:02:03.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.911+0000 7f1fa9200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa41a4010 con 0x7f1fa419c160 2024-09-13T16:02:03.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.912+0000 7f1fa3400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fa41006e0 0x7f1fa41972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.912+0000 7f1fa3400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fa41006e0 0x7f1fa41972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39166/0 (socket says 172.21.15.86:39166) 2024-09-13T16:02:03.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.912+0000 7f1fa3400640 1 -- 172.21.15.86:0/3435563843 learned_addr learned my addr 172.21.15.86:0/3435563843 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:02:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.912+0000 7f1fa2a00640 1 --2- 172.21.15.86:0/3435563843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fa4197820 0x7f1fa419bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.912+0000 7f1fa3e00640 1 --2- 172.21.15.86:0/3435563843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa419c160 0x7f1fa419c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.912+0000 7f1fa3400640 1 -- 172.21.15.86:0/3435563843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa419c160 msgr2=0x7f1fa419c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.912+0000 7f1fa3400640 1 --2- 172.21.15.86:0/3435563843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa419c160 0x7f1fa419c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.912+0000 7f1fa3400640 1 -- 172.21.15.86:0/3435563843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fa4197820 msgr2=0x7f1fa419bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.912+0000 7f1fa3400640 1 --2- 172.21.15.86:0/3435563843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fa4197820 0x7f1fa419bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.912+0000 7f1fa3400640 1 -- 172.21.15.86:0/3435563843 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f94009900 con 0x7f1fa41006e0 2024-09-13T16:02:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.912+0000 7f1fa2a00640 1 --2- 172.21.15.86:0/3435563843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fa4197820 0x7f1fa419bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:03.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.913+0000 7f1fa3400640 1 --2- 172.21.15.86:0/3435563843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fa41006e0 0x7f1fa41972e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1f94006010 tx=0x7f1f9402eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:03.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.913+0000 7f1f9be00640 1 -- 172.21.15.86:0/3435563843 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9403e070 con 0x7f1fa41006e0 2024-09-13T16:02:03.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.913+0000 7f1f9be00640 1 -- 172.21.15.86:0/3435563843 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1f9402fb50 con 0x7f1fa41006e0 2024-09-13T16:02:03.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.913+0000 7f1fa9200640 1 -- 172.21.15.86:0/3435563843 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa41a4260 con 0x7f1fa41006e0 2024-09-13T16:02:03.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.913+0000 7f1f9be00640 1 -- 172.21.15.86:0/3435563843 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f94004800 con 0x7f1fa41006e0 2024-09-13T16:02:03.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.913+0000 7f1fa9200640 1 -- 172.21.15.86:0/3435563843 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa41a4750 con 0x7f1fa41006e0 2024-09-13T16:02:03.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.914+0000 7f1f9be00640 1 -- 172.21.15.86:0/3435563843 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f1f9400a040 con 0x7f1fa41006e0 2024-09-13T16:02:03.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.914+0000 7f1fa9200640 1 -- 172.21.15.86:0/3435563843 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa40687a0 con 0x7f1fa41006e0 2024-09-13T16:02:03.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.914+0000 7f1f9be00640 1 --2- 172.21.15.86:0/3435563843 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1f88038be0 0x7f1f8803b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:03.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.915+0000 7f1f9be00640 1 -- 172.21.15.86:0/3435563843 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1f9406bf50 con 0x7f1fa41006e0 2024-09-13T16:02:03.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.915+0000 7f1fa2a00640 1 --2- 172.21.15.86:0/3435563843 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1f88038be0 0x7f1f8803b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:03.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.915+0000 7f1fa2a00640 1 --2- 172.21.15.86:0/3435563843 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1f88038be0 0x7f1f8803b0a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1f90009e20 tx=0x7f1f90009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:03.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:03.920+0000 7f1f9be00640 1 -- 172.21.15.86:0/3435563843 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1f94037d80 con 0x7f1fa41006e0 2024-09-13T16:02:04.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:04.099+0000 7f1fa9200640 1 -- 172.21.15.86:0/3435563843 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f1fa4109b30 con 0x7f1fa41006e0 2024-09-13T16:02:04.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:04.099+0000 7f1f9be00640 1 -- 172.21.15.86:0/3435563843 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+275 (secure 0 0 0) 0x7f1f94047020 con 0x7f1fa41006e0 2024-09-13T16:02:04.101 INFO:teuthology.orchestra.run.smithi086.stdout:# minimal ceph.conf for 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:02:04.101 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2024-09-13T16:02:04.101 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:02:04.101 INFO:teuthology.orchestra.run.smithi086.stdout: mon_host = [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-13T16:02:04.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:04.102+0000 7f1fa9200640 1 -- 172.21.15.86:0/3435563843 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1f88038be0 msgr2=0x7f1f8803b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:04.102+0000 7f1fa9200640 1 --2- 172.21.15.86:0/3435563843 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1f88038be0 0x7f1f8803b0a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1f90009e20 tx=0x7f1f90009190 comp rx=0 tx=0).stop 2024-09-13T16:02:04.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:04.102+0000 7f1fa9200640 1 -- 172.21.15.86:0/3435563843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fa41006e0 msgr2=0x7f1fa41972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:04.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:04.102+0000 7f1fa9200640 1 --2- 172.21.15.86:0/3435563843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fa41006e0 0x7f1fa41972e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1f94006010 tx=0x7f1f9402eab0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:04.102+0000 7f1fa9200640 1 -- 172.21.15.86:0/3435563843 shutdown_connections 2024-09-13T16:02:04.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:04.102+0000 7f1fa9200640 1 --2- 172.21.15.86:0/3435563843 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1f88038be0 0x7f1f8803b0a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:04.102+0000 7f1fa9200640 1 --2- 172.21.15.86:0/3435563843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa419c160 0x7f1fa419c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:04.102+0000 7f1fa9200640 1 --2- 172.21.15.86:0/3435563843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fa4197820 0x7f1fa419bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:04.102+0000 7f1fa9200640 1 --2- 172.21.15.86:0/3435563843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fa41006e0 0x7f1fa41972e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:04.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:04.102+0000 7f1fa9200640 1 -- 172.21.15.86:0/3435563843 >> 172.21.15.86:0/3435563843 conn(0x7f1fa40fa190 msgr2=0x7f1fa4105930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:04.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:04.102+0000 7f1fa9200640 1 -- 172.21.15.86:0/3435563843 shutdown_connections 2024-09-13T16:02:04.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:04.102+0000 7f1fa9200640 1 -- 172.21.15.86:0/3435563843 wait complete. 2024-09-13T16:02:04.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:04 smithi086 ceph-mon[30379]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:04.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:04 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3435563843' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:04.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:04 smithi139 ceph-mon[35320]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:04.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:04 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3435563843' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:04.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:04 smithi194 ceph-mon[35694]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:04.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:04 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3435563843' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:05.105 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-13T16:02:05.105 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T16:02:05.105 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T16:02:05.163 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T16:02:05.163 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:02:05.259 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T16:02:05.259 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T16:02:05.288 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T16:02:05.288 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:02:05.354 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T16:02:05.354 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T16:02:05.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:05.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:05.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:05.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:05 smithi086 ceph-mon[30379]: Reconfiguring mon.b (monmap changed)... 2024-09-13T16:02:05.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:02:05.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:02:05.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:05.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:05 smithi086 ceph-mon[30379]: Reconfiguring daemon mon.b on smithi139 2024-09-13T16:02:05.388 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T16:02:05.388 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:02:05.457 INFO:tasks.cephadm:Adding mgr.x on smithi086 2024-09-13T16:02:05.457 INFO:tasks.cephadm:Adding mgr.y on smithi139 2024-09-13T16:02:05.457 INFO:tasks.cephadm:Adding mgr.z on smithi194 2024-09-13T16:02:05.457 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi086=x;smithi139=y;smithi194=z' 2024-09-13T16:02:05.690 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:02:05.709 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:05.709 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:05.710 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:05.710 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:05 smithi139 ceph-mon[35320]: Reconfiguring mon.b (monmap changed)... 2024-09-13T16:02:05.710 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:02:05.710 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:02:05.710 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:05.710 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:05 smithi139 ceph-mon[35320]: Reconfiguring daemon mon.b on smithi139 2024-09-13T16:02:05.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:05.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:05.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:05.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:05 smithi194 ceph-mon[35694]: Reconfiguring mon.b (monmap changed)... 2024-09-13T16:02:05.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:02:05.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:02:05.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:05.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:05 smithi194 ceph-mon[35694]: Reconfiguring daemon mon.b on smithi139 2024-09-13T16:02:06.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:06 smithi139 ceph-mon[35320]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:06.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:06 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:06.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:06 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:06.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:06 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:02:06.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:06 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:02:06.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:06 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:06.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:06 smithi194 ceph-mon[35694]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:06.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:06 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:06.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:06 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:06.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:06 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:02:06.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:06 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:02:06.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:06 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:06.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:06 smithi086 ceph-mon[30379]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:06.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:06 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:06.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:06 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:06.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:06 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:02:06.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:06 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:02:06.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:06 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:07.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.431+0000 7f0e703f6640 1 -- 172.21.15.194:0/1380931620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e680fe7d0 msgr2=0x7f0e680febd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:07.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.431+0000 7f0e703f6640 1 --2- 172.21.15.194:0/1380931620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e680fe7d0 0x7f0e680febd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0e64009880 tx=0x7f0e6402a5d0 comp rx=0 tx=0).stop 2024-09-13T16:02:07.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.432+0000 7f0e703f6640 1 -- 172.21.15.194:0/1380931620 shutdown_connections 2024-09-13T16:02:07.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.432+0000 7f0e703f6640 1 --2- 172.21.15.194:0/1380931620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e680fe7d0 0x7f0e680febd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:07.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.432+0000 7f0e703f6640 1 -- 172.21.15.194:0/1380931620 >> 172.21.15.194:0/1380931620 conn(0x7f0e680f9f40 msgr2=0x7f0e680fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:07.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.432+0000 7f0e703f6640 1 -- 172.21.15.194:0/1380931620 shutdown_connections 2024-09-13T16:02:07.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.432+0000 7f0e703f6640 1 -- 172.21.15.194:0/1380931620 wait complete. 2024-09-13T16:02:07.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.432+0000 7f0e703f6640 1 Processor -- start 2024-09-13T16:02:07.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.432+0000 7f0e703f6640 1 -- start start 2024-09-13T16:02:07.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.432+0000 7f0e703f6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e680fe7d0 0x7f0e68068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:07.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.432+0000 7f0e703f6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e68197c50 0x7f0e6819a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:07.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.432+0000 7f0e703f6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e6819a580 0x7f0e6819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:07.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.432+0000 7f0e703f6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6819d220 con 0x7f0e6819a580 2024-09-13T16:02:07.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.432+0000 7f0e703f6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6819d390 con 0x7f0e68197c50 2024-09-13T16:02:07.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.432+0000 7f0e703f6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6819d550 con 0x7f0e680fe7d0 2024-09-13T16:02:07.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.432+0000 7f0e6e192640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e680fe7d0 0x7f0e68068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:07.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.432+0000 7f0e6e192640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e680fe7d0 0x7f0e68068700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37012/0 (socket says 172.21.15.194:37012) 2024-09-13T16:02:07.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.432+0000 7f0e6e192640 1 -- 172.21.15.194:0/2417588252 learned_addr learned my addr 172.21.15.194:0/2417588252 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T16:02:07.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.433+0000 7f0e6d991640 1 --2- 172.21.15.194:0/2417588252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e68197c50 0x7f0e6819a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:07.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.433+0000 7f0e6e993640 1 --2- 172.21.15.194:0/2417588252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e6819a580 0x7f0e6819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:07.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.433+0000 7f0e6e192640 1 -- 172.21.15.194:0/2417588252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e68197c50 msgr2=0x7f0e6819a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:07.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.433+0000 7f0e6e192640 1 --2- 172.21.15.194:0/2417588252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e68197c50 0x7f0e6819a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:07.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.433+0000 7f0e6e192640 1 -- 172.21.15.194:0/2417588252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e6819a580 msgr2=0x7f0e6819ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:07.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.433+0000 7f0e6e192640 1 --2- 172.21.15.194:0/2417588252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e6819a580 0x7f0e6819ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:07.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.433+0000 7f0e6e192640 1 -- 172.21.15.194:0/2417588252 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e64009560 con 0x7f0e680fe7d0 2024-09-13T16:02:07.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.433+0000 7f0e6d991640 1 --2- 172.21.15.194:0/2417588252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e68197c50 0x7f0e6819a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:07.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.433+0000 7f0e6e993640 1 --2- 172.21.15.194:0/2417588252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e6819a580 0x7f0e6819ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:07.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.433+0000 7f0e6e192640 1 --2- 172.21.15.194:0/2417588252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e680fe7d0 0x7f0e68068700 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0e64031400 tx=0x7f0e640043d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:07.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.433+0000 7f0e5f7fe640 1 -- 172.21.15.194:0/2417588252 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e64005210 con 0x7f0e680fe7d0 2024-09-13T16:02:07.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.433+0000 7f0e703f6640 1 -- 172.21.15.194:0/2417588252 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6819d770 con 0x7f0e680fe7d0 2024-09-13T16:02:07.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.433+0000 7f0e5f7fe640 1 -- 172.21.15.194:0/2417588252 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0e64004ba0 con 0x7f0e680fe7d0 2024-09-13T16:02:07.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.433+0000 7f0e5f7fe640 1 -- 172.21.15.194:0/2417588252 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e64003ab0 con 0x7f0e680fe7d0 2024-09-13T16:02:07.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.433+0000 7f0e703f6640 1 -- 172.21.15.194:0/2417588252 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6819dc90 con 0x7f0e680fe7d0 2024-09-13T16:02:07.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.434+0000 7f0e5f7fe640 1 -- 172.21.15.194:0/2417588252 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f0e64003c70 con 0x7f0e680fe7d0 2024-09-13T16:02:07.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.434+0000 7f0e5f7fe640 1 --2- 172.21.15.194:0/2417588252 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f0e54038b90 0x7f0e5403b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:07.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.434+0000 7f0e5f7fe640 1 -- 172.21.15.194:0/2417588252 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0e6406c480 con 0x7f0e680fe7d0 2024-09-13T16:02:07.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.434+0000 7f0e703f6640 1 -- 172.21.15.194:0/2417588252 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6818d5d0 con 0x7f0e680fe7d0 2024-09-13T16:02:07.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.435+0000 7f0e6d991640 1 --2- 172.21.15.194:0/2417588252 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f0e54038b90 0x7f0e5403b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:07.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.435+0000 7f0e6d991640 1 --2- 172.21.15.194:0/2417588252 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f0e54038b90 0x7f0e5403b050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0e68068c80 tx=0x7f0e58008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:07.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.439+0000 7f0e5f7fe640 1 -- 172.21.15.194:0/2417588252 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0e64035070 con 0x7f0e680fe7d0 2024-09-13T16:02:07.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.616+0000 7f0e703f6640 1 -- 172.21.15.194:0/2417588252 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi086=x;smithi139=y;smithi194=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e6802c450 con 0x7f0e54038b90 2024-09-13T16:02:07.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.624+0000 7f0e5f7fe640 1 -- 172.21.15.194:0/2417588252 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f0e6802c450 con 0x7f0e54038b90 2024-09-13T16:02:07.625 INFO:teuthology.orchestra.run.smithi194.stdout:Scheduled mgr update... 2024-09-13T16:02:07.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.626+0000 7f0e703f6640 1 -- 172.21.15.194:0/2417588252 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f0e54038b90 msgr2=0x7f0e5403b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:07.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.626+0000 7f0e703f6640 1 --2- 172.21.15.194:0/2417588252 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f0e54038b90 0x7f0e5403b050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0e68068c80 tx=0x7f0e58008040 comp rx=0 tx=0).stop 2024-09-13T16:02:07.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.626+0000 7f0e703f6640 1 -- 172.21.15.194:0/2417588252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e680fe7d0 msgr2=0x7f0e68068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:07.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.626+0000 7f0e703f6640 1 --2- 172.21.15.194:0/2417588252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e680fe7d0 0x7f0e68068700 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0e64031400 tx=0x7f0e640043d0 comp rx=0 tx=0).stop 2024-09-13T16:02:07.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.626+0000 7f0e703f6640 1 -- 172.21.15.194:0/2417588252 shutdown_connections 2024-09-13T16:02:07.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.626+0000 7f0e703f6640 1 --2- 172.21.15.194:0/2417588252 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f0e54038b90 0x7f0e5403b050 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:07.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.626+0000 7f0e703f6640 1 --2- 172.21.15.194:0/2417588252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e6819a580 0x7f0e6819ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:07.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.626+0000 7f0e703f6640 1 --2- 172.21.15.194:0/2417588252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e68197c50 0x7f0e6819a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:07.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.626+0000 7f0e703f6640 1 --2- 172.21.15.194:0/2417588252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e680fe7d0 0x7f0e68068700 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:07.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.626+0000 7f0e703f6640 1 -- 172.21.15.194:0/2417588252 >> 172.21.15.194:0/2417588252 conn(0x7f0e680f9f40 msgr2=0x7f0e680faab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:07.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.626+0000 7f0e703f6640 1 -- 172.21.15.194:0/2417588252 shutdown_connections 2024-09-13T16:02:07.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:02:07.626+0000 7f0e703f6640 1 -- 172.21.15.194:0/2417588252 wait complete. 2024-09-13T16:02:07.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:07 smithi139 ceph-mon[35320]: Reconfiguring mon.c (monmap changed)... 2024-09-13T16:02:07.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:07 smithi139 ceph-mon[35320]: Reconfiguring daemon mon.c on smithi194 2024-09-13T16:02:07.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:07 smithi194 ceph-mon[35694]: Reconfiguring mon.c (monmap changed)... 2024-09-13T16:02:07.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:07 smithi194 ceph-mon[35694]: Reconfiguring daemon mon.c on smithi194 2024-09-13T16:02:07.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:07 smithi086 ceph-mon[30379]: Reconfiguring mon.c (monmap changed)... 2024-09-13T16:02:07.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:07 smithi086 ceph-mon[30379]: Reconfiguring daemon mon.c on smithi194 2024-09-13T16:02:08.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:08 smithi139 ceph-mon[35320]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:08.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:08 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:08.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:08 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:08.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:08 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:08.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:08 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:08.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:08 smithi194 ceph-mon[35694]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:08.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:08 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:08.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:08 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:08.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:08 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:08.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:08 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:08.833 DEBUG:teuthology.orchestra.run.smithi139:mgr.y> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mgr.y.service 2024-09-13T16:02:08.836 DEBUG:teuthology.orchestra.run.smithi194:mgr.z> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mgr.z.service 2024-09-13T16:02:08.838 INFO:tasks.cephadm:Deploying OSDs... 2024-09-13T16:02:08.839 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T16:02:08.839 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T16:02:08.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:08 smithi086 ceph-mon[30379]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:08.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:08 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:08.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:08 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:08.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:08 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:08.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:08 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:08.875 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T16:02:08.875 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 2024-09-13T16:02:08.953 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T16:02:08.953 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:02:08.953 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 639 Links: 1 2024-09-13T16:02:08.953 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:02:08.953 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:02:08.953 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-13 16:01:13.924462000 +0000 2024-09-13T16:02:08.953 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-13 15:57:08.245217403 +0000 2024-09-13T16:02:08.953 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-13 15:57:08.245217403 +0000 2024-09-13T16:02:08.953 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-13 15:57:08.245217403 +0000 2024-09-13T16:02:08.953 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T16:02:09.046 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-13T16:02:09.047 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-13T16:02:09.047 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000288463 s, 1.8 MB/s 2024-09-13T16:02:09.049 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T16:02:09.086 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 2024-09-13T16:02:09.161 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T16:02:09.161 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:02:09.161 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 659 Links: 1 2024-09-13T16:02:09.161 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:02:09.162 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:02:09.162 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-13 16:01:13.973460923 +0000 2024-09-13T16:02:09.162 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-13 15:57:08.729206641 +0000 2024-09-13T16:02:09.162 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-13 15:57:08.729206641 +0000 2024-09-13T16:02:09.162 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-13 15:57:08.729206641 +0000 2024-09-13T16:02:09.162 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T16:02:09.254 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-13T16:02:09.254 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-13T16:02:09.254 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000494597 s, 1.0 MB/s 2024-09-13T16:02:09.256 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T16:02:09.293 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 2024-09-13T16:02:09.369 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T16:02:09.369 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:02:09.369 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 678 Links: 1 2024-09-13T16:02:09.369 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:02:09.369 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:02:09.369 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-13 16:01:14.021459868 +0000 2024-09-13T16:02:09.370 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-13 15:57:09.239195299 +0000 2024-09-13T16:02:09.370 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-13 15:57:09.239195299 +0000 2024-09-13T16:02:09.370 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-13 15:57:09.239195299 +0000 2024-09-13T16:02:09.370 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T16:02:09.427 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:09 smithi194 ceph-mon[35694]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi086=x;smithi139=y;smithi194=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:02:09.427 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:09 smithi194 ceph-mon[35694]: Saving service mgr spec with placement smithi086=x;smithi139=y;smithi194=z;count:3 2024-09-13T16:02:09.427 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:09 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:09.427 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:09 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:02:09.463 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-13T16:02:09.463 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-13T16:02:09.463 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000291309 s, 1.8 MB/s 2024-09-13T16:02:09.466 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T16:02:09.502 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 2024-09-13T16:02:09.578 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T16:02:09.578 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:02:09.578 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 694 Links: 1 2024-09-13T16:02:09.578 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:02:09.578 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:02:09.578 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-13 16:01:14.067458857 +0000 2024-09-13T16:02:09.578 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-13 15:57:09.720184603 +0000 2024-09-13T16:02:09.578 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-13 15:57:09.720184603 +0000 2024-09-13T16:02:09.578 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-13 15:57:09.720184603 +0000 2024-09-13T16:02:09.579 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T16:02:09.670 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-13T16:02:09.671 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-13T16:02:09.671 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000274786 s, 1.9 MB/s 2024-09-13T16:02:09.673 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T16:02:09.710 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T16:02:09.710 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T16:02:09.730 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T16:02:09.730 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 2024-09-13T16:02:09.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:09 smithi139 ceph-mon[35320]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi086=x;smithi139=y;smithi194=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:02:09.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:09 smithi139 ceph-mon[35320]: Saving service mgr spec with placement smithi086=x;smithi139=y;smithi194=z;count:3 2024-09-13T16:02:09.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:09 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:09.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:09 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:02:09.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:09 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:09.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:09 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:02:09.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:09 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T16:02:09.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:09 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:02:09.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:09 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:09.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:09 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:09.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:09 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:02:09.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:09 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T16:02:09.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:09 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:02:09.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:09 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:09.767 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T16:02:09.767 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:02:09.767 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-13T16:02:09.767 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:02:09.767 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:02:09.767 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-13 16:01:53.994125783 +0000 2024-09-13T16:02:09.767 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-13 15:56:46.001472852 +0000 2024-09-13T16:02:09.767 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-13 15:56:46.001472852 +0000 2024-09-13T16:02:09.768 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-13 15:56:46.001472852 +0000 2024-09-13T16:02:09.768 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T16:02:09.834 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-13T16:02:09.834 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-13T16:02:09.834 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000232808 s, 2.2 MB/s 2024-09-13T16:02:09.835 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T16:02:09.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:09 smithi086 ceph-mon[30379]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi086=x;smithi139=y;smithi194=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:02:09.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:09 smithi086 ceph-mon[30379]: Saving service mgr spec with placement smithi086=x;smithi139=y;smithi194=z;count:3 2024-09-13T16:02:09.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:09 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:09.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:09 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:02:09.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:09 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:09.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:09 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:02:09.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:09 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T16:02:09.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:09 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:02:09.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:09 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:09.893 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 2024-09-13T16:02:09.951 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T16:02:09.951 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:02:09.951 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-13T16:02:09.952 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:02:09.952 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:02:09.952 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-13 16:01:53.995125761 +0000 2024-09-13T16:02:09.952 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-13 15:56:46.350465103 +0000 2024-09-13T16:02:09.952 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-13 15:56:46.350465103 +0000 2024-09-13T16:02:09.952 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-13 15:56:46.350465103 +0000 2024-09-13T16:02:09.952 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T16:02:10.019 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-13T16:02:10.019 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-13T16:02:10.019 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000196518 s, 2.6 MB/s 2024-09-13T16:02:10.020 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T16:02:10.078 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 2024-09-13T16:02:10.135 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T16:02:10.135 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:02:10.135 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-13T16:02:10.136 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:02:10.136 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:02:10.136 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-13 16:01:53.995125761 +0000 2024-09-13T16:02:10.136 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-13 15:56:46.665458110 +0000 2024-09-13T16:02:10.136 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-13 15:56:46.665458110 +0000 2024-09-13T16:02:10.136 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-13 15:56:46.665458110 +0000 2024-09-13T16:02:10.136 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T16:02:10.201 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-13T16:02:10.201 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-13T16:02:10.201 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000217491 s, 2.4 MB/s 2024-09-13T16:02:10.203 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T16:02:10.260 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 2024-09-13T16:02:10.316 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T16:02:10.316 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:02:10.316 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-13T16:02:10.316 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:02:10.316 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:02:10.316 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-13 16:01:53.996125740 +0000 2024-09-13T16:02:10.316 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-13 15:56:46.991450872 +0000 2024-09-13T16:02:10.316 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-13 15:56:46.991450872 +0000 2024-09-13T16:02:10.317 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-13 15:56:46.991450872 +0000 2024-09-13T16:02:10.317 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T16:02:10.380 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-13T16:02:10.380 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-13T16:02:10.381 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000248012 s, 2.1 MB/s 2024-09-13T16:02:10.382 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T16:02:10.438 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T16:02:10.439 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T16:02:10.456 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T16:02:10.456 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2024-09-13T16:02:10.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:10 smithi139 ceph-mon[35320]: Deploying daemon mgr.z on smithi194 2024-09-13T16:02:10.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:10 smithi139 ceph-mon[35320]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:10.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:10 smithi194 ceph-mon[35694]: Deploying daemon mgr.z on smithi194 2024-09-13T16:02:10.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:10 smithi194 ceph-mon[35694]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:10.512 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T16:02:10.512 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:02:10.513 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-13T16:02:10.513 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:02:10.513 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:02:10.513 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-13 16:02:10.308807631 +0000 2024-09-13T16:02:10.513 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-13 15:56:46.583076693 +0000 2024-09-13T16:02:10.514 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-13 15:56:46.583076693 +0000 2024-09-13T16:02:10.514 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-13 15:56:46.583076693 +0000 2024-09-13T16:02:10.514 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T16:02:10.578 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-13T16:02:10.578 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-13T16:02:10.578 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000322898 s, 1.6 MB/s 2024-09-13T16:02:10.579 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T16:02:10.636 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2024-09-13T16:02:10.692 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T16:02:10.693 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:02:10.693 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-13T16:02:10.693 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:02:10.693 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:02:10.693 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-13 16:02:10.308807631 +0000 2024-09-13T16:02:10.693 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-13 15:56:46.921069895 +0000 2024-09-13T16:02:10.693 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-13 15:56:46.921069895 +0000 2024-09-13T16:02:10.693 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-13 15:56:46.921069895 +0000 2024-09-13T16:02:10.693 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T16:02:10.768 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-13T16:02:10.769 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-13T16:02:10.769 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000241428 s, 2.1 MB/s 2024-09-13T16:02:10.770 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T16:02:10.827 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2024-09-13T16:02:10.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:10 smithi086 ceph-mon[30379]: Deploying daemon mgr.z on smithi194 2024-09-13T16:02:10.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:10 smithi086 ceph-mon[30379]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:10.883 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T16:02:10.883 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:02:10.883 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-13T16:02:10.883 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:02:10.883 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:02:10.883 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-13 16:02:10.308807631 +0000 2024-09-13T16:02:10.883 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-13 15:56:47.248063318 +0000 2024-09-13T16:02:10.884 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-13 15:56:47.248063318 +0000 2024-09-13T16:02:10.884 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-13 15:56:47.248063318 +0000 2024-09-13T16:02:10.884 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T16:02:10.948 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-13T16:02:10.948 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-13T16:02:10.948 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000184224 s, 2.8 MB/s 2024-09-13T16:02:10.949 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T16:02:11.006 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2024-09-13T16:02:11.062 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T16:02:11.062 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:02:11.062 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-13T16:02:11.062 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:02:11.062 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:02:11.062 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-13 16:02:10.309807611 +0000 2024-09-13T16:02:11.062 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-13 15:56:47.560057043 +0000 2024-09-13T16:02:11.062 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-13 15:56:47.560057043 +0000 2024-09-13T16:02:11.062 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-13 15:56:47.560057043 +0000 2024-09-13T16:02:11.063 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T16:02:11.123 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:11 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:11.037+0000 7fd76cdc0040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T16:02:11.126 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-13T16:02:11.126 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-13T16:02:11.126 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000248919 s, 2.1 MB/s 2024-09-13T16:02:11.128 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T16:02:11.184 INFO:tasks.cephadm:Deploying osd.0 on smithi086 with /dev/vg_nvme/lv_4... 2024-09-13T16:02:11.185 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T16:02:11.408 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:11 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:11.191+0000 7fd76cdc0040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T16:02:11.453 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:11 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:11.258+0000 7fd76cdc0040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T16:02:11.453 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:11 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:11.407+0000 7fd76cdc0040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:02:11.494 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:02:11.755 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:11 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:11.545+0000 7fd76cdc0040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T16:02:12.255 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:11 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:11.860+0000 7fd76cdc0040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T16:02:12.255 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:11 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:11.922+0000 7fd76cdc0040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T16:02:12.255 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:12 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:12.106+0000 7fd76cdc0040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T16:02:12.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:12.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:12.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:12.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:02:12.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T16:02:12.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:02:12.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:12.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:12 smithi194 ceph-mon[35694]: Deploying daemon mgr.y on smithi139 2024-09-13T16:02:12.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:12 smithi194 ceph-mon[35694]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:12.265 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:12.265 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:12.265 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:12.265 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:02:12.265 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T16:02:12.265 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:02:12.265 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:12.265 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:12 smithi139 ceph-mon[35320]: Deploying daemon mgr.y on smithi139 2024-09-13T16:02:12.265 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:12 smithi139 ceph-mon[35320]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:12.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:12.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:12.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:12.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:02:12.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T16:02:12.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:02:12.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:12.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:12 smithi086 ceph-mon[30379]: Deploying daemon mgr.y on smithi139 2024-09-13T16:02:12.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:12 smithi086 ceph-mon[30379]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:12.919 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:12 smithi139 systemd[1]: Starting Ceph mgr.y for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:02:13.178 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:12 smithi139 podman[36681]: 2024-09-13 16:02:12.917591661 +0000 UTC m=+0.091461747 container create 1ba50c639eb1c9c3a5390a30783ca3f51081c131e4806524c838285225681fef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T16:02:13.178 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:12 smithi139 podman[36681]: 2024-09-13 16:02:12.84223551 +0000 UTC m=+0.016105607 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:02:13.178 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:13 smithi139 podman[36681]: 2024-09-13 16:02:13.094586869 +0000 UTC m=+0.268456968 container init 1ba50c639eb1c9c3a5390a30783ca3f51081c131e4806524c838285225681fef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-13T16:02:13.179 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:13 smithi139 podman[36681]: 2024-09-13 16:02:13.097369332 +0000 UTC m=+0.271239426 container start 1ba50c639eb1c9c3a5390a30783ca3f51081c131e4806524c838285225681fef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:02:13.179 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:13 smithi139 ceph-mgr[36700]: -- 172.21.15.139:0/2010392467 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a770874d00 con 0x55a770849000 2024-09-13T16:02:13.255 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:12 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:12.974+0000 7fd76cdc0040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T16:02:13.255 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:13 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:13.038+0000 7fd76cdc0040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T16:02:13.439 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:13 smithi139 bash[36681]: 1ba50c639eb1c9c3a5390a30783ca3f51081c131e4806524c838285225681fef 2024-09-13T16:02:13.439 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:13 smithi139 systemd[1]: Started Ceph mgr.y for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:02:13.439 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:13 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:13.218+0000 7f95fe0ac040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T16:02:13.439 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:13 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:13.280+0000 7f95fe0ac040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T16:02:13.439 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:13 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:13.437+0000 7f95fe0ac040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T16:02:13.583 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T16:02:13.691 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:13 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:13.509+0000 7f95fe0ac040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T16:02:13.691 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:13 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:13.672+0000 7f95fe0ac040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:02:13.712 INFO:teuthology.orchestra.run.smithi086.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T16:02:13.745 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10+0 records in 2024-09-13T16:02:13.745 INFO:teuthology.orchestra.run.smithi086.stderr:10+0 records out 2024-09-13T16:02:13.745 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0278329 s, 377 MB/s 2024-09-13T16:02:13.745 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping successful for: 2024-09-13T16:02:13.951 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:13 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:13.830+0000 7f95fe0ac040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T16:02:14.055 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:13 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:13.791+0000 7fd76cdc0040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T16:02:14.055 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:13 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:13.908+0000 7fd76cdc0040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T16:02:14.220 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:14 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:14.156+0000 7f95fe0ac040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T16:02:14.345 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:14 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:14.345 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:14 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:14.345 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:14 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:14.345 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:14 smithi194 ceph-mon[35694]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:14.345 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:14 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:14.345 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:14 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:14.345 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:14 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:14.057+0000 7fd76cdc0040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:02:14.346 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:14 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:14.119+0000 7fd76cdc0040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T16:02:14.346 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:14 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:14.270+0000 7fd76cdc0040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T16:02:14.346 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:14 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:14.343+0000 7fd76cdc0040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T16:02:14.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:14 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:14.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:14 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:14.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:14 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:14.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:14 smithi086 ceph-mon[30379]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:14.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:14 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:14.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:14 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:14.413 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi086:vg_nvme/lv_4 2024-09-13T16:02:14.498 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:14 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:14.218+0000 7f95fe0ac040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T16:02:14.498 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:14 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:14.414+0000 7f95fe0ac040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T16:02:14.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:14 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:14.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:14 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:14.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:14 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:14.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:14 smithi139 ceph-mon[35320]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:14.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:14 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:14.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:14 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:14.633 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:14 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:14.409+0000 7fd76cdc0040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T16:02:14.633 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:14 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:14.567+0000 7fd76cdc0040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T16:02:14.633 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:14 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:14.631+0000 7fd76cdc0040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T16:02:14.736 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:02:14.897 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:14 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:14.697+0000 7fd76cdc0040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T16:02:14.897 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:14 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:14.779+0000 7fd76cdc0040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T16:02:14.897 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:14 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:14.837+0000 7fd76cdc0040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T16:02:14.897 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:14 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:14.895+0000 7fd76cdc0040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T16:02:15.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:15 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:15.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:15 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:15.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:15 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:15.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:15 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:15.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:15 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:15.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:15 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:15.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:15 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:02:15.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:15 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:15.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:15 smithi086 ceph-mon[30379]: Reconfiguring mgr.x (unknown last config time)... 2024-09-13T16:02:15.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:15 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:02:15.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:15 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:02:15.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:15 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:15.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:15 smithi086 ceph-mon[30379]: Reconfiguring daemon mgr.x on smithi086 2024-09-13T16:02:15.665 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:15 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:15.665 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:15 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:15.665 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:15 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:15.665 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:15 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:15.665 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:15 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:15.665 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:15 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:15.665 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:15 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:02:15.666 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:15 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:15.666 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:15 smithi194 ceph-mon[35694]: Reconfiguring mgr.x (unknown last config time)... 2024-09-13T16:02:15.666 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:15 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:02:15.666 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:15 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:02:15.666 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:15 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:15.666 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:15 smithi194 ceph-mon[35694]: Reconfiguring daemon mgr.x on smithi086 2024-09-13T16:02:15.748 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:15 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:15.282+0000 7f95fe0ac040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T16:02:15.749 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:15 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:15.348+0000 7f95fe0ac040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T16:02:15.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:15 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:15.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:15 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:15.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:15 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:15.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:15 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:15.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:15 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:15.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:15 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:15.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:15 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:02:15.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:15 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:15.750 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:15 smithi139 ceph-mon[35320]: Reconfiguring mgr.x (unknown last config time)... 2024-09-13T16:02:15.750 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:15 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:02:15.750 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:15 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:02:15.750 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:15 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:15.750 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:15 smithi139 ceph-mon[35320]: Reconfiguring daemon mgr.x on smithi086 2024-09-13T16:02:16.004 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:02:15 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z[37375]: 2024-09-13T16:02:15.663+0000 7fd76cdc0040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T16:02:16.364 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:16 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:16.054+0000 7f95fe0ac040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T16:02:16.364 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:16 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:16.165+0000 7f95fe0ac040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T16:02:16.364 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:16 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:16.303+0000 7f95fe0ac040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:02:16.364 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:16 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:16.363+0000 7f95fe0ac040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T16:02:16.597 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:16 smithi086 ceph-mon[30379]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:16.597 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:16 smithi086 ceph-mon[30379]: Standby manager daemon z started 2024-09-13T16:02:16.597 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:16 smithi086 ceph-mon[30379]: from='mgr.? 172.21.15.194:0/3553879643' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T16:02:16.597 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:16 smithi086 ceph-mon[30379]: from='mgr.? 172.21.15.194:0/3553879643' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T16:02:16.598 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:16 smithi086 ceph-mon[30379]: from='mgr.? 172.21.15.194:0/3553879643' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T16:02:16.598 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:16 smithi086 ceph-mon[30379]: from='mgr.? 172.21.15.194:0/3553879643' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T16:02:16.636 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:16 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:16.510+0000 7f95fe0ac040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T16:02:16.636 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:16 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:16.576+0000 7f95fe0ac040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T16:02:16.636 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:16 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:16.634+0000 7f95fe0ac040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T16:02:16.636 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:16 smithi139 ceph-mon[35320]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:16.636 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:16 smithi139 ceph-mon[35320]: Standby manager daemon z started 2024-09-13T16:02:16.636 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:16 smithi139 ceph-mon[35320]: from='mgr.? 172.21.15.194:0/3553879643' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T16:02:16.636 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:16 smithi139 ceph-mon[35320]: from='mgr.? 172.21.15.194:0/3553879643' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T16:02:16.636 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:16 smithi139 ceph-mon[35320]: from='mgr.? 172.21.15.194:0/3553879643' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T16:02:16.636 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:16 smithi139 ceph-mon[35320]: from='mgr.? 172.21.15.194:0/3553879643' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T16:02:16.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:16 smithi194 ceph-mon[35694]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:16.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:16 smithi194 ceph-mon[35694]: Standby manager daemon z started 2024-09-13T16:02:16.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:16 smithi194 ceph-mon[35694]: from='mgr.? 172.21.15.194:0/3553879643' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T16:02:16.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:16 smithi194 ceph-mon[35694]: from='mgr.? 172.21.15.194:0/3553879643' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T16:02:16.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:16 smithi194 ceph-mon[35694]: from='mgr.? 172.21.15.194:0/3553879643' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T16:02:16.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:16 smithi194 ceph-mon[35694]: from='mgr.? 172.21.15.194:0/3553879643' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T16:02:16.918 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:16 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:16.789+0000 7f95fe0ac040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T16:02:16.918 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:16 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:16.852+0000 7f95fe0ac040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T16:02:16.918 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:16 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:16.917+0000 7f95fe0ac040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T16:02:17.248 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:16 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:16.998+0000 7f95fe0ac040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T16:02:17.248 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:17 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:17.055+0000 7f95fe0ac040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T16:02:17.248 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:17 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:17.112+0000 7f95fe0ac040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T16:02:17.535 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:17 smithi086 ceph-mon[30379]: mgrmap e14: x(active, since 77s), standbys: z 2024-09-13T16:02:17.535 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:17 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T16:02:17.535 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:17 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:17.536 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:17 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:17.536 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:17 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:17.536 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:17 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:17.536 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:17 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:02:17.536 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:17 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:17.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.640+0000 7fc062a00640 1 -- 172.21.15.86:0/1552595453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc05c0ffc30 msgr2=0x7fc05c100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.640+0000 7fc062a00640 1 --2- 172.21.15.86:0/1552595453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc05c0ffc30 0x7fc05c100030 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc050009900 tx=0x7fc05002a410 comp rx=0 tx=0).stop 2024-09-13T16:02:17.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.640+0000 7fc062a00640 1 -- 172.21.15.86:0/1552595453 shutdown_connections 2024-09-13T16:02:17.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.640+0000 7fc062a00640 1 --2- 172.21.15.86:0/1552595453 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc05c1017f0 0x7fc05c108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.640+0000 7fc062a00640 1 --2- 172.21.15.86:0/1552595453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc05c100e30 0x7fc05c1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.640+0000 7fc062a00640 1 --2- 172.21.15.86:0/1552595453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc05c0ffc30 0x7fc05c100030 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.640+0000 7fc062a00640 1 -- 172.21.15.86:0/1552595453 >> 172.21.15.86:0/1552595453 conn(0x7fc05c0fb3c0 msgr2=0x7fc05c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:17.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.640+0000 7fc062a00640 1 -- 172.21.15.86:0/1552595453 shutdown_connections 2024-09-13T16:02:17.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.640+0000 7fc062a00640 1 -- 172.21.15.86:0/1552595453 wait complete. 2024-09-13T16:02:17.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.641+0000 7fc062a00640 1 Processor -- start 2024-09-13T16:02:17.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.641+0000 7fc062a00640 1 -- start start 2024-09-13T16:02:17.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.641+0000 7fc062a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc05c0ffc30 0x7fc05c197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.641+0000 7fc062a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc05c100e30 0x7fc05c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.641+0000 7fc062a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc05c1017f0 0x7fc05c19f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.641+0000 7fc062a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c19f970 con 0x7fc05c1017f0 2024-09-13T16:02:17.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.641+0000 7fc062a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c19fae0 con 0x7fc05c0ffc30 2024-09-13T16:02:17.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.641+0000 7fc062a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c19fca0 con 0x7fc05c100e30 2024-09-13T16:02:17.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.641+0000 7fc061600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc05c0ffc30 0x7fc05c197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.642+0000 7fc061600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc05c0ffc30 0x7fc05c197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:43056/0 (socket says 172.21.15.86:43056) 2024-09-13T16:02:17.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.642+0000 7fc061600640 1 -- 172.21.15.86:0/3542637701 learned_addr learned my addr 172.21.15.86:0/3542637701 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:02:17.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.642+0000 7fc060c00640 1 --2- 172.21.15.86:0/3542637701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc05c100e30 0x7fc05c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.642+0000 7fc062000640 1 --2- 172.21.15.86:0/3542637701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc05c1017f0 0x7fc05c19f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.642+0000 7fc061600640 1 -- 172.21.15.86:0/3542637701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc05c100e30 msgr2=0x7fc05c1983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.642+0000 7fc061600640 1 --2- 172.21.15.86:0/3542637701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc05c100e30 0x7fc05c1983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.642+0000 7fc061600640 1 -- 172.21.15.86:0/3542637701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc05c1017f0 msgr2=0x7fc05c19f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:17.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.642+0000 7fc061600640 1 --2- 172.21.15.86:0/3542637701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc05c1017f0 0x7fc05c19f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:17.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.642+0000 7fc061600640 1 -- 172.21.15.86:0/3542637701 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc048009490 con 0x7fc05c0ffc30 2024-09-13T16:02:17.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.642+0000 7fc062000640 1 --2- 172.21.15.86:0/3542637701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc05c1017f0 0x7fc05c19f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:17.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.642+0000 7fc061600640 1 --2- 172.21.15.86:0/3542637701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc05c0ffc30 0x7fc05c197e70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc050031510 tx=0x7fc050004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:17.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.642+0000 7fc05a000640 1 -- 172.21.15.86:0/3542637701 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc050005210 con 0x7fc05c0ffc30 2024-09-13T16:02:17.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.643+0000 7fc05a000640 1 -- 172.21.15.86:0/3542637701 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc050004ba0 con 0x7fc05c0ffc30 2024-09-13T16:02:17.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.643+0000 7fc062a00640 1 -- 172.21.15.86:0/3542637701 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc050009560 con 0x7fc05c0ffc30 2024-09-13T16:02:17.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.643+0000 7fc05a000640 1 -- 172.21.15.86:0/3542637701 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc050003b20 con 0x7fc05c0ffc30 2024-09-13T16:02:17.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.643+0000 7fc062a00640 1 -- 172.21.15.86:0/3542637701 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05c1a01c0 con 0x7fc05c0ffc30 2024-09-13T16:02:17.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.644+0000 7fc062a00640 1 -- 172.21.15.86:0/3542637701 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05c10b650 con 0x7fc05c0ffc30 2024-09-13T16:02:17.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.644+0000 7fc05a000640 1 -- 172.21.15.86:0/3542637701 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 14) v1 ==== 90707+0+0 (secure 0 0 0) 0x7fc050003c80 con 0x7fc05c0ffc30 2024-09-13T16:02:17.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.645+0000 7fc05a000640 1 --2- 172.21.15.86:0/3542637701 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc04406ccb0 0x7fc04406f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:17.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.645+0000 7fc05a000640 1 -- 172.21.15.86:0/3542637701 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc0500abb60 con 0x7fc05c0ffc30 2024-09-13T16:02:17.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.646+0000 7fc060c00640 1 --2- 172.21.15.86:0/3542637701 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc04406ccb0 0x7fc04406f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:17.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.646+0000 7fc060c00640 1 --2- 172.21.15.86:0/3542637701 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc04406ccb0 0x7fc04406f170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc05c199390 tx=0x7fc048005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:17.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.650+0000 7fc05a000640 1 -- 172.21.15.86:0/3542637701 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc050077170 con 0x7fc05c0ffc30 2024-09-13T16:02:17.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:17 smithi139 ceph-mon[35320]: mgrmap e14: x(active, since 77s), standbys: z 2024-09-13T16:02:17.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:17 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T16:02:17.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:17 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:17.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:17 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:17.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:17 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:17.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:17 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:17.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:17 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:02:17.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:17 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:17.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:17 smithi194 ceph-mon[35694]: mgrmap e14: x(active, since 77s), standbys: z 2024-09-13T16:02:17.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:17 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T16:02:17.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:17 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:17.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:17 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:17.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:17 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:17.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:17 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:17.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:17 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:02:17.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:17 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:17.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:17.829+0000 7fc062a00640 1 -- 172.21.15.86:0/3542637701 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc05c073e00 con 0x7fc04406ccb0 2024-09-13T16:02:18.248 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:02:17 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y[36696]: 2024-09-13T16:02:17.887+0000 7f95fe0ac040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T16:02:18.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:18.441+0000 7fc05a000640 1 -- 172.21.15.86:0/3542637701 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7fc050004d10 con 0x7fc05c0ffc30 2024-09-13T16:02:18.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:18 smithi086 ceph-mon[30379]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:18.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:18 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:02:18.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:18 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:02:18.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:18 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:18.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:18 smithi086 ceph-mon[30379]: Standby manager daemon y started 2024-09-13T16:02:18.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:18 smithi086 ceph-mon[30379]: from='mgr.? 172.21.15.139:0/3219479006' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T16:02:18.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:18 smithi086 ceph-mon[30379]: from='mgr.? 172.21.15.139:0/3219479006' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T16:02:18.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:18 smithi086 ceph-mon[30379]: from='mgr.? 172.21.15.139:0/3219479006' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T16:02:18.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:18 smithi086 ceph-mon[30379]: from='mgr.? 172.21.15.139:0/3219479006' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T16:02:18.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:18 smithi139 ceph-mon[35320]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:18.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:18 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:02:18.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:18 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:02:18.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:18 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:18.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:18 smithi139 ceph-mon[35320]: Standby manager daemon y started 2024-09-13T16:02:18.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:18 smithi139 ceph-mon[35320]: from='mgr.? 172.21.15.139:0/3219479006' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T16:02:18.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:18 smithi139 ceph-mon[35320]: from='mgr.? 172.21.15.139:0/3219479006' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T16:02:18.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:18 smithi139 ceph-mon[35320]: from='mgr.? 172.21.15.139:0/3219479006' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T16:02:18.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:18 smithi139 ceph-mon[35320]: from='mgr.? 172.21.15.139:0/3219479006' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T16:02:18.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:18 smithi194 ceph-mon[35694]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:18.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:18 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:02:18.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:18 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:02:18.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:18 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:18.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:18 smithi194 ceph-mon[35694]: Standby manager daemon y started 2024-09-13T16:02:18.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:18 smithi194 ceph-mon[35694]: from='mgr.? 172.21.15.139:0/3219479006' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T16:02:18.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:18 smithi194 ceph-mon[35694]: from='mgr.? 172.21.15.139:0/3219479006' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T16:02:18.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:18 smithi194 ceph-mon[35694]: from='mgr.? 172.21.15.139:0/3219479006' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T16:02:18.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:18 smithi194 ceph-mon[35694]: from='mgr.? 172.21.15.139:0/3219479006' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T16:02:19.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:19 smithi139 ceph-mon[35320]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:02:19.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:19 smithi139 ceph-mon[35320]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-09-13T16:02:19.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:19 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T16:02:19.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:19 smithi194 ceph-mon[35694]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:02:19.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:19 smithi194 ceph-mon[35694]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-09-13T16:02:19.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:19 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T16:02:19.768 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:19 smithi086 ceph-mon[30379]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:02:19.768 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:19 smithi086 ceph-mon[30379]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-09-13T16:02:19.768 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:19 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T16:02:20.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:20 smithi086 ceph-mon[30379]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:20.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:20 smithi139 ceph-mon[35320]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:20.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:20 smithi194 ceph-mon[35694]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:21.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:21 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/132149500' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12239385-09af-43d5-9d41-bd3c2a6a7c23"}]: dispatch 2024-09-13T16:02:21.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:21 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/132149500' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12239385-09af-43d5-9d41-bd3c2a6a7c23"}]': finished 2024-09-13T16:02:21.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:21 smithi139 ceph-mon[35320]: osdmap e5: 1 total, 0 up, 1 in 2024-09-13T16:02:21.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:21 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:02:21.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:21 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2973236801' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:02:21.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:21 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/132149500' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12239385-09af-43d5-9d41-bd3c2a6a7c23"}]: dispatch 2024-09-13T16:02:21.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:21 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/132149500' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12239385-09af-43d5-9d41-bd3c2a6a7c23"}]': finished 2024-09-13T16:02:21.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:21 smithi194 ceph-mon[35694]: osdmap e5: 1 total, 0 up, 1 in 2024-09-13T16:02:21.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:21 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:02:21.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:21 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2973236801' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:02:21.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:21 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/132149500' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12239385-09af-43d5-9d41-bd3c2a6a7c23"}]: dispatch 2024-09-13T16:02:21.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:21 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/132149500' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12239385-09af-43d5-9d41-bd3c2a6a7c23"}]': finished 2024-09-13T16:02:21.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:21 smithi086 ceph-mon[30379]: osdmap e5: 1 total, 0 up, 1 in 2024-09-13T16:02:21.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:21 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:02:21.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:21 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2973236801' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:02:22.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:22 smithi139 ceph-mon[35320]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:22.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:22 smithi194 ceph-mon[35694]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:22.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:22 smithi086 ceph-mon[30379]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:24.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:24 smithi139 ceph-mon[35320]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:24.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:24 smithi194 ceph-mon[35694]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:24.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:24 smithi086 ceph-mon[30379]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:26.722 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:26 smithi086 ceph-mon[30379]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:26.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:26 smithi139 ceph-mon[35320]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:26.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:26 smithi194 ceph-mon[35694]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:28.727 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:28 smithi086 ceph-mon[30379]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:28.727 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:28 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T16:02:28.727 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:28 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:28.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:28 smithi139 ceph-mon[35320]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:28.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:28 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T16:02:28.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:28 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:28.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:28 smithi194 ceph-mon[35694]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:28 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T16:02:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:28 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:29.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:29 smithi139 ceph-mon[35320]: Deploying daemon osd.0 on smithi086 2024-09-13T16:02:29.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:29 smithi194 ceph-mon[35694]: Deploying daemon osd.0 on smithi086 2024-09-13T16:02:29.761 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:29 smithi086 ceph-mon[30379]: Deploying daemon osd.0 on smithi086 2024-09-13T16:02:30.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:30 smithi139 ceph-mon[35320]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:30 smithi194 ceph-mon[35694]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:30.825 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:30 smithi086 ceph-mon[30379]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:32.513 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:32 smithi086 ceph-mon[30379]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:32.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:32 smithi139 ceph-mon[35320]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:32.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:32 smithi194 ceph-mon[35694]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:34.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:34 smithi086 ceph-mon[30379]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:34.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:34 smithi139 ceph-mon[35320]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:34.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:34 smithi194 ceph-mon[35694]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:35.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:35 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:35.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:35 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:35.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:35 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:35.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:35 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:35.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:35 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:35.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:35 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:35.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:35 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:35.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:35 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:35.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:35 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:36.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:36 smithi086 ceph-mon[30379]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:36.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:36 smithi139 ceph-mon[35320]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:37.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:36 smithi194 ceph-mon[35694]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:37.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:37 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:37.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:37 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:37.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:37 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:37.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:37 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:02:37.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:37 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:37.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:37 smithi086 ceph-mon[30379]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:38.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:37 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:38.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:37 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:38.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:37 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:38.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:37 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:02:38.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:37 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:38.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:37 smithi139 ceph-mon[35320]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:38.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:37 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:38.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:37 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:38.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:37 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:38.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:37 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:02:38.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:37 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:38.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:37 smithi194 ceph-mon[35694]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:38.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:38.771+0000 7fc05a000640 1 -- 172.21.15.86:0/3542637701 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc05c073e00 con 0x7fc04406ccb0 2024-09-13T16:02:38.773 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 0 on host 'smithi086' 2024-09-13T16:02:38.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:38.774+0000 7fc062a00640 1 -- 172.21.15.86:0/3542637701 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc04406ccb0 msgr2=0x7fc04406f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:38.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:38.774+0000 7fc062a00640 1 --2- 172.21.15.86:0/3542637701 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc04406ccb0 0x7fc04406f170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc05c199390 tx=0x7fc048005f90 comp rx=0 tx=0).stop 2024-09-13T16:02:38.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:38.774+0000 7fc062a00640 1 -- 172.21.15.86:0/3542637701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc05c0ffc30 msgr2=0x7fc05c197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:38.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:38.774+0000 7fc062a00640 1 --2- 172.21.15.86:0/3542637701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc05c0ffc30 0x7fc05c197e70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc050031510 tx=0x7fc050004360 comp rx=0 tx=0).stop 2024-09-13T16:02:38.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:38.774+0000 7fc062a00640 1 -- 172.21.15.86:0/3542637701 shutdown_connections 2024-09-13T16:02:38.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:38.774+0000 7fc062a00640 1 --2- 172.21.15.86:0/3542637701 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc04406ccb0 0x7fc04406f170 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:38.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:38.774+0000 7fc062a00640 1 --2- 172.21.15.86:0/3542637701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc05c1017f0 0x7fc05c19f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:38.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:38.774+0000 7fc062a00640 1 --2- 172.21.15.86:0/3542637701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc05c100e30 0x7fc05c1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:38.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:38.774+0000 7fc062a00640 1 --2- 172.21.15.86:0/3542637701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc05c0ffc30 0x7fc05c197e70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:38.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:38.774+0000 7fc062a00640 1 -- 172.21.15.86:0/3542637701 >> 172.21.15.86:0/3542637701 conn(0x7fc05c0fb3c0 msgr2=0x7fc05c0726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:38.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:38.774+0000 7fc062a00640 1 -- 172.21.15.86:0/3542637701 shutdown_connections 2024-09-13T16:02:38.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:02:38.775+0000 7fc062a00640 1 -- 172.21.15.86:0/3542637701 wait complete. 2024-09-13T16:02:39.114 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:38 smithi086 ceph-mon[30379]: from='osd.0 [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T16:02:39.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:38 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:39.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:38 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:39.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:38 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:39.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:38 smithi139 ceph-mon[35320]: from='osd.0 [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T16:02:39.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:38 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:39.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:38 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:39.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:38 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:39.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:38 smithi194 ceph-mon[35694]: from='osd.0 [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T16:02:39.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:38 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:39.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:38 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:39.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:38 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:39.496 DEBUG:teuthology.orchestra.run.smithi086:osd.0> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.0.service 2024-09-13T16:02:39.500 INFO:tasks.cephadm:Deploying osd.1 on smithi139 with /dev/vg_nvme/lv_4... 2024-09-13T16:02:39.501 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T16:02:39.704 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:02:40.049 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:39 smithi139 ceph-mon[35320]: from='osd.0 [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T16:02:40.049 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:39 smithi139 ceph-mon[35320]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T16:02:40.049 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:39 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:02:40.049 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:39 smithi139 ceph-mon[35320]: from='osd.0 [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-13T16:02:40.049 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:39 smithi139 ceph-mon[35320]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:40.050 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:39 smithi086 ceph-mon[30379]: from='osd.0 [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T16:02:40.051 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:39 smithi086 ceph-mon[30379]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T16:02:40.051 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:39 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:02:40.051 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:39 smithi086 ceph-mon[30379]: from='osd.0 [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-13T16:02:40.051 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:39 smithi086 ceph-mon[30379]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:40.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:39 smithi194 ceph-mon[35694]: from='osd.0 [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T16:02:40.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:39 smithi194 ceph-mon[35694]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T16:02:40.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:39 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:02:40.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:39 smithi194 ceph-mon[35694]: from='osd.0 [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-13T16:02:40.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:39 smithi194 ceph-mon[35694]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:40.798 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:02:40 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-0[44638]: 2024-09-13T16:02:40.543+0000 7f3ae5e00640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T16:02:40.799 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:02:40 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-0[44638]: 2024-09-13T16:02:40.565+0000 7f3adb400640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:02:41.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:40 smithi139 ceph-mon[35320]: from='osd.0 [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-13T16:02:41.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:40 smithi139 ceph-mon[35320]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T16:02:41.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:40 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:02:41.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:40 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:02:41.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:40 smithi139 ceph-mon[35320]: from='osd.0 [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994]' entity='osd.0' 2024-09-13T16:02:41.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:40 smithi086 ceph-mon[30379]: from='osd.0 [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-13T16:02:41.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:40 smithi086 ceph-mon[30379]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T16:02:41.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:40 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:02:41.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:40 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:02:41.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:40 smithi086 ceph-mon[30379]: from='osd.0 [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994]' entity='osd.0' 2024-09-13T16:02:41.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:40 smithi194 ceph-mon[35694]: from='osd.0 [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-13T16:02:41.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:40 smithi194 ceph-mon[35694]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T16:02:41.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:40 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:02:41.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:40 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:02:41.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:40 smithi194 ceph-mon[35694]: from='osd.0 [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994]' entity='osd.0' 2024-09-13T16:02:41.440 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T16:02:41.525 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T16:02:41.539 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2024-09-13T16:02:41.539 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2024-09-13T16:02:41.539 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0130697 s, 802 MB/s 2024-09-13T16:02:41.539 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2024-09-13T16:02:42.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:41 smithi139 ceph-mon[35320]: purged_snaps scrub starts 2024-09-13T16:02:42.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:41 smithi139 ceph-mon[35320]: purged_snaps scrub ok 2024-09-13T16:02:42.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:02:42.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:41 smithi139 ceph-mon[35320]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:42.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:41 smithi139 ceph-mon[35320]: osd.0 [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994] boot 2024-09-13T16:02:42.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:41 smithi139 ceph-mon[35320]: osdmap e8: 1 total, 1 up, 1 in 2024-09-13T16:02:42.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:02:42.114 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_4 2024-09-13T16:02:42.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:41 smithi086 ceph-mon[30379]: purged_snaps scrub starts 2024-09-13T16:02:42.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:41 smithi086 ceph-mon[30379]: purged_snaps scrub ok 2024-09-13T16:02:42.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:02:42.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:41 smithi086 ceph-mon[30379]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:42.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:41 smithi086 ceph-mon[30379]: osd.0 [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994] boot 2024-09-13T16:02:42.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:41 smithi086 ceph-mon[30379]: osdmap e8: 1 total, 1 up, 1 in 2024-09-13T16:02:42.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:02:42.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:41 smithi194 ceph-mon[35694]: purged_snaps scrub starts 2024-09-13T16:02:42.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:41 smithi194 ceph-mon[35694]: purged_snaps scrub ok 2024-09-13T16:02:42.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:02:42.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:41 smithi194 ceph-mon[35694]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:02:42.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:41 smithi194 ceph-mon[35694]: osd.0 [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994] boot 2024-09-13T16:02:42.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:41 smithi194 ceph-mon[35694]: osdmap e8: 1 total, 1 up, 1 in 2024-09-13T16:02:42.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:02:42.313 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:02:43.641 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:43 smithi139 ceph-mon[35320]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T16:02:43.641 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:43 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:43.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:43 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:43.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:43 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:02:43.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:43 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:43.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:43 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:43.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:43 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:02:43.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:43 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:43.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.814+0000 7fac26f2c640 1 -- 172.21.15.139:0/354150835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20101920 msgr2=0x7fac20108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:43.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.814+0000 7fac26f2c640 1 --2- 172.21.15.139:0/354150835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20101920 0x7fac20108240 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fac18009ca0 tx=0x7fac1802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:02:43.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.814+0000 7fac26f2c640 1 -- 172.21.15.139:0/354150835 shutdown_connections 2024-09-13T16:02:43.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.814+0000 7fac26f2c640 1 --2- 172.21.15.139:0/354150835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20101920 0x7fac20108240 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:43.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.814+0000 7fac26f2c640 1 --2- 172.21.15.139:0/354150835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac20100f60 0x7fac201013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:43.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.814+0000 7fac26f2c640 1 --2- 172.21.15.139:0/354150835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac200ffe00 0x7fac20100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:43.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.814+0000 7fac26f2c640 1 -- 172.21.15.139:0/354150835 >> 172.21.15.139:0/354150835 conn(0x7fac200fb590 msgr2=0x7fac200fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:43.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.814+0000 7fac26f2c640 1 -- 172.21.15.139:0/354150835 shutdown_connections 2024-09-13T16:02:43.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.814+0000 7fac26f2c640 1 -- 172.21.15.139:0/354150835 wait complete. 2024-09-13T16:02:43.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.815+0000 7fac26f2c640 1 Processor -- start 2024-09-13T16:02:43.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.815+0000 7fac26f2c640 1 -- start start 2024-09-13T16:02:43.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.815+0000 7fac26f2c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac200ffe00 0x7fac20195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:43.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.815+0000 7fac26f2c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20100f60 0x7fac201962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:43.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.815+0000 7fac26f2c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac20101920 0x7fac2019d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:43.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.815+0000 7fac26f2c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2019d880 con 0x7fac20101920 2024-09-13T16:02:43.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.815+0000 7fac26f2c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2019d9f0 con 0x7fac20100f60 2024-09-13T16:02:43.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.815+0000 7fac26f2c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2019dbb0 con 0x7fac200ffe00 2024-09-13T16:02:43.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.815+0000 7fac1ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20100f60 0x7fac201962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:43.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.815+0000 7fac1ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20100f60 0x7fac201962d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57118/0 (socket says 172.21.15.139:57118) 2024-09-13T16:02:43.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.815+0000 7fac1ffff640 1 -- 172.21.15.139:0/3288702946 learned_addr learned my addr 172.21.15.139:0/3288702946 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T16:02:43.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.815+0000 7fac24cc8640 1 --2- 172.21.15.139:0/3288702946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac200ffe00 0x7fac20195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:43.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.815+0000 7fac1ffff640 1 -- 172.21.15.139:0/3288702946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac200ffe00 msgr2=0x7fac20195d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:43.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.815+0000 7fac1ffff640 1 --2- 172.21.15.139:0/3288702946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac200ffe00 0x7fac20195d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:43.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.815+0000 7fac1ffff640 1 -- 172.21.15.139:0/3288702946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac20101920 msgr2=0x7fac2019d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:43.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.815+0000 7fac1ffff640 1 --2- 172.21.15.139:0/3288702946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac20101920 0x7fac2019d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:43.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.815+0000 7fac1ffff640 1 -- 172.21.15.139:0/3288702946 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac18009900 con 0x7fac20100f60 2024-09-13T16:02:43.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.816+0000 7fac1ffff640 1 --2- 172.21.15.139:0/3288702946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20100f60 0x7fac201962d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00c970 tx=0x7fac0c00ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:43.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.816+0000 7fac1dffb640 1 -- 172.21.15.139:0/3288702946 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c007c10 con 0x7fac20100f60 2024-09-13T16:02:43.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.816+0000 7fac1dffb640 1 -- 172.21.15.139:0/3288702946 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fac0c007d70 con 0x7fac20100f60 2024-09-13T16:02:43.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.816+0000 7fac26f2c640 1 -- 172.21.15.139:0/3288702946 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2019de90 con 0x7fac20100f60 2024-09-13T16:02:43.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.816+0000 7fac1dffb640 1 -- 172.21.15.139:0/3288702946 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c00f8a0 con 0x7fac20100f60 2024-09-13T16:02:43.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.816+0000 7fac26f2c640 1 -- 172.21.15.139:0/3288702946 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2019e2d0 con 0x7fac20100f60 2024-09-13T16:02:43.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.818+0000 7fac26f2c640 1 -- 172.21.15.139:0/3288702946 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac201070c0 con 0x7fac20100f60 2024-09-13T16:02:43.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.818+0000 7fac1dffb640 1 -- 172.21.15.139:0/3288702946 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7fac0c018af0 con 0x7fac20100f60 2024-09-13T16:02:43.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.819+0000 7fac1dffb640 1 --2- 172.21.15.139:0/3288702946 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fac100a0ff0 0x7fac100a34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:43.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.819+0000 7fac1dffb640 1 -- 172.21.15.139:0/3288702946 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7fac0c013070 con 0x7fac20100f60 2024-09-13T16:02:43.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.820+0000 7fac24cc8640 1 --2- 172.21.15.139:0/3288702946 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fac100a0ff0 0x7fac100a34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:43.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.820+0000 7fac24cc8640 1 --2- 172.21.15.139:0/3288702946 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fac100a0ff0 0x7fac100a34b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac14005fd0 tx=0x7fac14005ce0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:43.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.823+0000 7fac1dffb640 1 -- 172.21.15.139:0/3288702946 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fac0c0964e0 con 0x7fac20100f60 2024-09-13T16:02:43.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:43 smithi086 ceph-mon[30379]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T16:02:43.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:43 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:43.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:43 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:43.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:43 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:02:43.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:43 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:43.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:43 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:43.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:43 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:02:43.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:43 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:43.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:02:43.995+0000 7fac26f2c640 1 -- 172.21.15.139:0/3288702946 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fac2002c4f0 con 0x7fac100a0ff0 2024-09-13T16:02:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:43 smithi194 ceph-mon[35694]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T16:02:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:43 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:43 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:43 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:02:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:43 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:43 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:43 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:02:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:43 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:44.687 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:44 smithi139 ceph-mon[35320]: Detected new or changed devices on smithi086 2024-09-13T16:02:44.687 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:44 smithi139 ceph-mon[35320]: Adjusting osd_memory_target on smithi086 to 17089M 2024-09-13T16:02:44.688 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:44 smithi139 ceph-mon[35320]: pgmap v51: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:44.688 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:44 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:02:44.688 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:44 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:02:44.688 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:44 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:44.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:44 smithi086 ceph-mon[30379]: Detected new or changed devices on smithi086 2024-09-13T16:02:44.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:44 smithi086 ceph-mon[30379]: Adjusting osd_memory_target on smithi086 to 17089M 2024-09-13T16:02:44.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:44 smithi086 ceph-mon[30379]: pgmap v51: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:44.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:44 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:02:44.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:44 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:02:44.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:44 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:45.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:44 smithi194 ceph-mon[35694]: Detected new or changed devices on smithi086 2024-09-13T16:02:45.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:44 smithi194 ceph-mon[35694]: Adjusting osd_memory_target on smithi086 to 17089M 2024-09-13T16:02:45.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:44 smithi194 ceph-mon[35694]: pgmap v51: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:45.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:44 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:02:45.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:44 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:02:45.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:44 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:45.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:45 smithi086 ceph-mon[30379]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:02:45.902 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:45 smithi139 ceph-mon[35320]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:02:46.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:45 smithi194 ceph-mon[35694]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:02:46.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:46 smithi139 ceph-mon[35320]: pgmap v52: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:46.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:46 smithi139 ceph-mon[35320]: from='client.? 172.21.15.139:0/3083628613' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffcf9a5b-5119-4f86-9167-a0e04732f974"}]: dispatch 2024-09-13T16:02:46.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:46 smithi139 ceph-mon[35320]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffcf9a5b-5119-4f86-9167-a0e04732f974"}]: dispatch 2024-09-13T16:02:46.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:46 smithi139 ceph-mon[35320]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffcf9a5b-5119-4f86-9167-a0e04732f974"}]': finished 2024-09-13T16:02:46.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:46 smithi139 ceph-mon[35320]: osdmap e10: 2 total, 1 up, 2 in 2024-09-13T16:02:46.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:46 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:02:46.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:46 smithi086 ceph-mon[30379]: pgmap v52: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:46.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:46 smithi086 ceph-mon[30379]: from='client.? 172.21.15.139:0/3083628613' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffcf9a5b-5119-4f86-9167-a0e04732f974"}]: dispatch 2024-09-13T16:02:46.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:46 smithi086 ceph-mon[30379]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffcf9a5b-5119-4f86-9167-a0e04732f974"}]: dispatch 2024-09-13T16:02:46.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:46 smithi086 ceph-mon[30379]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffcf9a5b-5119-4f86-9167-a0e04732f974"}]': finished 2024-09-13T16:02:46.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:46 smithi086 ceph-mon[30379]: osdmap e10: 2 total, 1 up, 2 in 2024-09-13T16:02:46.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:46 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:02:47.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:46 smithi194 ceph-mon[35694]: pgmap v52: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:47.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:46 smithi194 ceph-mon[35694]: from='client.? 172.21.15.139:0/3083628613' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffcf9a5b-5119-4f86-9167-a0e04732f974"}]: dispatch 2024-09-13T16:02:47.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:46 smithi194 ceph-mon[35694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffcf9a5b-5119-4f86-9167-a0e04732f974"}]: dispatch 2024-09-13T16:02:47.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:46 smithi194 ceph-mon[35694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffcf9a5b-5119-4f86-9167-a0e04732f974"}]': finished 2024-09-13T16:02:47.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:46 smithi194 ceph-mon[35694]: osdmap e10: 2 total, 1 up, 2 in 2024-09-13T16:02:47.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:46 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:02:47.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:47 smithi086 ceph-mon[30379]: from='client.? 172.21.15.139:0/3570504110' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:02:47.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:47 smithi139 ceph-mon[35320]: from='client.? 172.21.15.139:0/3570504110' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:02:48.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:47 smithi194 ceph-mon[35694]: from='client.? 172.21.15.139:0/3570504110' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:02:48.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:48 smithi086 ceph-mon[30379]: pgmap v54: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:48.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:48 smithi139 ceph-mon[35320]: pgmap v54: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:49.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:48 smithi194 ceph-mon[35694]: pgmap v54: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:50.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:50 smithi139 ceph-mon[35320]: pgmap v55: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:50.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:50 smithi086 ceph-mon[30379]: pgmap v55: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:51.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:50 smithi194 ceph-mon[35694]: pgmap v55: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:52.702 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:52 smithi139 ceph-mon[35320]: pgmap v56: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:52.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:52 smithi086 ceph-mon[30379]: pgmap v56: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:53.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:52 smithi194 ceph-mon[35694]: pgmap v56: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:53.680 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:53 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T16:02:53.680 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:53 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:53.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:53 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T16:02:53.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:53 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:54.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:53 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T16:02:54.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:53 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:54.845 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:54 smithi139 ceph-mon[35320]: Deploying daemon osd.1 on smithi139 2024-09-13T16:02:54.845 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:54 smithi139 ceph-mon[35320]: pgmap v57: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:54.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:54 smithi086 ceph-mon[30379]: Deploying daemon osd.1 on smithi139 2024-09-13T16:02:54.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:54 smithi086 ceph-mon[30379]: pgmap v57: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:55.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:54 smithi194 ceph-mon[35694]: Deploying daemon osd.1 on smithi139 2024-09-13T16:02:55.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:54 smithi194 ceph-mon[35694]: pgmap v57: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:56.673 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:56 smithi139 ceph-mon[35320]: pgmap v58: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:56 smithi086 ceph-mon[30379]: pgmap v58: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:57.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:56 smithi194 ceph-mon[35694]: pgmap v58: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:58.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:58 smithi086 ceph-mon[30379]: pgmap v59: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:58.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:58 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:58.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:58 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:58.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:02:58 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:58.931 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:58 smithi139 ceph-mon[35320]: pgmap v59: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:58.931 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:58 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:58.931 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:58 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:58.931 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:02:58 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:59.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:58 smithi194 ceph-mon[35694]: pgmap v59: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:02:59.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:58 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:59.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:58 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:02:59.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:02:58 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:00.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:00 smithi139 ceph-mon[35320]: pgmap v60: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:03:00.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:00.780+0000 7fac1dffb640 1 -- 172.21.15.139:0/3288702946 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fac2002c4f0 con 0x7fac100a0ff0 2024-09-13T16:03:00.782 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 1 on host 'smithi139' 2024-09-13T16:03:00.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:00.783+0000 7fac26f2c640 1 -- 172.21.15.139:0/3288702946 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fac100a0ff0 msgr2=0x7fac100a34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:00.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:00.783+0000 7fac26f2c640 1 --2- 172.21.15.139:0/3288702946 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fac100a0ff0 0x7fac100a34b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac14005fd0 tx=0x7fac14005ce0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:00.783+0000 7fac26f2c640 1 -- 172.21.15.139:0/3288702946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20100f60 msgr2=0x7fac201962d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:00.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:00.783+0000 7fac26f2c640 1 --2- 172.21.15.139:0/3288702946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20100f60 0x7fac201962d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00c970 tx=0x7fac0c00ce30 comp rx=0 tx=0).stop 2024-09-13T16:03:00.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:00.783+0000 7fac26f2c640 1 -- 172.21.15.139:0/3288702946 shutdown_connections 2024-09-13T16:03:00.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:00.783+0000 7fac26f2c640 1 --2- 172.21.15.139:0/3288702946 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fac100a0ff0 0x7fac100a34b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:00.783+0000 7fac26f2c640 1 --2- 172.21.15.139:0/3288702946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac20101920 0x7fac2019d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:00.783+0000 7fac26f2c640 1 --2- 172.21.15.139:0/3288702946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20100f60 0x7fac201962d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:00.783+0000 7fac26f2c640 1 --2- 172.21.15.139:0/3288702946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac200ffe00 0x7fac20195d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:00.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:00.783+0000 7fac26f2c640 1 -- 172.21.15.139:0/3288702946 >> 172.21.15.139:0/3288702946 conn(0x7fac200fb590 msgr2=0x7fac20104290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:00.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:00.783+0000 7fac26f2c640 1 -- 172.21.15.139:0/3288702946 shutdown_connections 2024-09-13T16:03:00.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:00.783+0000 7fac26f2c640 1 -- 172.21.15.139:0/3288702946 wait complete. 2024-09-13T16:03:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:00 smithi086 ceph-mon[30379]: pgmap v60: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:03:01.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:00 smithi194 ceph-mon[35694]: pgmap v60: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:03:01.389 DEBUG:teuthology.orchestra.run.smithi139:osd.1> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.1.service 2024-09-13T16:03:01.392 INFO:tasks.cephadm:Deploying osd.2 on smithi194 with /dev/vg_nvme/lv_4... 2024-09-13T16:03:01.392 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T16:03:01.593 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:03:01.979 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:01 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:01.979 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:01 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:01.979 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:01 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:01.979 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:01 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:01.979 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:01 smithi194 ceph-mon[35694]: pgmap v61: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:03:01.980 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:01 smithi194 ceph-mon[35694]: from='osd.1 [v2:172.21.15.139:6800/341901766,v1:172.21.15.139:6801/341901766]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T16:03:01.980 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:01 smithi194 ceph-mon[35694]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T16:03:01.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:01.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:01.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:01.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:01.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:01 smithi139 ceph-mon[35320]: pgmap v61: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:03:01.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:01 smithi139 ceph-mon[35320]: from='osd.1 [v2:172.21.15.139:6800/341901766,v1:172.21.15.139:6801/341901766]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T16:03:01.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:01 smithi139 ceph-mon[35320]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T16:03:01.999 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:03:01 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-1[39802]: 2024-09-13T16:03:01.762+0000 7fbab2aca640 -1 osd.1 0 log_to_monitors true 2024-09-13T16:03:02.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:01 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:02.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:01 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:02.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:01 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:02.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:01 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:02.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:01 smithi086 ceph-mon[30379]: pgmap v61: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:03:02.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:01 smithi086 ceph-mon[30379]: from='osd.1 [v2:172.21.15.139:6800/341901766,v1:172.21.15.139:6801/341901766]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T16:03:02.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:01 smithi086 ceph-mon[30379]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T16:03:03.213 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T16:03:03.213 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:03 smithi194 ceph-mon[35694]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T16:03:03.214 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:03 smithi194 ceph-mon[35694]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T16:03:03.214 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:03 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:03:03.214 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:03 smithi194 ceph-mon[35694]: from='osd.1 [v2:172.21.15.139:6800/341901766,v1:172.21.15.139:6801/341901766]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:03:03.214 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:03 smithi194 ceph-mon[35694]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:03:03.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:03 smithi139 ceph-mon[35320]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T16:03:03.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:03 smithi139 ceph-mon[35320]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T16:03:03.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:03 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:03:03.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:03 smithi139 ceph-mon[35320]: from='osd.1 [v2:172.21.15.139:6800/341901766,v1:172.21.15.139:6801/341901766]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:03:03.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:03 smithi139 ceph-mon[35320]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:03:03.318 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T16:03:03.330 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2024-09-13T16:03:03.330 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2024-09-13T16:03:03.331 INFO:teuthology.orchestra.run.smithi194.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.01141 s, 919 MB/s 2024-09-13T16:03:03.331 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 2024-09-13T16:03:03.331 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2024-09-13T16:03:03.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:03 smithi086 ceph-mon[30379]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T16:03:03.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:03 smithi086 ceph-mon[30379]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T16:03:03.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:03 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:03:03.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:03 smithi086 ceph-mon[30379]: from='osd.1 [v2:172.21.15.139:6800/341901766,v1:172.21.15.139:6801/341901766]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:03:03.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:03 smithi086 ceph-mon[30379]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:03:03.960 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_4 2024-09-13T16:03:03.998 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:03:03 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-1[39802]: 2024-09-13T16:03:03.764+0000 7fbaaf262640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T16:03:03.998 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:03:03 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-1[39802]: 2024-09-13T16:03:03.768+0000 7fbaa686c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:03:04.164 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:03:04.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:04 smithi194 ceph-mon[35694]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-13T16:03:04.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:04 smithi194 ceph-mon[35694]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T16:03:04.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:04 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:03:04.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:04 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:03:04.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:04 smithi194 ceph-mon[35694]: pgmap v64: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:03:04.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:04 smithi194 ceph-mon[35694]: from='osd.1 ' entity='osd.1' 2024-09-13T16:03:04.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:04 smithi086 ceph-mon[30379]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-13T16:03:04.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:04 smithi086 ceph-mon[30379]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T16:03:04.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:04 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:03:04.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:04 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:03:04.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:04 smithi086 ceph-mon[30379]: pgmap v64: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:03:04.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:04 smithi086 ceph-mon[30379]: from='osd.1 ' entity='osd.1' 2024-09-13T16:03:04.415 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:04 smithi139 ceph-mon[35320]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-13T16:03:04.415 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:04 smithi139 ceph-mon[35320]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T16:03:04.415 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:04 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:03:04.416 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:04 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:03:04.416 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:04 smithi139 ceph-mon[35320]: pgmap v64: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:03:04.416 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:04 smithi139 ceph-mon[35320]: from='osd.1 ' entity='osd.1' 2024-09-13T16:03:05.161 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: purged_snaps scrub starts 2024-09-13T16:03:05.162 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: purged_snaps scrub ok 2024-09-13T16:03:05.162 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:03:05.162 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: Detected new or changed devices on smithi139 2024-09-13T16:03:05.162 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:05.162 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:05.162 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:05.162 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: Adjusting osd_memory_target on smithi139 to 17088M 2024-09-13T16:03:05.162 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:05.162 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:05.162 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:05.162 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:05.163 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:03:05.163 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:05.163 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:05.163 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:05.163 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: osd.1 [v2:172.21.15.139:6800/341901766,v1:172.21.15.139:6801/341901766] boot 2024-09-13T16:03:05.163 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: osdmap e13: 2 total, 2 up, 2 in 2024-09-13T16:03:05.163 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:03:05.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: purged_snaps scrub starts 2024-09-13T16:03:05.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: purged_snaps scrub ok 2024-09-13T16:03:05.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:03:05.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: Detected new or changed devices on smithi139 2024-09-13T16:03:05.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:05.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:05.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:05.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: Adjusting osd_memory_target on smithi139 to 17088M 2024-09-13T16:03:05.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:05.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:05.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:05.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:05.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:03:05.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:05.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:05.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:05.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: osd.1 [v2:172.21.15.139:6800/341901766,v1:172.21.15.139:6801/341901766] boot 2024-09-13T16:03:05.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: osdmap e13: 2 total, 2 up, 2 in 2024-09-13T16:03:05.367 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:03:05.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: purged_snaps scrub starts 2024-09-13T16:03:05.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: purged_snaps scrub ok 2024-09-13T16:03:05.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:03:05.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: Detected new or changed devices on smithi139 2024-09-13T16:03:05.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:05.500 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:05.501 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:05.501 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: Adjusting osd_memory_target on smithi139 to 17088M 2024-09-13T16:03:05.501 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:05.501 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:05.501 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:05.501 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:05.502 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:03:05.502 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:05.502 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:05.502 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:05.503 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: osd.1 [v2:172.21.15.139:6800/341901766,v1:172.21.15.139:6801/341901766] boot 2024-09-13T16:03:05.503 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: osdmap e13: 2 total, 2 up, 2 in 2024-09-13T16:03:05.503 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:03:05.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.594+0000 7fa2dc3f4640 1 -- 172.21.15.194:0/1521043003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2d40fece0 msgr2=0x7fa2d40ff0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.594+0000 7fa2dc3f4640 1 --2- 172.21.15.194:0/1521043003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2d40fece0 0x7fa2d40ff0e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0009900 tx=0x7fa2d002a410 comp rx=0 tx=0).stop 2024-09-13T16:03:05.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.595+0000 7fa2dc3f4640 1 -- 172.21.15.194:0/1521043003 shutdown_connections 2024-09-13T16:03:05.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.595+0000 7fa2dc3f4640 1 --2- 172.21.15.194:0/1521043003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2d41008a0 0x7fa2d4107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.595+0000 7fa2dc3f4640 1 --2- 172.21.15.194:0/1521043003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d40ffee0 0x7fa2d4100360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.595+0000 7fa2dc3f4640 1 --2- 172.21.15.194:0/1521043003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2d40fece0 0x7fa2d40ff0e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.595+0000 7fa2dc3f4640 1 -- 172.21.15.194:0/1521043003 >> 172.21.15.194:0/1521043003 conn(0x7fa2d40fa490 msgr2=0x7fa2d40fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.595+0000 7fa2dc3f4640 1 -- 172.21.15.194:0/1521043003 shutdown_connections 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.595+0000 7fa2dc3f4640 1 -- 172.21.15.194:0/1521043003 wait complete. 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.595+0000 7fa2dc3f4640 1 Processor -- start 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.595+0000 7fa2dc3f4640 1 -- start start 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.595+0000 7fa2dc3f4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2d40fece0 0x7fa2d41981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.595+0000 7fa2dc3f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d40ffee0 0x7fa2d4198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.595+0000 7fa2dc3f4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2d41008a0 0x7fa2d419f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.595+0000 7fa2dc3f4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d419fce0 con 0x7fa2d40fece0 2024-09-13T16:03:05.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.595+0000 7fa2dc3f4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d419fe50 con 0x7fa2d40ffee0 2024-09-13T16:03:05.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.595+0000 7fa2dc3f4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d41a0010 con 0x7fa2d41008a0 2024-09-13T16:03:05.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.595+0000 7fa2da991640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2d41008a0 0x7fa2d419f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.596+0000 7fa2da991640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2d41008a0 0x7fa2d419f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:40856/0 (socket says 172.21.15.194:40856) 2024-09-13T16:03:05.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.596+0000 7fa2da991640 1 -- 172.21.15.194:0/1810554742 learned_addr learned my addr 172.21.15.194:0/1810554742 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T16:03:05.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.596+0000 7fa2d998f640 1 --2- 172.21.15.194:0/1810554742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d40ffee0 0x7fa2d4198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.596+0000 7fa2da190640 1 --2- 172.21.15.194:0/1810554742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2d40fece0 0x7fa2d41981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.596+0000 7fa2da991640 1 -- 172.21.15.194:0/1810554742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d40ffee0 msgr2=0x7fa2d4198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.596+0000 7fa2da991640 1 --2- 172.21.15.194:0/1810554742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d40ffee0 0x7fa2d4198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.596+0000 7fa2da991640 1 -- 172.21.15.194:0/1810554742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2d40fece0 msgr2=0x7fa2d41981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.596+0000 7fa2da991640 1 --2- 172.21.15.194:0/1810554742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2d40fece0 0x7fa2d41981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.596+0000 7fa2da991640 1 -- 172.21.15.194:0/1810554742 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d0009560 con 0x7fa2d41008a0 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.596+0000 7fa2da190640 1 --2- 172.21.15.194:0/1810554742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2d40fece0 0x7fa2d41981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.596+0000 7fa2da991640 1 --2- 172.21.15.194:0/1810554742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2d41008a0 0x7fa2d419f7a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00b970 tx=0x7fa2cc00bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.596+0000 7fa2cb7fe640 1 -- 172.21.15.194:0/1810554742 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc00caa0 con 0x7fa2d41008a0 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.596+0000 7fa2cb7fe640 1 -- 172.21.15.194:0/1810554742 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa2cc00cc00 con 0x7fa2d41008a0 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.596+0000 7fa2dc3f4640 1 -- 172.21.15.194:0/1810554742 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d41a02f0 con 0x7fa2d41008a0 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.596+0000 7fa2cb7fe640 1 -- 172.21.15.194:0/1810554742 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc007650 con 0x7fa2d41008a0 2024-09-13T16:03:05.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.596+0000 7fa2dc3f4640 1 -- 172.21.15.194:0/1810554742 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d41a0870 con 0x7fa2d41008a0 2024-09-13T16:03:05.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.597+0000 7fa2dc3f4640 1 -- 172.21.15.194:0/1810554742 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d410a7c0 con 0x7fa2d41008a0 2024-09-13T16:03:05.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.598+0000 7fa2cb7fe640 1 -- 172.21.15.194:0/1810554742 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7fa2cc0077f0 con 0x7fa2d41008a0 2024-09-13T16:03:05.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.599+0000 7fa2cb7fe640 1 --2- 172.21.15.194:0/1810554742 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa2c00a10a0 0x7fa2c00a3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:05.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.599+0000 7fa2cb7fe640 1 -- 172.21.15.194:0/1810554742 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2309+0+0 (secure 0 0 0) 0x7fa2cc0ca800 con 0x7fa2d41008a0 2024-09-13T16:03:05.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.599+0000 7fa2da190640 1 --2- 172.21.15.194:0/1810554742 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa2c00a10a0 0x7fa2c00a3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:05.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.600+0000 7fa2da190640 1 --2- 172.21.15.194:0/1810554742 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa2c00a10a0 0x7fa2c00a3560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0006010 tx=0x7fa2d0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:05.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.603+0000 7fa2cb7fe640 1 -- 172.21.15.194:0/1810554742 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa2cc0957e0 con 0x7fa2d41008a0 2024-09-13T16:03:05.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:05.777+0000 7fa2dc3f4640 1 -- 172.21.15.194:0/1810554742 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2d40686a0 con 0x7fa2c00a10a0 2024-09-13T16:03:06.324 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:06 smithi194 ceph-mon[35694]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:06.325 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:06 smithi194 ceph-mon[35694]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T16:03:06.325 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:06 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:03:06.325 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:06 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:03:06.325 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:06 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:06.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:06 smithi086 ceph-mon[30379]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:06.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:06 smithi086 ceph-mon[30379]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T16:03:06.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:06 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:03:06.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:06 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:03:06.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:06 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:06.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:06 smithi139 ceph-mon[35320]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:06.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:06 smithi139 ceph-mon[35320]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T16:03:06.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:06 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:03:06.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:06 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:03:06.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:06 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:07.221 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:07 smithi194 ceph-mon[35694]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:03:07.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:07 smithi086 ceph-mon[30379]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:03:07.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:07 smithi139 ceph-mon[35320]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:03:08.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:08 smithi086 ceph-mon[30379]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:08.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:08 smithi086 ceph-mon[30379]: from='client.? 172.21.15.194:0/2147513370' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbe88e68-9e6f-47d2-a401-ab8c02700099"}]: dispatch 2024-09-13T16:03:08.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:08 smithi086 ceph-mon[30379]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbe88e68-9e6f-47d2-a401-ab8c02700099"}]: dispatch 2024-09-13T16:03:08.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:08 smithi086 ceph-mon[30379]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbe88e68-9e6f-47d2-a401-ab8c02700099"}]': finished 2024-09-13T16:03:08.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:08 smithi086 ceph-mon[30379]: osdmap e15: 3 total, 2 up, 3 in 2024-09-13T16:03:08.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:08 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:03:08.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:08 smithi139 ceph-mon[35320]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:08.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:08 smithi139 ceph-mon[35320]: from='client.? 172.21.15.194:0/2147513370' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbe88e68-9e6f-47d2-a401-ab8c02700099"}]: dispatch 2024-09-13T16:03:08.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:08 smithi139 ceph-mon[35320]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbe88e68-9e6f-47d2-a401-ab8c02700099"}]: dispatch 2024-09-13T16:03:08.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:08 smithi139 ceph-mon[35320]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbe88e68-9e6f-47d2-a401-ab8c02700099"}]': finished 2024-09-13T16:03:08.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:08 smithi139 ceph-mon[35320]: osdmap e15: 3 total, 2 up, 3 in 2024-09-13T16:03:08.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:08 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:03:08.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:08 smithi194 ceph-mon[35694]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:08.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:08 smithi194 ceph-mon[35694]: from='client.? 172.21.15.194:0/2147513370' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbe88e68-9e6f-47d2-a401-ab8c02700099"}]: dispatch 2024-09-13T16:03:08.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:08 smithi194 ceph-mon[35694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbe88e68-9e6f-47d2-a401-ab8c02700099"}]: dispatch 2024-09-13T16:03:08.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:08 smithi194 ceph-mon[35694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbe88e68-9e6f-47d2-a401-ab8c02700099"}]': finished 2024-09-13T16:03:08.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:08 smithi194 ceph-mon[35694]: osdmap e15: 3 total, 2 up, 3 in 2024-09-13T16:03:08.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:08 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:03:09.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:09 smithi086 ceph-mon[30379]: from='client.? 172.21.15.194:0/418299390' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:03:09.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:09 smithi139 ceph-mon[35320]: from='client.? 172.21.15.194:0/418299390' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:03:09.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:09 smithi194 ceph-mon[35694]: from='client.? 172.21.15.194:0/418299390' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:03:10.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:10 smithi086 ceph-mon[30379]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:10.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:10 smithi139 ceph-mon[35320]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:10.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:10 smithi194 ceph-mon[35694]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:12.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:12 smithi194 ceph-mon[35694]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:12.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:12 smithi086 ceph-mon[30379]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:12.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:12 smithi139 ceph-mon[35320]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:14.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:14 smithi086 ceph-mon[30379]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:14.745 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:14 smithi194 ceph-mon[35694]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:14.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:14 smithi139 ceph-mon[35320]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:15.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:15 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T16:03:15.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:15 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:15.745 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:15 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T16:03:15.745 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:15 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:15.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:15 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T16:03:15.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:15 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:16.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:16 smithi086 ceph-mon[30379]: Deploying daemon osd.2 on smithi194 2024-09-13T16:03:16.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:16 smithi086 ceph-mon[30379]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:16.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:16 smithi139 ceph-mon[35320]: Deploying daemon osd.2 on smithi194 2024-09-13T16:03:16.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:16 smithi139 ceph-mon[35320]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:16.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:16 smithi194 ceph-mon[35694]: Deploying daemon osd.2 on smithi194 2024-09-13T16:03:16.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:16 smithi194 ceph-mon[35694]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:18.611 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:18 smithi194 ceph-mon[35694]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:18.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:18 smithi086 ceph-mon[30379]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:18.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:18 smithi139 ceph-mon[35320]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:20.495 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:20 smithi194 ceph-mon[35694]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:20.495 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:20 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:03:20.495 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:20 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:20.495 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:20 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:20.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:20 smithi086 ceph-mon[30379]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:20.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:20 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:03:20.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:20 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:20.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:20 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:20.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:20 smithi139 ceph-mon[35320]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:20.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:20 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:03:20.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:20 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:20.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:20 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:22.429 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:22 smithi194 ceph-mon[35694]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:22.429 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:22 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:22.429 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:22 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:22.429 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:22 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:22.429 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:22 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:22.430 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:22 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:22.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:22 smithi086 ceph-mon[30379]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:22.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:22 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:22.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:22 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:22.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:22 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:22.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:22 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:22.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:22 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:22.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:22.745+0000 7fa2cb7fe640 1 -- 172.21.15.194:0/1810554742 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa2d40686a0 con 0x7fa2c00a10a0 2024-09-13T16:03:22.747 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 2 on host 'smithi194' 2024-09-13T16:03:22.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:22 smithi139 ceph-mon[35320]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:22.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:22 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:22.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:22 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:22.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:22 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:22.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:22 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:22.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:22 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:22.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:22.747+0000 7fa2dc3f4640 1 -- 172.21.15.194:0/1810554742 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa2c00a10a0 msgr2=0x7fa2c00a3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:22.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:22.747+0000 7fa2dc3f4640 1 --2- 172.21.15.194:0/1810554742 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa2c00a10a0 0x7fa2c00a3560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0006010 tx=0x7fa2d0031400 comp rx=0 tx=0).stop 2024-09-13T16:03:22.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:22.747+0000 7fa2dc3f4640 1 -- 172.21.15.194:0/1810554742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2d41008a0 msgr2=0x7fa2d419f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:22.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:22.747+0000 7fa2dc3f4640 1 --2- 172.21.15.194:0/1810554742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2d41008a0 0x7fa2d419f7a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00b970 tx=0x7fa2cc00bd70 comp rx=0 tx=0).stop 2024-09-13T16:03:22.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:22.747+0000 7fa2dc3f4640 1 -- 172.21.15.194:0/1810554742 shutdown_connections 2024-09-13T16:03:22.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:22.747+0000 7fa2dc3f4640 1 --2- 172.21.15.194:0/1810554742 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa2c00a10a0 0x7fa2c00a3560 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:22.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:22.747+0000 7fa2dc3f4640 1 --2- 172.21.15.194:0/1810554742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2d41008a0 0x7fa2d419f7a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:22.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:22.747+0000 7fa2dc3f4640 1 --2- 172.21.15.194:0/1810554742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d40ffee0 0x7fa2d4198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:22.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:22.747+0000 7fa2dc3f4640 1 --2- 172.21.15.194:0/1810554742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2d40fece0 0x7fa2d41981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:22.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:22.747+0000 7fa2dc3f4640 1 -- 172.21.15.194:0/1810554742 >> 172.21.15.194:0/1810554742 conn(0x7fa2d40fa490 msgr2=0x7fa2d4067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:22.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:22.747+0000 7fa2dc3f4640 1 -- 172.21.15.194:0/1810554742 shutdown_connections 2024-09-13T16:03:22.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:03:22.747+0000 7fa2dc3f4640 1 -- 172.21.15.194:0/1810554742 wait complete. 2024-09-13T16:03:23.344 DEBUG:teuthology.orchestra.run.smithi194:osd.2> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.2.service 2024-09-13T16:03:23.347 INFO:tasks.cephadm:Deploying osd.3 on smithi086 with /dev/vg_nvme/lv_3... 2024-09-13T16:03:23.347 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T16:03:23.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:23 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:03:23.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:23 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:23.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:23 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:23.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:23 smithi086 ceph-mon[30379]: from='osd.2 [v2:172.21.15.194:6800/2776695129,v1:172.21.15.194:6801/2776695129]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T16:03:23.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:23 smithi086 ceph-mon[30379]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T16:03:23.663 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:03:23.668 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:23 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:03:23.668 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:23 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:23.668 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:23 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:23.668 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:23 smithi194 ceph-mon[35694]: from='osd.2 [v2:172.21.15.194:6800/2776695129,v1:172.21.15.194:6801/2776695129]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T16:03:23.668 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:23 smithi194 ceph-mon[35694]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T16:03:23.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:23 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:03:23.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:23 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:23.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:23 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:23.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:23 smithi139 ceph-mon[35320]: from='osd.2 [v2:172.21.15.194:6800/2776695129,v1:172.21.15.194:6801/2776695129]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T16:03:23.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:23 smithi139 ceph-mon[35320]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T16:03:24.602 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:24 smithi086 ceph-mon[30379]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:24.602 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:24 smithi086 ceph-mon[30379]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T16:03:24.602 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:24 smithi086 ceph-mon[30379]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T16:03:24.602 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:24 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:03:24.603 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:24 smithi086 ceph-mon[30379]: from='osd.2 [v2:172.21.15.194:6800/2776695129,v1:172.21.15.194:6801/2776695129]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:03:24.603 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:24 smithi086 ceph-mon[30379]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:03:24.683 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:24 smithi194 ceph-mon[35694]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:24.683 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:24 smithi194 ceph-mon[35694]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T16:03:24.683 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:24 smithi194 ceph-mon[35694]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T16:03:24.684 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:24 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:03:24.684 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:24 smithi194 ceph-mon[35694]: from='osd.2 [v2:172.21.15.194:6800/2776695129,v1:172.21.15.194:6801/2776695129]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:03:24.684 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:24 smithi194 ceph-mon[35694]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:03:24.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:24 smithi139 ceph-mon[35320]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:24.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:24 smithi139 ceph-mon[35320]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T16:03:24.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:24 smithi139 ceph-mon[35320]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T16:03:24.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:24 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:03:24.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:24 smithi139 ceph-mon[35320]: from='osd.2 [v2:172.21.15.194:6800/2776695129,v1:172.21.15.194:6801/2776695129]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:03:24.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:24 smithi139 ceph-mon[35320]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:03:24.950 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:03:24 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-2[40705]: 2024-09-13T16:03:24.756+0000 7f54dbf83640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T16:03:24.950 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:03:24 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-2[40705]: 2024-09-13T16:03:24.760+0000 7f54d7dac640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:03:25.846 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T16:03:25.861 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:25 smithi194 ceph-mon[35694]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-13T16:03:25.862 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:25 smithi194 ceph-mon[35694]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T16:03:25.862 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:25 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:03:25.862 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:25 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:03:25.862 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:25 smithi194 ceph-mon[35694]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:25.988 INFO:teuthology.orchestra.run.smithi086.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T16:03:26.021 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10+0 records in 2024-09-13T16:03:26.021 INFO:teuthology.orchestra.run.smithi086.stderr:10+0 records out 2024-09-13T16:03:26.022 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0277902 s, 377 MB/s 2024-09-13T16:03:26.022 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:25 smithi086 ceph-mon[30379]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-13T16:03:26.022 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:25 smithi086 ceph-mon[30379]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T16:03:26.022 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:25 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:03:26.022 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:25 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:03:26.023 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:25 smithi086 ceph-mon[30379]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:26.023 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping successful for: 2024-09-13T16:03:26.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:25 smithi139 ceph-mon[35320]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-13T16:03:26.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:25 smithi139 ceph-mon[35320]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T16:03:26.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:25 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:03:26.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:25 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:03:26.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:25 smithi139 ceph-mon[35320]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:03:26.755 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi086:vg_nvme/lv_3 2024-09-13T16:03:27.061 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:03:27.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:26 smithi086 ceph-mon[30379]: purged_snaps scrub starts 2024-09-13T16:03:27.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:26 smithi086 ceph-mon[30379]: purged_snaps scrub ok 2024-09-13T16:03:27.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:26 smithi086 ceph-mon[30379]: osd.2 [v2:172.21.15.194:6800/2776695129,v1:172.21.15.194:6801/2776695129] boot 2024-09-13T16:03:27.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:26 smithi086 ceph-mon[30379]: osdmap e18: 3 total, 3 up, 3 in 2024-09-13T16:03:27.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:26 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:03:27.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:26 smithi086 ceph-mon[30379]: Detected new or changed devices on smithi194 2024-09-13T16:03:27.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:26 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:27.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:26 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:27.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:26 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:27.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:26 smithi086 ceph-mon[30379]: Adjusting osd_memory_target on smithi194 to 17088M 2024-09-13T16:03:27.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:26 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:27.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:26 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:27.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:26 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:27.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:26 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:27.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:26 smithi139 ceph-mon[35320]: purged_snaps scrub starts 2024-09-13T16:03:27.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:26 smithi139 ceph-mon[35320]: purged_snaps scrub ok 2024-09-13T16:03:27.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:26 smithi139 ceph-mon[35320]: osd.2 [v2:172.21.15.194:6800/2776695129,v1:172.21.15.194:6801/2776695129] boot 2024-09-13T16:03:27.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:26 smithi139 ceph-mon[35320]: osdmap e18: 3 total, 3 up, 3 in 2024-09-13T16:03:27.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:26 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:03:27.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:26 smithi139 ceph-mon[35320]: Detected new or changed devices on smithi194 2024-09-13T16:03:27.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:26 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:27.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:26 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:27.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:26 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:27.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:26 smithi139 ceph-mon[35320]: Adjusting osd_memory_target on smithi194 to 17088M 2024-09-13T16:03:27.251 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:26 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:27.251 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:26 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:27.251 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:26 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:27.251 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:26 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:27.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:26 smithi194 ceph-mon[35694]: purged_snaps scrub starts 2024-09-13T16:03:27.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:26 smithi194 ceph-mon[35694]: purged_snaps scrub ok 2024-09-13T16:03:27.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:26 smithi194 ceph-mon[35694]: osd.2 [v2:172.21.15.194:6800/2776695129,v1:172.21.15.194:6801/2776695129] boot 2024-09-13T16:03:27.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:26 smithi194 ceph-mon[35694]: osdmap e18: 3 total, 3 up, 3 in 2024-09-13T16:03:27.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:26 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:03:27.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:26 smithi194 ceph-mon[35694]: Detected new or changed devices on smithi194 2024-09-13T16:03:27.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:26 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:27.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:26 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:27.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:26 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:27.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:26 smithi194 ceph-mon[35694]: Adjusting osd_memory_target on smithi194 to 17088M 2024-09-13T16:03:27.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:26 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:27.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:26 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:27.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:26 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:27.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:26 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:28.261 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:28 smithi086 ceph-mon[30379]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T16:03:28.261 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:28 smithi086 ceph-mon[30379]: pgmap v83: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:28.262 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:28 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:03:28.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:28 smithi139 ceph-mon[35320]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T16:03:28.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:28 smithi139 ceph-mon[35320]: pgmap v83: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:28.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:28 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:03:28.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:28 smithi194 ceph-mon[35694]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T16:03:28.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:28 smithi194 ceph-mon[35694]: pgmap v83: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:28.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:28 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:03:28.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.934+0000 7f4a41200640 1 -- 172.21.15.86:0/3992116735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a3c106750 msgr2=0x7f4a3c106b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:28.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.934+0000 7f4a41200640 1 --2- 172.21.15.86:0/3992116735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a3c106750 0x7f4a3c106b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c009900 tx=0x7f4a2c02a3e0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.934+0000 7f4a41200640 1 -- 172.21.15.86:0/3992116735 shutdown_connections 2024-09-13T16:03:28.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.934+0000 7f4a41200640 1 --2- 172.21.15.86:0/3992116735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c107fb0 0x7f4a3c10e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.934+0000 7f4a41200640 1 --2- 172.21.15.86:0/3992116735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a3c1075f0 0x7f4a3c107a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.934+0000 7f4a41200640 1 --2- 172.21.15.86:0/3992116735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a3c106750 0x7f4a3c106b50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.934+0000 7f4a41200640 1 -- 172.21.15.86:0/3992116735 >> 172.21.15.86:0/3992116735 conn(0x7f4a3c0756c0 msgr2=0x7f4a3c077b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:28.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.935+0000 7f4a41200640 1 -- 172.21.15.86:0/3992116735 shutdown_connections 2024-09-13T16:03:28.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.935+0000 7f4a41200640 1 -- 172.21.15.86:0/3992116735 wait complete. 2024-09-13T16:03:28.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.935+0000 7f4a41200640 1 Processor -- start 2024-09-13T16:03:28.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.936+0000 7f4a41200640 1 -- start start 2024-09-13T16:03:28.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.936+0000 7f4a41200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a3c106750 0x7f4a3c19c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:28.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.936+0000 7f4a41200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c1075f0 0x7f4a3c19c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:28.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.936+0000 7f4a41200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a3c107fb0 0x7f4a3c1a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:28.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.936+0000 7f4a41200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c1a3f40 con 0x7f4a3c107fb0 2024-09-13T16:03:28.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.936+0000 7f4a41200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c1a40b0 con 0x7f4a3c1075f0 2024-09-13T16:03:28.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.936+0000 7f4a41200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c1a4270 con 0x7f4a3c106750 2024-09-13T16:03:28.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.936+0000 7f4a3a800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a3c107fb0 0x7f4a3c1a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:28.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.936+0000 7f4a3a800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a3c107fb0 0x7f4a3c1a3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53978/0 (socket says 172.21.15.86:53978) 2024-09-13T16:03:28.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.936+0000 7f4a3a800640 1 -- 172.21.15.86:0/3747394406 learned_addr learned my addr 172.21.15.86:0/3747394406 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:03:28.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.936+0000 7f4a39e00640 1 --2- 172.21.15.86:0/3747394406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a3c106750 0x7f4a3c19c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:28.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.936+0000 7f4a31400640 1 --2- 172.21.15.86:0/3747394406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c1075f0 0x7f4a3c19c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:28.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.937+0000 7f4a3a800640 1 -- 172.21.15.86:0/3747394406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a3c106750 msgr2=0x7f4a3c19c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:28.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.937+0000 7f4a3a800640 1 --2- 172.21.15.86:0/3747394406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a3c106750 0x7f4a3c19c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.937+0000 7f4a3a800640 1 -- 172.21.15.86:0/3747394406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c1075f0 msgr2=0x7f4a3c19c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:28.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.937+0000 7f4a3a800640 1 --2- 172.21.15.86:0/3747394406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c1075f0 0x7f4a3c19c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:28.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.937+0000 7f4a3a800640 1 -- 172.21.15.86:0/3747394406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c009560 con 0x7f4a3c107fb0 2024-09-13T16:03:28.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.937+0000 7f4a3a800640 1 --2- 172.21.15.86:0/3747394406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a3c107fb0 0x7f4a3c1a3a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400e970 tx=0x7f4a3400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:28.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.937+0000 7f4a33400640 1 -- 172.21.15.86:0/3747394406 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a34009720 con 0x7f4a3c107fb0 2024-09-13T16:03:28.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.937+0000 7f4a33400640 1 -- 172.21.15.86:0/3747394406 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4a34005500 con 0x7f4a3c107fb0 2024-09-13T16:03:28.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.937+0000 7f4a41200640 1 -- 172.21.15.86:0/3747394406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a3c1a4550 con 0x7f4a3c107fb0 2024-09-13T16:03:28.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.937+0000 7f4a33400640 1 -- 172.21.15.86:0/3747394406 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a34010430 con 0x7f4a3c107fb0 2024-09-13T16:03:28.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.937+0000 7f4a41200640 1 -- 172.21.15.86:0/3747394406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3c1a4a00 con 0x7f4a3c107fb0 2024-09-13T16:03:28.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.938+0000 7f4a41200640 1 -- 172.21.15.86:0/3747394406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a3c10d7e0 con 0x7f4a3c107fb0 2024-09-13T16:03:28.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.942+0000 7f4a33400640 1 -- 172.21.15.86:0/3747394406 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f4a34005000 con 0x7f4a3c107fb0 2024-09-13T16:03:28.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.943+0000 7f4a33400640 1 --2- 172.21.15.86:0/3747394406 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4a200a1020 0x7f4a200a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:28.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.943+0000 7f4a33400640 1 -- 172.21.15.86:0/3747394406 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3226+0+0 (secure 0 0 0) 0x7f4a34014070 con 0x7f4a3c107fb0 2024-09-13T16:03:28.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.943+0000 7f4a39e00640 1 --2- 172.21.15.86:0/3747394406 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4a200a1020 0x7f4a200a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:28.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.944+0000 7f4a39e00640 1 --2- 172.21.15.86:0/3747394406 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4a200a1020 0x7f4a200a34e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c031510 tx=0x7f4a2c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:28.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:28.946+0000 7f4a33400640 1 -- 172.21.15.86:0/3747394406 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4a34096520 con 0x7f4a3c107fb0 2024-09-13T16:03:29.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:29.126+0000 7f4a41200640 1 -- 172.21.15.86:0/3747394406 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a3c02c480 con 0x7f4a200a1020 2024-09-13T16:03:29.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:29 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T16:03:29.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:29 smithi139 ceph-mon[35320]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T16:03:29.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:29 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:03:29.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:29 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:03:29.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:29 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:03:29.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:29 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:29 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T16:03:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:29 smithi194 ceph-mon[35694]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T16:03:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:29 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:03:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:29 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:03:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:29 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:03:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:29 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:29.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:29 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T16:03:29.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:29 smithi086 ceph-mon[30379]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T16:03:29.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:29 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:03:29.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:29 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:03:29.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:29 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:03:29.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:29 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:29.932 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:03:29 smithi086 sudo[48944]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T16:03:29.932 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:03:29 smithi086 sudo[48944]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:03:29.932 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:03:29 smithi086 sudo[48944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:03:29.932 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:03:29 smithi086 sudo[48944]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:03:30.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:30.230+0000 7f4a33400640 1 -- 172.21.15.86:0/3747394406 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4a340968f0 con 0x7f4a3c107fb0 2024-09-13T16:03:30.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:30 smithi086 ceph-mon[30379]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:03:30.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T16:03:30.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:30 smithi086 ceph-mon[30379]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T16:03:30.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:30 smithi086 ceph-mon[30379]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:30.502 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:30 smithi139 ceph-mon[35320]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:03:30.502 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T16:03:30.502 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:30 smithi139 ceph-mon[35320]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T16:03:30.503 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:30 smithi139 ceph-mon[35320]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:30.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:30 smithi194 ceph-mon[35694]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:03:30.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T16:03:30.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:30 smithi194 ceph-mon[35694]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T16:03:30.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:30 smithi194 ceph-mon[35694]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:30.856 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:03:30 smithi086 sudo[48966]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T16:03:30.856 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:03:30 smithi086 sudo[48966]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:03:30.856 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:03:30 smithi086 sudo[48966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:03:30.856 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:03:30 smithi086 sudo[48966]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:03:30.954 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:03:30 smithi139 sudo[43467]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T16:03:30.954 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:03:30 smithi139 sudo[43467]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:03:30.954 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:03:30 smithi139 sudo[43467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:03:30.955 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:03:30 smithi139 sudo[43467]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:03:31.223 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:03:30 smithi139 sudo[43470]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T16:03:31.223 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:03:30 smithi139 sudo[43470]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:03:31.224 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:03:30 smithi139 sudo[43470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:03:31.224 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:03:30 smithi139 sudo[43470]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:03:31.494 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:31 smithi194 ceph-mon[35694]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T16:03:31.495 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:31 smithi194 ceph-mon[35694]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-13T16:03:31.495 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:31 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:31.495 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:31 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:31.495 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:03:31 smithi194 sudo[44726]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T16:03:31.495 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:03:31 smithi194 sudo[44726]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:03:31.495 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:03:31 smithi194 sudo[44726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:03:31.495 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:03:31 smithi194 sudo[44726]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:03:31.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:31 smithi139 ceph-mon[35320]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T16:03:31.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:31 smithi139 ceph-mon[35320]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-13T16:03:31.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:31 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:31.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:31 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:31.517 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:31 smithi086 ceph-mon[30379]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T16:03:31.518 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:31 smithi086 ceph-mon[30379]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-13T16:03:31.518 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:31 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:31.518 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:31 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:31.755 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:03:31 smithi194 sudo[44729]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T16:03:31.755 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:03:31 smithi194 sudo[44729]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:03:31.755 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:03:31 smithi194 sudo[44729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:03:31.755 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:03:31 smithi194 sudo[44729]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:03:32.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:32 smithi086 sudo[49038]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T16:03:32.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:32 smithi086 sudo[49038]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:03:32.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:32 smithi086 sudo[49038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:03:32.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:32 smithi086 sudo[49038]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:03:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:32 smithi086 sudo[49042]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T16:03:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:32 smithi086 sudo[49042]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:03:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:32 smithi086 sudo[49042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:03:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:32 smithi086 sudo[49042]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:03:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:32 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:32 smithi086 ceph-mon[30379]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T16:03:32.873 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:32 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:32.873 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:32 smithi194 ceph-mon[35694]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T16:03:32.873 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:32 smithi194 sudo[44733]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T16:03:32.873 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:32 smithi194 sudo[44733]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:03:32.874 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:32 smithi194 sudo[44733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:03:32.874 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:32 smithi194 sudo[44733]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:03:32.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:32 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:32.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:32 smithi139 ceph-mon[35320]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T16:03:33.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 sudo[44736]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T16:03:33.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 sudo[44736]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:03:33.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 sudo[44736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:03:33.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 sudo[44736]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:03:33.608 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 sudo[43473]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T16:03:33.609 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 sudo[43473]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:03:33.609 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 sudo[43473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:03:33.609 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 sudo[43473]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:03:33.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 sudo[43476]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T16:03:33.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 sudo[43476]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:03:33.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 sudo[43476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:03:33.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 sudo[43476]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:03:33.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:33.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1488428725' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4fc18705-76a0-44bc-a402-abf53572dd15"}]: dispatch 2024-09-13T16:03:33.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T16:03:33.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:03:33.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:03:33.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4fc18705-76a0-44bc-a402-abf53572dd15"}]: dispatch 2024-09-13T16:03:33.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:03:34.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4fc18705-76a0-44bc-a402-abf53572dd15"}]': finished 2024-09-13T16:03:34.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T16:03:34.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:03:34.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T16:03:34.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:03:34.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:03:34.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:03:34.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T16:03:34.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:03:34.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:03:34.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:03:34.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: pgmap v90: 1 pgs: 1 active+clean; 449 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:34.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:33 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3486004831' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:03:34.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:34.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1488428725' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4fc18705-76a0-44bc-a402-abf53572dd15"}]: dispatch 2024-09-13T16:03:34.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T16:03:34.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:03:34.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:03:34.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4fc18705-76a0-44bc-a402-abf53572dd15"}]: dispatch 2024-09-13T16:03:34.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:03:34.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4fc18705-76a0-44bc-a402-abf53572dd15"}]': finished 2024-09-13T16:03:34.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T16:03:34.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:03:34.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T16:03:34.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:03:34.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:03:34.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:03:34.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T16:03:34.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:03:34.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:03:34.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:03:34.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: pgmap v90: 1 pgs: 1 active+clean; 449 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:34.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:33 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3486004831' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:03:34.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:34.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1488428725' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4fc18705-76a0-44bc-a402-abf53572dd15"}]: dispatch 2024-09-13T16:03:34.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T16:03:34.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:03:34.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:03:34.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4fc18705-76a0-44bc-a402-abf53572dd15"}]: dispatch 2024-09-13T16:03:34.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:03:34.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4fc18705-76a0-44bc-a402-abf53572dd15"}]': finished 2024-09-13T16:03:34.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T16:03:34.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:03:34.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T16:03:34.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:03:34.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:03:34.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:03:34.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T16:03:34.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:03:34.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:03:34.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:03:34.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: pgmap v90: 1 pgs: 1 active+clean; 449 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:34.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:33 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3486004831' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:03:34.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:34 smithi139 ceph-mon[35320]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T16:03:34.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:34 smithi139 ceph-mon[35320]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T16:03:35.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:34 smithi194 ceph-mon[35694]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T16:03:35.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:34 smithi194 ceph-mon[35694]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T16:03:35.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:34 smithi086 ceph-mon[30379]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T16:03:35.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:34 smithi086 ceph-mon[30379]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T16:03:35.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:35 smithi139 ceph-mon[35320]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 362 KiB/s wr, 24 op/s 2024-09-13T16:03:36.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:35 smithi194 ceph-mon[35694]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 362 KiB/s wr, 24 op/s 2024-09-13T16:03:36.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:35 smithi086 ceph-mon[30379]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 362 KiB/s wr, 24 op/s 2024-09-13T16:03:38.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:38 smithi086 ceph-mon[30379]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 259 KiB/s wr, 17 op/s 2024-09-13T16:03:38.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:38 smithi139 ceph-mon[35320]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 259 KiB/s wr, 17 op/s 2024-09-13T16:03:38.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:38 smithi194 ceph-mon[35694]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 259 KiB/s wr, 17 op/s 2024-09-13T16:03:40.535 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:40 smithi086 ceph-mon[30379]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 202 KiB/s wr, 13 op/s 2024-09-13T16:03:40.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:40 smithi139 ceph-mon[35320]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 202 KiB/s wr, 13 op/s 2024-09-13T16:03:40.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:40 smithi194 ceph-mon[35694]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 202 KiB/s wr, 13 op/s 2024-09-13T16:03:41.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T16:03:41.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:41.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:41 smithi086 ceph-mon[30379]: Deploying daemon osd.3 on smithi086 2024-09-13T16:03:41.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T16:03:41.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:41.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:41 smithi194 ceph-mon[35694]: Deploying daemon osd.3 on smithi086 2024-09-13T16:03:41.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T16:03:41.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:41.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:41 smithi139 ceph-mon[35320]: Deploying daemon osd.3 on smithi086 2024-09-13T16:03:42.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:42 smithi086 ceph-mon[30379]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-09-13T16:03:42.649 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:42 smithi139 ceph-mon[35320]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-09-13T16:03:42.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:42 smithi194 ceph-mon[35694]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-09-13T16:03:44.574 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:44 smithi086 ceph-mon[30379]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 171 KiB/s wr, 11 op/s 2024-09-13T16:03:44.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:44 smithi139 ceph-mon[35320]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 171 KiB/s wr, 11 op/s 2024-09-13T16:03:44.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:44 smithi194 ceph-mon[35694]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 171 KiB/s wr, 11 op/s 2024-09-13T16:03:46.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:46 smithi086 ceph-mon[30379]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2024-09-13T16:03:46.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:46 smithi139 ceph-mon[35320]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2024-09-13T16:03:46.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:46 smithi194 ceph-mon[35694]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2024-09-13T16:03:47.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:47 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:03:47.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:47 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:47.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:47 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:47.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:47 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:03:47.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:47 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:47.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:47 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:47.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:47 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:03:47.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:47 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:47.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:47 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:48.602 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:48 smithi086 ceph-mon[30379]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:48.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:48 smithi139 ceph-mon[35320]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:48.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:48 smithi194 ceph-mon[35694]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:50.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:50 smithi086 ceph-mon[30379]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:50.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:50 smithi139 ceph-mon[35320]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:50.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:50 smithi194 ceph-mon[35694]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:51.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:51.464+0000 7f4a33400640 1 -- 172.21.15.86:0/3747394406 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4a3c02c480 con 0x7f4a200a1020 2024-09-13T16:03:51.465 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 3 on host 'smithi086' 2024-09-13T16:03:51.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:51.466+0000 7f4a41200640 1 -- 172.21.15.86:0/3747394406 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4a200a1020 msgr2=0x7f4a200a34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:51.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:51.466+0000 7f4a41200640 1 --2- 172.21.15.86:0/3747394406 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4a200a1020 0x7f4a200a34e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c031510 tx=0x7f4a2c0058d0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:51.466+0000 7f4a41200640 1 -- 172.21.15.86:0/3747394406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a3c107fb0 msgr2=0x7f4a3c1a3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:51.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:51.466+0000 7f4a41200640 1 --2- 172.21.15.86:0/3747394406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a3c107fb0 0x7f4a3c1a3a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400e970 tx=0x7f4a3400ed70 comp rx=0 tx=0).stop 2024-09-13T16:03:51.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:51.466+0000 7f4a41200640 1 -- 172.21.15.86:0/3747394406 shutdown_connections 2024-09-13T16:03:51.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:51.466+0000 7f4a41200640 1 --2- 172.21.15.86:0/3747394406 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4a200a1020 0x7f4a200a34e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:51.466+0000 7f4a41200640 1 --2- 172.21.15.86:0/3747394406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a3c107fb0 0x7f4a3c1a3a00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:51.466+0000 7f4a41200640 1 --2- 172.21.15.86:0/3747394406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a3c1075f0 0x7f4a3c19c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:51.466+0000 7f4a41200640 1 --2- 172.21.15.86:0/3747394406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a3c106750 0x7f4a3c19c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:51.466+0000 7f4a41200640 1 -- 172.21.15.86:0/3747394406 >> 172.21.15.86:0/3747394406 conn(0x7f4a3c0756c0 msgr2=0x7f4a3c10a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:51.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:51.467+0000 7f4a41200640 1 -- 172.21.15.86:0/3747394406 shutdown_connections 2024-09-13T16:03:51.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:03:51.467+0000 7f4a41200640 1 -- 172.21.15.86:0/3747394406 wait complete. 2024-09-13T16:03:51.814 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:51.815 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:51.815 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:51.815 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:51.815 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:51.815 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:51 smithi086 ceph-mon[30379]: from='osd.3 [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T16:03:51.815 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:03:51.815 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:51.815 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:51.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:51 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:51.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:51 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:51.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:51 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:51.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:51 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:51.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:51 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:51.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:51 smithi139 ceph-mon[35320]: from='osd.3 [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T16:03:51.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:51 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:03:51.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:51 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:51.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:51 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:52.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:52.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:52.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:52.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:52.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:52.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:51 smithi194 ceph-mon[35694]: from='osd.3 [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T16:03:52.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:03:52.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:52.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:52.237 DEBUG:teuthology.orchestra.run.smithi086:osd.3> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.3.service 2024-09-13T16:03:52.241 INFO:tasks.cephadm:Deploying osd.4 on smithi139 with /dev/vg_nvme/lv_3... 2024-09-13T16:03:52.241 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T16:03:52.447 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:03:52.751 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:52 smithi086 ceph-mon[30379]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:52.751 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:52 smithi086 ceph-mon[30379]: from='osd.3 [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T16:03:52.751 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:52 smithi086 ceph-mon[30379]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T16:03:52.751 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:03:52.751 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:52 smithi086 ceph-mon[30379]: from='osd.3 [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-13T16:03:52.751 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:03:52 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-3[51069]: 2024-09-13T16:03:52.605+0000 7f26b5e00640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T16:03:52.751 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:03:52 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-3[51069]: 2024-09-13T16:03:52.612+0000 7f26b0e00640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:03:52.840 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:52 smithi139 ceph-mon[35320]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:52.840 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:52 smithi139 ceph-mon[35320]: from='osd.3 [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T16:03:52.840 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:52 smithi139 ceph-mon[35320]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T16:03:52.840 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:52 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:03:52.840 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:52 smithi139 ceph-mon[35320]: from='osd.3 [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-13T16:03:53.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:52 smithi194 ceph-mon[35694]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:53.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:52 smithi194 ceph-mon[35694]: from='osd.3 [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T16:03:53.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:52 smithi194 ceph-mon[35694]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T16:03:53.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:03:53.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:52 smithi194 ceph-mon[35694]: from='osd.3 [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-13T16:03:53.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:53 smithi086 ceph-mon[30379]: from='osd.3 [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-13T16:03:53.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:53 smithi086 ceph-mon[30379]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T16:03:53.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:53 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:03:53.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:53 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:03:53.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:53 smithi086 ceph-mon[30379]: osd.3 [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096] boot 2024-09-13T16:03:53.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:53 smithi086 ceph-mon[30379]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T16:03:53.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:53 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:03:53.894 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:53 smithi139 ceph-mon[35320]: from='osd.3 [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-13T16:03:53.894 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:53 smithi139 ceph-mon[35320]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T16:03:53.894 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:53 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:03:53.894 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:53 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:03:53.894 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:53 smithi139 ceph-mon[35320]: osd.3 [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096] boot 2024-09-13T16:03:53.894 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:53 smithi139 ceph-mon[35320]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T16:03:53.894 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:53 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:03:54.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:53 smithi194 ceph-mon[35694]: from='osd.3 [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-13T16:03:54.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:53 smithi194 ceph-mon[35694]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T16:03:54.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:53 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:03:54.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:53 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:03:54.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:53 smithi194 ceph-mon[35694]: osd.3 [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096] boot 2024-09-13T16:03:54.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:53 smithi194 ceph-mon[35694]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T16:03:54.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:53 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:03:54.394 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T16:03:54.480 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T16:03:54.495 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2024-09-13T16:03:54.496 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2024-09-13T16:03:54.496 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.012586 s, 833 MB/s 2024-09-13T16:03:54.496 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2024-09-13T16:03:54.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:54 smithi086 ceph-mon[30379]: purged_snaps scrub starts 2024-09-13T16:03:54.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:54 smithi086 ceph-mon[30379]: purged_snaps scrub ok 2024-09-13T16:03:54.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:54 smithi086 ceph-mon[30379]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:54.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:54 smithi086 ceph-mon[30379]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T16:03:54.884 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:54 smithi139 ceph-mon[35320]: purged_snaps scrub starts 2024-09-13T16:03:54.884 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:54 smithi139 ceph-mon[35320]: purged_snaps scrub ok 2024-09-13T16:03:54.884 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:54 smithi139 ceph-mon[35320]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:54.884 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:54 smithi139 ceph-mon[35320]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T16:03:55.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:54 smithi194 ceph-mon[35694]: purged_snaps scrub starts 2024-09-13T16:03:55.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:54 smithi194 ceph-mon[35694]: purged_snaps scrub ok 2024-09-13T16:03:55.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:54 smithi194 ceph-mon[35694]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:03:55.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:54 smithi194 ceph-mon[35694]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T16:03:55.212 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_3 2024-09-13T16:03:55.409 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:03:56.699 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:56 smithi139 ceph-mon[35320]: pgmap v105: 1 pgs: 1 remapped+peering; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:03:56.699 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:56 smithi139 ceph-mon[35320]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T16:03:56.699 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:56 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:56.699 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:56 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:56.700 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:56 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:56.700 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:56 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:56.700 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:56 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:56.700 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:56 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:56.700 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:56 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:56.700 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:56 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:56.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:56 smithi194 ceph-mon[35694]: pgmap v105: 1 pgs: 1 remapped+peering; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:03:56.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:56 smithi194 ceph-mon[35694]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T16:03:56.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:56 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:56.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:56 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:56.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:56 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:56.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:56 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:56.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:56 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:56.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:56 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:56.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:56 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:56.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:56 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:56 smithi086 ceph-mon[30379]: pgmap v105: 1 pgs: 1 remapped+peering; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:03:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:56 smithi086 ceph-mon[30379]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T16:03:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:56 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:56 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:56 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:56 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:56 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:56.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:56 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:56.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:56 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:56.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:56 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:03:57.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.033+0000 7fea39b4c640 1 -- 172.21.15.139:0/2055253549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea34101920 msgr2=0x7fea34108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:57.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.033+0000 7fea39b4c640 1 --2- 172.21.15.139:0/2055253549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea34101920 0x7fea34108240 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fea2c009900 tx=0x7fea2c02a410 comp rx=0 tx=0).stop 2024-09-13T16:03:57.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.033+0000 7fea39b4c640 1 -- 172.21.15.139:0/2055253549 shutdown_connections 2024-09-13T16:03:57.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.033+0000 7fea39b4c640 1 --2- 172.21.15.139:0/2055253549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea34101920 0x7fea34108240 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:57.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.033+0000 7fea39b4c640 1 --2- 172.21.15.139:0/2055253549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea34100f60 0x7fea341013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:57.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.033+0000 7fea39b4c640 1 --2- 172.21.15.139:0/2055253549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea340ffe00 0x7fea34100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:57.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.033+0000 7fea39b4c640 1 -- 172.21.15.139:0/2055253549 >> 172.21.15.139:0/2055253549 conn(0x7fea340fb5d0 msgr2=0x7fea340fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:57.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.033+0000 7fea39b4c640 1 -- 172.21.15.139:0/2055253549 shutdown_connections 2024-09-13T16:03:57.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.033+0000 7fea39b4c640 1 -- 172.21.15.139:0/2055253549 wait complete. 2024-09-13T16:03:57.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.033+0000 7fea39b4c640 1 Processor -- start 2024-09-13T16:03:57.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.034+0000 7fea39b4c640 1 -- start start 2024-09-13T16:03:57.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.034+0000 7fea39b4c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea340ffe00 0x7fea34074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:57.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.034+0000 7fea39b4c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea34100f60 0x7fea340728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:57.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.034+0000 7fea39b4c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea34101920 0x7fea34072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:57.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.034+0000 7fea39b4c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea34073570 con 0x7fea340ffe00 2024-09-13T16:03:57.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.034+0000 7fea39b4c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea340736e0 con 0x7fea34101920 2024-09-13T16:03:57.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.034+0000 7fea39b4c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3419fe40 con 0x7fea34100f60 2024-09-13T16:03:57.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.034+0000 7fea33fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea34101920 0x7fea34072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:57.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.034+0000 7fea33fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea34101920 0x7fea34072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56082/0 (socket says 172.21.15.139:56082) 2024-09-13T16:03:57.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.034+0000 7fea33fff640 1 -- 172.21.15.139:0/3903727009 learned_addr learned my addr 172.21.15.139:0/3903727009 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T16:03:57.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.034+0000 7fea337fe640 1 --2- 172.21.15.139:0/3903727009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea340ffe00 0x7fea34074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:57.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.034+0000 7fea32ffd640 1 --2- 172.21.15.139:0/3903727009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea34100f60 0x7fea340728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:57.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.034+0000 7fea33fff640 1 -- 172.21.15.139:0/3903727009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea34100f60 msgr2=0x7fea340728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:57.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.034+0000 7fea33fff640 1 --2- 172.21.15.139:0/3903727009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea34100f60 0x7fea340728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:57.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.034+0000 7fea33fff640 1 -- 172.21.15.139:0/3903727009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea340ffe00 msgr2=0x7fea34074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:57.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.034+0000 7fea33fff640 1 --2- 172.21.15.139:0/3903727009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea340ffe00 0x7fea34074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:57.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.034+0000 7fea33fff640 1 -- 172.21.15.139:0/3903727009 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2c009560 con 0x7fea34101920 2024-09-13T16:03:57.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.034+0000 7fea33fff640 1 --2- 172.21.15.139:0/3903727009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea34101920 0x7fea34072de0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fea2c031a60 tx=0x7fea2c0043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:57.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.035+0000 7fea30ff9640 1 -- 172.21.15.139:0/3903727009 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c005210 con 0x7fea34101920 2024-09-13T16:03:57.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.035+0000 7fea30ff9640 1 -- 172.21.15.139:0/3903727009 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fea2c004ba0 con 0x7fea34101920 2024-09-13T16:03:57.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.035+0000 7fea39b4c640 1 -- 172.21.15.139:0/3903727009 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea341a0090 con 0x7fea34101920 2024-09-13T16:03:57.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.035+0000 7fea30ff9640 1 -- 172.21.15.139:0/3903727009 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c003b30 con 0x7fea34101920 2024-09-13T16:03:57.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.035+0000 7fea39b4c640 1 -- 172.21.15.139:0/3903727009 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea341a0530 con 0x7fea34101920 2024-09-13T16:03:57.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.036+0000 7fea39b4c640 1 -- 172.21.15.139:0/3903727009 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea341071c0 con 0x7fea34101920 2024-09-13T16:03:57.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.037+0000 7fea30ff9640 1 -- 172.21.15.139:0/3903727009 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fea2c003c90 con 0x7fea34101920 2024-09-13T16:03:57.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.038+0000 7fea30ff9640 1 --2- 172.21.15.139:0/3903727009 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fea1c0a1080 0x7fea1c0a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:57.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.038+0000 7fea30ff9640 1 -- 172.21.15.139:0/3903727009 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3669+0+0 (secure 0 0 0) 0x7fea2c0ec300 con 0x7fea34101920 2024-09-13T16:03:57.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.038+0000 7fea337fe640 1 --2- 172.21.15.139:0/3903727009 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fea1c0a1080 0x7fea1c0a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:57.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.038+0000 7fea337fe640 1 --2- 172.21.15.139:0/3903727009 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fea1c0a1080 0x7fea1c0a3540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fea24005fd0 tx=0x7fea24009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:57.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.042+0000 7fea30ff9640 1 -- 172.21.15.139:0/3903727009 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fea2c0b6d60 con 0x7fea34101920 2024-09-13T16:03:57.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:03:57.210+0000 7fea39b4c640 1 -- 172.21.15.139:0/3903727009 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fea3402c450 con 0x7fea1c0a1080 2024-09-13T16:03:57.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:57 smithi139 ceph-mon[35320]: Detected new or changed devices on smithi086 2024-09-13T16:03:57.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:57 smithi139 ceph-mon[35320]: Adjusting osd_memory_target on smithi086 to 8544M 2024-09-13T16:03:57.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:57 smithi139 ceph-mon[35320]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T16:03:57.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:57 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:03:57.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:57 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:03:57.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:57 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:57.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:57 smithi139 ceph-mon[35320]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T16:03:57.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:57 smithi194 ceph-mon[35694]: Detected new or changed devices on smithi086 2024-09-13T16:03:57.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:57 smithi194 ceph-mon[35694]: Adjusting osd_memory_target on smithi086 to 8544M 2024-09-13T16:03:57.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:57 smithi194 ceph-mon[35694]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T16:03:57.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:57 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:03:57.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:57 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:03:57.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:57 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:57.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:57 smithi194 ceph-mon[35694]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T16:03:57.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:57 smithi086 ceph-mon[30379]: Detected new or changed devices on smithi086 2024-09-13T16:03:57.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:57 smithi086 ceph-mon[30379]: Adjusting osd_memory_target on smithi086 to 8544M 2024-09-13T16:03:57.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:57 smithi086 ceph-mon[30379]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T16:03:57.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:57 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:03:57.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:57 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:03:57.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:57 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:57.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:57 smithi086 ceph-mon[30379]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T16:03:58.550 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:58 smithi139 ceph-mon[35320]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:03:58.550 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:03:58 smithi139 ceph-mon[35320]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:03:58.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:58 smithi086 ceph-mon[30379]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:03:58.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:03:58 smithi086 ceph-mon[30379]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:03:58.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:58 smithi194 ceph-mon[35694]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:03:58.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:03:58 smithi194 ceph-mon[35694]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:04:00.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:00 smithi139 ceph-mon[35320]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:04:00.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:00 smithi139 ceph-mon[35320]: from='client.? 172.21.15.139:0/1801629232' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9e36a79-e2ce-4639-8aa0-5c231156fe58"}]: dispatch 2024-09-13T16:04:00.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:00 smithi139 ceph-mon[35320]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9e36a79-e2ce-4639-8aa0-5c231156fe58"}]: dispatch 2024-09-13T16:04:00.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:00 smithi139 ceph-mon[35320]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9e36a79-e2ce-4639-8aa0-5c231156fe58"}]': finished 2024-09-13T16:04:00.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:00 smithi139 ceph-mon[35320]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T16:04:00.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:04:00.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:00 smithi139 ceph-mon[35320]: from='client.? 172.21.15.139:0/570700609' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:04:00.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:00 smithi194 ceph-mon[35694]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:04:00.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:00 smithi194 ceph-mon[35694]: from='client.? 172.21.15.139:0/1801629232' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9e36a79-e2ce-4639-8aa0-5c231156fe58"}]: dispatch 2024-09-13T16:04:00.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:00 smithi194 ceph-mon[35694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9e36a79-e2ce-4639-8aa0-5c231156fe58"}]: dispatch 2024-09-13T16:04:00.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:00 smithi194 ceph-mon[35694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9e36a79-e2ce-4639-8aa0-5c231156fe58"}]': finished 2024-09-13T16:04:00.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:00 smithi194 ceph-mon[35694]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T16:04:00.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:04:00.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:00 smithi194 ceph-mon[35694]: from='client.? 172.21.15.139:0/570700609' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:04:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:00 smithi086 ceph-mon[30379]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:04:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:00 smithi086 ceph-mon[30379]: from='client.? 172.21.15.139:0/1801629232' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9e36a79-e2ce-4639-8aa0-5c231156fe58"}]: dispatch 2024-09-13T16:04:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:00 smithi086 ceph-mon[30379]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9e36a79-e2ce-4639-8aa0-5c231156fe58"}]: dispatch 2024-09-13T16:04:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:00 smithi086 ceph-mon[30379]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9e36a79-e2ce-4639-8aa0-5c231156fe58"}]': finished 2024-09-13T16:04:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:00 smithi086 ceph-mon[30379]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T16:04:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:04:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:00 smithi086 ceph-mon[30379]: from='client.? 172.21.15.139:0/570700609' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:04:02.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:02 smithi139 ceph-mon[35320]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-13T16:04:02.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:02 smithi194 ceph-mon[35694]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-13T16:04:02.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:02 smithi086 ceph-mon[30379]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-13T16:04:04.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:04 smithi139 ceph-mon[35320]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-13T16:04:04.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:04 smithi194 ceph-mon[35694]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-13T16:04:04.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:04 smithi086 ceph-mon[30379]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-13T16:04:06.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:06 smithi139 ceph-mon[35320]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T16:04:06.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:06 smithi194 ceph-mon[35694]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T16:04:06.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:06 smithi086 ceph-mon[30379]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T16:04:07.729 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:07 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T16:04:07.729 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:07 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:07.729 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:07 smithi139 ceph-mon[35320]: Deploying daemon osd.4 on smithi139 2024-09-13T16:04:07.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:07 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T16:04:07.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:07 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:07.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:07 smithi194 ceph-mon[35694]: Deploying daemon osd.4 on smithi139 2024-09-13T16:04:07.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:07 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T16:04:07.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:07 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:07.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:07 smithi086 ceph-mon[30379]: Deploying daemon osd.4 on smithi139 2024-09-13T16:04:08.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:08 smithi139 ceph-mon[35320]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T16:04:08.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:08 smithi194 ceph-mon[35694]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T16:04:08.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:08 smithi086 ceph-mon[30379]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T16:04:10.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:10 smithi139 ceph-mon[35320]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T16:04:10.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:10 smithi194 ceph-mon[35694]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T16:04:10.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:10 smithi086 ceph-mon[30379]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T16:04:11.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:11 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:04:11.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:11 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:11.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:11 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:11.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:11 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:04:11.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:11 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:11.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:11 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:11.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:11 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:04:11.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:11 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:11.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:11 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:12.728 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:12 smithi139 ceph-mon[35320]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-13T16:04:12.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:12 smithi194 ceph-mon[35694]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-13T16:04:12.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:12 smithi086 ceph-mon[30379]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-13T16:04:14.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:04:14.084+0000 7fea30ff9640 1 -- 172.21.15.139:0/3903727009 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fea3402c450 con 0x7fea1c0a1080 2024-09-13T16:04:14.085 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 4 on host 'smithi139' 2024-09-13T16:04:14.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:04:14.086+0000 7fea39b4c640 1 -- 172.21.15.139:0/3903727009 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fea1c0a1080 msgr2=0x7fea1c0a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:14.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:04:14.086+0000 7fea39b4c640 1 --2- 172.21.15.139:0/3903727009 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fea1c0a1080 0x7fea1c0a3540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fea24005fd0 tx=0x7fea24009680 comp rx=0 tx=0).stop 2024-09-13T16:04:14.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:04:14.086+0000 7fea39b4c640 1 -- 172.21.15.139:0/3903727009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea34101920 msgr2=0x7fea34072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:14.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:04:14.086+0000 7fea39b4c640 1 --2- 172.21.15.139:0/3903727009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea34101920 0x7fea34072de0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fea2c031a60 tx=0x7fea2c0043b0 comp rx=0 tx=0).stop 2024-09-13T16:04:14.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:04:14.086+0000 7fea39b4c640 1 -- 172.21.15.139:0/3903727009 shutdown_connections 2024-09-13T16:04:14.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:04:14.086+0000 7fea39b4c640 1 --2- 172.21.15.139:0/3903727009 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fea1c0a1080 0x7fea1c0a3540 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:14.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:04:14.086+0000 7fea39b4c640 1 --2- 172.21.15.139:0/3903727009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea34101920 0x7fea34072de0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:14.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:04:14.086+0000 7fea39b4c640 1 --2- 172.21.15.139:0/3903727009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea34100f60 0x7fea340728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:14.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:04:14.086+0000 7fea39b4c640 1 --2- 172.21.15.139:0/3903727009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea340ffe00 0x7fea34074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:14.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:04:14.086+0000 7fea39b4c640 1 -- 172.21.15.139:0/3903727009 >> 172.21.15.139:0/3903727009 conn(0x7fea340fb5d0 msgr2=0x7fea34104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:14.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:04:14.086+0000 7fea39b4c640 1 -- 172.21.15.139:0/3903727009 shutdown_connections 2024-09-13T16:04:14.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:04:14.086+0000 7fea39b4c640 1 -- 172.21.15.139:0/3903727009 wait complete. 2024-09-13T16:04:14.599 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:14 smithi139 ceph-mon[35320]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:04:14.599 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:14 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:14.599 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:14 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:14 smithi194 ceph-mon[35694]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:04:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:14 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:14 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:14.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:14 smithi086 ceph-mon[30379]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:04:14.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:14 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:14.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:14 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:15.272 DEBUG:teuthology.orchestra.run.smithi139:osd.4> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.4.service 2024-09-13T16:04:15.274 INFO:tasks.cephadm:Deploying osd.5 on smithi194 with /dev/vg_nvme/lv_3... 2024-09-13T16:04:15.275 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T16:04:15.485 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:04:15.605 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:15 smithi194 ceph-mon[35694]: from='osd.4 [v2:172.21.15.139:6808/2161852608,v1:172.21.15.139:6809/2161852608]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T16:04:15.606 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:15 smithi194 ceph-mon[35694]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T16:04:15.606 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:15 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:15.606 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:15 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:15.722 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:15 smithi139 ceph-mon[35320]: from='osd.4 [v2:172.21.15.139:6808/2161852608,v1:172.21.15.139:6809/2161852608]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T16:04:15.722 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:15 smithi139 ceph-mon[35320]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T16:04:15.722 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:15 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:15.722 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:15 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:15.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:15 smithi086 ceph-mon[30379]: from='osd.4 [v2:172.21.15.139:6808/2161852608,v1:172.21.15.139:6809/2161852608]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T16:04:15.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:15 smithi086 ceph-mon[30379]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T16:04:15.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:15 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:15.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:15 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:16.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:16 smithi139 ceph-mon[35320]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:04:16.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:16 smithi139 ceph-mon[35320]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T16:04:16.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:16 smithi139 ceph-mon[35320]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T16:04:16.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:16 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:04:16.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:16 smithi139 ceph-mon[35320]: from='osd.4 [v2:172.21.15.139:6808/2161852608,v1:172.21.15.139:6809/2161852608]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:04:16.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:16 smithi139 ceph-mon[35320]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:04:16.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:16 smithi194 ceph-mon[35694]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:04:16.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:16 smithi194 ceph-mon[35694]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T16:04:16.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:16 smithi194 ceph-mon[35694]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T16:04:16.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:16 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:04:16.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:16 smithi194 ceph-mon[35694]: from='osd.4 [v2:172.21.15.139:6808/2161852608,v1:172.21.15.139:6809/2161852608]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:04:16.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:16 smithi194 ceph-mon[35694]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:04:16.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:16 smithi086 ceph-mon[30379]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:04:16.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:16 smithi086 ceph-mon[30379]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T16:04:16.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:16 smithi086 ceph-mon[30379]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T16:04:16.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:04:16.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:16 smithi086 ceph-mon[30379]: from='osd.4 [v2:172.21.15.139:6808/2161852608,v1:172.21.15.139:6809/2161852608]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:04:16.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:16 smithi086 ceph-mon[30379]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:04:17.277 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:04:17 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-4[46222]: 2024-09-13T16:04:17.163+0000 7f7cc6b1d640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T16:04:17.278 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:04:17 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-4[46222]: 2024-09-13T16:04:17.169+0000 7f7cbe93e640 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:04:17.286 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T16:04:17.377 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T16:04:17.394 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2024-09-13T16:04:17.394 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2024-09-13T16:04:17.394 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.015379 s, 682 MB/s 2024-09-13T16:04:17.394 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2024-09-13T16:04:17.695 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:17 smithi194 ceph-mon[35694]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-13T16:04:17.695 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:17 smithi194 ceph-mon[35694]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T16:04:17.695 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:17 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:04:17.695 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:17 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:04:17.695 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:17 smithi194 ceph-mon[35694]: from='osd.4 ' entity='osd.4' 2024-09-13T16:04:17.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:17 smithi139 ceph-mon[35320]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-13T16:04:17.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:17 smithi139 ceph-mon[35320]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T16:04:17.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:17 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:04:17.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:17 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:04:17.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:17 smithi139 ceph-mon[35320]: from='osd.4 ' entity='osd.4' 2024-09-13T16:04:17.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:17 smithi086 ceph-mon[30379]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-13T16:04:17.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:17 smithi086 ceph-mon[30379]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T16:04:17.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:17 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:04:17.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:17 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:04:17.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:17 smithi086 ceph-mon[30379]: from='osd.4 ' entity='osd.4' 2024-09-13T16:04:17.993 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_3 2024-09-13T16:04:18.196 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:04:18.582 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:18 smithi194 ceph-mon[35694]: purged_snaps scrub starts 2024-09-13T16:04:18.582 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:18 smithi194 ceph-mon[35694]: purged_snaps scrub ok 2024-09-13T16:04:18.583 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:18 smithi194 ceph-mon[35694]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:04:18.583 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:18 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:04:18.583 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:18 smithi194 ceph-mon[35694]: osd.4 [v2:172.21.15.139:6808/2161852608,v1:172.21.15.139:6809/2161852608] boot 2024-09-13T16:04:18.583 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:18 smithi194 ceph-mon[35694]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T16:04:18.583 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:18 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:04:18.583 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:18 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:18.583 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:18 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:18.583 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:18 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:18.583 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:18 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:18.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:18 smithi139 ceph-mon[35320]: purged_snaps scrub starts 2024-09-13T16:04:18.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:18 smithi139 ceph-mon[35320]: purged_snaps scrub ok 2024-09-13T16:04:18.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:18 smithi139 ceph-mon[35320]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:04:18.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:18 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:04:18.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:18 smithi139 ceph-mon[35320]: osd.4 [v2:172.21.15.139:6808/2161852608,v1:172.21.15.139:6809/2161852608] boot 2024-09-13T16:04:18.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:18 smithi139 ceph-mon[35320]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T16:04:18.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:18 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:04:18.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:18 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:18.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:18 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:18.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:18 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:18.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:18 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:18.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:18 smithi086 ceph-mon[30379]: purged_snaps scrub starts 2024-09-13T16:04:18.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:18 smithi086 ceph-mon[30379]: purged_snaps scrub ok 2024-09-13T16:04:18.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:18 smithi086 ceph-mon[30379]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:04:18.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:18 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:04:18.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:18 smithi086 ceph-mon[30379]: osd.4 [v2:172.21.15.139:6808/2161852608,v1:172.21.15.139:6809/2161852608] boot 2024-09-13T16:04:18.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:18 smithi086 ceph-mon[30379]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T16:04:18.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:18 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:04:18.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:18 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:18.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:18 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:18.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:18 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:18.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:18 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:19.589 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:19 smithi194 ceph-mon[35694]: Detected new or changed devices on smithi139 2024-09-13T16:04:19.589 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:19 smithi194 ceph-mon[35694]: Adjusting osd_memory_target on smithi139 to 8544M 2024-09-13T16:04:19.589 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:19 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:19.589 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:19 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:19.589 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:19 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:04:19.589 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:19 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:19.589 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:19 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:04:19.589 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:19 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:19.589 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:19 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:04:19.589 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:19 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:19.590 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:19 smithi194 ceph-mon[35694]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T16:04:19.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:19 smithi139 ceph-mon[35320]: Detected new or changed devices on smithi139 2024-09-13T16:04:19.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:19 smithi139 ceph-mon[35320]: Adjusting osd_memory_target on smithi139 to 8544M 2024-09-13T16:04:19.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:19 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:19.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:19 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:19.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:19 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:04:19.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:19 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:19.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:19 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:04:19.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:19 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:19.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:19 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:04:19.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:19 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:19.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:19 smithi139 ceph-mon[35320]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T16:04:19.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.802+0000 7f97938c5640 1 -- 172.21.15.194:0/3642653436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978c100f60 msgr2=0x7f978c1013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:19.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.802+0000 7f97938c5640 1 --2- 172.21.15.194:0/3642653436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978c100f60 0x7f978c1013e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9780009900 tx=0x7f978002a410 comp rx=0 tx=0).stop 2024-09-13T16:04:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.802+0000 7f97938c5640 1 -- 172.21.15.194:0/3642653436 shutdown_connections 2024-09-13T16:04:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.802+0000 7f97938c5640 1 --2- 172.21.15.194:0/3642653436 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f978c101920 0x7f978c108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.802+0000 7f97938c5640 1 --2- 172.21.15.194:0/3642653436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978c100f60 0x7f978c1013e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.802+0000 7f97938c5640 1 --2- 172.21.15.194:0/3642653436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f978c0ffe00 0x7f978c100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.802+0000 7f97938c5640 1 -- 172.21.15.194:0/3642653436 >> 172.21.15.194:0/3642653436 conn(0x7f978c0fb5d0 msgr2=0x7f978c0fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.802+0000 7f97938c5640 1 -- 172.21.15.194:0/3642653436 shutdown_connections 2024-09-13T16:04:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.802+0000 7f97938c5640 1 -- 172.21.15.194:0/3642653436 wait complete. 2024-09-13T16:04:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.802+0000 7f97938c5640 1 Processor -- start 2024-09-13T16:04:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.802+0000 7f97938c5640 1 -- start start 2024-09-13T16:04:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f97938c5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f978c0ffe00 0x7f978c195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f97938c5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f978c100f60 0x7f978c1963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f97938c5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978c101920 0x7f978c19d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:19.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f97938c5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c19d990 con 0x7f978c0ffe00 2024-09-13T16:04:19.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f97938c5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c19db00 con 0x7f978c100f60 2024-09-13T16:04:19.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f97938c5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c19dcc0 con 0x7f978c101920 2024-09-13T16:04:19.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f9791e62640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978c101920 0x7f978c19d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:19.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f9791e62640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978c101920 0x7f978c19d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60422/0 (socket says 172.21.15.194:60422) 2024-09-13T16:04:19.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f9791e62640 1 -- 172.21.15.194:0/1283275308 learned_addr learned my addr 172.21.15.194:0/1283275308 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T16:04:19.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f9790e60640 1 --2- 172.21.15.194:0/1283275308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f978c100f60 0x7f978c1963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:19.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f9791661640 1 --2- 172.21.15.194:0/1283275308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f978c0ffe00 0x7f978c195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:19.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f9791e62640 1 -- 172.21.15.194:0/1283275308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f978c100f60 msgr2=0x7f978c1963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:19.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f9791e62640 1 --2- 172.21.15.194:0/1283275308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f978c100f60 0x7f978c1963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:19.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f9791e62640 1 -- 172.21.15.194:0/1283275308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f978c0ffe00 msgr2=0x7f978c195e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:19.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f9791e62640 1 --2- 172.21.15.194:0/1283275308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f978c0ffe00 0x7f978c195e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:19.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f9791e62640 1 -- 172.21.15.194:0/1283275308 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9780009560 con 0x7f978c101920 2024-09-13T16:04:19.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f9791661640 1 --2- 172.21.15.194:0/1283275308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f978c0ffe00 0x7f978c195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:04:19.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f9791e62640 1 --2- 172.21.15.194:0/1283275308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978c101920 0x7f978c19d450 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f978400eaa0 tx=0x7f978400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:19.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f978a7fc640 1 -- 172.21.15.194:0/1283275308 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978400cdb0 con 0x7f978c101920 2024-09-13T16:04:19.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f97938c5640 1 -- 172.21.15.194:0/1283275308 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978c19dfa0 con 0x7f978c101920 2024-09-13T16:04:19.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f978a7fc640 1 -- 172.21.15.194:0/1283275308 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9784005020 con 0x7f978c101920 2024-09-13T16:04:19.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f978a7fc640 1 -- 172.21.15.194:0/1283275308 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840116b0 con 0x7f978c101920 2024-09-13T16:04:19.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.803+0000 7f97938c5640 1 -- 172.21.15.194:0/1283275308 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978c19e410 con 0x7f978c101920 2024-09-13T16:04:19.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.805+0000 7f97938c5640 1 -- 172.21.15.194:0/1283275308 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978c107210 con 0x7f978c101920 2024-09-13T16:04:19.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.806+0000 7f978a7fc640 1 -- 172.21.15.194:0/1283275308 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9784005520 con 0x7f978c101920 2024-09-13T16:04:19.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.806+0000 7f978a7fc640 1 --2- 172.21.15.194:0/1283275308 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f97740a10b0 0x7f97740a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:19.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.806+0000 7f978a7fc640 1 -- 172.21.15.194:0/1283275308 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f97840cbb70 con 0x7f978c101920 2024-09-13T16:04:19.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.806+0000 7f9791661640 1 --2- 172.21.15.194:0/1283275308 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f97740a10b0 0x7f97740a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:19.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.807+0000 7f9791661640 1 --2- 172.21.15.194:0/1283275308 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f97740a10b0 0x7f97740a3570 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f977c009b40 tx=0x7f977c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:19.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.810+0000 7f978a7fc640 1 -- 172.21.15.194:0/1283275308 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9784096370 con 0x7f978c101920 2024-09-13T16:04:19.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:19 smithi086 ceph-mon[30379]: Detected new or changed devices on smithi139 2024-09-13T16:04:19.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:19 smithi086 ceph-mon[30379]: Adjusting osd_memory_target on smithi139 to 8544M 2024-09-13T16:04:19.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:19 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:19.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:19 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:19.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:19 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:04:19.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:19 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:19.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:19 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:04:19.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:19 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:19.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:19 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:04:19.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:19 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:19.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:19 smithi086 ceph-mon[30379]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T16:04:19.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:19.982+0000 7f97938c5640 1 -- 172.21.15.194:0/1283275308 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f978c02c480 con 0x7f97740a10b0 2024-09-13T16:04:20.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:20 smithi194 ceph-mon[35694]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:20.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:20 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:04:20.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:20 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:04:20.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:20 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:20.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:20 smithi086 ceph-mon[30379]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:20.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:20 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:04:20.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:20 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:04:20.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:20 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:20.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:20 smithi139 ceph-mon[35320]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:20.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:20 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:04:20.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:20 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:04:20.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:20 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:21.576 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:21 smithi194 ceph-mon[35694]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:04:21.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:21 smithi086 ceph-mon[30379]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:04:21.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:21 smithi139 ceph-mon[35320]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:04:22.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:22 smithi194 ceph-mon[35694]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:22.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:22 smithi194 ceph-mon[35694]: from='client.? 172.21.15.194:0/299639108' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8564481f-4357-4cdb-ad3f-ce793ce8d590"}]: dispatch 2024-09-13T16:04:22.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:22 smithi194 ceph-mon[35694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8564481f-4357-4cdb-ad3f-ce793ce8d590"}]: dispatch 2024-09-13T16:04:22.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:22 smithi194 ceph-mon[35694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8564481f-4357-4cdb-ad3f-ce793ce8d590"}]': finished 2024-09-13T16:04:22.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:22 smithi194 ceph-mon[35694]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T16:04:22.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:22 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:04:22.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:22 smithi086 ceph-mon[30379]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:22.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:22 smithi086 ceph-mon[30379]: from='client.? 172.21.15.194:0/299639108' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8564481f-4357-4cdb-ad3f-ce793ce8d590"}]: dispatch 2024-09-13T16:04:22.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:22 smithi086 ceph-mon[30379]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8564481f-4357-4cdb-ad3f-ce793ce8d590"}]: dispatch 2024-09-13T16:04:22.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:22 smithi086 ceph-mon[30379]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8564481f-4357-4cdb-ad3f-ce793ce8d590"}]': finished 2024-09-13T16:04:22.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:22 smithi086 ceph-mon[30379]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T16:04:22.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:22 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:04:22.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:22 smithi139 ceph-mon[35320]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:22.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:22 smithi139 ceph-mon[35320]: from='client.? 172.21.15.194:0/299639108' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8564481f-4357-4cdb-ad3f-ce793ce8d590"}]: dispatch 2024-09-13T16:04:22.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:22 smithi139 ceph-mon[35320]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8564481f-4357-4cdb-ad3f-ce793ce8d590"}]: dispatch 2024-09-13T16:04:22.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:22 smithi139 ceph-mon[35320]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8564481f-4357-4cdb-ad3f-ce793ce8d590"}]': finished 2024-09-13T16:04:22.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:22 smithi139 ceph-mon[35320]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T16:04:22.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:22 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:04:23.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:23 smithi086 ceph-mon[30379]: from='client.? 172.21.15.194:0/1843450436' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:04:23.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:23 smithi139 ceph-mon[35320]: from='client.? 172.21.15.194:0/1843450436' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:04:24.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:23 smithi194 ceph-mon[35694]: from='client.? 172.21.15.194:0/1843450436' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:04:24.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:24 smithi086 ceph-mon[30379]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:24.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:24 smithi139 ceph-mon[35320]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:25.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:24 smithi194 ceph-mon[35694]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:26.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:26 smithi194 ceph-mon[35694]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:26.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:26 smithi086 ceph-mon[30379]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:26.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:26 smithi139 ceph-mon[35320]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:28 smithi194 ceph-mon[35694]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:28.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:28 smithi086 ceph-mon[30379]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:28.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:28 smithi139 ceph-mon[35320]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:29.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:29 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T16:04:29.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:29 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:29.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:29 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T16:04:29.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:29 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:29.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:29 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T16:04:29.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:29 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:30 smithi194 ceph-mon[35694]: Deploying daemon osd.5 on smithi194 2024-09-13T16:04:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:30 smithi194 ceph-mon[35694]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:30 smithi086 ceph-mon[30379]: Deploying daemon osd.5 on smithi194 2024-09-13T16:04:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:30 smithi086 ceph-mon[30379]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:30.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:30 smithi139 ceph-mon[35320]: Deploying daemon osd.5 on smithi194 2024-09-13T16:04:30.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:30 smithi139 ceph-mon[35320]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:32 smithi194 ceph-mon[35694]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:32 smithi086 ceph-mon[30379]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:32.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:32 smithi139 ceph-mon[35320]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:34.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:34 smithi194 ceph-mon[35694]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:34.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:34 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:04:34.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:34 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:34.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:34 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:34.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:34 smithi086 ceph-mon[30379]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:34.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:34 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:04:34.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:34 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:34.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:34 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:35.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:34 smithi139 ceph-mon[35320]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:35.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:34 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:04:35.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:34 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:35.002 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:34 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:36.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:36 smithi194 ceph-mon[35694]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:36.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:36 smithi086 ceph-mon[30379]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:36.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:36 smithi139 ceph-mon[35320]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:37.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:37.310+0000 7f978a7fc640 1 -- 172.21.15.194:0/1283275308 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f978c02c480 con 0x7f97740a10b0 2024-09-13T16:04:37.312 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 5 on host 'smithi194' 2024-09-13T16:04:37.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:37.312+0000 7f97938c5640 1 -- 172.21.15.194:0/1283275308 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f97740a10b0 msgr2=0x7f97740a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:37.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:37.312+0000 7f97938c5640 1 --2- 172.21.15.194:0/1283275308 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f97740a10b0 0x7f97740a3570 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f977c009b40 tx=0x7f977c005e50 comp rx=0 tx=0).stop 2024-09-13T16:04:37.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:37.312+0000 7f97938c5640 1 -- 172.21.15.194:0/1283275308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978c101920 msgr2=0x7f978c19d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:37.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:37.312+0000 7f97938c5640 1 --2- 172.21.15.194:0/1283275308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978c101920 0x7f978c19d450 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f978400eaa0 tx=0x7f978400ef60 comp rx=0 tx=0).stop 2024-09-13T16:04:37.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:37.312+0000 7f97938c5640 1 -- 172.21.15.194:0/1283275308 shutdown_connections 2024-09-13T16:04:37.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:37.312+0000 7f97938c5640 1 --2- 172.21.15.194:0/1283275308 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f97740a10b0 0x7f97740a3570 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:37.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:37.312+0000 7f97938c5640 1 --2- 172.21.15.194:0/1283275308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978c101920 0x7f978c19d450 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:37.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:37.312+0000 7f97938c5640 1 --2- 172.21.15.194:0/1283275308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f978c100f60 0x7f978c1963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:37.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:37.312+0000 7f97938c5640 1 --2- 172.21.15.194:0/1283275308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f978c0ffe00 0x7f978c195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:37.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:37.312+0000 7f97938c5640 1 -- 172.21.15.194:0/1283275308 >> 172.21.15.194:0/1283275308 conn(0x7f978c0fb5d0 msgr2=0x7f978c1043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:37.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:37.312+0000 7f97938c5640 1 -- 172.21.15.194:0/1283275308 shutdown_connections 2024-09-13T16:04:37.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:04:37.312+0000 7f97938c5640 1 -- 172.21.15.194:0/1283275308 wait complete. 2024-09-13T16:04:38.083 DEBUG:teuthology.orchestra.run.smithi194:osd.5> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.5.service 2024-09-13T16:04:38.085 INFO:tasks.cephadm:Deploying osd.6 on smithi086 with /dev/vg_nvme/lv_2... 2024-09-13T16:04:38.085 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T16:04:38.400 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:38 smithi194 ceph-mon[35694]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:38.401 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:38 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:38.401 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:38 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:38.401 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:38 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:38.401 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:38 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:38.401 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:38 smithi194 ceph-mon[35694]: from='osd.5 [v2:172.21.15.194:6808/290656117,v1:172.21.15.194:6809/290656117]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T16:04:38.401 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:38 smithi194 ceph-mon[35694]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T16:04:38.405 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:04:38.542 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:38 smithi086 ceph-mon[30379]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:38.542 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:38 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:38.542 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:38 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:38.542 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:38 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:38.542 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:38 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:38.542 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:38 smithi086 ceph-mon[30379]: from='osd.5 [v2:172.21.15.194:6808/290656117,v1:172.21.15.194:6809/290656117]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T16:04:38.542 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:38 smithi086 ceph-mon[30379]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T16:04:38.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:38 smithi139 ceph-mon[35320]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:38.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:38 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:38.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:38 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:38.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:38 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:38.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:38 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:38.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:38 smithi139 ceph-mon[35320]: from='osd.5 [v2:172.21.15.194:6808/290656117,v1:172.21.15.194:6809/290656117]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T16:04:38.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:38 smithi139 ceph-mon[35320]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T16:04:39.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:39 smithi139 ceph-mon[35320]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T16:04:39.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:39 smithi139 ceph-mon[35320]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T16:04:39.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:39 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:04:39.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:39 smithi139 ceph-mon[35320]: from='osd.5 [v2:172.21.15.194:6808/290656117,v1:172.21.15.194:6809/290656117]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:04:39.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:39 smithi139 ceph-mon[35320]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:04:39.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:39 smithi139 ceph-mon[35320]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:40.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:39 smithi194 ceph-mon[35694]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T16:04:40.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:39 smithi194 ceph-mon[35694]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T16:04:40.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:39 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:04:40.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:39 smithi194 ceph-mon[35694]: from='osd.5 [v2:172.21.15.194:6808/290656117,v1:172.21.15.194:6809/290656117]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:04:40.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:39 smithi194 ceph-mon[35694]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:04:40.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:39 smithi194 ceph-mon[35694]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:40.019 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:39 smithi086 ceph-mon[30379]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T16:04:40.019 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:39 smithi086 ceph-mon[30379]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T16:04:40.019 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:39 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:04:40.019 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:39 smithi086 ceph-mon[30379]: from='osd.5 [v2:172.21.15.194:6808/290656117,v1:172.21.15.194:6809/290656117]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:04:40.020 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:39 smithi086 ceph-mon[30379]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:04:40.020 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:39 smithi086 ceph-mon[30379]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:04:40.725 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:04:40 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5[47572]: 2024-09-13T16:04:40.413+0000 7f44dd3be640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T16:04:40.725 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:04:40 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5[47572]: 2024-09-13T16:04:40.422+0000 7f44d51df640 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:04:40.737 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T16:04:40.903 INFO:teuthology.orchestra.run.smithi086.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T16:04:40.936 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10+0 records in 2024-09-13T16:04:40.936 INFO:teuthology.orchestra.run.smithi086.stderr:10+0 records out 2024-09-13T16:04:40.936 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0277645 s, 378 MB/s 2024-09-13T16:04:40.936 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping successful for: 2024-09-13T16:04:40.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:40 smithi139 ceph-mon[35320]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-13T16:04:40.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:40 smithi139 ceph-mon[35320]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T16:04:40.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:40 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:04:40.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:40 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:04:40.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:40 smithi139 ceph-mon[35320]: from='osd.5 ' entity='osd.5' 2024-09-13T16:04:41.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:40 smithi194 ceph-mon[35694]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-13T16:04:41.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:40 smithi194 ceph-mon[35694]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T16:04:41.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:40 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:04:41.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:40 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:04:41.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:40 smithi194 ceph-mon[35694]: from='osd.5 ' entity='osd.5' 2024-09-13T16:04:41.008 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:40 smithi086 ceph-mon[30379]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-13T16:04:41.008 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:40 smithi086 ceph-mon[30379]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T16:04:41.009 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:40 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:04:41.009 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:40 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:04:41.009 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:40 smithi086 ceph-mon[30379]: from='osd.5 ' entity='osd.5' 2024-09-13T16:04:41.724 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi086:vg_nvme/lv_2 2024-09-13T16:04:41.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: purged_snaps scrub starts 2024-09-13T16:04:41.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: purged_snaps scrub ok 2024-09-13T16:04:41.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: osd.5 [v2:172.21.15.194:6808/290656117,v1:172.21.15.194:6809/290656117] boot 2024-09-13T16:04:41.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T16:04:41.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:04:41.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: Detected new or changed devices on smithi194 2024-09-13T16:04:41.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:41.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:41.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:41.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:42.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: Adjusting osd_memory_target on smithi194 to 8544M 2024-09-13T16:04:42.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:42.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:42.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:04:42.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:42.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 438 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:04:42.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:04:42.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:42.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:04:42.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:42.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:41 smithi139 ceph-mon[35320]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T16:04:42.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: purged_snaps scrub starts 2024-09-13T16:04:42.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: purged_snaps scrub ok 2024-09-13T16:04:42.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: osd.5 [v2:172.21.15.194:6808/290656117,v1:172.21.15.194:6809/290656117] boot 2024-09-13T16:04:42.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T16:04:42.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:04:42.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: Detected new or changed devices on smithi194 2024-09-13T16:04:42.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:42.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: Adjusting osd_memory_target on smithi194 to 8544M 2024-09-13T16:04:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:04:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 438 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:04:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:04:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:04:42.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:42.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:41 smithi194 ceph-mon[35694]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T16:04:42.032 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:04:42.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: purged_snaps scrub starts 2024-09-13T16:04:42.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: purged_snaps scrub ok 2024-09-13T16:04:42.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: osd.5 [v2:172.21.15.194:6808/290656117,v1:172.21.15.194:6809/290656117] boot 2024-09-13T16:04:42.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T16:04:42.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:04:42.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: Detected new or changed devices on smithi194 2024-09-13T16:04:42.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:42.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:42.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:42.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:42.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: Adjusting osd_memory_target on smithi194 to 8544M 2024-09-13T16:04:42.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:42.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:42.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:04:42.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:42.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 438 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:04:42.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:04:42.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:42.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:04:42.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:04:42.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:41 smithi086 ceph-mon[30379]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T16:04:43.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:43 smithi139 ceph-mon[35320]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T16:04:43.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:43 smithi139 ceph-mon[35320]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 438 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:04:43.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:43 smithi139 ceph-mon[35320]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T16:04:44.005 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:43 smithi086 ceph-mon[30379]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T16:04:44.005 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:43 smithi086 ceph-mon[30379]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 438 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:04:44.005 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:43 smithi086 ceph-mon[30379]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T16:04:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:43 smithi194 ceph-mon[35694]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T16:04:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:43 smithi194 ceph-mon[35694]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 438 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:04:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:43 smithi194 ceph-mon[35694]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T16:04:44.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.117+0000 7f7afca00640 1 -- 172.21.15.86:0/1092124562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7af8107c70 msgr2=0x7f7af810a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:44.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.117+0000 7f7afca00640 1 --2- 172.21.15.86:0/1092124562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7af8107c70 0x7f7af810a130 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009ca0 tx=0x7f7af002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:04:44.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.117+0000 7f7afca00640 1 -- 172.21.15.86:0/1092124562 shutdown_connections 2024-09-13T16:04:44.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.117+0000 7f7afca00640 1 --2- 172.21.15.86:0/1092124562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7af8107c70 0x7f7af810a130 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:44.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.117+0000 7f7afca00640 1 --2- 172.21.15.86:0/1092124562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7af8072f10 0x7f7af8073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:44.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.117+0000 7f7afca00640 1 --2- 172.21.15.86:0/1092124562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7af80744e0 0x7f7af8072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:44.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.117+0000 7f7afca00640 1 -- 172.21.15.86:0/1092124562 >> 172.21.15.86:0/1092124562 conn(0x7f7af80fb5a0 msgr2=0x7f7af80fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:44.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.117+0000 7f7afca00640 1 -- 172.21.15.86:0/1092124562 shutdown_connections 2024-09-13T16:04:44.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.117+0000 7f7afca00640 1 -- 172.21.15.86:0/1092124562 wait complete. 2024-09-13T16:04:44.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.118+0000 7f7afca00640 1 Processor -- start 2024-09-13T16:04:44.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.119+0000 7f7afca00640 1 -- start start 2024-09-13T16:04:44.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.119+0000 7f7afca00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7af8072f10 0x7f7af81980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:44.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.119+0000 7f7afca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7af80744e0 0x7f7af81985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:44.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.119+0000 7f7afca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7af8107c70 0x7f7af819f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:44.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.119+0000 7f7afca00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af819fbb0 con 0x7f7af80744e0 2024-09-13T16:04:44.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.119+0000 7f7afca00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af819fd20 con 0x7f7af8072f10 2024-09-13T16:04:44.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.119+0000 7f7afca00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af819fee0 con 0x7f7af8107c70 2024-09-13T16:04:44.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.119+0000 7f7af5e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7af8072f10 0x7f7af81980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:44.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.119+0000 7f7af5e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7af8072f10 0x7f7af81980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:46022/0 (socket says 172.21.15.86:46022) 2024-09-13T16:04:44.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.119+0000 7f7af5e00640 1 -- 172.21.15.86:0/3739157415 learned_addr learned my addr 172.21.15.86:0/3739157415 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:04:44.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.119+0000 7f7af5400640 1 --2- 172.21.15.86:0/3739157415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7af80744e0 0x7f7af81985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:44.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.119+0000 7f7af6800640 1 --2- 172.21.15.86:0/3739157415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7af8107c70 0x7f7af819f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:44.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.120+0000 7f7af5e00640 1 -- 172.21.15.86:0/3739157415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7af8107c70 msgr2=0x7f7af819f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:44.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.120+0000 7f7af5e00640 1 --2- 172.21.15.86:0/3739157415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7af8107c70 0x7f7af819f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:44.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.120+0000 7f7af5e00640 1 -- 172.21.15.86:0/3739157415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7af80744e0 msgr2=0x7f7af81985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:44.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.120+0000 7f7af5e00640 1 --2- 172.21.15.86:0/3739157415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7af80744e0 0x7f7af81985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:44.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.120+0000 7f7af5e00640 1 -- 172.21.15.86:0/3739157415 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af0009900 con 0x7f7af8072f10 2024-09-13T16:04:44.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.120+0000 7f7af5400640 1 --2- 172.21.15.86:0/3739157415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7af80744e0 0x7f7af81985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:04:44.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.120+0000 7f7af5e00640 1 --2- 172.21.15.86:0/3739157415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7af8072f10 0x7f7af81980b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800e9c0 tx=0x7f7ae800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:44.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.120+0000 7f7aeea00640 1 -- 172.21.15.86:0/3739157415 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8009700 con 0x7f7af8072f10 2024-09-13T16:04:44.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.120+0000 7f7aeea00640 1 -- 172.21.15.86:0/3739157415 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7ae800cd80 con 0x7f7af8072f10 2024-09-13T16:04:44.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.120+0000 7f7afca00640 1 -- 172.21.15.86:0/3739157415 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af81a01c0 con 0x7f7af8072f10 2024-09-13T16:04:44.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.120+0000 7f7aeea00640 1 -- 172.21.15.86:0/3739157415 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8010430 con 0x7f7af8072f10 2024-09-13T16:04:44.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.120+0000 7f7afca00640 1 -- 172.21.15.86:0/3739157415 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af81a0740 con 0x7f7af8072f10 2024-09-13T16:04:44.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.121+0000 7f7afca00640 1 -- 172.21.15.86:0/3739157415 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af81069f0 con 0x7f7af8072f10 2024-09-13T16:04:44.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.123+0000 7f7aeea00640 1 -- 172.21.15.86:0/3739157415 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7ae8005000 con 0x7f7af8072f10 2024-09-13T16:04:44.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.125+0000 7f7aeea00640 1 --2- 172.21.15.86:0/3739157415 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7adc0a10b0 0x7f7adc0a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:44.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.125+0000 7f7aeea00640 1 -- 172.21.15.86:0/3739157415 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4533+0+0 (secure 0 0 0) 0x7f7ae8014070 con 0x7f7af8072f10 2024-09-13T16:04:44.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.125+0000 7f7af5400640 1 --2- 172.21.15.86:0/3739157415 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7adc0a10b0 0x7f7adc0a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:44.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.125+0000 7f7af5400640 1 --2- 172.21.15.86:0/3739157415 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7adc0a10b0 0x7f7adc0a3570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7af81995d0 tx=0x7f7ae4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:44.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.127+0000 7f7aeea00640 1 -- 172.21.15.86:0/3739157415 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7ae8096790 con 0x7f7af8072f10 2024-09-13T16:04:44.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:04:44.306+0000 7f7afca00640 1 -- 172.21.15.86:0/3739157415 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7af802c450 con 0x7f7adc0a10b0 2024-09-13T16:04:44.989 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:44 smithi086 ceph-mon[30379]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:04:44.989 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:44 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:04:44.989 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:44 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:04:44.989 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:44 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:44.989 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:44 smithi086 ceph-mon[30379]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T16:04:44.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:44 smithi139 ceph-mon[35320]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:04:44.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:44 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:04:44.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:44 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:04:44.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:44 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:44.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:44 smithi139 ceph-mon[35320]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T16:04:45.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:44 smithi194 ceph-mon[35694]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:04:45.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:44 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:04:45.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:44 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:04:45.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:44 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:45.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:44 smithi194 ceph-mon[35694]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T16:04:46.021 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:45 smithi139 ceph-mon[35320]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 438 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T16:04:46.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:45 smithi086 ceph-mon[30379]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 438 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T16:04:46.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:45 smithi194 ceph-mon[35694]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 438 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T16:04:48.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:48 smithi086 ceph-mon[30379]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-09-13T16:04:48.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:48 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1733902803' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b725bb8-2413-455e-bd91-56fb50a5903a"}]: dispatch 2024-09-13T16:04:48.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:48 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1733902803' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b725bb8-2413-455e-bd91-56fb50a5903a"}]': finished 2024-09-13T16:04:48.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:48 smithi086 ceph-mon[30379]: osdmap e44: 7 total, 6 up, 7 in 2024-09-13T16:04:48.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:48 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:04:48.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:48 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2904036660' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:04:48.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:48 smithi139 ceph-mon[35320]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-09-13T16:04:48.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:48 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1733902803' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b725bb8-2413-455e-bd91-56fb50a5903a"}]: dispatch 2024-09-13T16:04:48.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:48 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1733902803' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b725bb8-2413-455e-bd91-56fb50a5903a"}]': finished 2024-09-13T16:04:48.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:48 smithi139 ceph-mon[35320]: osdmap e44: 7 total, 6 up, 7 in 2024-09-13T16:04:48.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:48 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:04:48.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:48 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2904036660' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:04:48.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:48 smithi194 ceph-mon[35694]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-09-13T16:04:48.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:48 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1733902803' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b725bb8-2413-455e-bd91-56fb50a5903a"}]: dispatch 2024-09-13T16:04:48.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:48 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1733902803' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b725bb8-2413-455e-bd91-56fb50a5903a"}]': finished 2024-09-13T16:04:48.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:48 smithi194 ceph-mon[35694]: osdmap e44: 7 total, 6 up, 7 in 2024-09-13T16:04:48.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:48 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:04:48.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:48 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2904036660' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:04:50.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:50 smithi086 ceph-mon[30379]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T16:04:50.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:50 smithi139 ceph-mon[35320]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T16:04:50.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:50 smithi194 ceph-mon[35694]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T16:04:52.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:52 smithi086 ceph-mon[30379]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-13T16:04:52.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:52 smithi139 ceph-mon[35320]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-13T16:04:52.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:52 smithi194 ceph-mon[35694]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-13T16:04:54.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:54 smithi086 ceph-mon[30379]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-13T16:04:54.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:54 smithi139 ceph-mon[35320]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-13T16:04:54.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:54 smithi194 ceph-mon[35694]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-13T16:04:56.591 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:56 smithi086 ceph-mon[30379]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:04:56.591 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:56 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-13T16:04:56.591 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:56 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:56.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:56 smithi139 ceph-mon[35320]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:04:56.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:56 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-13T16:04:56.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:56 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:56.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:56 smithi194 ceph-mon[35694]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:04:56.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:56 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-13T16:04:56.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:56 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:57.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:57 smithi086 ceph-mon[30379]: Deploying daemon osd.6 on smithi086 2024-09-13T16:04:57.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:57 smithi139 ceph-mon[35320]: Deploying daemon osd.6 on smithi086 2024-09-13T16:04:57.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:57 smithi194 ceph-mon[35694]: Deploying daemon osd.6 on smithi086 2024-09-13T16:04:58.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:04:58 smithi086 ceph-mon[30379]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:04:58.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:04:58 smithi139 ceph-mon[35320]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:04:58.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:04:58 smithi194 ceph-mon[35694]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:00.483 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:00 smithi086 ceph-mon[30379]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:00.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:00 smithi139 ceph-mon[35320]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:00.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:00 smithi194 ceph-mon[35694]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:02.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:02 smithi086 ceph-mon[30379]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:02.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:02 smithi139 ceph-mon[35320]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:02.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:02 smithi194 ceph-mon[35694]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:03.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:03 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:03.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:03 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:03.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:03 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:03.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:03 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:03.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:03 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:03.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:03 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:03.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:03 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:03.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:03 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:03.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:03 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:04.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:04 smithi139 ceph-mon[35320]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:04.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:04 smithi194 ceph-mon[35694]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:04.768 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:04 smithi086 ceph-mon[30379]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:06.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:05:06.438+0000 7f7aeea00640 1 -- 172.21.15.86:0/3739157415 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7af802c450 con 0x7f7adc0a10b0 2024-09-13T16:05:06.441 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 6 on host 'smithi086' 2024-09-13T16:05:06.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:05:06.441+0000 7f7afca00640 1 -- 172.21.15.86:0/3739157415 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7adc0a10b0 msgr2=0x7f7adc0a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:06.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:05:06.441+0000 7f7afca00640 1 --2- 172.21.15.86:0/3739157415 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7adc0a10b0 0x7f7adc0a3570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7af81995d0 tx=0x7f7ae4008040 comp rx=0 tx=0).stop 2024-09-13T16:05:06.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:05:06.441+0000 7f7afca00640 1 -- 172.21.15.86:0/3739157415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7af8072f10 msgr2=0x7f7af81980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:06.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:05:06.441+0000 7f7afca00640 1 --2- 172.21.15.86:0/3739157415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7af8072f10 0x7f7af81980b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800e9c0 tx=0x7f7ae800ee80 comp rx=0 tx=0).stop 2024-09-13T16:05:06.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:05:06.441+0000 7f7afca00640 1 -- 172.21.15.86:0/3739157415 shutdown_connections 2024-09-13T16:05:06.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:05:06.441+0000 7f7afca00640 1 --2- 172.21.15.86:0/3739157415 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7adc0a10b0 0x7f7adc0a3570 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:06.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:05:06.441+0000 7f7afca00640 1 --2- 172.21.15.86:0/3739157415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7af8107c70 0x7f7af819f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:06.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:05:06.441+0000 7f7afca00640 1 --2- 172.21.15.86:0/3739157415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7af80744e0 0x7f7af81985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:06.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:05:06.441+0000 7f7afca00640 1 --2- 172.21.15.86:0/3739157415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7af8072f10 0x7f7af81980b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:06.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:05:06.441+0000 7f7afca00640 1 -- 172.21.15.86:0/3739157415 >> 172.21.15.86:0/3739157415 conn(0x7f7af80fb5a0 msgr2=0x7f7af8103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:06.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:05:06.441+0000 7f7afca00640 1 -- 172.21.15.86:0/3739157415 shutdown_connections 2024-09-13T16:05:06.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:05:06.441+0000 7f7afca00640 1 -- 172.21.15.86:0/3739157415 wait complete. 2024-09-13T16:05:06.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:06 smithi139 ceph-mon[35320]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:06.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:06 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:06.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:06 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:06.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:06 smithi139 ceph-mon[35320]: from='osd.6 [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T16:05:06.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:06 smithi194 ceph-mon[35694]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:06.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:06 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:06.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:06 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:06.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:06 smithi194 ceph-mon[35694]: from='osd.6 [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T16:05:06.858 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:06 smithi086 ceph-mon[30379]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:06.858 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:06 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:06.858 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:06 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:06.858 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:06 smithi086 ceph-mon[30379]: from='osd.6 [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T16:05:07.247 DEBUG:teuthology.orchestra.run.smithi086:osd.6> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.6.service 2024-09-13T16:05:07.251 INFO:tasks.cephadm:Deploying osd.7 on smithi139 with /dev/vg_nvme/lv_2... 2024-09-13T16:05:07.251 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T16:05:07.457 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:05:08.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:07 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:08.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:07 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:08.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:07 smithi086 ceph-mon[30379]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:08.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:07 smithi086 ceph-mon[30379]: from='osd.6 [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-13T16:05:08.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:07 smithi086 ceph-mon[30379]: osdmap e45: 7 total, 6 up, 7 in 2024-09-13T16:05:08.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:07 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:05:08.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:07 smithi086 ceph-mon[30379]: from='osd.6 [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-13T16:05:08.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:07 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:08.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:07 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:08.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:07 smithi139 ceph-mon[35320]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:08.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:07 smithi139 ceph-mon[35320]: from='osd.6 [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-13T16:05:08.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:07 smithi139 ceph-mon[35320]: osdmap e45: 7 total, 6 up, 7 in 2024-09-13T16:05:08.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:07 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:05:08.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:07 smithi139 ceph-mon[35320]: from='osd.6 [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-13T16:05:08.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:07 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:08.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:07 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:08.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:07 smithi194 ceph-mon[35694]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:08.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:07 smithi194 ceph-mon[35694]: from='osd.6 [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-13T16:05:08.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:07 smithi194 ceph-mon[35694]: osdmap e45: 7 total, 6 up, 7 in 2024-09-13T16:05:08.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:07 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:05:08.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:07 smithi194 ceph-mon[35694]: from='osd.6 [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-13T16:05:08.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:05:08 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:05:08.465+0000 7f3167200640 -1 osd.6 0 waiting for initial osdmap 2024-09-13T16:05:08.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:05:08 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:05:08.476+0000 7f3162200640 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:05:09.345 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T16:05:09.441 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T16:05:09.457 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2024-09-13T16:05:09.458 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2024-09-13T16:05:09.458 INFO:teuthology.orchestra.run.smithi139.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0138023 s, 760 MB/s 2024-09-13T16:05:09.458 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 2024-09-13T16:05:09.458 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2024-09-13T16:05:09.518 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:09 smithi139 ceph-mon[35320]: from='osd.6 [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-13T16:05:09.518 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:09 smithi139 ceph-mon[35320]: osdmap e46: 7 total, 6 up, 7 in 2024-09-13T16:05:09.518 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:09 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:05:09.518 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:09 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:05:09.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:09 smithi086 ceph-mon[30379]: from='osd.6 [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-13T16:05:09.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:09 smithi086 ceph-mon[30379]: osdmap e46: 7 total, 6 up, 7 in 2024-09-13T16:05:09.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:09 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:05:09.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:09 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:05:09.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:09 smithi194 ceph-mon[35694]: from='osd.6 [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-13T16:05:09.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:09 smithi194 ceph-mon[35694]: osdmap e46: 7 total, 6 up, 7 in 2024-09-13T16:05:09.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:09 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:05:09.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:09 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:05:10.160 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_2 2024-09-13T16:05:10.356 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:05:10.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:10 smithi086 ceph-mon[30379]: purged_snaps scrub starts 2024-09-13T16:05:10.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:10 smithi086 ceph-mon[30379]: purged_snaps scrub ok 2024-09-13T16:05:10.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:10 smithi086 ceph-mon[30379]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:10.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:10 smithi086 ceph-mon[30379]: osd.6 [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372] boot 2024-09-13T16:05:10.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:10 smithi086 ceph-mon[30379]: osdmap e47: 7 total, 7 up, 7 in 2024-09-13T16:05:10.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:10 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:05:10.744 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:10 smithi139 ceph-mon[35320]: purged_snaps scrub starts 2024-09-13T16:05:10.745 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:10 smithi139 ceph-mon[35320]: purged_snaps scrub ok 2024-09-13T16:05:10.745 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:10 smithi139 ceph-mon[35320]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:10.745 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:10 smithi139 ceph-mon[35320]: osd.6 [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372] boot 2024-09-13T16:05:10.745 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:10 smithi139 ceph-mon[35320]: osdmap e47: 7 total, 7 up, 7 in 2024-09-13T16:05:10.745 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:10 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:05:10.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:10 smithi194 ceph-mon[35694]: purged_snaps scrub starts 2024-09-13T16:05:10.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:10 smithi194 ceph-mon[35694]: purged_snaps scrub ok 2024-09-13T16:05:10.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:10 smithi194 ceph-mon[35694]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:05:10.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:10 smithi194 ceph-mon[35694]: osd.6 [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372] boot 2024-09-13T16:05:10.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:10 smithi194 ceph-mon[35694]: osdmap e47: 7 total, 7 up, 7 in 2024-09-13T16:05:10.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:10 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:05:11.737 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:11 smithi139 ceph-mon[35320]: osdmap e48: 7 total, 7 up, 7 in 2024-09-13T16:05:11.737 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:11 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:11.737 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:11 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:11.738 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:11 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:11.738 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:11 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:11.738 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:11 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:11.738 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:11 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:11.738 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:11 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:11.738 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:11 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:11.738 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:11 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:11.738 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:11 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:11.738 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:11 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:11.738 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:11 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:11.738 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:11 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:11.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:11 smithi194 ceph-mon[35694]: osdmap e48: 7 total, 7 up, 7 in 2024-09-13T16:05:11.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:11 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:11.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:11 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:11.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:11 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:11.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:11 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:11.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:11 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:11.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:11 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:11.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:11 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:11.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:11 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:11.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:11 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:11.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:11 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:11.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:11 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:11.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:11 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:11.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:11 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:11.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:11 smithi086 ceph-mon[30379]: osdmap e48: 7 total, 7 up, 7 in 2024-09-13T16:05:11.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:11 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:11.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:11 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:11.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:11 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:11.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:11 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:11.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:11 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:11.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:11 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:11.867 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:11 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:11.867 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:11 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:11.867 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:11 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:11.867 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:11 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:11.867 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:11 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:11.867 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:11 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:11.868 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:11 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:11.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.914+0000 7f854c1a5640 1 -- 172.21.15.139:0/3577832801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8544100f60 msgr2=0x7f85441013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:11.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.914+0000 7f854c1a5640 1 --2- 172.21.15.139:0/3577832801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8544100f60 0x7f85441013e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8534009900 tx=0x7f853402a410 comp rx=0 tx=0).stop 2024-09-13T16:05:11.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.914+0000 7f854c1a5640 1 -- 172.21.15.139:0/3577832801 shutdown_connections 2024-09-13T16:05:11.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.914+0000 7f854c1a5640 1 --2- 172.21.15.139:0/3577832801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8544101920 0x7f8544108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:11.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.914+0000 7f854c1a5640 1 --2- 172.21.15.139:0/3577832801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8544100f60 0x7f85441013e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:11.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.914+0000 7f854c1a5640 1 --2- 172.21.15.139:0/3577832801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85440ffe00 0x7f8544100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:11.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.914+0000 7f854c1a5640 1 -- 172.21.15.139:0/3577832801 >> 172.21.15.139:0/3577832801 conn(0x7f85440fb590 msgr2=0x7f85440fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:11.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.914+0000 7f854c1a5640 1 -- 172.21.15.139:0/3577832801 shutdown_connections 2024-09-13T16:05:11.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.914+0000 7f854c1a5640 1 -- 172.21.15.139:0/3577832801 wait complete. 2024-09-13T16:05:11.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.914+0000 7f854c1a5640 1 Processor -- start 2024-09-13T16:05:11.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.914+0000 7f854c1a5640 1 -- start start 2024-09-13T16:05:11.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.914+0000 7f854c1a5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85440ffe00 0x7f8544074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:11.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.914+0000 7f854c1a5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8544100f60 0x7f85440728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:11.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.914+0000 7f854c1a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8544101920 0x7f8544072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:11.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f854c1a5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8544073570 con 0x7f85440ffe00 2024-09-13T16:05:11.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f854c1a5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85440736e0 con 0x7f8544101920 2024-09-13T16:05:11.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f854c1a5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854419ff60 con 0x7f8544100f60 2024-09-13T16:05:11.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f854a742640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8544101920 0x7f8544072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:11.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f854a742640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8544101920 0x7f8544072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:50302/0 (socket says 172.21.15.139:50302) 2024-09-13T16:05:11.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f854a742640 1 -- 172.21.15.139:0/151023824 learned_addr learned my addr 172.21.15.139:0/151023824 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T16:05:11.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f8549f41640 1 --2- 172.21.15.139:0/151023824 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85440ffe00 0x7f8544074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:11.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f8549740640 1 --2- 172.21.15.139:0/151023824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8544100f60 0x7f85440728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:11.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f854a742640 1 -- 172.21.15.139:0/151023824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8544100f60 msgr2=0x7f85440728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:11.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f854a742640 1 --2- 172.21.15.139:0/151023824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8544100f60 0x7f85440728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:11.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f854a742640 1 -- 172.21.15.139:0/151023824 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85440ffe00 msgr2=0x7f8544074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:11.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f854a742640 1 --2- 172.21.15.139:0/151023824 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85440ffe00 0x7f8544074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:11.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f854a742640 1 -- 172.21.15.139:0/151023824 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8534009560 con 0x7f8544101920 2024-09-13T16:05:11.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f8549f41640 1 --2- 172.21.15.139:0/151023824 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85440ffe00 0x7f8544074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:05:11.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f854a742640 1 --2- 172.21.15.139:0/151023824 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8544101920 0x7f8544072de0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f853c00b9a0 tx=0x7f853c00be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:11.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f853affd640 1 -- 172.21.15.139:0/151023824 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c00cba0 con 0x7f8544101920 2024-09-13T16:05:11.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f853affd640 1 -- 172.21.15.139:0/151023824 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f853c00cd00 con 0x7f8544101920 2024-09-13T16:05:11.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f853affd640 1 -- 172.21.15.139:0/151023824 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c0076f0 con 0x7f8544101920 2024-09-13T16:05:11.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f854c1a5640 1 -- 172.21.15.139:0/151023824 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85441a0210 con 0x7f8544101920 2024-09-13T16:05:11.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.915+0000 7f854c1a5640 1 -- 172.21.15.139:0/151023824 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85441a0690 con 0x7f8544101920 2024-09-13T16:05:11.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.916+0000 7f854c1a5640 1 -- 172.21.15.139:0/151023824 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8544107240 con 0x7f8544101920 2024-09-13T16:05:11.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.917+0000 7f853affd640 1 -- 172.21.15.139:0/151023824 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f853c014440 con 0x7f8544101920 2024-09-13T16:05:11.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.918+0000 7f853affd640 1 --2- 172.21.15.139:0/151023824 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f85300a1080 0x7f85300a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:11.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.918+0000 7f853affd640 1 -- 172.21.15.139:0/151023824 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f853c0cb4b0 con 0x7f8544101920 2024-09-13T16:05:11.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.918+0000 7f8549f41640 1 --2- 172.21.15.139:0/151023824 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f85300a1080 0x7f85300a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:11.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.919+0000 7f8549f41640 1 --2- 172.21.15.139:0/151023824 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f85300a1080 0x7f85300a3540 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f85400058c0 tx=0x7f8540005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:11.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:11.922+0000 7f853affd640 1 -- 172.21.15.139:0/151023824 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f853c095a00 con 0x7f8544101920 2024-09-13T16:05:12.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:12.095+0000 7f854c1a5640 1 -- 172.21.15.139:0/151023824 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f854402c450 con 0x7f85300a1080 2024-09-13T16:05:12.704 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:12 smithi139 ceph-mon[35320]: Detected new or changed devices on smithi086 2024-09-13T16:05:12.704 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:12 smithi139 ceph-mon[35320]: Adjusting osd_memory_target on smithi086 to 5696M 2024-09-13T16:05:12.704 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:12 smithi139 ceph-mon[35320]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:12.704 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:05:12.704 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:05:12.704 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:12.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:12 smithi194 ceph-mon[35694]: Detected new or changed devices on smithi086 2024-09-13T16:05:12.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:12 smithi194 ceph-mon[35694]: Adjusting osd_memory_target on smithi086 to 5696M 2024-09-13T16:05:12.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:12 smithi194 ceph-mon[35694]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:12.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:05:12.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:05:12.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:12.844 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:12 smithi086 ceph-mon[30379]: Detected new or changed devices on smithi086 2024-09-13T16:05:12.844 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:12 smithi086 ceph-mon[30379]: Adjusting osd_memory_target on smithi086 to 5696M 2024-09-13T16:05:12.844 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:12 smithi086 ceph-mon[30379]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:12.844 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:05:12.844 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:05:12.844 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:13.722 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:13 smithi139 ceph-mon[35320]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:05:13.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:13 smithi194 ceph-mon[35694]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:05:13.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:13 smithi086 ceph-mon[30379]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:05:14.739 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:14 smithi139 ceph-mon[35320]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:14.739 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:14 smithi139 ceph-mon[35320]: from='client.? 172.21.15.139:0/4129899587' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16cd9e1d-c8b7-4aba-b735-f89cd340af5c"}]: dispatch 2024-09-13T16:05:14.739 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:14 smithi139 ceph-mon[35320]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16cd9e1d-c8b7-4aba-b735-f89cd340af5c"}]: dispatch 2024-09-13T16:05:14.739 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:14 smithi139 ceph-mon[35320]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16cd9e1d-c8b7-4aba-b735-f89cd340af5c"}]': finished 2024-09-13T16:05:14.739 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:14 smithi139 ceph-mon[35320]: osdmap e49: 8 total, 7 up, 8 in 2024-09-13T16:05:14.739 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:14 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:05:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:14 smithi194 ceph-mon[35694]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:14 smithi194 ceph-mon[35694]: from='client.? 172.21.15.139:0/4129899587' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16cd9e1d-c8b7-4aba-b735-f89cd340af5c"}]: dispatch 2024-09-13T16:05:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:14 smithi194 ceph-mon[35694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16cd9e1d-c8b7-4aba-b735-f89cd340af5c"}]: dispatch 2024-09-13T16:05:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:14 smithi194 ceph-mon[35694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16cd9e1d-c8b7-4aba-b735-f89cd340af5c"}]': finished 2024-09-13T16:05:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:14 smithi194 ceph-mon[35694]: osdmap e49: 8 total, 7 up, 8 in 2024-09-13T16:05:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:14 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:05:14.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:14 smithi086 ceph-mon[30379]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:14.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:14 smithi086 ceph-mon[30379]: from='client.? 172.21.15.139:0/4129899587' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16cd9e1d-c8b7-4aba-b735-f89cd340af5c"}]: dispatch 2024-09-13T16:05:14.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:14 smithi086 ceph-mon[30379]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16cd9e1d-c8b7-4aba-b735-f89cd340af5c"}]: dispatch 2024-09-13T16:05:14.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:14 smithi086 ceph-mon[30379]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16cd9e1d-c8b7-4aba-b735-f89cd340af5c"}]': finished 2024-09-13T16:05:14.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:14 smithi086 ceph-mon[30379]: osdmap e49: 8 total, 7 up, 8 in 2024-09-13T16:05:14.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:14 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:05:15.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:15 smithi139 ceph-mon[35320]: from='client.? 172.21.15.139:0/3522343758' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:05:15.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:15 smithi194 ceph-mon[35694]: from='client.? 172.21.15.139:0/3522343758' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:05:15.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:15 smithi086 ceph-mon[30379]: from='client.? 172.21.15.139:0/3522343758' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:05:16.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:16 smithi139 ceph-mon[35320]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:16.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:16 smithi194 ceph-mon[35694]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:16.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:16 smithi086 ceph-mon[30379]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:18.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:18 smithi139 ceph-mon[35320]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:18.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:18 smithi194 ceph-mon[35694]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:18.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:18 smithi086 ceph-mon[30379]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:20.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:20 smithi139 ceph-mon[35320]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:20.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:20 smithi194 ceph-mon[35694]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:20.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:20 smithi086 ceph-mon[30379]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:21.653 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:21 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-13T16:05:21.654 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:21 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:21.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:21 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-13T16:05:21.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:21 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:21.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:21 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-13T16:05:21.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:21 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:22.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:22 smithi139 ceph-mon[35320]: Deploying daemon osd.7 on smithi139 2024-09-13T16:05:22.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:22 smithi139 ceph-mon[35320]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:22.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:22 smithi194 ceph-mon[35694]: Deploying daemon osd.7 on smithi139 2024-09-13T16:05:22.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:22 smithi194 ceph-mon[35694]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:22.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:22 smithi086 ceph-mon[30379]: Deploying daemon osd.7 on smithi139 2024-09-13T16:05:22.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:22 smithi086 ceph-mon[30379]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:24.737 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:24 smithi139 ceph-mon[35320]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:24.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:24 smithi194 ceph-mon[35694]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:24.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:24 smithi086 ceph-mon[30379]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:26.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:26 smithi139 ceph-mon[35320]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:26.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:26 smithi194 ceph-mon[35694]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:26.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:26 smithi086 ceph-mon[30379]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:27.687 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:27 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:27.688 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:27 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:27.688 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:27 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:27.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:27 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:27.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:27 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:27.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:27 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:27.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:27 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:27.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:27 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:27.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:27 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:28.871 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:28 smithi086 ceph-mon[30379]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:28.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:28 smithi139 ceph-mon[35320]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:29.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:28 smithi194 ceph-mon[35694]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:30.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:30.106+0000 7f853affd640 1 -- 172.21.15.139:0/151023824 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f854402c450 con 0x7f85300a1080 2024-09-13T16:05:30.108 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 7 on host 'smithi139' 2024-09-13T16:05:30.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:30.108+0000 7f854c1a5640 1 -- 172.21.15.139:0/151023824 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f85300a1080 msgr2=0x7f85300a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:30.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:30.108+0000 7f854c1a5640 1 --2- 172.21.15.139:0/151023824 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f85300a1080 0x7f85300a3540 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f85400058c0 tx=0x7f8540005850 comp rx=0 tx=0).stop 2024-09-13T16:05:30.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:30.108+0000 7f854c1a5640 1 -- 172.21.15.139:0/151023824 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8544101920 msgr2=0x7f8544072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:30.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:30.108+0000 7f854c1a5640 1 --2- 172.21.15.139:0/151023824 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8544101920 0x7f8544072de0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f853c00b9a0 tx=0x7f853c00be60 comp rx=0 tx=0).stop 2024-09-13T16:05:30.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:30.108+0000 7f854c1a5640 1 -- 172.21.15.139:0/151023824 shutdown_connections 2024-09-13T16:05:30.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:30.108+0000 7f854c1a5640 1 --2- 172.21.15.139:0/151023824 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f85300a1080 0x7f85300a3540 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:30.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:30.108+0000 7f854c1a5640 1 --2- 172.21.15.139:0/151023824 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8544101920 0x7f8544072de0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:30.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:30.108+0000 7f854c1a5640 1 --2- 172.21.15.139:0/151023824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8544100f60 0x7f85440728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:30.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:30.108+0000 7f854c1a5640 1 --2- 172.21.15.139:0/151023824 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85440ffe00 0x7f8544074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:30.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:30.108+0000 7f854c1a5640 1 -- 172.21.15.139:0/151023824 >> 172.21.15.139:0/151023824 conn(0x7f85440fb590 msgr2=0x7f8544104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:30.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:30.108+0000 7f854c1a5640 1 -- 172.21.15.139:0/151023824 shutdown_connections 2024-09-13T16:05:30.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:05:30.108+0000 7f854c1a5640 1 -- 172.21.15.139:0/151023824 wait complete. 2024-09-13T16:05:30.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:30 smithi139 ceph-mon[35320]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:30.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:30.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:30 smithi194 ceph-mon[35694]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:30.826 DEBUG:teuthology.orchestra.run.smithi139:osd.7> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.7.service 2024-09-13T16:05:30.828 INFO:tasks.cephadm:Deploying osd.8 on smithi194 with /dev/vg_nvme/lv_2... 2024-09-13T16:05:30.828 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T16:05:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:30 smithi086 ceph-mon[30379]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:30.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:30.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:31.034 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:05:31.488 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:31 smithi194 ceph-mon[35694]: from='osd.7 [v2:172.21.15.139:6816/2698233714,v1:172.21.15.139:6817/2698233714]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T16:05:31.488 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:31 smithi194 ceph-mon[35694]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T16:05:31.652 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:31 smithi139 ceph-mon[35320]: from='osd.7 [v2:172.21.15.139:6816/2698233714,v1:172.21.15.139:6817/2698233714]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T16:05:31.652 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:31 smithi139 ceph-mon[35320]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T16:05:31.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:31 smithi086 ceph-mon[30379]: from='osd.7 [v2:172.21.15.139:6816/2698233714,v1:172.21.15.139:6817/2698233714]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T16:05:31.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:31 smithi086 ceph-mon[30379]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T16:05:32.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:32 smithi194 ceph-mon[35694]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:32.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:32 smithi194 ceph-mon[35694]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-13T16:05:32.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:32 smithi194 ceph-mon[35694]: osdmap e50: 8 total, 7 up, 8 in 2024-09-13T16:05:32.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:32 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:05:32.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:32 smithi194 ceph-mon[35694]: from='osd.7 [v2:172.21.15.139:6816/2698233714,v1:172.21.15.139:6817/2698233714]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:05:32.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:32 smithi194 ceph-mon[35694]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:05:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:32 smithi139 ceph-mon[35320]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:32 smithi139 ceph-mon[35320]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-13T16:05:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:32 smithi139 ceph-mon[35320]: osdmap e50: 8 total, 7 up, 8 in 2024-09-13T16:05:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:32 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:05:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:32 smithi139 ceph-mon[35320]: from='osd.7 [v2:172.21.15.139:6816/2698233714,v1:172.21.15.139:6817/2698233714]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:05:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:32 smithi139 ceph-mon[35320]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:05:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:32 smithi086 ceph-mon[30379]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:32 smithi086 ceph-mon[30379]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-13T16:05:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:32 smithi086 ceph-mon[30379]: osdmap e50: 8 total, 7 up, 8 in 2024-09-13T16:05:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:32 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:05:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:32 smithi086 ceph-mon[30379]: from='osd.7 [v2:172.21.15.139:6816/2698233714,v1:172.21.15.139:6817/2698233714]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:05:32.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:32 smithi086 ceph-mon[30379]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:05:32.891 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T16:05:32.982 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T16:05:32.996 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2024-09-13T16:05:32.996 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2024-09-13T16:05:32.996 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115054 s, 911 MB/s 2024-09-13T16:05:32.996 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2024-09-13T16:05:33.401 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:05:33 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:05:33.105+0000 7f78d2cd1640 -1 osd.7 0 waiting for initial osdmap 2024-09-13T16:05:33.401 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:05:33 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:05:33.116+0000 7f78caaf2640 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:05:33.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:33 smithi194 ceph-mon[35694]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-13T16:05:33.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:33 smithi194 ceph-mon[35694]: osdmap e51: 8 total, 7 up, 8 in 2024-09-13T16:05:33.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:33 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:05:33.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:33 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:05:33.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:33 smithi194 ceph-mon[35694]: from='osd.7 ' entity='osd.7' 2024-09-13T16:05:33.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:33 smithi194 ceph-mon[35694]: osd.7 [v2:172.21.15.139:6816/2698233714,v1:172.21.15.139:6817/2698233714] boot 2024-09-13T16:05:33.679 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_2 2024-09-13T16:05:33.702 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:33 smithi139 ceph-mon[35320]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-13T16:05:33.702 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:33 smithi139 ceph-mon[35320]: osdmap e51: 8 total, 7 up, 8 in 2024-09-13T16:05:33.702 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:33 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:05:33.702 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:33 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:05:33.702 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:33 smithi139 ceph-mon[35320]: from='osd.7 ' entity='osd.7' 2024-09-13T16:05:33.702 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:33 smithi139 ceph-mon[35320]: osd.7 [v2:172.21.15.139:6816/2698233714,v1:172.21.15.139:6817/2698233714] boot 2024-09-13T16:05:33.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:33 smithi086 ceph-mon[30379]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-13T16:05:33.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:33 smithi086 ceph-mon[30379]: osdmap e51: 8 total, 7 up, 8 in 2024-09-13T16:05:33.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:05:33.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:05:33.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:33 smithi086 ceph-mon[30379]: from='osd.7 ' entity='osd.7' 2024-09-13T16:05:33.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:33 smithi086 ceph-mon[30379]: osd.7 [v2:172.21.15.139:6816/2698233714,v1:172.21.15.139:6817/2698233714] boot 2024-09-13T16:05:33.887 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:05:34.734 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:34 smithi194 ceph-mon[35694]: purged_snaps scrub starts 2024-09-13T16:05:34.734 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:34 smithi194 ceph-mon[35694]: purged_snaps scrub ok 2024-09-13T16:05:34.735 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:34 smithi194 ceph-mon[35694]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:34.735 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:34 smithi194 ceph-mon[35694]: osdmap e52: 8 total, 8 up, 8 in 2024-09-13T16:05:34.735 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:34 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:05:34.735 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:34 smithi194 ceph-mon[35694]: osdmap e53: 8 total, 8 up, 8 in 2024-09-13T16:05:34.735 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:34 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:34.735 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:34 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:34.735 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:34 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:34.736 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:34 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:34.736 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:34 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:34.736 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:34 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:34.736 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:34 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:34.736 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:34 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:34.737 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:34 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:34.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:34 smithi139 ceph-mon[35320]: purged_snaps scrub starts 2024-09-13T16:05:34.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:34 smithi139 ceph-mon[35320]: purged_snaps scrub ok 2024-09-13T16:05:34.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:34 smithi139 ceph-mon[35320]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:34.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:34 smithi139 ceph-mon[35320]: osdmap e52: 8 total, 8 up, 8 in 2024-09-13T16:05:34.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:34 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:05:34.750 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:34 smithi139 ceph-mon[35320]: osdmap e53: 8 total, 8 up, 8 in 2024-09-13T16:05:34.750 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:34 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:34.750 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:34 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:34.750 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:34 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:34.750 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:34 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:34.751 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:34 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:34.751 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:34 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:34.751 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:34 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:34.751 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:34 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:34.751 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:34 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:34.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:34 smithi086 ceph-mon[30379]: purged_snaps scrub starts 2024-09-13T16:05:34.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:34 smithi086 ceph-mon[30379]: purged_snaps scrub ok 2024-09-13T16:05:34.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:34 smithi086 ceph-mon[30379]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:05:34.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:34 smithi086 ceph-mon[30379]: osdmap e52: 8 total, 8 up, 8 in 2024-09-13T16:05:34.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:34 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:05:34.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:34 smithi086 ceph-mon[30379]: osdmap e53: 8 total, 8 up, 8 in 2024-09-13T16:05:34.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:34 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:34.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:34 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:34.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:34 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:34.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:34 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:34.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:34 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:34.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:34 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:34.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:34 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:34.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:34 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:34.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:34 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:35.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.552+0000 7fd909491640 1 -- 172.21.15.194:0/167799029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd904100ff0 msgr2=0x7fd904101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:35.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.552+0000 7fd909491640 1 --2- 172.21.15.194:0/167799029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd904100ff0 0x7fd904101470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009900 tx=0x7fd8ec02a410 comp rx=0 tx=0).stop 2024-09-13T16:05:35.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.552+0000 7fd909491640 1 -- 172.21.15.194:0/167799029 shutdown_connections 2024-09-13T16:05:35.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.552+0000 7fd909491640 1 --2- 172.21.15.194:0/167799029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9041019b0 0x7fd904108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:35.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.552+0000 7fd909491640 1 --2- 172.21.15.194:0/167799029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd904100ff0 0x7fd904101470 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:35.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.552+0000 7fd909491640 1 --2- 172.21.15.194:0/167799029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9040ffdf0 0x7fd9041001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:35.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.552+0000 7fd909491640 1 -- 172.21.15.194:0/167799029 >> 172.21.15.194:0/167799029 conn(0x7fd9040fb5a0 msgr2=0x7fd9040fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:35.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.552+0000 7fd909491640 1 -- 172.21.15.194:0/167799029 shutdown_connections 2024-09-13T16:05:35.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.552+0000 7fd909491640 1 -- 172.21.15.194:0/167799029 wait complete. 2024-09-13T16:05:35.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.552+0000 7fd909491640 1 Processor -- start 2024-09-13T16:05:35.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd909491640 1 -- start start 2024-09-13T16:05:35.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd909491640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9040ffdf0 0x7fd904195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:35.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd909491640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd904100ff0 0x7fd904196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:35.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd909491640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9041019b0 0x7fd90419d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:35.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd909491640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90419d9c0 con 0x7fd9041019b0 2024-09-13T16:05:35.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd909491640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90419db30 con 0x7fd904100ff0 2024-09-13T16:05:35.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd909491640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90419dcf0 con 0x7fd9040ffdf0 2024-09-13T16:05:35.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd902ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9040ffdf0 0x7fd904195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:35.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd902ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9040ffdf0 0x7fd904195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:47008/0 (socket says 172.21.15.194:47008) 2024-09-13T16:05:35.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd902ffd640 1 -- 172.21.15.194:0/1178301815 learned_addr learned my addr 172.21.15.194:0/1178301815 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T16:05:35.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd8fa7fc640 1 --2- 172.21.15.194:0/1178301815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd904100ff0 0x7fd904196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:35.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd9037fe640 1 --2- 172.21.15.194:0/1178301815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9041019b0 0x7fd90419d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:35.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd902ffd640 1 -- 172.21.15.194:0/1178301815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd904100ff0 msgr2=0x7fd904196400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:35.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd902ffd640 1 --2- 172.21.15.194:0/1178301815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd904100ff0 0x7fd904196400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:35.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd902ffd640 1 -- 172.21.15.194:0/1178301815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9041019b0 msgr2=0x7fd90419d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:35.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd902ffd640 1 --2- 172.21.15.194:0/1178301815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9041019b0 0x7fd90419d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:35.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd902ffd640 1 -- 172.21.15.194:0/1178301815 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec009560 con 0x7fd9040ffdf0 2024-09-13T16:05:35.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd9037fe640 1 --2- 172.21.15.194:0/1178301815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9041019b0 0x7fd90419d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:05:35.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.553+0000 7fd902ffd640 1 --2- 172.21.15.194:0/1178301815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9040ffdf0 0x7fd904195ec0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400d950 tx=0x7fd8f400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:35.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.554+0000 7fd900ff9640 1 -- 172.21.15.194:0/1178301815 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4009c30 con 0x7fd9040ffdf0 2024-09-13T16:05:35.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.554+0000 7fd900ff9640 1 -- 172.21.15.194:0/1178301815 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd8f4009d90 con 0x7fd9040ffdf0 2024-09-13T16:05:35.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.554+0000 7fd909491640 1 -- 172.21.15.194:0/1178301815 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90419dfd0 con 0x7fd9040ffdf0 2024-09-13T16:05:35.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.554+0000 7fd900ff9640 1 -- 172.21.15.194:0/1178301815 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f400f740 con 0x7fd9040ffdf0 2024-09-13T16:05:35.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.554+0000 7fd909491640 1 -- 172.21.15.194:0/1178301815 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90419e390 con 0x7fd9040ffdf0 2024-09-13T16:05:35.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.555+0000 7fd909491640 1 -- 172.21.15.194:0/1178301815 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd904107190 con 0x7fd9040ffdf0 2024-09-13T16:05:35.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.556+0000 7fd900ff9640 1 -- 172.21.15.194:0/1178301815 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd8f4010460 con 0x7fd9040ffdf0 2024-09-13T16:05:35.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.557+0000 7fd900ff9640 1 --2- 172.21.15.194:0/1178301815 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd8f00a10b0 0x7fd8f00a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:35.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.557+0000 7fd900ff9640 1 -- 172.21.15.194:0/1178301815 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5397+0+0 (secure 0 0 0) 0x7fd8f40cba90 con 0x7fd9040ffdf0 2024-09-13T16:05:35.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.557+0000 7fd8fa7fc640 1 --2- 172.21.15.194:0/1178301815 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd8f00a10b0 0x7fd8f00a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:35.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.558+0000 7fd8fa7fc640 1 --2- 172.21.15.194:0/1178301815 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd8f00a10b0 0x7fd8f00a3570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec031510 tx=0x7fd8ec0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:35.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.560+0000 7fd900ff9640 1 -- 172.21.15.194:0/1178301815 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd8f4095d80 con 0x7fd9040ffdf0 2024-09-13T16:05:35.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:35.732+0000 7fd909491640 1 -- 172.21.15.194:0/1178301815 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd90402c520 con 0x7fd8f00a10b0 2024-09-13T16:05:35.734 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:35 smithi194 ceph-mon[35694]: Detected new or changed devices on smithi139 2024-09-13T16:05:35.734 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:35 smithi194 ceph-mon[35694]: Adjusting osd_memory_target on smithi139 to 5696M 2024-09-13T16:05:35.734 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:35 smithi194 ceph-mon[35694]: osdmap e54: 8 total, 8 up, 8 in 2024-09-13T16:05:35.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:35 smithi139 ceph-mon[35320]: Detected new or changed devices on smithi139 2024-09-13T16:05:35.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:35 smithi139 ceph-mon[35320]: Adjusting osd_memory_target on smithi139 to 5696M 2024-09-13T16:05:35.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:35 smithi139 ceph-mon[35320]: osdmap e54: 8 total, 8 up, 8 in 2024-09-13T16:05:35.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:35 smithi086 ceph-mon[30379]: Detected new or changed devices on smithi139 2024-09-13T16:05:35.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:35 smithi086 ceph-mon[30379]: Adjusting osd_memory_target on smithi139 to 5696M 2024-09-13T16:05:35.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:35 smithi086 ceph-mon[30379]: osdmap e54: 8 total, 8 up, 8 in 2024-09-13T16:05:36.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:36 smithi139 ceph-mon[35320]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:36.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:36 smithi139 ceph-mon[35320]: osdmap e55: 8 total, 8 up, 8 in 2024-09-13T16:05:36.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:36 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:05:36.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:36 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:05:36.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:36 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:36.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:36 smithi194 ceph-mon[35694]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:36.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:36 smithi194 ceph-mon[35694]: osdmap e55: 8 total, 8 up, 8 in 2024-09-13T16:05:36.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:36 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:05:36.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:36 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:05:36.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:36 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:36.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:36 smithi086 ceph-mon[30379]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:36.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:36 smithi086 ceph-mon[30379]: osdmap e55: 8 total, 8 up, 8 in 2024-09-13T16:05:36.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:05:36.867 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:05:36.867 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:37.745 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:37 smithi194 ceph-mon[35694]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:05:37.746 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:37 smithi194 ceph-mon[35694]: osdmap e56: 8 total, 8 up, 8 in 2024-09-13T16:05:37.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:37 smithi139 ceph-mon[35320]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:05:37.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:37 smithi139 ceph-mon[35320]: osdmap e56: 8 total, 8 up, 8 in 2024-09-13T16:05:37.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:37 smithi086 ceph-mon[30379]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:05:37.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:37 smithi086 ceph-mon[30379]: osdmap e56: 8 total, 8 up, 8 in 2024-09-13T16:05:38.631 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:38 smithi194 ceph-mon[35694]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:38.631 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:38 smithi194 ceph-mon[35694]: from='client.? 172.21.15.194:0/576782711' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f925eb0e-8f3f-478d-a2f0-442d7c3a47f1"}]: dispatch 2024-09-13T16:05:38.631 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:38 smithi194 ceph-mon[35694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f925eb0e-8f3f-478d-a2f0-442d7c3a47f1"}]: dispatch 2024-09-13T16:05:38.631 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:38 smithi194 ceph-mon[35694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f925eb0e-8f3f-478d-a2f0-442d7c3a47f1"}]': finished 2024-09-13T16:05:38.631 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:38 smithi194 ceph-mon[35694]: osdmap e57: 9 total, 8 up, 9 in 2024-09-13T16:05:38.631 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:38 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:05:38.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:38 smithi139 ceph-mon[35320]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:38.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:38 smithi139 ceph-mon[35320]: from='client.? 172.21.15.194:0/576782711' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f925eb0e-8f3f-478d-a2f0-442d7c3a47f1"}]: dispatch 2024-09-13T16:05:38.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:38 smithi139 ceph-mon[35320]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f925eb0e-8f3f-478d-a2f0-442d7c3a47f1"}]: dispatch 2024-09-13T16:05:38.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:38 smithi139 ceph-mon[35320]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f925eb0e-8f3f-478d-a2f0-442d7c3a47f1"}]': finished 2024-09-13T16:05:38.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:38 smithi139 ceph-mon[35320]: osdmap e57: 9 total, 8 up, 9 in 2024-09-13T16:05:38.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:38 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:05:38.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:38 smithi086 ceph-mon[30379]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:38.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:38 smithi086 ceph-mon[30379]: from='client.? 172.21.15.194:0/576782711' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f925eb0e-8f3f-478d-a2f0-442d7c3a47f1"}]: dispatch 2024-09-13T16:05:38.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:38 smithi086 ceph-mon[30379]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f925eb0e-8f3f-478d-a2f0-442d7c3a47f1"}]: dispatch 2024-09-13T16:05:38.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:38 smithi086 ceph-mon[30379]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f925eb0e-8f3f-478d-a2f0-442d7c3a47f1"}]': finished 2024-09-13T16:05:38.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:38 smithi086 ceph-mon[30379]: osdmap e57: 9 total, 8 up, 9 in 2024-09-13T16:05:38.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:38 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:05:39.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:39 smithi139 ceph-mon[35320]: from='client.? 172.21.15.194:0/2117297566' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:05:39.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:39 smithi194 ceph-mon[35694]: from='client.? 172.21.15.194:0/2117297566' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:05:39.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:39 smithi086 ceph-mon[30379]: from='client.? 172.21.15.194:0/2117297566' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:05:40.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:40 smithi139 ceph-mon[35320]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:40.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:40 smithi194 ceph-mon[35694]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:40.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:40 smithi086 ceph-mon[30379]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:42.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:42 smithi139 ceph-mon[35320]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:42.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:42 smithi194 ceph-mon[35694]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:42 smithi086 ceph-mon[30379]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:44.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:44 smithi139 ceph-mon[35320]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:44.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:44 smithi194 ceph-mon[35694]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:44.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:44 smithi086 ceph-mon[30379]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:45.573 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-13T16:05:45.574 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:45.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:45 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-13T16:05:45.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:45 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:45.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:45 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-13T16:05:45.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:45 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:46.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:46 smithi194 ceph-mon[35694]: Deploying daemon osd.8 on smithi194 2024-09-13T16:05:46.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:46 smithi194 ceph-mon[35694]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:46.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:46 smithi139 ceph-mon[35320]: Deploying daemon osd.8 on smithi194 2024-09-13T16:05:46.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:46 smithi139 ceph-mon[35320]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:46.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:46 smithi086 ceph-mon[30379]: Deploying daemon osd.8 on smithi194 2024-09-13T16:05:46.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:46 smithi086 ceph-mon[30379]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:48.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:48 smithi139 ceph-mon[35320]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:48.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:48 smithi194 ceph-mon[35694]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:48.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:48 smithi086 ceph-mon[30379]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:50.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:50 smithi139 ceph-mon[35320]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:50.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:50 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:50.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:50 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:50.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:50 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:50.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:50 smithi194 ceph-mon[35694]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:50.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:50 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:50.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:50 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:50.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:50 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:50.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:50 smithi086 ceph-mon[30379]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:50.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:50 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:50.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:50 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:50.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:50 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:52.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:52 smithi139 ceph-mon[35320]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:52.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:52 smithi194 ceph-mon[35694]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:52.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:52 smithi086 ceph-mon[30379]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:53.550 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 8 on host 'smithi194' 2024-09-13T16:05:53.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:53.548+0000 7fd900ff9640 1 -- 172.21.15.194:0/1178301815 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd90402c520 con 0x7fd8f00a10b0 2024-09-13T16:05:53.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:53.550+0000 7fd909491640 1 -- 172.21.15.194:0/1178301815 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd8f00a10b0 msgr2=0x7fd8f00a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:53.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:53.550+0000 7fd909491640 1 --2- 172.21.15.194:0/1178301815 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd8f00a10b0 0x7fd8f00a3570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec031510 tx=0x7fd8ec0058d0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:53.550+0000 7fd909491640 1 -- 172.21.15.194:0/1178301815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9040ffdf0 msgr2=0x7fd904195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:53.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:53.550+0000 7fd909491640 1 --2- 172.21.15.194:0/1178301815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9040ffdf0 0x7fd904195ec0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400d950 tx=0x7fd8f400de10 comp rx=0 tx=0).stop 2024-09-13T16:05:53.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:53.550+0000 7fd909491640 1 -- 172.21.15.194:0/1178301815 shutdown_connections 2024-09-13T16:05:53.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:53.550+0000 7fd909491640 1 --2- 172.21.15.194:0/1178301815 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd8f00a10b0 0x7fd8f00a3570 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:53.550+0000 7fd909491640 1 --2- 172.21.15.194:0/1178301815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9041019b0 0x7fd90419d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:53.550+0000 7fd909491640 1 --2- 172.21.15.194:0/1178301815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd904100ff0 0x7fd904196400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:53.550+0000 7fd909491640 1 --2- 172.21.15.194:0/1178301815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9040ffdf0 0x7fd904195ec0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:53.550+0000 7fd909491640 1 -- 172.21.15.194:0/1178301815 >> 172.21.15.194:0/1178301815 conn(0x7fd9040fb5a0 msgr2=0x7fd904104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:53.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:53.551+0000 7fd909491640 1 -- 172.21.15.194:0/1178301815 shutdown_connections 2024-09-13T16:05:53.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:05:53.551+0000 7fd909491640 1 -- 172.21.15.194:0/1178301815 wait complete. 2024-09-13T16:05:54.072 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:53 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:54.072 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:53 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:54.072 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:53 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:54.073 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:53 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:54.073 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:53 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:54.073 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:53 smithi194 ceph-mon[35694]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:54.073 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:53 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:54.073 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:53 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:54.073 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:53 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:54.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:53 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:54.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:53 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:54.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:53 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:54.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:53 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:54.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:53 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:54.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:53 smithi086 ceph-mon[30379]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:54.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:53 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:54.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:53 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:54.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:53 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:54.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:53 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:54.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:53 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:54.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:53 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:54.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:53 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:54.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:53 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:54.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:53 smithi139 ceph-mon[35320]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:54.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:53 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:54.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:53 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:54.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:53 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:54.316 DEBUG:teuthology.orchestra.run.smithi194:osd.8> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.8.service 2024-09-13T16:05:54.319 INFO:tasks.cephadm:Deploying osd.9 on smithi086 with /dev/vg_nvme/lv_1... 2024-09-13T16:05:54.319 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-13T16:05:54.638 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:05:55.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:54 smithi194 ceph-mon[35694]: from='osd.8 [v2:172.21.15.194:6816/1203296705,v1:172.21.15.194:6817/1203296705]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T16:05:55.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:54 smithi194 ceph-mon[35694]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T16:05:55.084 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:54 smithi086 ceph-mon[30379]: from='osd.8 [v2:172.21.15.194:6816/1203296705,v1:172.21.15.194:6817/1203296705]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T16:05:55.084 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:54 smithi086 ceph-mon[30379]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T16:05:55.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:54 smithi139 ceph-mon[35320]: from='osd.8 [v2:172.21.15.194:6816/1203296705,v1:172.21.15.194:6817/1203296705]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T16:05:55.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:54 smithi139 ceph-mon[35320]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T16:05:55.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:55 smithi086 ceph-mon[30379]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-13T16:05:55.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:55 smithi086 ceph-mon[30379]: osdmap e58: 9 total, 8 up, 9 in 2024-09-13T16:05:55.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:55 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:05:55.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:55 smithi086 ceph-mon[30379]: from='osd.8 [v2:172.21.15.194:6816/1203296705,v1:172.21.15.194:6817/1203296705]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:05:55.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:55 smithi086 ceph-mon[30379]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:05:55.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:55 smithi086 ceph-mon[30379]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:56.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:55 smithi139 ceph-mon[35320]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-13T16:05:56.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:55 smithi139 ceph-mon[35320]: osdmap e58: 9 total, 8 up, 9 in 2024-09-13T16:05:56.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:55 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:05:56.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:55 smithi139 ceph-mon[35320]: from='osd.8 [v2:172.21.15.194:6816/1203296705,v1:172.21.15.194:6817/1203296705]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:05:56.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:55 smithi139 ceph-mon[35320]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:05:56.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:55 smithi139 ceph-mon[35320]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:56.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:55 smithi194 ceph-mon[35694]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-13T16:05:56.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:55 smithi194 ceph-mon[35694]: osdmap e58: 9 total, 8 up, 9 in 2024-09-13T16:05:56.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:55 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:05:56.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:55 smithi194 ceph-mon[35694]: from='osd.8 [v2:172.21.15.194:6816/1203296705,v1:172.21.15.194:6817/1203296705]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:05:56.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:55 smithi194 ceph-mon[35694]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:05:56.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:55 smithi194 ceph-mon[35694]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:56.835 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:05:56 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:05:56.512+0000 7ffa9c324640 -1 osd.8 0 waiting for initial osdmap 2024-09-13T16:05:56.835 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:05:56 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:05:56.527+0000 7ffa94145640 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:05:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:56 smithi086 ceph-mon[30379]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-13T16:05:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:56 smithi086 ceph-mon[30379]: osdmap e59: 9 total, 8 up, 9 in 2024-09-13T16:05:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:56 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:05:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:56 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:05:56.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:56 smithi086 ceph-mon[30379]: from='osd.8 ' entity='osd.8' 2024-09-13T16:05:56.993 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-13T16:05:57.131 INFO:teuthology.orchestra.run.smithi086.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-13T16:05:57.168 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10+0 records in 2024-09-13T16:05:57.169 INFO:teuthology.orchestra.run.smithi086.stderr:10+0 records out 2024-09-13T16:05:57.169 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0319205 s, 328 MB/s 2024-09-13T16:05:57.169 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping successful for: 2024-09-13T16:05:57.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:56 smithi139 ceph-mon[35320]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-13T16:05:57.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:56 smithi139 ceph-mon[35320]: osdmap e59: 9 total, 8 up, 9 in 2024-09-13T16:05:57.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:56 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:05:57.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:56 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:05:57.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:56 smithi139 ceph-mon[35320]: from='osd.8 ' entity='osd.8' 2024-09-13T16:05:57.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:56 smithi194 ceph-mon[35694]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-13T16:05:57.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:56 smithi194 ceph-mon[35694]: osdmap e59: 9 total, 8 up, 9 in 2024-09-13T16:05:57.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:56 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:05:57.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:56 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:05:57.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:56 smithi194 ceph-mon[35694]: from='osd.8 ' entity='osd.8' 2024-09-13T16:05:57.969 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi086:vg_nvme/lv_1 2024-09-13T16:05:58.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:57 smithi086 ceph-mon[30379]: purged_snaps scrub starts 2024-09-13T16:05:58.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:57 smithi086 ceph-mon[30379]: purged_snaps scrub ok 2024-09-13T16:05:58.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:57 smithi086 ceph-mon[30379]: osd.8 [v2:172.21.15.194:6816/1203296705,v1:172.21.15.194:6817/1203296705] boot 2024-09-13T16:05:58.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:57 smithi086 ceph-mon[30379]: osdmap e60: 9 total, 9 up, 9 in 2024-09-13T16:05:58.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:57 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:05:58.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:57 smithi086 ceph-mon[30379]: Detected new or changed devices on smithi194 2024-09-13T16:05:58.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:57 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:58.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:57 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:58.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:57 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:58.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:57 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:58.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:57 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:58.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:57 smithi086 ceph-mon[30379]: Adjusting osd_memory_target on smithi194 to 5696M 2024-09-13T16:05:58.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:57 smithi086 ceph-mon[30379]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:58.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:57 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:58.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:57 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:58.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:57 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:58.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:57 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:58.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:57 smithi086 ceph-mon[30379]: osdmap e61: 9 total, 9 up, 9 in 2024-09-13T16:05:58.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:57 smithi139 ceph-mon[35320]: purged_snaps scrub starts 2024-09-13T16:05:58.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:57 smithi139 ceph-mon[35320]: purged_snaps scrub ok 2024-09-13T16:05:58.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:57 smithi139 ceph-mon[35320]: osd.8 [v2:172.21.15.194:6816/1203296705,v1:172.21.15.194:6817/1203296705] boot 2024-09-13T16:05:58.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:57 smithi139 ceph-mon[35320]: osdmap e60: 9 total, 9 up, 9 in 2024-09-13T16:05:58.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:57 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:05:58.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:57 smithi139 ceph-mon[35320]: Detected new or changed devices on smithi194 2024-09-13T16:05:58.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:57 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:58.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:57 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:58.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:57 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:58.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:57 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:58.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:57 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:58.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:57 smithi139 ceph-mon[35320]: Adjusting osd_memory_target on smithi194 to 5696M 2024-09-13T16:05:58.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:57 smithi139 ceph-mon[35320]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:58.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:57 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:58.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:57 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:58.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:57 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:58.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:57 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:58.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:57 smithi139 ceph-mon[35320]: osdmap e61: 9 total, 9 up, 9 in 2024-09-13T16:05:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:57 smithi194 ceph-mon[35694]: purged_snaps scrub starts 2024-09-13T16:05:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:57 smithi194 ceph-mon[35694]: purged_snaps scrub ok 2024-09-13T16:05:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:57 smithi194 ceph-mon[35694]: osd.8 [v2:172.21.15.194:6816/1203296705,v1:172.21.15.194:6817/1203296705] boot 2024-09-13T16:05:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:57 smithi194 ceph-mon[35694]: osdmap e60: 9 total, 9 up, 9 in 2024-09-13T16:05:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:57 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:05:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:57 smithi194 ceph-mon[35694]: Detected new or changed devices on smithi194 2024-09-13T16:05:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:57 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:57 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:57 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:57 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:57 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:05:58.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:57 smithi194 ceph-mon[35694]: Adjusting osd_memory_target on smithi194 to 5696M 2024-09-13T16:05:58.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:57 smithi194 ceph-mon[35694]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:05:58.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:57 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:58.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:57 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:58.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:57 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:58.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:57 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:05:58.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:57 smithi194 ceph-mon[35694]: osdmap e61: 9 total, 9 up, 9 in 2024-09-13T16:05:58.278 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:06:00.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:59 smithi086 ceph-mon[30379]: osdmap e62: 9 total, 9 up, 9 in 2024-09-13T16:06:00.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:05:59 smithi086 ceph-mon[30379]: pgmap v202: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:00.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:59 smithi139 ceph-mon[35320]: osdmap e62: 9 total, 9 up, 9 in 2024-09-13T16:06:00.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:05:59 smithi139 ceph-mon[35320]: pgmap v202: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:00.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:59 smithi194 ceph-mon[35694]: osdmap e62: 9 total, 9 up, 9 in 2024-09-13T16:06:00.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:05:59 smithi194 ceph-mon[35694]: pgmap v202: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:00.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.299+0000 7f7732600640 1 -- 172.21.15.86:0/1654808366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f772c0ffc30 msgr2=0x7f772c100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:00.324 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.299+0000 7f7732600640 1 --2- 172.21.15.86:0/1654808366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f772c0ffc30 0x7f772c100030 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7720009900 tx=0x7f772002a410 comp rx=0 tx=0).stop 2024-09-13T16:06:00.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.299+0000 7f7732600640 1 -- 172.21.15.86:0/1654808366 shutdown_connections 2024-09-13T16:06:00.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.299+0000 7f7732600640 1 --2- 172.21.15.86:0/1654808366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f772c1017f0 0x7f772c108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:00.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.299+0000 7f7732600640 1 --2- 172.21.15.86:0/1654808366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f772c100e30 0x7f772c1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:00.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.299+0000 7f7732600640 1 --2- 172.21.15.86:0/1654808366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f772c0ffc30 0x7f772c100030 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:00.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.299+0000 7f7732600640 1 -- 172.21.15.86:0/1654808366 >> 172.21.15.86:0/1654808366 conn(0x7f772c0fb3c0 msgr2=0x7f772c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:00.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.299+0000 7f7732600640 1 -- 172.21.15.86:0/1654808366 shutdown_connections 2024-09-13T16:06:00.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.299+0000 7f7732600640 1 -- 172.21.15.86:0/1654808366 wait complete. 2024-09-13T16:06:00.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.300+0000 7f7732600640 1 Processor -- start 2024-09-13T16:06:00.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.300+0000 7f7732600640 1 -- start start 2024-09-13T16:06:00.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.300+0000 7f7732600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f772c0ffc30 0x7f772c197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:00.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.300+0000 7f7732600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f772c100e30 0x7f772c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:00.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.300+0000 7f7732600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f772c1017f0 0x7f772c19f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.300+0000 7f7732600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c19f950 con 0x7f772c100e30 2024-09-13T16:06:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.300+0000 7f7732600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c19fac0 con 0x7f772c0ffc30 2024-09-13T16:06:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.300+0000 7f7732600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c19fc80 con 0x7f772c1017f0 2024-09-13T16:06:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.301+0000 7f772be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f772c100e30 0x7f772c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.301+0000 7f772be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f772c100e30 0x7f772c1983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59926/0 (socket says 172.21.15.86:59926) 2024-09-13T16:06:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.301+0000 7f772be00640 1 -- 172.21.15.86:0/2113106642 learned_addr learned my addr 172.21.15.86:0/2113106642 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:06:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.301+0000 7f7731c00640 1 --2- 172.21.15.86:0/2113106642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f772c1017f0 0x7f772c19f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.301+0000 7f7731200640 1 --2- 172.21.15.86:0/2113106642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f772c0ffc30 0x7f772c197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.301+0000 7f772be00640 1 -- 172.21.15.86:0/2113106642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f772c1017f0 msgr2=0x7f772c19f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.301+0000 7f772be00640 1 --2- 172.21.15.86:0/2113106642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f772c1017f0 0x7f772c19f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.301+0000 7f772be00640 1 -- 172.21.15.86:0/2113106642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f772c0ffc30 msgr2=0x7f772c197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.301+0000 7f772be00640 1 --2- 172.21.15.86:0/2113106642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f772c0ffc30 0x7f772c197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.301+0000 7f772be00640 1 -- 172.21.15.86:0/2113106642 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7720009560 con 0x7f772c100e30 2024-09-13T16:06:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.301+0000 7f7731c00640 1 --2- 172.21.15.86:0/2113106642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f772c1017f0 0x7f772c19f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:06:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.301+0000 7f772be00640 1 --2- 172.21.15.86:0/2113106642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f772c100e30 0x7f772c1983e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f771800e9f0 tx=0x7f771800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.302+0000 7f7729600640 1 -- 172.21.15.86:0/2113106642 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718009700 con 0x7f772c100e30 2024-09-13T16:06:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.302+0000 7f7729600640 1 -- 172.21.15.86:0/2113106642 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f771800cd80 con 0x7f772c100e30 2024-09-13T16:06:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.302+0000 7f7729600640 1 -- 172.21.15.86:0/2113106642 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718018920 con 0x7f772c100e30 2024-09-13T16:06:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.302+0000 7f7732600640 1 -- 172.21.15.86:0/2113106642 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772c19ff60 con 0x7f772c100e30 2024-09-13T16:06:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.302+0000 7f7732600640 1 -- 172.21.15.86:0/2113106642 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772c1a0380 con 0x7f772c100e30 2024-09-13T16:06:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.303+0000 7f7732600640 1 -- 172.21.15.86:0/2113106642 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772c10b620 con 0x7f772c100e30 2024-09-13T16:06:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.305+0000 7f7729600640 1 -- 172.21.15.86:0/2113106642 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7718018a80 con 0x7f772c100e30 2024-09-13T16:06:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.307+0000 7f7729600640 1 --2- 172.21.15.86:0/2113106642 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f77140a1120 0x7f77140a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:00.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.308+0000 7f7729600640 1 -- 172.21.15.86:0/2113106642 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5829+0+0 (secure 0 0 0) 0x7f7718014070 con 0x7f772c100e30 2024-09-13T16:06:00.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.308+0000 7f7731200640 1 --2- 172.21.15.86:0/2113106642 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f77140a1120 0x7f77140a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:00.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.308+0000 7f7731200640 1 --2- 172.21.15.86:0/2113106642 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f77140a1120 0x7f77140a35e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f772002aa00 tx=0x7f77200058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:00.328 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.310+0000 7f7729600640 1 -- 172.21.15.86:0/2113106642 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7718096860 con 0x7f772c100e30 2024-09-13T16:06:00.493 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:00.491+0000 7f7732600640 1 -- 172.21.15.86:0/2113106642 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f772c1a0570 con 0x7f77140a1120 2024-09-13T16:06:01.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:00 smithi086 ceph-mon[30379]: osdmap e63: 9 total, 9 up, 9 in 2024-09-13T16:06:01.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:00 smithi086 ceph-mon[30379]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:06:01.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:06:01.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:06:01.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:01.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:00 smithi139 ceph-mon[35320]: osdmap e63: 9 total, 9 up, 9 in 2024-09-13T16:06:01.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:00 smithi139 ceph-mon[35320]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:06:01.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:06:01.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:06:01.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:01.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:00 smithi194 ceph-mon[35694]: osdmap e63: 9 total, 9 up, 9 in 2024-09-13T16:06:01.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:00 smithi194 ceph-mon[35694]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:06:01.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:06:01.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:06:01.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:02.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:01 smithi086 ceph-mon[30379]: osdmap e64: 9 total, 9 up, 9 in 2024-09-13T16:06:02.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:01 smithi086 ceph-mon[30379]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:02.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:01 smithi139 ceph-mon[35320]: osdmap e64: 9 total, 9 up, 9 in 2024-09-13T16:06:02.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:01 smithi139 ceph-mon[35320]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:02.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:01 smithi194 ceph-mon[35694]: osdmap e64: 9 total, 9 up, 9 in 2024-09-13T16:06:02.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:01 smithi194 ceph-mon[35694]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:04.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:04 smithi086 ceph-mon[30379]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:04.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:04 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2906123087' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c8594d9-50ac-433d-ba13-ad218f127bda"}]: dispatch 2024-09-13T16:06:04.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:04 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2906123087' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c8594d9-50ac-433d-ba13-ad218f127bda"}]': finished 2024-09-13T16:06:04.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:04 smithi086 ceph-mon[30379]: osdmap e65: 10 total, 9 up, 10 in 2024-09-13T16:06:04.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:04 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:06:04.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:04 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/41600253' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:06:04.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:04 smithi139 ceph-mon[35320]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:04.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:04 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2906123087' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c8594d9-50ac-433d-ba13-ad218f127bda"}]: dispatch 2024-09-13T16:06:04.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:04 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2906123087' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c8594d9-50ac-433d-ba13-ad218f127bda"}]': finished 2024-09-13T16:06:04.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:04 smithi139 ceph-mon[35320]: osdmap e65: 10 total, 9 up, 10 in 2024-09-13T16:06:04.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:04 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:06:04.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:04 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/41600253' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:06:04.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:04 smithi194 ceph-mon[35694]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:04.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:04 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2906123087' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c8594d9-50ac-433d-ba13-ad218f127bda"}]: dispatch 2024-09-13T16:06:04.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:04 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2906123087' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c8594d9-50ac-433d-ba13-ad218f127bda"}]': finished 2024-09-13T16:06:04.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:04 smithi194 ceph-mon[35694]: osdmap e65: 10 total, 9 up, 10 in 2024-09-13T16:06:04.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:04 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:06:04.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:04 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/41600253' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:06:06.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:06 smithi086 ceph-mon[30379]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T16:06:06.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:06 smithi139 ceph-mon[35320]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T16:06:06.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:06 smithi194 ceph-mon[35694]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T16:06:08.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:08 smithi086 ceph-mon[30379]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-13T16:06:08.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:08 smithi139 ceph-mon[35320]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-13T16:06:08.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:08 smithi194 ceph-mon[35694]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-13T16:06:10.473 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:10 smithi086 ceph-mon[30379]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-13T16:06:10.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:10 smithi139 ceph-mon[35320]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-13T16:06:10.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:10 smithi194 ceph-mon[35694]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-13T16:06:12.657 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:12 smithi086 ceph-mon[30379]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T16:06:12.658 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-13T16:06:12.658 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:12.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:12 smithi139 ceph-mon[35320]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T16:06:12.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-13T16:06:12.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:12.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:12 smithi194 ceph-mon[35694]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T16:06:12.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-13T16:06:12.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:13.547 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:13 smithi086 ceph-mon[30379]: Deploying daemon osd.9 on smithi086 2024-09-13T16:06:13.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:13 smithi139 ceph-mon[35320]: Deploying daemon osd.9 on smithi086 2024-09-13T16:06:13.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:13 smithi194 ceph-mon[35694]: Deploying daemon osd.9 on smithi086 2024-09-13T16:06:14.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:14 smithi086 ceph-mon[30379]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T16:06:14.649 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:14 smithi139 ceph-mon[35320]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T16:06:14.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:14 smithi194 ceph-mon[35694]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T16:06:16.509 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:16 smithi086 ceph-mon[30379]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:16.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:16 smithi139 ceph-mon[35320]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:16.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:16 smithi194 ceph-mon[35694]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:18.569 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:18 smithi086 ceph-mon[30379]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:18.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:18 smithi139 ceph-mon[35320]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:18.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:18 smithi194 ceph-mon[35694]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:19.655 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:19 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:06:19.656 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:19 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:19.656 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:19 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:19.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:19 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:06:19.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:19 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:19.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:19 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:19.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:19 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:06:19.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:19 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:19.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:19 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:20.663 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:20 smithi086 ceph-mon[30379]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:20.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:20 smithi139 ceph-mon[35320]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:20.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:20 smithi194 ceph-mon[35694]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:22.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:22 smithi139 ceph-mon[35320]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:22.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:22 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:22.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:22 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:22.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:22 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:22.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:22 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:06:22.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:22 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:22.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:22 smithi194 ceph-mon[35694]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:22.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:22 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:22.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:22 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:22.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:22 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:22.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:22 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:06:22.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:22 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:22.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:22 smithi086 ceph-mon[30379]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:22.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:22 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:22.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:22 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:22.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:22 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:22.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:22 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:06:22.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:22 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:23.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:23.472+0000 7f7729600640 1 -- 172.21.15.86:0/2113106642 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f772c1a0570 con 0x7f77140a1120 2024-09-13T16:06:23.475 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 9 on host 'smithi086' 2024-09-13T16:06:23.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:23.475+0000 7f7732600640 1 -- 172.21.15.86:0/2113106642 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f77140a1120 msgr2=0x7f77140a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:23.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:23.475+0000 7f7732600640 1 --2- 172.21.15.86:0/2113106642 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f77140a1120 0x7f77140a35e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f772002aa00 tx=0x7f77200058d0 comp rx=0 tx=0).stop 2024-09-13T16:06:23.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:23.475+0000 7f7732600640 1 -- 172.21.15.86:0/2113106642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f772c100e30 msgr2=0x7f772c1983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:23.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:23.475+0000 7f7732600640 1 --2- 172.21.15.86:0/2113106642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f772c100e30 0x7f772c1983e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f771800e9f0 tx=0x7f771800eeb0 comp rx=0 tx=0).stop 2024-09-13T16:06:23.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:23.475+0000 7f7732600640 1 -- 172.21.15.86:0/2113106642 shutdown_connections 2024-09-13T16:06:23.477 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:23.475+0000 7f7732600640 1 --2- 172.21.15.86:0/2113106642 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f77140a1120 0x7f77140a35e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:23.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:23.475+0000 7f7732600640 1 --2- 172.21.15.86:0/2113106642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f772c1017f0 0x7f772c19f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:23.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:23.475+0000 7f7732600640 1 --2- 172.21.15.86:0/2113106642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f772c100e30 0x7f772c1983e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:23.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:23.475+0000 7f7732600640 1 --2- 172.21.15.86:0/2113106642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f772c0ffc30 0x7f772c197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:23.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:23.475+0000 7f7732600640 1 -- 172.21.15.86:0/2113106642 >> 172.21.15.86:0/2113106642 conn(0x7f772c0fb3c0 msgr2=0x7f772c106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:23.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:23.475+0000 7f7732600640 1 -- 172.21.15.86:0/2113106642 shutdown_connections 2024-09-13T16:06:23.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:06:23.475+0000 7f7732600640 1 -- 172.21.15.86:0/2113106642 wait complete. 2024-09-13T16:06:23.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:23 smithi139 ceph-mon[35320]: from='osd.9 [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T16:06:23.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:23 smithi194 ceph-mon[35694]: from='osd.9 [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T16:06:23.847 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:23 smithi086 ceph-mon[30379]: from='osd.9 [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T16:06:24.335 DEBUG:teuthology.orchestra.run.smithi086:osd.9> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.9.service 2024-09-13T16:06:24.339 INFO:tasks.cephadm:Deploying osd.10 on smithi139 with /dev/vg_nvme/lv_1... 2024-09-13T16:06:24.340 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-13T16:06:24.548 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:06:24.565 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:24 smithi086 ceph-mon[30379]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:24.566 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:24 smithi086 ceph-mon[30379]: from='osd.9 [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-13T16:06:24.566 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:24 smithi086 ceph-mon[30379]: osdmap e66: 10 total, 9 up, 10 in 2024-09-13T16:06:24.566 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:24 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:06:24.566 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:24 smithi086 ceph-mon[30379]: from='osd.9 [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-13T16:06:24.566 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:24 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:06:24.566 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:24 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:24.566 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:24 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:24.566 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:06:24 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:06:24.415+0000 7fd11b800640 -1 osd.9 0 waiting for initial osdmap 2024-09-13T16:06:24.567 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:06:24 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:06:24.435+0000 7fd116800640 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:06:24.669 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:24 smithi139 ceph-mon[35320]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:24.669 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:24 smithi139 ceph-mon[35320]: from='osd.9 [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-13T16:06:24.669 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:24 smithi139 ceph-mon[35320]: osdmap e66: 10 total, 9 up, 10 in 2024-09-13T16:06:24.669 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:24 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:06:24.669 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:24 smithi139 ceph-mon[35320]: from='osd.9 [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-13T16:06:24.669 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:24 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:06:24.670 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:24 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:24.670 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:24 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:24.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:24 smithi194 ceph-mon[35694]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:24.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:24 smithi194 ceph-mon[35694]: from='osd.9 [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-13T16:06:24.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:24 smithi194 ceph-mon[35694]: osdmap e66: 10 total, 9 up, 10 in 2024-09-13T16:06:24.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:24 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:06:24.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:24 smithi194 ceph-mon[35694]: from='osd.9 [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-13T16:06:24.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:24 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:06:24.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:24 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:24.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:24 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:25.705 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:25 smithi086 ceph-mon[30379]: from='osd.9 [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-13T16:06:25.705 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:25 smithi086 ceph-mon[30379]: osdmap e67: 10 total, 9 up, 10 in 2024-09-13T16:06:25.705 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:25 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:06:25.705 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:25 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:06:25.726 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:25 smithi139 ceph-mon[35320]: from='osd.9 [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-13T16:06:25.726 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:25 smithi139 ceph-mon[35320]: osdmap e67: 10 total, 9 up, 10 in 2024-09-13T16:06:25.726 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:25 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:06:25.726 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:25 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:06:25.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:25 smithi194 ceph-mon[35694]: from='osd.9 [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-13T16:06:25.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:25 smithi194 ceph-mon[35694]: osdmap e67: 10 total, 9 up, 10 in 2024-09-13T16:06:25.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:25 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:06:25.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:25 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:06:26.512 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:26 smithi139 ceph-mon[35320]: purged_snaps scrub starts 2024-09-13T16:06:26.512 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:26 smithi139 ceph-mon[35320]: purged_snaps scrub ok 2024-09-13T16:06:26.512 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:26 smithi139 ceph-mon[35320]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:26.512 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:26 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:06:26.512 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:26 smithi139 ceph-mon[35320]: osd.9 [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980] boot 2024-09-13T16:06:26.512 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:26 smithi139 ceph-mon[35320]: osdmap e68: 10 total, 10 up, 10 in 2024-09-13T16:06:26.512 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:26 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:06:26.525 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-13T16:06:26.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:26 smithi086 ceph-mon[30379]: purged_snaps scrub starts 2024-09-13T16:06:26.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:26 smithi086 ceph-mon[30379]: purged_snaps scrub ok 2024-09-13T16:06:26.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:26 smithi086 ceph-mon[30379]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:26.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:26 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:06:26.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:26 smithi086 ceph-mon[30379]: osd.9 [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980] boot 2024-09-13T16:06:26.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:26 smithi086 ceph-mon[30379]: osdmap e68: 10 total, 10 up, 10 in 2024-09-13T16:06:26.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:26 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:06:26.625 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-13T16:06:26.638 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2024-09-13T16:06:26.638 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2024-09-13T16:06:26.638 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113174 s, 927 MB/s 2024-09-13T16:06:26.638 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2024-09-13T16:06:26.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:26 smithi194 ceph-mon[35694]: purged_snaps scrub starts 2024-09-13T16:06:26.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:26 smithi194 ceph-mon[35694]: purged_snaps scrub ok 2024-09-13T16:06:26.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:26 smithi194 ceph-mon[35694]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:06:26.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:26 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:06:26.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:26 smithi194 ceph-mon[35694]: osd.9 [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980] boot 2024-09-13T16:06:26.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:26 smithi194 ceph-mon[35694]: osdmap e68: 10 total, 10 up, 10 in 2024-09-13T16:06:26.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:26 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:06:27.451 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_1 2024-09-13T16:06:27.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:27 smithi086 ceph-mon[30379]: osdmap e69: 10 total, 10 up, 10 in 2024-09-13T16:06:27.647 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:06:27.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:27 smithi139 ceph-mon[35320]: osdmap e69: 10 total, 10 up, 10 in 2024-09-13T16:06:27.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:27 smithi194 ceph-mon[35694]: osdmap e69: 10 total, 10 up, 10 in 2024-09-13T16:06:28.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:28 smithi139 ceph-mon[35320]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:28.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:28 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:28.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:28 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:28.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:28 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:28.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:28 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:28.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:28 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:28.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:28 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:28.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:28 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:28.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:28 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:28.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:28 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:06:28.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:28 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:28 smithi194 ceph-mon[35694]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:28 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:28 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:28 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:28 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:28 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:28 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:28 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:28 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:28 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:06:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:28 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:28.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:28 smithi086 ceph-mon[30379]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:28.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:28 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:28.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:28 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:28.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:28 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:28.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:28 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:28.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:28 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:28.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:28 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:28.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:28 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:28.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:28 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:28.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:28 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:06:28.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:28 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:29.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.372+0000 7f972bab7640 1 -- 172.21.15.139:0/2606512898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9724100f60 msgr2=0x7f97241013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:29.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.372+0000 7f972bab7640 1 --2- 172.21.15.139:0/2606512898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9724100f60 0x7f97241013e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9714009900 tx=0x7f971402a410 comp rx=0 tx=0).stop 2024-09-13T16:06:29.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.372+0000 7f972bab7640 1 -- 172.21.15.139:0/2606512898 shutdown_connections 2024-09-13T16:06:29.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.372+0000 7f972bab7640 1 --2- 172.21.15.139:0/2606512898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9724101920 0x7f9724108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:29.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.372+0000 7f972bab7640 1 --2- 172.21.15.139:0/2606512898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9724100f60 0x7f97241013e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:29.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.372+0000 7f972bab7640 1 --2- 172.21.15.139:0/2606512898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97240ffe00 0x7f9724100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:29.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.372+0000 7f972bab7640 1 -- 172.21.15.139:0/2606512898 >> 172.21.15.139:0/2606512898 conn(0x7f97240fb5d0 msgr2=0x7f97240fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:29.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.372+0000 7f972bab7640 1 -- 172.21.15.139:0/2606512898 shutdown_connections 2024-09-13T16:06:29.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.372+0000 7f972bab7640 1 -- 172.21.15.139:0/2606512898 wait complete. 2024-09-13T16:06:29.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.372+0000 7f972bab7640 1 Processor -- start 2024-09-13T16:06:29.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.372+0000 7f972bab7640 1 -- start start 2024-09-13T16:06:29.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.372+0000 7f972bab7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97240ffe00 0x7f9724074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:29.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.372+0000 7f972bab7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9724100f60 0x7f97240728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:29.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.372+0000 7f972bab7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9724101920 0x7f9724072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:29.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.372+0000 7f972bab7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97240734e0 con 0x7f9724101920 2024-09-13T16:06:29.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.372+0000 7f972bab7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9724073650 con 0x7f9724100f60 2024-09-13T16:06:29.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.372+0000 7f972bab7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972419fe80 con 0x7f97240ffe00 2024-09-13T16:06:29.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.373+0000 7f9729052640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9724100f60 0x7f97240728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:29.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.373+0000 7f9729052640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9724100f60 0x7f97240728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:59958/0 (socket says 172.21.15.139:59958) 2024-09-13T16:06:29.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.373+0000 7f9729052640 1 -- 172.21.15.139:0/1117390009 learned_addr learned my addr 172.21.15.139:0/1117390009 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T16:06:29.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.373+0000 7f9729853640 1 --2- 172.21.15.139:0/1117390009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97240ffe00 0x7f9724074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:29.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.373+0000 7f9729052640 1 -- 172.21.15.139:0/1117390009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97240ffe00 msgr2=0x7f9724074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:29.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.373+0000 7f9729052640 1 --2- 172.21.15.139:0/1117390009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97240ffe00 0x7f9724074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:29.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.373+0000 7f9729052640 1 -- 172.21.15.139:0/1117390009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9724101920 msgr2=0x7f9724072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:29.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.373+0000 7f9729052640 1 --2- 172.21.15.139:0/1117390009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9724101920 0x7f9724072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:29.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.373+0000 7f9729052640 1 -- 172.21.15.139:0/1117390009 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9714009560 con 0x7f9724100f60 2024-09-13T16:06:29.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.373+0000 7f9729853640 1 --2- 172.21.15.139:0/1117390009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97240ffe00 0x7f9724074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:06:29.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.373+0000 7f9729052640 1 --2- 172.21.15.139:0/1117390009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9724100f60 0x7f97240728a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9714031510 tx=0x7f9714004430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:29.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.373+0000 7f971affd640 1 -- 172.21.15.139:0/1117390009 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9714005210 con 0x7f9724100f60 2024-09-13T16:06:29.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.373+0000 7f972bab7640 1 -- 172.21.15.139:0/1117390009 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97241a0080 con 0x7f9724100f60 2024-09-13T16:06:29.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.373+0000 7f971affd640 1 -- 172.21.15.139:0/1117390009 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9714004ba0 con 0x7f9724100f60 2024-09-13T16:06:29.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.373+0000 7f971affd640 1 -- 172.21.15.139:0/1117390009 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9714003c50 con 0x7f9724100f60 2024-09-13T16:06:29.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.373+0000 7f972bab7640 1 -- 172.21.15.139:0/1117390009 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97241a0520 con 0x7f9724100f60 2024-09-13T16:06:29.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.374+0000 7f972bab7640 1 -- 172.21.15.139:0/1117390009 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97241071c0 con 0x7f9724100f60 2024-09-13T16:06:29.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.375+0000 7f971affd640 1 -- 172.21.15.139:0/1117390009 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9714004d10 con 0x7f9724100f60 2024-09-13T16:06:29.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.376+0000 7f971affd640 1 --2- 172.21.15.139:0/1117390009 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f97100a1080 0x7f97100a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:29.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.376+0000 7f971affd640 1 -- 172.21.15.139:0/1117390009 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f97140ecee0 con 0x7f9724100f60 2024-09-13T16:06:29.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.377+0000 7f9729853640 1 --2- 172.21.15.139:0/1117390009 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f97100a1080 0x7f97100a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:29.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.377+0000 7f9729853640 1 --2- 172.21.15.139:0/1117390009 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f97100a1080 0x7f97100a3540 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9720005d00 tx=0x7f9720005ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:29.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.380+0000 7f971affd640 1 -- 172.21.15.139:0/1117390009 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f97140b6e70 con 0x7f9724100f60 2024-09-13T16:06:29.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:29.552+0000 7f972bab7640 1 -- 172.21.15.139:0/1117390009 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f97240608f0 con 0x7f97100a1080 2024-09-13T16:06:29.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:29 smithi139 ceph-mon[35320]: Detected new or changed devices on smithi086 2024-09-13T16:06:29.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:29 smithi139 ceph-mon[35320]: Adjusting osd_memory_target on smithi086 to 4272M 2024-09-13T16:06:29.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:29 smithi194 ceph-mon[35694]: Detected new or changed devices on smithi086 2024-09-13T16:06:29.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:29 smithi194 ceph-mon[35694]: Adjusting osd_memory_target on smithi086 to 4272M 2024-09-13T16:06:29.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:29 smithi086 ceph-mon[30379]: Detected new or changed devices on smithi086 2024-09-13T16:06:29.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:29 smithi086 ceph-mon[30379]: Adjusting osd_memory_target on smithi086 to 4272M 2024-09-13T16:06:30.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:30 smithi139 ceph-mon[35320]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:30.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:30 smithi139 ceph-mon[35320]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:06:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:06:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:06:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:30 smithi194 ceph-mon[35694]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:30 smithi194 ceph-mon[35694]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:06:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:06:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:06:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:30 smithi086 ceph-mon[30379]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:30 smithi086 ceph-mon[30379]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:06:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:06:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:06:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:32.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:32 smithi139 ceph-mon[35320]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:32.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:32 smithi139 ceph-mon[35320]: from='client.? 172.21.15.139:0/4244497683' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76100365-5171-4b49-86f5-6dafe8134186"}]: dispatch 2024-09-13T16:06:32.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:32 smithi139 ceph-mon[35320]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76100365-5171-4b49-86f5-6dafe8134186"}]: dispatch 2024-09-13T16:06:32.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:32 smithi139 ceph-mon[35320]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76100365-5171-4b49-86f5-6dafe8134186"}]': finished 2024-09-13T16:06:32.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:32 smithi139 ceph-mon[35320]: osdmap e70: 11 total, 10 up, 11 in 2024-09-13T16:06:32.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:32 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:06:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:32 smithi194 ceph-mon[35694]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:32 smithi194 ceph-mon[35694]: from='client.? 172.21.15.139:0/4244497683' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76100365-5171-4b49-86f5-6dafe8134186"}]: dispatch 2024-09-13T16:06:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:32 smithi194 ceph-mon[35694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76100365-5171-4b49-86f5-6dafe8134186"}]: dispatch 2024-09-13T16:06:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:32 smithi194 ceph-mon[35694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76100365-5171-4b49-86f5-6dafe8134186"}]': finished 2024-09-13T16:06:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:32 smithi194 ceph-mon[35694]: osdmap e70: 11 total, 10 up, 11 in 2024-09-13T16:06:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:32 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:06:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:32 smithi086 ceph-mon[30379]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:32 smithi086 ceph-mon[30379]: from='client.? 172.21.15.139:0/4244497683' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76100365-5171-4b49-86f5-6dafe8134186"}]: dispatch 2024-09-13T16:06:32.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:32 smithi086 ceph-mon[30379]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76100365-5171-4b49-86f5-6dafe8134186"}]: dispatch 2024-09-13T16:06:32.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:32 smithi086 ceph-mon[30379]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76100365-5171-4b49-86f5-6dafe8134186"}]': finished 2024-09-13T16:06:32.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:32 smithi086 ceph-mon[30379]: osdmap e70: 11 total, 10 up, 11 in 2024-09-13T16:06:32.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:32 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:06:33.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:33 smithi139 ceph-mon[35320]: from='client.? 172.21.15.139:0/1484078793' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:06:33.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:33 smithi194 ceph-mon[35694]: from='client.? 172.21.15.139:0/1484078793' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:06:33.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:33 smithi086 ceph-mon[30379]: from='client.? 172.21.15.139:0/1484078793' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:06:34.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:34 smithi139 ceph-mon[35320]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:34.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:34 smithi194 ceph-mon[35694]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:34.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:34 smithi086 ceph-mon[30379]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:36.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:36 smithi139 ceph-mon[35320]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:36.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:36 smithi194 ceph-mon[35694]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:36.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:36 smithi086 ceph-mon[30379]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:38.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:38 smithi139 ceph-mon[35320]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:38.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:38 smithi194 ceph-mon[35694]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:38.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:38 smithi086 ceph-mon[30379]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:39.745 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:39 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-13T16:06:39.746 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:39 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:39.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:39 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-13T16:06:39.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:39 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:39.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:39 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-13T16:06:39.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:39 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:40.733 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:40 smithi139 ceph-mon[35320]: Deploying daemon osd.10 on smithi139 2024-09-13T16:06:40.733 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:40 smithi139 ceph-mon[35320]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:40.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:40 smithi194 ceph-mon[35694]: Deploying daemon osd.10 on smithi139 2024-09-13T16:06:40.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:40 smithi194 ceph-mon[35694]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:40.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:40 smithi086 ceph-mon[30379]: Deploying daemon osd.10 on smithi139 2024-09-13T16:06:40.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:40 smithi086 ceph-mon[30379]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:42.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:42 smithi139 ceph-mon[35320]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:42.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:42 smithi194 ceph-mon[35694]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:42 smithi086 ceph-mon[30379]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:44.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:44 smithi139 ceph-mon[35320]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:44.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:44 smithi194 ceph-mon[35694]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:44.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:44 smithi086 ceph-mon[30379]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:45.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:45 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:06:45.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:45 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:45.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:45 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:45.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:45 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:06:45.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:45 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:45.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:45 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:45.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:06:45.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:45.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:46.860 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:46 smithi139 ceph-mon[35320]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:46.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:46 smithi086 ceph-mon[30379]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:47.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:46 smithi194 ceph-mon[35694]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:48.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:48.047+0000 7f971affd640 1 -- 172.21.15.139:0/1117390009 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f97240608f0 con 0x7f97100a1080 2024-09-13T16:06:48.049 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 10 on host 'smithi139' 2024-09-13T16:06:48.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:48.050+0000 7f972bab7640 1 -- 172.21.15.139:0/1117390009 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f97100a1080 msgr2=0x7f97100a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:48.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:48.050+0000 7f972bab7640 1 --2- 172.21.15.139:0/1117390009 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f97100a1080 0x7f97100a3540 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9720005d00 tx=0x7f9720005ed0 comp rx=0 tx=0).stop 2024-09-13T16:06:48.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:48.050+0000 7f972bab7640 1 -- 172.21.15.139:0/1117390009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9724100f60 msgr2=0x7f97240728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:48.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:48.050+0000 7f972bab7640 1 --2- 172.21.15.139:0/1117390009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9724100f60 0x7f97240728a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9714031510 tx=0x7f9714004430 comp rx=0 tx=0).stop 2024-09-13T16:06:48.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:48.050+0000 7f972bab7640 1 -- 172.21.15.139:0/1117390009 shutdown_connections 2024-09-13T16:06:48.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:48.050+0000 7f972bab7640 1 --2- 172.21.15.139:0/1117390009 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f97100a1080 0x7f97100a3540 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:48.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:48.050+0000 7f972bab7640 1 --2- 172.21.15.139:0/1117390009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9724101920 0x7f9724072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:48.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:48.050+0000 7f972bab7640 1 --2- 172.21.15.139:0/1117390009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9724100f60 0x7f97240728a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:48.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:48.050+0000 7f972bab7640 1 --2- 172.21.15.139:0/1117390009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97240ffe00 0x7f9724074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:48.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:48.050+0000 7f972bab7640 1 -- 172.21.15.139:0/1117390009 >> 172.21.15.139:0/1117390009 conn(0x7f97240fb5d0 msgr2=0x7f9724104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:48.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:48.050+0000 7f972bab7640 1 -- 172.21.15.139:0/1117390009 shutdown_connections 2024-09-13T16:06:48.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T16:06:48.050+0000 7f972bab7640 1 -- 172.21.15.139:0/1117390009 wait complete. 2024-09-13T16:06:48.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:48 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:48.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:48 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:48.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:48 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:48.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:48 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:06:48.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:48 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:48.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:48 smithi086 ceph-mon[30379]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:48.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:48 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:06:48.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:48 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:48.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:48 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:48.727 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:48 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:48.727 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:48 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:48.727 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:48 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:48.727 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:48 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:06:48.727 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:48 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:48.727 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:48 smithi139 ceph-mon[35320]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:48.727 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:48 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:06:48.727 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:48 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:48.727 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:48 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:48.748 DEBUG:teuthology.orchestra.run.smithi139:osd.10> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.10.service 2024-09-13T16:06:48.750 INFO:tasks.cephadm:Deploying osd.11 on smithi194 with /dev/vg_nvme/lv_1... 2024-09-13T16:06:48.750 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-13T16:06:48.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:48 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:48.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:48 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:48.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:48 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:48.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:48 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:06:48.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:48 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:48.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:48 smithi194 ceph-mon[35694]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:48.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:48 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:06:48.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:48 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:48.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:48 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:48.957 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:06:49.350 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:49 smithi194 ceph-mon[35694]: from='osd.10 [v2:172.21.15.139:6824/4290408323,v1:172.21.15.139:6825/4290408323]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T16:06:49.350 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:49 smithi194 ceph-mon[35694]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T16:06:49.608 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:49 smithi139 ceph-mon[35320]: from='osd.10 [v2:172.21.15.139:6824/4290408323,v1:172.21.15.139:6825/4290408323]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T16:06:49.608 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:49 smithi139 ceph-mon[35320]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T16:06:49.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:49 smithi086 ceph-mon[30379]: from='osd.10 [v2:172.21.15.139:6824/4290408323,v1:172.21.15.139:6825/4290408323]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T16:06:49.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:49 smithi086 ceph-mon[30379]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T16:06:50.471 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:50 smithi139 ceph-mon[35320]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-13T16:06:50.471 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:50 smithi139 ceph-mon[35320]: osdmap e71: 11 total, 10 up, 11 in 2024-09-13T16:06:50.471 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:50 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:06:50.472 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:50 smithi139 ceph-mon[35320]: from='osd.10 [v2:172.21.15.139:6824/4290408323,v1:172.21.15.139:6825/4290408323]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:06:50.472 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:50 smithi139 ceph-mon[35320]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:06:50.472 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:50 smithi139 ceph-mon[35320]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:50.472 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:06:50 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:06:50.303+0000 7fbdaed0f640 -1 osd.10 0 waiting for initial osdmap 2024-09-13T16:06:50.472 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:06:50 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:06:50.316+0000 7fbdaab38640 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:06:50.482 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:50 smithi194 ceph-mon[35694]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-13T16:06:50.482 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:50 smithi194 ceph-mon[35694]: osdmap e71: 11 total, 10 up, 11 in 2024-09-13T16:06:50.482 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:50 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:06:50.482 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:50 smithi194 ceph-mon[35694]: from='osd.10 [v2:172.21.15.139:6824/4290408323,v1:172.21.15.139:6825/4290408323]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:06:50.483 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:50 smithi194 ceph-mon[35694]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:06:50.483 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:50 smithi194 ceph-mon[35694]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:50.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:50 smithi086 ceph-mon[30379]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-13T16:06:50.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:50 smithi086 ceph-mon[30379]: osdmap e71: 11 total, 10 up, 11 in 2024-09-13T16:06:50.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:50 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:06:50.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:50 smithi086 ceph-mon[30379]: from='osd.10 [v2:172.21.15.139:6824/4290408323,v1:172.21.15.139:6825/4290408323]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:06:50.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:50 smithi086 ceph-mon[30379]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-13T16:06:50.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:50 smithi086 ceph-mon[30379]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:06:50.853 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-13T16:06:50.936 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-13T16:06:50.950 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2024-09-13T16:06:50.950 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2024-09-13T16:06:50.951 INFO:teuthology.orchestra.run.smithi194.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0118387 s, 886 MB/s 2024-09-13T16:06:50.951 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2024-09-13T16:06:51.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:51 smithi086 ceph-mon[30379]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-13T16:06:51.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:51 smithi086 ceph-mon[30379]: osdmap e72: 11 total, 10 up, 11 in 2024-09-13T16:06:51.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:06:51.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:51 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:06:51.654 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:51 smithi194 ceph-mon[35694]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-13T16:06:51.654 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:51 smithi194 ceph-mon[35694]: osdmap e72: 11 total, 10 up, 11 in 2024-09-13T16:06:51.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:06:51.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:51 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:06:51.677 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_1 2024-09-13T16:06:51.709 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:51 smithi139 ceph-mon[35320]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-13T16:06:51.709 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:51 smithi139 ceph-mon[35320]: osdmap e72: 11 total, 10 up, 11 in 2024-09-13T16:06:51.709 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:51 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:06:51.709 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:51 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:06:51.923 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:06:52.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:52 smithi086 ceph-mon[30379]: purged_snaps scrub starts 2024-09-13T16:06:52.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:52 smithi086 ceph-mon[30379]: purged_snaps scrub ok 2024-09-13T16:06:52.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:52 smithi086 ceph-mon[30379]: osd.10 [v2:172.21.15.139:6824/4290408323,v1:172.21.15.139:6825/4290408323] boot 2024-09-13T16:06:52.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:52 smithi086 ceph-mon[30379]: osdmap e73: 11 total, 11 up, 11 in 2024-09-13T16:06:52.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:06:52.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:52 smithi086 ceph-mon[30379]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:06:52.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:52.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:52.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:52.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:52.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:52.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:52.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:52.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:52.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:06:52.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:52.617 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:52 smithi086 ceph-mon[30379]: osdmap e74: 11 total, 11 up, 11 in 2024-09-13T16:06:52.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:52 smithi139 ceph-mon[35320]: purged_snaps scrub starts 2024-09-13T16:06:52.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:52 smithi139 ceph-mon[35320]: purged_snaps scrub ok 2024-09-13T16:06:52.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:52 smithi139 ceph-mon[35320]: osd.10 [v2:172.21.15.139:6824/4290408323,v1:172.21.15.139:6825/4290408323] boot 2024-09-13T16:06:52.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:52 smithi139 ceph-mon[35320]: osdmap e73: 11 total, 11 up, 11 in 2024-09-13T16:06:52.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:52 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:06:52.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:52 smithi139 ceph-mon[35320]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:06:52.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:52 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:52.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:52 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:52.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:52 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:52.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:52 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:52.750 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:52 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:52.750 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:52 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:52.750 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:52 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:52.750 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:52 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:52.750 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:52 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:06:52.750 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:52 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:52.750 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:52 smithi139 ceph-mon[35320]: osdmap e74: 11 total, 11 up, 11 in 2024-09-13T16:06:52.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:52 smithi194 ceph-mon[35694]: purged_snaps scrub starts 2024-09-13T16:06:52.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:52 smithi194 ceph-mon[35694]: purged_snaps scrub ok 2024-09-13T16:06:52.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:52 smithi194 ceph-mon[35694]: osd.10 [v2:172.21.15.139:6824/4290408323,v1:172.21.15.139:6825/4290408323] boot 2024-09-13T16:06:52.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:52 smithi194 ceph-mon[35694]: osdmap e73: 11 total, 11 up, 11 in 2024-09-13T16:06:52.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:06:52.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:52 smithi194 ceph-mon[35694]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:06:52.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:52.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:52.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:52.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:52.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:52.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:06:52.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:52.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:52.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:06:52.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:06:52.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:52 smithi194 ceph-mon[35694]: osdmap e74: 11 total, 11 up, 11 in 2024-09-13T16:06:53.496 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:53 smithi194 ceph-mon[35694]: Detected new or changed devices on smithi139 2024-09-13T16:06:53.497 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:53 smithi194 ceph-mon[35694]: Adjusting osd_memory_target on smithi139 to 4272M 2024-09-13T16:06:53.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:53 smithi086 ceph-mon[30379]: Detected new or changed devices on smithi139 2024-09-13T16:06:53.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:53 smithi086 ceph-mon[30379]: Adjusting osd_memory_target on smithi139 to 4272M 2024-09-13T16:06:53.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.704+0000 7ff3305c9640 1 -- 172.21.15.194:0/230453053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3280ffe00 msgr2=0x7ff328100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:53.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.704+0000 7ff3305c9640 1 --2- 172.21.15.194:0/230453053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3280ffe00 0x7ff328100200 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff324009900 tx=0x7ff32402a410 comp rx=0 tx=0).stop 2024-09-13T16:06:53.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.704+0000 7ff3305c9640 1 -- 172.21.15.194:0/230453053 shutdown_connections 2024-09-13T16:06:53.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.704+0000 7ff3305c9640 1 --2- 172.21.15.194:0/230453053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff328101920 0x7ff328108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:53.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.704+0000 7ff3305c9640 1 --2- 172.21.15.194:0/230453053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff328100f60 0x7ff3281013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:53.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.704+0000 7ff3305c9640 1 --2- 172.21.15.194:0/230453053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3280ffe00 0x7ff328100200 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:53.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.704+0000 7ff3305c9640 1 -- 172.21.15.194:0/230453053 >> 172.21.15.194:0/230453053 conn(0x7ff3280fb5d0 msgr2=0x7ff3280fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:53.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.704+0000 7ff3305c9640 1 -- 172.21.15.194:0/230453053 shutdown_connections 2024-09-13T16:06:53.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.704+0000 7ff3305c9640 1 -- 172.21.15.194:0/230453053 wait complete. 2024-09-13T16:06:53.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.705+0000 7ff3305c9640 1 Processor -- start 2024-09-13T16:06:53.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.705+0000 7ff3305c9640 1 -- start start 2024-09-13T16:06:53.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.705+0000 7ff3305c9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3280ffe00 0x7ff328195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:53.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.705+0000 7ff3305c9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff328100f60 0x7ff328196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:53.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.705+0000 7ff3305c9640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff328101920 0x7ff32819d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:53.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.705+0000 7ff3305c9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32819d9b0 con 0x7ff3280ffe00 2024-09-13T16:06:53.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.705+0000 7ff3305c9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32819db20 con 0x7ff328100f60 2024-09-13T16:06:53.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.705+0000 7ff3305c9640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32819dce0 con 0x7ff328101920 2024-09-13T16:06:53.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.705+0000 7ff32eb66640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff328101920 0x7ff32819d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:53.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.705+0000 7ff32eb66640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff328101920 0x7ff32819d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:47294/0 (socket says 172.21.15.194:47294) 2024-09-13T16:06:53.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.705+0000 7ff32eb66640 1 -- 172.21.15.194:0/1255993307 learned_addr learned my addr 172.21.15.194:0/1255993307 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T16:06:53.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.705+0000 7ff32db64640 1 --2- 172.21.15.194:0/1255993307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff328100f60 0x7ff328196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:53.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.705+0000 7ff32eb66640 1 -- 172.21.15.194:0/1255993307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff328100f60 msgr2=0x7ff328196440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:53.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.705+0000 7ff32eb66640 1 --2- 172.21.15.194:0/1255993307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff328100f60 0x7ff328196440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:53.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.705+0000 7ff32eb66640 1 -- 172.21.15.194:0/1255993307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3280ffe00 msgr2=0x7ff328195f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:53.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.705+0000 7ff32eb66640 1 --2- 172.21.15.194:0/1255993307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3280ffe00 0x7ff328195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:53.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.705+0000 7ff32eb66640 1 -- 172.21.15.194:0/1255993307 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff324009560 con 0x7ff328101920 2024-09-13T16:06:53.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.706+0000 7ff32eb66640 1 --2- 172.21.15.194:0/1255993307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff328101920 0x7ff32819d470 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff32000b970 tx=0x7ff32000be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:53.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.706+0000 7ff31f7fe640 1 -- 172.21.15.194:0/1255993307 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32000cb40 con 0x7ff328101920 2024-09-13T16:06:53.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.706+0000 7ff31f7fe640 1 -- 172.21.15.194:0/1255993307 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff32000cca0 con 0x7ff328101920 2024-09-13T16:06:53.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.706+0000 7ff3305c9640 1 -- 172.21.15.194:0/1255993307 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32819dfc0 con 0x7ff328101920 2024-09-13T16:06:53.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.706+0000 7ff31f7fe640 1 -- 172.21.15.194:0/1255993307 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff320007780 con 0x7ff328101920 2024-09-13T16:06:53.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.706+0000 7ff3305c9640 1 -- 172.21.15.194:0/1255993307 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32819e3e0 con 0x7ff328101920 2024-09-13T16:06:53.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.707+0000 7ff3305c9640 1 -- 172.21.15.194:0/1255993307 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff328107190 con 0x7ff328101920 2024-09-13T16:06:53.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.708+0000 7ff31f7fe640 1 -- 172.21.15.194:0/1255993307 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff320014440 con 0x7ff328101920 2024-09-13T16:06:53.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.708+0000 7ff31f7fe640 1 --2- 172.21.15.194:0/1255993307 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff3140a10b0 0x7ff3140a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:53.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.709+0000 7ff31f7fe640 1 -- 172.21.15.194:0/1255993307 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6694+0+0 (secure 0 0 0) 0x7ff3200cbba0 con 0x7ff328101920 2024-09-13T16:06:53.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.709+0000 7ff32e365640 1 --2- 172.21.15.194:0/1255993307 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff3140a10b0 0x7ff3140a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:53.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.710+0000 7ff32e365640 1 --2- 172.21.15.194:0/1255993307 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff3140a10b0 0x7ff3140a3570 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff324009230 tx=0x7ff3240314d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:53.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.713+0000 7ff31f7fe640 1 -- 172.21.15.194:0/1255993307 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff320095980 con 0x7ff328101920 2024-09-13T16:06:53.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:53 smithi139 ceph-mon[35320]: Detected new or changed devices on smithi139 2024-09-13T16:06:53.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:53 smithi139 ceph-mon[35320]: Adjusting osd_memory_target on smithi139 to 4272M 2024-09-13T16:06:53.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:06:53.884+0000 7ff3305c9640 1 -- 172.21.15.194:0/1255993307 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff32802c550 con 0x7ff3140a10b0 2024-09-13T16:06:54.502 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:54 smithi194 ceph-mon[35694]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:06:54.502 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:54 smithi194 ceph-mon[35694]: osdmap e75: 11 total, 11 up, 11 in 2024-09-13T16:06:54.502 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:54 smithi194 ceph-mon[35694]: osdmap e76: 11 total, 11 up, 11 in 2024-09-13T16:06:54.502 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:54 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:06:54.502 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:54 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:06:54.502 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:54 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:54.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:54 smithi086 ceph-mon[30379]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:06:54.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:54 smithi086 ceph-mon[30379]: osdmap e75: 11 total, 11 up, 11 in 2024-09-13T16:06:54.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:54 smithi086 ceph-mon[30379]: osdmap e76: 11 total, 11 up, 11 in 2024-09-13T16:06:54.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:54 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:06:54.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:54 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:06:54.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:54 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:54.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:54 smithi139 ceph-mon[35320]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:06:54.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:54 smithi139 ceph-mon[35320]: osdmap e75: 11 total, 11 up, 11 in 2024-09-13T16:06:54.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:54 smithi139 ceph-mon[35320]: osdmap e76: 11 total, 11 up, 11 in 2024-09-13T16:06:54.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:06:54.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:06:54.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:54 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:55.700 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:55 smithi194 ceph-mon[35694]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:06:55.701 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:55 smithi194 ceph-mon[35694]: osdmap e77: 11 total, 11 up, 11 in 2024-09-13T16:06:55.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:55 smithi139 ceph-mon[35320]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:06:55.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:55 smithi139 ceph-mon[35320]: osdmap e77: 11 total, 11 up, 11 in 2024-09-13T16:06:55.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:55 smithi086 ceph-mon[30379]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:06:55.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:55 smithi086 ceph-mon[30379]: osdmap e77: 11 total, 11 up, 11 in 2024-09-13T16:06:56.733 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:56 smithi194 ceph-mon[35694]: pgmap v245: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T16:06:56.733 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:56 smithi194 ceph-mon[35694]: from='client.? 172.21.15.194:0/4221770104' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc3ff2ca-ee19-400d-90cf-3954079ab602"}]: dispatch 2024-09-13T16:06:56.733 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:56 smithi194 ceph-mon[35694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc3ff2ca-ee19-400d-90cf-3954079ab602"}]: dispatch 2024-09-13T16:06:56.733 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:56 smithi194 ceph-mon[35694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc3ff2ca-ee19-400d-90cf-3954079ab602"}]': finished 2024-09-13T16:06:56.733 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:56 smithi194 ceph-mon[35694]: osdmap e78: 12 total, 11 up, 12 in 2024-09-13T16:06:56.734 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:56 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:06:56.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:56 smithi139 ceph-mon[35320]: pgmap v245: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T16:06:56.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:56 smithi139 ceph-mon[35320]: from='client.? 172.21.15.194:0/4221770104' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc3ff2ca-ee19-400d-90cf-3954079ab602"}]: dispatch 2024-09-13T16:06:56.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:56 smithi139 ceph-mon[35320]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc3ff2ca-ee19-400d-90cf-3954079ab602"}]: dispatch 2024-09-13T16:06:56.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:56 smithi139 ceph-mon[35320]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc3ff2ca-ee19-400d-90cf-3954079ab602"}]': finished 2024-09-13T16:06:56.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:56 smithi139 ceph-mon[35320]: osdmap e78: 12 total, 11 up, 12 in 2024-09-13T16:06:56.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:56 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:06:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:56 smithi086 ceph-mon[30379]: pgmap v245: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T16:06:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:56 smithi086 ceph-mon[30379]: from='client.? 172.21.15.194:0/4221770104' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc3ff2ca-ee19-400d-90cf-3954079ab602"}]: dispatch 2024-09-13T16:06:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:56 smithi086 ceph-mon[30379]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc3ff2ca-ee19-400d-90cf-3954079ab602"}]: dispatch 2024-09-13T16:06:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:56 smithi086 ceph-mon[30379]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc3ff2ca-ee19-400d-90cf-3954079ab602"}]': finished 2024-09-13T16:06:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:56 smithi086 ceph-mon[30379]: osdmap e78: 12 total, 11 up, 12 in 2024-09-13T16:06:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:56 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:06:57.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:57 smithi139 ceph-mon[35320]: from='client.? 172.21.15.194:0/3373264302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:06:57.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:57 smithi194 ceph-mon[35694]: from='client.? 172.21.15.194:0/3373264302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:06:57.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:57 smithi086 ceph-mon[30379]: from='client.? 172.21.15.194:0/3373264302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:06:58.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:06:58 smithi139 ceph-mon[35320]: pgmap v247: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T16:06:58.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:06:58 smithi194 ceph-mon[35694]: pgmap v247: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T16:06:58.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:06:58 smithi086 ceph-mon[30379]: pgmap v247: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T16:06:59.615 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:06:59 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:06:59.269+0000 7f4ba5c00640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-13T16:07:00.700 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:00 smithi194 ceph-mon[35694]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T16:07:00.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:00 smithi139 ceph-mon[35320]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T16:07:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:00 smithi086 ceph-mon[30379]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T16:07:02.652 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:02 smithi194 ceph-mon[35694]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:02.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:02 smithi139 ceph-mon[35320]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:02.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:02 smithi086 ceph-mon[30379]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:03.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:03 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-13T16:07:03.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:03 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:03.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:03 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-13T16:07:03.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:03 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:03.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:03 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-13T16:07:03.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:03 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:04.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:04 smithi139 ceph-mon[35320]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:04.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:04 smithi139 ceph-mon[35320]: Deploying daemon osd.11 on smithi194 2024-09-13T16:07:04.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:04 smithi194 ceph-mon[35694]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:04.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:04 smithi194 ceph-mon[35694]: Deploying daemon osd.11 on smithi194 2024-09-13T16:07:04.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:04 smithi086 ceph-mon[30379]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:04.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:04 smithi086 ceph-mon[30379]: Deploying daemon osd.11 on smithi194 2024-09-13T16:07:06.745 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:06 smithi194 ceph-mon[35694]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:06.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:06 smithi139 ceph-mon[35320]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:06.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:06 smithi086 ceph-mon[30379]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:08.660 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:08 smithi194 ceph-mon[35694]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:08.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:08 smithi086 ceph-mon[30379]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:08.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:08 smithi139 ceph-mon[35320]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:09.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:09 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:07:09.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:09 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:09.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:09 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:09.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:09 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:07:09.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:09 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:09.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:09 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:09.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:09 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:07:09.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:09 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:09.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:09 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:10.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:10 smithi194 ceph-mon[35694]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:10.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:10 smithi086 ceph-mon[30379]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:10.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:10 smithi139 ceph-mon[35320]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:12.222 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 11 on host 'smithi194' 2024-09-13T16:07:12.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:12.220+0000 7ff31f7fe640 1 -- 172.21.15.194:0/1255993307 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7ff32802c550 con 0x7ff3140a10b0 2024-09-13T16:07:12.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:12.222+0000 7ff3305c9640 1 -- 172.21.15.194:0/1255993307 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff3140a10b0 msgr2=0x7ff3140a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:12.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:12.222+0000 7ff3305c9640 1 --2- 172.21.15.194:0/1255993307 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff3140a10b0 0x7ff3140a3570 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff324009230 tx=0x7ff3240314d0 comp rx=0 tx=0).stop 2024-09-13T16:07:12.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:12.222+0000 7ff3305c9640 1 -- 172.21.15.194:0/1255993307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff328101920 msgr2=0x7ff32819d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:12.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:12.222+0000 7ff3305c9640 1 --2- 172.21.15.194:0/1255993307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff328101920 0x7ff32819d470 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff32000b970 tx=0x7ff32000be30 comp rx=0 tx=0).stop 2024-09-13T16:07:12.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:12.222+0000 7ff3305c9640 1 -- 172.21.15.194:0/1255993307 shutdown_connections 2024-09-13T16:07:12.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:12.222+0000 7ff3305c9640 1 --2- 172.21.15.194:0/1255993307 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff3140a10b0 0x7ff3140a3570 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:12.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:12.222+0000 7ff3305c9640 1 --2- 172.21.15.194:0/1255993307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff328101920 0x7ff32819d470 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:12.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:12.222+0000 7ff3305c9640 1 --2- 172.21.15.194:0/1255993307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff328100f60 0x7ff328196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:12.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:12.222+0000 7ff3305c9640 1 --2- 172.21.15.194:0/1255993307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3280ffe00 0x7ff328195f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:12.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:12.222+0000 7ff3305c9640 1 -- 172.21.15.194:0/1255993307 >> 172.21.15.194:0/1255993307 conn(0x7ff3280fb5d0 msgr2=0x7ff328104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:12.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:12.222+0000 7ff3305c9640 1 -- 172.21.15.194:0/1255993307 shutdown_connections 2024-09-13T16:07:12.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:12.223+0000 7ff3305c9640 1 -- 172.21.15.194:0/1255993307 wait complete. 2024-09-13T16:07:12.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:12 smithi194 ceph-mon[35694]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:12.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:12.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:12.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:12.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:07:12.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:12.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:07:12.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:12.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:12 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:12.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:12 smithi086 ceph-mon[30379]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:12.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:12.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:12.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:12.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:07:12.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:12.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:07:12.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:12.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:12 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:12.912 DEBUG:teuthology.orchestra.run.smithi194:osd.11> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.11.service 2024-09-13T16:07:12.915 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-13T16:07:12.916 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T16:07:12.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:12 smithi139 ceph-mon[35320]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:12.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:12.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:12.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:12.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:07:12.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:12.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:07:12.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:12.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:12 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:13.238 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:07:13.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:13 smithi086 ceph-mon[30379]: from='osd.11 [v2:172.21.15.194:6824/886506943,v1:172.21.15.194:6825/886506943]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T16:07:13.713 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:13 smithi086 ceph-mon[30379]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T16:07:13.773 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:13 smithi194 ceph-mon[35694]: from='osd.11 [v2:172.21.15.194:6824/886506943,v1:172.21.15.194:6825/886506943]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T16:07:13.773 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:13 smithi194 ceph-mon[35694]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T16:07:13.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:13 smithi139 ceph-mon[35320]: from='osd.11 [v2:172.21.15.194:6824/886506943,v1:172.21.15.194:6825/886506943]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T16:07:13.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:13 smithi139 ceph-mon[35320]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T16:07:14.696 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:14 smithi086 ceph-mon[30379]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:14.697 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:14 smithi086 ceph-mon[30379]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-13T16:07:14.697 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:14 smithi086 ceph-mon[30379]: osdmap e79: 12 total, 11 up, 12 in 2024-09-13T16:07:14.697 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:14 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:07:14.697 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:14 smithi086 ceph-mon[30379]: from='osd.11 [v2:172.21.15.194:6824/886506943,v1:172.21.15.194:6825/886506943]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:07:14.697 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:14 smithi086 ceph-mon[30379]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:07:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:14 smithi194 ceph-mon[35694]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:14 smithi194 ceph-mon[35694]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-13T16:07:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:14 smithi194 ceph-mon[35694]: osdmap e79: 12 total, 11 up, 12 in 2024-09-13T16:07:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:14 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:07:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:14 smithi194 ceph-mon[35694]: from='osd.11 [v2:172.21.15.194:6824/886506943,v1:172.21.15.194:6825/886506943]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:07:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:14 smithi194 ceph-mon[35694]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:07:14.900 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:14 smithi139 ceph-mon[35320]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:14.900 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:14 smithi139 ceph-mon[35320]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-13T16:07:14.900 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:14 smithi139 ceph-mon[35320]: osdmap e79: 12 total, 11 up, 12 in 2024-09-13T16:07:14.900 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:14 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:07:14.900 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:14 smithi139 ceph-mon[35320]: from='osd.11 [v2:172.21.15.194:6824/886506943,v1:172.21.15.194:6825/886506943]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:07:14.900 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:14 smithi139 ceph-mon[35320]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-13T16:07:15.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.360+0000 7f63ae800640 1 -- 172.21.15.86:0/2540406395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63a8102010 msgr2=0x7f63a8102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:15.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.360+0000 7f63ae800640 1 --2- 172.21.15.86:0/2540406395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63a8102010 0x7f63a8102410 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6398009900 tx=0x7f639802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:07:15.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.360+0000 7f63ae800640 1 -- 172.21.15.86:0/2540406395 shutdown_connections 2024-09-13T16:07:15.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.360+0000 7f63ae800640 1 --2- 172.21.15.86:0/2540406395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a8103bd0 0x7f63a810a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:15.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.360+0000 7f63ae800640 1 --2- 172.21.15.86:0/2540406395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63a8103210 0x7f63a8103690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:15.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.360+0000 7f63ae800640 1 --2- 172.21.15.86:0/2540406395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63a8102010 0x7f63a8102410 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:15.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.360+0000 7f63ae800640 1 -- 172.21.15.86:0/2540406395 >> 172.21.15.86:0/2540406395 conn(0x7f63a80fd7a0 msgr2=0x7f63a80ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:15.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.360+0000 7f63ae800640 1 -- 172.21.15.86:0/2540406395 shutdown_connections 2024-09-13T16:07:15.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.360+0000 7f63ae800640 1 -- 172.21.15.86:0/2540406395 wait complete. 2024-09-13T16:07:15.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.361+0000 7f63ae800640 1 Processor -- start 2024-09-13T16:07:15.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.361+0000 7f63ae800640 1 -- start start 2024-09-13T16:07:15.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.361+0000 7f63ae800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a8102010 0x7f63a81980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:15.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.361+0000 7f63ae800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63a8103210 0x7f63a81985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:15.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.361+0000 7f63ae800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63a8103bd0 0x7f63a819f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:15.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.361+0000 7f63ae800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a819fbb0 con 0x7f63a8103bd0 2024-09-13T16:07:15.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.361+0000 7f63ae800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a819fd20 con 0x7f63a8103210 2024-09-13T16:07:15.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.361+0000 7f63ae800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a819fee0 con 0x7f63a8102010 2024-09-13T16:07:15.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.362+0000 7f63a7400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a8102010 0x7f63a81980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:15.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.362+0000 7f63a7400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a8102010 0x7f63a81980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:54908/0 (socket says 172.21.15.86:54908) 2024-09-13T16:07:15.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.362+0000 7f63a7400640 1 -- 172.21.15.86:0/1096532414 learned_addr learned my addr 172.21.15.86:0/1096532414 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:07:15.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.362+0000 7f63a7e00640 1 --2- 172.21.15.86:0/1096532414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63a8103bd0 0x7f63a819f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:15.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.362+0000 7f639fe00640 1 --2- 172.21.15.86:0/1096532414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63a8103210 0x7f63a81985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:15.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.362+0000 7f63a7400640 1 -- 172.21.15.86:0/1096532414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63a8103210 msgr2=0x7f63a81985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:15.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.362+0000 7f63a7400640 1 --2- 172.21.15.86:0/1096532414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63a8103210 0x7f63a81985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:15.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.362+0000 7f63a7400640 1 -- 172.21.15.86:0/1096532414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63a8103bd0 msgr2=0x7f63a819f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:15.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.362+0000 7f63a7400640 1 --2- 172.21.15.86:0/1096532414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63a8103bd0 0x7f63a819f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:15.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.362+0000 7f63a7400640 1 -- 172.21.15.86:0/1096532414 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6398009560 con 0x7f63a8102010 2024-09-13T16:07:15.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.363+0000 7f63a7400640 1 --2- 172.21.15.86:0/1096532414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a8102010 0x7f63a81980b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6398031510 tx=0x7f6398004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:15.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.363+0000 7f63a4c00640 1 -- 172.21.15.86:0/1096532414 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398005000 con 0x7f63a8102010 2024-09-13T16:07:15.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.363+0000 7f63a4c00640 1 -- 172.21.15.86:0/1096532414 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f63980046c0 con 0x7f63a8102010 2024-09-13T16:07:15.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.363+0000 7f63ae800640 1 -- 172.21.15.86:0/1096532414 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a81a0160 con 0x7f63a8102010 2024-09-13T16:07:15.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.363+0000 7f63a4c00640 1 -- 172.21.15.86:0/1096532414 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398003a10 con 0x7f63a8102010 2024-09-13T16:07:15.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.363+0000 7f63ae800640 1 -- 172.21.15.86:0/1096532414 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a81a0650 con 0x7f63a8102010 2024-09-13T16:07:15.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.364+0000 7f63ae800640 1 -- 172.21.15.86:0/1096532414 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a81094b0 con 0x7f63a8102010 2024-09-13T16:07:15.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.366+0000 7f63a4c00640 1 -- 172.21.15.86:0/1096532414 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6398004bc0 con 0x7f63a8102010 2024-09-13T16:07:15.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.367+0000 7f63a4c00640 1 --2- 172.21.15.86:0/1096532414 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f638c0a1130 0x7f638c0a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:15.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.367+0000 7f63a4c00640 1 -- 172.21.15.86:0/1096532414 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f63980ed1f0 con 0x7f63a8102010 2024-09-13T16:07:15.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.367+0000 7f639fe00640 1 --2- 172.21.15.86:0/1096532414 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f638c0a1130 0x7f638c0a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:15.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.368+0000 7f639fe00640 1 --2- 172.21.15.86:0/1096532414 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f638c0a1130 0x7f638c0a35f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f63a81995d0 tx=0x7f6390005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:15.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.371+0000 7f63a4c00640 1 -- 172.21.15.86:0/1096532414 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f63980b6ea0 con 0x7f63a8102010 2024-09-13T16:07:15.506 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:07:15 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:07:15.239+0000 7f7f53a1d640 -1 osd.11 0 waiting for initial osdmap 2024-09-13T16:07:15.506 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:07:15 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:07:15.253+0000 7f7f4b83e640 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:07:15.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.548+0000 7f63ae800640 1 -- 172.21.15.86:0/1096532414 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f63a810da00 con 0x7f63a8102010 2024-09-13T16:07:15.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.549+0000 7f63a4c00640 1 -- 172.21.15.86:0/1096532414 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) v1 ==== 74+0+133 (secure 0 0 0) 0x7f63980ba4c0 con 0x7f63a8102010 2024-09-13T16:07:15.551 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:07:15.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.551+0000 7f63ae800640 1 -- 172.21.15.86:0/1096532414 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f638c0a1130 msgr2=0x7f638c0a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:15.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.551+0000 7f63ae800640 1 --2- 172.21.15.86:0/1096532414 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f638c0a1130 0x7f638c0a35f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f63a81995d0 tx=0x7f6390005f90 comp rx=0 tx=0).stop 2024-09-13T16:07:15.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.551+0000 7f63ae800640 1 -- 172.21.15.86:0/1096532414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a8102010 msgr2=0x7f63a81980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:15.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.551+0000 7f63ae800640 1 --2- 172.21.15.86:0/1096532414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a8102010 0x7f63a81980b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6398031510 tx=0x7f6398004270 comp rx=0 tx=0).stop 2024-09-13T16:07:15.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.551+0000 7f63ae800640 1 -- 172.21.15.86:0/1096532414 shutdown_connections 2024-09-13T16:07:15.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.551+0000 7f63ae800640 1 --2- 172.21.15.86:0/1096532414 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f638c0a1130 0x7f638c0a35f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:15.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.551+0000 7f63ae800640 1 --2- 172.21.15.86:0/1096532414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63a8103bd0 0x7f63a819f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:15.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.551+0000 7f63ae800640 1 --2- 172.21.15.86:0/1096532414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63a8103210 0x7f63a81985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:15.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.551+0000 7f63ae800640 1 --2- 172.21.15.86:0/1096532414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a8102010 0x7f63a81980b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:15.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.551+0000 7f63ae800640 1 -- 172.21.15.86:0/1096532414 >> 172.21.15.86:0/1096532414 conn(0x7f63a80fd7a0 msgr2=0x7f63a8106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:15.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.552+0000 7f63ae800640 1 -- 172.21.15.86:0/1096532414 shutdown_connections 2024-09-13T16:07:15.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:15.552+0000 7f63ae800640 1 -- 172.21.15.86:0/1096532414 wait complete. 2024-09-13T16:07:15.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:15 smithi086 ceph-mon[30379]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-13T16:07:15.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:15 smithi086 ceph-mon[30379]: osdmap e80: 12 total, 11 up, 12 in 2024-09-13T16:07:15.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:15 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:07:15.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:15 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:07:15.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:15 smithi086 ceph-mon[30379]: from='osd.11 ' entity='osd.11' 2024-09-13T16:07:15.874 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:15 smithi194 ceph-mon[35694]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-13T16:07:15.874 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:15 smithi194 ceph-mon[35694]: osdmap e80: 12 total, 11 up, 12 in 2024-09-13T16:07:15.874 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:15 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:07:15.874 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:15 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:07:15.875 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:15 smithi194 ceph-mon[35694]: from='osd.11 ' entity='osd.11' 2024-09-13T16:07:15.918 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:15 smithi139 ceph-mon[35320]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-13T16:07:15.918 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:15 smithi139 ceph-mon[35320]: osdmap e80: 12 total, 11 up, 12 in 2024-09-13T16:07:15.918 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:15 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:07:15.918 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:15 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:07:15.919 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:15 smithi139 ceph-mon[35320]: from='osd.11 ' entity='osd.11' 2024-09-13T16:07:16.452 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":80,"num_osds":12,"num_up_osds":11,"osd_up_since":1726243611,"num_in_osds":12,"osd_in_since":1726243616,"num_remapped_pgs":0} 2024-09-13T16:07:16.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:16 smithi086 ceph-mon[30379]: purged_snaps scrub starts 2024-09-13T16:07:16.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:16 smithi086 ceph-mon[30379]: purged_snaps scrub ok 2024-09-13T16:07:16.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:16 smithi086 ceph-mon[30379]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:16.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:07:16.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:16 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1096532414' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T16:07:16.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:16.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:16.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:07:16.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:07:16.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:07:16.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:07:16.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:16.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:16.867 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:07:16.867 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:16.867 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:16 smithi086 ceph-mon[30379]: osd.11 [v2:172.21.15.194:6824/886506943,v1:172.21.15.194:6825/886506943] boot 2024-09-13T16:07:16.867 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:16 smithi086 ceph-mon[30379]: osdmap e81: 12 total, 12 up, 12 in 2024-09-13T16:07:16.867 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:16 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:07:16.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:16 smithi139 ceph-mon[35320]: purged_snaps scrub starts 2024-09-13T16:07:16.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:16 smithi139 ceph-mon[35320]: purged_snaps scrub ok 2024-09-13T16:07:16.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:16 smithi139 ceph-mon[35320]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:16.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:16 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:07:16.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:16 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1096532414' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T16:07:16.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:16 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:16.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:16 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:16.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:16 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:07:16.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:16 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:07:16.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:16 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:07:16.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:16 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:07:16.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:16 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:16.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:16 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:16.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:16 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:07:17.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:16 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:17.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:16 smithi139 ceph-mon[35320]: osd.11 [v2:172.21.15.194:6824/886506943,v1:172.21.15.194:6825/886506943] boot 2024-09-13T16:07:17.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:16 smithi139 ceph-mon[35320]: osdmap e81: 12 total, 12 up, 12 in 2024-09-13T16:07:17.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:16 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:07:17.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:16 smithi194 ceph-mon[35694]: purged_snaps scrub starts 2024-09-13T16:07:17.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:16 smithi194 ceph-mon[35694]: purged_snaps scrub ok 2024-09-13T16:07:17.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:16 smithi194 ceph-mon[35694]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:07:17.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:16 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:07:17.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:16 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1096532414' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T16:07:17.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:16 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:17.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:16 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:17.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:16 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:07:17.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:16 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:07:17.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:16 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:07:17.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:16 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:07:17.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:16 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:17.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:16 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:17.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:16 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:07:17.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:16 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:17.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:16 smithi194 ceph-mon[35694]: osd.11 [v2:172.21.15.194:6824/886506943,v1:172.21.15.194:6825/886506943] boot 2024-09-13T16:07:17.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:16 smithi194 ceph-mon[35694]: osdmap e81: 12 total, 12 up, 12 in 2024-09-13T16:07:17.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:16 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:07:17.453 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T16:07:17.767 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:07:17.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:17 smithi086 ceph-mon[30379]: Detected new or changed devices on smithi194 2024-09-13T16:07:17.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:17 smithi086 ceph-mon[30379]: Adjusting osd_memory_target on smithi194 to 4272M 2024-09-13T16:07:17.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:17 smithi139 ceph-mon[35320]: Detected new or changed devices on smithi194 2024-09-13T16:07:17.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:17 smithi139 ceph-mon[35320]: Adjusting osd_memory_target on smithi194 to 4272M 2024-09-13T16:07:18.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:17 smithi194 ceph-mon[35694]: Detected new or changed devices on smithi194 2024-09-13T16:07:18.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:17 smithi194 ceph-mon[35694]: Adjusting osd_memory_target on smithi194 to 4272M 2024-09-13T16:07:18.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:18 smithi086 ceph-mon[30379]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:18.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:18 smithi086 ceph-mon[30379]: osdmap e82: 12 total, 12 up, 12 in 2024-09-13T16:07:18.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:18 smithi139 ceph-mon[35320]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:18.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:18 smithi139 ceph-mon[35320]: osdmap e82: 12 total, 12 up, 12 in 2024-09-13T16:07:19.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:18 smithi194 ceph-mon[35694]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:19.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:18 smithi194 ceph-mon[35694]: osdmap e82: 12 total, 12 up, 12 in 2024-09-13T16:07:19.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.892+0000 7fdc13e00640 1 -- 172.21.15.86:0/3975806305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc14100e30 msgr2=0x7fdc141012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:19.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.892+0000 7fdc13e00640 1 --2- 172.21.15.86:0/3975806305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc14100e30 0x7fdc141012b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009900 tx=0x7fdc0002a410 comp rx=0 tx=0).stop 2024-09-13T16:07:19.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.892+0000 7fdc13e00640 1 -- 172.21.15.86:0/3975806305 shutdown_connections 2024-09-13T16:07:19.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.892+0000 7fdc13e00640 1 --2- 172.21.15.86:0/3975806305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc141017f0 0x7fdc14108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:19.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.892+0000 7fdc13e00640 1 --2- 172.21.15.86:0/3975806305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc14100e30 0x7fdc141012b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:19.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.892+0000 7fdc13e00640 1 --2- 172.21.15.86:0/3975806305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc140ffc30 0x7fdc14100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:19.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.892+0000 7fdc13e00640 1 -- 172.21.15.86:0/3975806305 >> 172.21.15.86:0/3975806305 conn(0x7fdc140fb3c0 msgr2=0x7fdc140fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:19.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.892+0000 7fdc13e00640 1 -- 172.21.15.86:0/3975806305 shutdown_connections 2024-09-13T16:07:19.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.892+0000 7fdc13e00640 1 -- 172.21.15.86:0/3975806305 wait complete. 2024-09-13T16:07:19.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.893+0000 7fdc13e00640 1 Processor -- start 2024-09-13T16:07:19.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.893+0000 7fdc13e00640 1 -- start start 2024-09-13T16:07:19.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.894+0000 7fdc13e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc140ffc30 0x7fdc14197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:19.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.894+0000 7fdc13e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc14100e30 0x7fdc14198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:19.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.894+0000 7fdc13e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc141017f0 0x7fdc1419f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:19.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.894+0000 7fdc13e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1419f9e0 con 0x7fdc14100e30 2024-09-13T16:07:19.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.894+0000 7fdc13e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1419fb50 con 0x7fdc140ffc30 2024-09-13T16:07:19.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.894+0000 7fdc13e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1419fd10 con 0x7fdc141017f0 2024-09-13T16:07:19.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.894+0000 7fdc12000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc14100e30 0x7fdc14198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:19.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.894+0000 7fdc12000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc14100e30 0x7fdc14198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34740/0 (socket says 172.21.15.86:34740) 2024-09-13T16:07:19.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.894+0000 7fdc12000640 1 -- 172.21.15.86:0/1638338906 learned_addr learned my addr 172.21.15.86:0/1638338906 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:07:19.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.894+0000 7fdc12a00640 1 --2- 172.21.15.86:0/1638338906 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc140ffc30 0x7fdc14197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:19.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.894+0000 7fdc13400640 1 --2- 172.21.15.86:0/1638338906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc141017f0 0x7fdc1419f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:19.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.894+0000 7fdc12000640 1 -- 172.21.15.86:0/1638338906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc141017f0 msgr2=0x7fdc1419f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:19.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.894+0000 7fdc12000640 1 --2- 172.21.15.86:0/1638338906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc141017f0 0x7fdc1419f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:19.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.895+0000 7fdc12000640 1 -- 172.21.15.86:0/1638338906 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc140ffc30 msgr2=0x7fdc14197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:19.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.895+0000 7fdc12000640 1 --2- 172.21.15.86:0/1638338906 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc140ffc30 0x7fdc14197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:19.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.895+0000 7fdc12000640 1 -- 172.21.15.86:0/1638338906 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc00009560 con 0x7fdc14100e30 2024-09-13T16:07:19.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.895+0000 7fdc12000640 1 --2- 172.21.15.86:0/1638338906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc14100e30 0x7fdc14198470 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdc00031510 tx=0x7fdc000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:19.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.895+0000 7fdc0b400640 1 -- 172.21.15.86:0/1638338906 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00004cc0 con 0x7fdc14100e30 2024-09-13T16:07:19.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.895+0000 7fdc0b400640 1 -- 172.21.15.86:0/1638338906 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdc00003ad0 con 0x7fdc14100e30 2024-09-13T16:07:19.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.895+0000 7fdc13e00640 1 -- 172.21.15.86:0/1638338906 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1419ff90 con 0x7fdc14100e30 2024-09-13T16:07:19.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.895+0000 7fdc0b400640 1 -- 172.21.15.86:0/1638338906 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00031d60 con 0x7fdc14100e30 2024-09-13T16:07:19.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.895+0000 7fdc13e00640 1 -- 172.21.15.86:0/1638338906 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc141a03a0 con 0x7fdc14100e30 2024-09-13T16:07:19.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.896+0000 7fdc13e00640 1 -- 172.21.15.86:0/1638338906 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1410b6a0 con 0x7fdc14100e30 2024-09-13T16:07:19.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.899+0000 7fdc0b400640 1 -- 172.21.15.86:0/1638338906 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fdc00003c40 con 0x7fdc14100e30 2024-09-13T16:07:19.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.901+0000 7fdc0b400640 1 --2- 172.21.15.86:0/1638338906 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fdbf80a10a0 0x7fdbf80a3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:19.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.901+0000 7fdc0b400640 1 -- 172.21.15.86:0/1638338906 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fdc000ed830 con 0x7fdc14100e30 2024-09-13T16:07:19.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.901+0000 7fdc12a00640 1 --2- 172.21.15.86:0/1638338906 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fdbf80a10a0 0x7fdbf80a3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:19.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.902+0000 7fdc12a00640 1 --2- 172.21.15.86:0/1638338906 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fdbf80a10a0 0x7fdbf80a3560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdc14100c90 tx=0x7fdc0400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:19.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:19.903+0000 7fdc0b400640 1 -- 172.21.15.86:0/1638338906 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdc000b7470 con 0x7fdc14100e30 2024-09-13T16:07:20.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:20.082+0000 7fdc13e00640 1 -- 172.21.15.86:0/1638338906 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fdc1410b880 con 0x7fdc14100e30 2024-09-13T16:07:20.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:20.082+0000 7fdc0b400640 1 -- 172.21.15.86:0/1638338906 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v82) v1 ==== 74+0+133 (secure 0 0 0) 0x7fdc000baa90 con 0x7fdc14100e30 2024-09-13T16:07:20.085 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:07:20.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:20.085+0000 7fdc13e00640 1 -- 172.21.15.86:0/1638338906 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fdbf80a10a0 msgr2=0x7fdbf80a3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:20.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:20.085+0000 7fdc13e00640 1 --2- 172.21.15.86:0/1638338906 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fdbf80a10a0 0x7fdbf80a3560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdc14100c90 tx=0x7fdc0400b390 comp rx=0 tx=0).stop 2024-09-13T16:07:20.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:20.085+0000 7fdc13e00640 1 -- 172.21.15.86:0/1638338906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc14100e30 msgr2=0x7fdc14198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:20.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:20.085+0000 7fdc13e00640 1 --2- 172.21.15.86:0/1638338906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc14100e30 0x7fdc14198470 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdc00031510 tx=0x7fdc000046c0 comp rx=0 tx=0).stop 2024-09-13T16:07:20.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:20.085+0000 7fdc13e00640 1 -- 172.21.15.86:0/1638338906 shutdown_connections 2024-09-13T16:07:20.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:20.085+0000 7fdc13e00640 1 --2- 172.21.15.86:0/1638338906 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fdbf80a10a0 0x7fdbf80a3560 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:20.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:20.085+0000 7fdc13e00640 1 --2- 172.21.15.86:0/1638338906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc141017f0 0x7fdc1419f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:20.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:20.085+0000 7fdc13e00640 1 --2- 172.21.15.86:0/1638338906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc14100e30 0x7fdc14198470 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:20.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:20.085+0000 7fdc13e00640 1 --2- 172.21.15.86:0/1638338906 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc140ffc30 0x7fdc14197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:20.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:20.085+0000 7fdc13e00640 1 -- 172.21.15.86:0/1638338906 >> 172.21.15.86:0/1638338906 conn(0x7fdc140fb3c0 msgr2=0x7fdc140726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:20.087 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:20.085+0000 7fdc13e00640 1 -- 172.21.15.86:0/1638338906 shutdown_connections 2024-09-13T16:07:20.088 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:20.085+0000 7fdc13e00640 1 -- 172.21.15.86:0/1638338906 wait complete. 2024-09-13T16:07:20.856 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:20 smithi086 ceph-mon[30379]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:20.856 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:20 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1638338906' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T16:07:20.887 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":82,"num_osds":12,"num_up_osds":12,"osd_up_since":1726243636,"num_in_osds":12,"osd_in_since":1726243616,"num_remapped_pgs":0} 2024-09-13T16:07:20.887 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T16:07:20.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:20 smithi139 ceph-mon[35320]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:20.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:20 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1638338906' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T16:07:21.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:20 smithi194 ceph-mon[35694]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:21.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:20 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1638338906' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T16:07:21.196 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:07:22.800 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:22 smithi086 ceph-mon[30379]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:22.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:22 smithi139 ceph-mon[35320]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:23.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:22 smithi194 ceph-mon[35694]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:23.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.177+0000 7fe734a00640 1 -- 172.21.15.86:0/1920706542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7301065f0 msgr2=0x7fe7301069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:23.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.178+0000 7fe734a00640 1 --2- 172.21.15.86:0/1920706542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7301065f0 0x7fe7301069d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe720009930 tx=0x7fe72002a420 comp rx=0 tx=0).stop 2024-09-13T16:07:23.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.178+0000 7fe734a00640 1 -- 172.21.15.86:0/1920706542 shutdown_connections 2024-09-13T16:07:23.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.178+0000 7fe734a00640 1 --2- 172.21.15.86:0/1920706542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe73010b720 0x7fe7301132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:23.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.178+0000 7fe734a00640 1 --2- 172.21.15.86:0/1920706542 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe730106fa0 0x7fe73010aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:23.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.178+0000 7fe734a00640 1 --2- 172.21.15.86:0/1920706542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7301065f0 0x7fe7301069d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:23.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.178+0000 7fe734a00640 1 -- 172.21.15.86:0/1920706542 >> 172.21.15.86:0/1920706542 conn(0x7fe730075d10 msgr2=0x7fe730078130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:23.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.178+0000 7fe734a00640 1 -- 172.21.15.86:0/1920706542 shutdown_connections 2024-09-13T16:07:23.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.178+0000 7fe734a00640 1 -- 172.21.15.86:0/1920706542 wait complete. 2024-09-13T16:07:23.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.179+0000 7fe734a00640 1 Processor -- start 2024-09-13T16:07:23.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.179+0000 7fe734a00640 1 -- start start 2024-09-13T16:07:23.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.179+0000 7fe734a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7301065f0 0x7fe73019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:23.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.179+0000 7fe734a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe730106fa0 0x7fe73019cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:23.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.179+0000 7fe734a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe73010b720 0x7fe7301a1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:23.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.179+0000 7fe734a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7301a1960 con 0x7fe7301065f0 2024-09-13T16:07:23.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.179+0000 7fe734a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7301a1ad0 con 0x7fe730106fa0 2024-09-13T16:07:23.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.179+0000 7fe734a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7301a1c90 con 0x7fe73010b720 2024-09-13T16:07:23.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.179+0000 7fe72de00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7301065f0 0x7fe73019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:23.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.179+0000 7fe72de00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7301065f0 0x7fe73019c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56048/0 (socket says 172.21.15.86:56048) 2024-09-13T16:07:23.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.180+0000 7fe72de00640 1 -- 172.21.15.86:0/377824607 learned_addr learned my addr 172.21.15.86:0/377824607 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:07:23.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.180+0000 7fe725400640 1 --2- 172.21.15.86:0/377824607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe730106fa0 0x7fe73019cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:23.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.180+0000 7fe72e800640 1 --2- 172.21.15.86:0/377824607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe73010b720 0x7fe7301a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:23.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.180+0000 7fe72de00640 1 -- 172.21.15.86:0/377824607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe73010b720 msgr2=0x7fe7301a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:23.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.180+0000 7fe72de00640 1 --2- 172.21.15.86:0/377824607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe73010b720 0x7fe7301a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:23.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.180+0000 7fe72de00640 1 -- 172.21.15.86:0/377824607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe730106fa0 msgr2=0x7fe73019cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:23.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.180+0000 7fe72de00640 1 --2- 172.21.15.86:0/377824607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe730106fa0 0x7fe73019cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:23.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.180+0000 7fe72de00640 1 -- 172.21.15.86:0/377824607 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe720009560 con 0x7fe7301065f0 2024-09-13T16:07:23.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.180+0000 7fe725400640 1 --2- 172.21.15.86:0/377824607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe730106fa0 0x7fe73019cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:07:23.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.180+0000 7fe72e800640 1 --2- 172.21.15.86:0/377824607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe73010b720 0x7fe7301a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:07:23.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.180+0000 7fe72de00640 1 --2- 172.21.15.86:0/377824607 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7301065f0 0x7fe73019c9f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe720005ab0 tx=0x7fe720005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:23.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.181+0000 7fe727400640 1 -- 172.21.15.86:0/377824607 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe720004ad0 con 0x7fe7301065f0 2024-09-13T16:07:23.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.181+0000 7fe727400640 1 -- 172.21.15.86:0/377824607 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe720004c30 con 0x7fe7301065f0 2024-09-13T16:07:23.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.181+0000 7fe727400640 1 -- 172.21.15.86:0/377824607 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe720031990 con 0x7fe7301065f0 2024-09-13T16:07:23.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.181+0000 7fe734a00640 1 -- 172.21.15.86:0/377824607 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7301a1f10 con 0x7fe7301065f0 2024-09-13T16:07:23.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.181+0000 7fe734a00640 1 -- 172.21.15.86:0/377824607 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7301a21e0 con 0x7fe7301065f0 2024-09-13T16:07:23.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.182+0000 7fe734a00640 1 -- 172.21.15.86:0/377824607 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe730107ad0 con 0x7fe7301065f0 2024-09-13T16:07:23.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.184+0000 7fe727400640 1 -- 172.21.15.86:0/377824607 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe720031af0 con 0x7fe7301065f0 2024-09-13T16:07:23.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.185+0000 7fe727400640 1 --2- 172.21.15.86:0/377824607 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe7140a1100 0x7fe7140a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:23.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.185+0000 7fe727400640 1 -- 172.21.15.86:0/377824607 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe7200ed510 con 0x7fe7301065f0 2024-09-13T16:07:23.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.185+0000 7fe725400640 1 --2- 172.21.15.86:0/377824607 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe7140a1100 0x7fe7140a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:23.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.186+0000 7fe725400640 1 --2- 172.21.15.86:0/377824607 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe7140a1100 0x7fe7140a35c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe73019dfa0 tx=0x7fe718005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:23.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.187+0000 7fe727400640 1 -- 172.21.15.86:0/377824607 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe7200b7150 con 0x7fe7301065f0 2024-09-13T16:07:23.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.361+0000 7fe734a00640 1 -- 172.21.15.86:0/377824607 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7301069d0 con 0x7fe7301065f0 2024-09-13T16:07:23.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.363+0000 7fe727400640 1 -- 172.21.15.86:0/377824607 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18411 (secure 0 0 0) 0x7fe7200ba770 con 0x7fe7301065f0 2024-09-13T16:07:23.365 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:07:23.365 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":82,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:07:17.532611+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:07:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.365+0000 7fe734a00640 1 -- 172.21.15.86:0/377824607 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe7140a1100 msgr2=0x7fe7140a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.365+0000 7fe734a00640 1 --2- 172.21.15.86:0/377824607 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe7140a1100 0x7fe7140a35c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe73019dfa0 tx=0x7fe718005f90 comp rx=0 tx=0).stop 2024-09-13T16:07:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.365+0000 7fe734a00640 1 -- 172.21.15.86:0/377824607 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7301065f0 msgr2=0x7fe73019c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.365+0000 7fe734a00640 1 --2- 172.21.15.86:0/377824607 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7301065f0 0x7fe73019c9f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe720005ab0 tx=0x7fe720005620 comp rx=0 tx=0).stop 2024-09-13T16:07:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.365+0000 7fe734a00640 1 -- 172.21.15.86:0/377824607 shutdown_connections 2024-09-13T16:07:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.365+0000 7fe734a00640 1 --2- 172.21.15.86:0/377824607 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe7140a1100 0x7fe7140a35c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.365+0000 7fe734a00640 1 --2- 172.21.15.86:0/377824607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe73010b720 0x7fe7301a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.365+0000 7fe734a00640 1 --2- 172.21.15.86:0/377824607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe730106fa0 0x7fe73019cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.365+0000 7fe734a00640 1 --2- 172.21.15.86:0/377824607 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7301065f0 0x7fe73019c9f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.365+0000 7fe734a00640 1 -- 172.21.15.86:0/377824607 >> 172.21.15.86:0/377824607 conn(0x7fe730075d10 msgr2=0x7fe7300770c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.365+0000 7fe734a00640 1 -- 172.21.15.86:0/377824607 shutdown_connections 2024-09-13T16:07:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:23.365+0000 7fe734a00640 1 -- 172.21.15.86:0/377824607 wait complete. 2024-09-13T16:07:23.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:23 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/377824607' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:07:23.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:23 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/377824607' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:07:24.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:23 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/377824607' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:07:24.105 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:03:27.830423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:07:24.106 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-13T16:07:24.416 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:07:24.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:24 smithi086 ceph-mon[30379]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:24.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:24 smithi139 ceph-mon[35320]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:25.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:24 smithi194 ceph-mon[35694]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:26.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.436+0000 7fcd28200640 1 -- 172.21.15.86:0/2848110708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd201065f0 msgr2=0x7fcd201069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:26.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.436+0000 7fcd28200640 1 --2- 172.21.15.86:0/2848110708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd201065f0 0x7fcd201069d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009930 tx=0x7fcd1402a420 comp rx=0 tx=0).stop 2024-09-13T16:07:26.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.436+0000 7fcd28200640 1 -- 172.21.15.86:0/2848110708 shutdown_connections 2024-09-13T16:07:26.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.436+0000 7fcd28200640 1 --2- 172.21.15.86:0/2848110708 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd2010b720 0x7fcd201132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:26.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.436+0000 7fcd28200640 1 --2- 172.21.15.86:0/2848110708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd20106fa0 0x7fcd2010aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:26.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.436+0000 7fcd28200640 1 --2- 172.21.15.86:0/2848110708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd201065f0 0x7fcd201069d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:26.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.436+0000 7fcd28200640 1 -- 172.21.15.86:0/2848110708 >> 172.21.15.86:0/2848110708 conn(0x7fcd20075d10 msgr2=0x7fcd20078130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:26.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.436+0000 7fcd28200640 1 -- 172.21.15.86:0/2848110708 shutdown_connections 2024-09-13T16:07:26.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.436+0000 7fcd28200640 1 -- 172.21.15.86:0/2848110708 wait complete. 2024-09-13T16:07:26.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.437+0000 7fcd28200640 1 Processor -- start 2024-09-13T16:07:26.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.437+0000 7fcd28200640 1 -- start start 2024-09-13T16:07:26.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.438+0000 7fcd28200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd201065f0 0x7fcd201a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:26.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.438+0000 7fcd28200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd20106fa0 0x7fcd201a2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:26.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.438+0000 7fcd28200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd2010b720 0x7fcd2019c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:26.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.438+0000 7fcd28200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2019ce90 con 0x7fcd201065f0 2024-09-13T16:07:26.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.438+0000 7fcd28200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2019d000 con 0x7fcd2010b720 2024-09-13T16:07:26.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.438+0000 7fcd28200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2019d1c0 con 0x7fcd20106fa0 2024-09-13T16:07:26.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.438+0000 7fcd25800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd201065f0 0x7fcd201a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:26.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.438+0000 7fcd25800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd201065f0 0x7fcd201a26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56066/0 (socket says 172.21.15.86:56066) 2024-09-13T16:07:26.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.438+0000 7fcd25800640 1 -- 172.21.15.86:0/1833533692 learned_addr learned my addr 172.21.15.86:0/1833533692 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:07:26.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.438+0000 7fcd24e00640 1 --2- 172.21.15.86:0/1833533692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd20106fa0 0x7fcd201a2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:26.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.438+0000 7fcd26200640 1 --2- 172.21.15.86:0/1833533692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd2010b720 0x7fcd2019c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:26.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.438+0000 7fcd25800640 1 -- 172.21.15.86:0/1833533692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd20106fa0 msgr2=0x7fcd201a2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:26.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.438+0000 7fcd25800640 1 --2- 172.21.15.86:0/1833533692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd20106fa0 0x7fcd201a2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:26.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.438+0000 7fcd25800640 1 -- 172.21.15.86:0/1833533692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd2010b720 msgr2=0x7fcd2019c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:26.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.438+0000 7fcd25800640 1 --2- 172.21.15.86:0/1833533692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd2010b720 0x7fcd2019c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:26.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.438+0000 7fcd25800640 1 -- 172.21.15.86:0/1833533692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd14009560 con 0x7fcd201065f0 2024-09-13T16:07:26.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.438+0000 7fcd24e00640 1 --2- 172.21.15.86:0/1833533692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd20106fa0 0x7fcd201a2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:07:26.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.438+0000 7fcd26200640 1 --2- 172.21.15.86:0/1833533692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd2010b720 0x7fcd2019c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:07:26.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.439+0000 7fcd25800640 1 --2- 172.21.15.86:0/1833533692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd201065f0 0x7fcd201a26a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcd14005940 tx=0x7fcd14004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:26.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.439+0000 7fcd1e000640 1 -- 172.21.15.86:0/1833533692 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd14005000 con 0x7fcd201065f0 2024-09-13T16:07:26.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.439+0000 7fcd28200640 1 -- 172.21.15.86:0/1833533692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2019d440 con 0x7fcd201065f0 2024-09-13T16:07:26.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.439+0000 7fcd1e000640 1 -- 172.21.15.86:0/1833533692 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcd14005640 con 0x7fcd201065f0 2024-09-13T16:07:26.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.439+0000 7fcd1e000640 1 -- 172.21.15.86:0/1833533692 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd14003900 con 0x7fcd201065f0 2024-09-13T16:07:26.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.439+0000 7fcd28200640 1 -- 172.21.15.86:0/1833533692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd201a9690 con 0x7fcd201065f0 2024-09-13T16:07:26.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.440+0000 7fcd28200640 1 -- 172.21.15.86:0/1833533692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd20107ad0 con 0x7fcd201065f0 2024-09-13T16:07:26.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.442+0000 7fcd1e000640 1 -- 172.21.15.86:0/1833533692 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcd140046c0 con 0x7fcd201065f0 2024-09-13T16:07:26.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.443+0000 7fcd1e000640 1 --2- 172.21.15.86:0/1833533692 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fcd080a1080 0x7fcd080a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:26.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.443+0000 7fcd1e000640 1 -- 172.21.15.86:0/1833533692 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcd140ed3f0 con 0x7fcd201065f0 2024-09-13T16:07:26.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.443+0000 7fcd24e00640 1 --2- 172.21.15.86:0/1833533692 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fcd080a1080 0x7fcd080a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:26.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.444+0000 7fcd24e00640 1 --2- 172.21.15.86:0/1833533692 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fcd080a1080 0x7fcd080a3540 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcd2019dc00 tx=0x7fcd0c00b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:26.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.447+0000 7fcd1e000640 1 -- 172.21.15.86:0/1833533692 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcd140b6f80 con 0x7fcd201065f0 2024-09-13T16:07:26.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:26 smithi086 ceph-mon[30379]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:26.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.622+0000 7fcd28200640 1 -- 172.21.15.86:0/1833533692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd2019d5d0 con 0x7fcd201065f0 2024-09-13T16:07:26.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.622+0000 7fcd1e000640 1 -- 172.21.15.86:0/1833533692 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd140ba5a0 con 0x7fcd201065f0 2024-09-13T16:07:26.624 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-09-13T16:07:26.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.624+0000 7fcd28200640 1 -- 172.21.15.86:0/1833533692 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fcd080a1080 msgr2=0x7fcd080a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:26.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.624+0000 7fcd28200640 1 --2- 172.21.15.86:0/1833533692 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fcd080a1080 0x7fcd080a3540 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcd2019dc00 tx=0x7fcd0c00b5f0 comp rx=0 tx=0).stop 2024-09-13T16:07:26.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.624+0000 7fcd28200640 1 -- 172.21.15.86:0/1833533692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd201065f0 msgr2=0x7fcd201a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:26.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.624+0000 7fcd28200640 1 --2- 172.21.15.86:0/1833533692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd201065f0 0x7fcd201a26a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcd14005940 tx=0x7fcd14004270 comp rx=0 tx=0).stop 2024-09-13T16:07:26.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.625+0000 7fcd28200640 1 -- 172.21.15.86:0/1833533692 shutdown_connections 2024-09-13T16:07:26.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.625+0000 7fcd28200640 1 --2- 172.21.15.86:0/1833533692 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fcd080a1080 0x7fcd080a3540 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:26.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.625+0000 7fcd28200640 1 --2- 172.21.15.86:0/1833533692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd2010b720 0x7fcd2019c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:26.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.625+0000 7fcd28200640 1 --2- 172.21.15.86:0/1833533692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd20106fa0 0x7fcd201a2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:26.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.625+0000 7fcd28200640 1 --2- 172.21.15.86:0/1833533692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd201065f0 0x7fcd201a26a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:26.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.625+0000 7fcd28200640 1 -- 172.21.15.86:0/1833533692 >> 172.21.15.86:0/1833533692 conn(0x7fcd20075d10 msgr2=0x7fcd200770c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:26.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.625+0000 7fcd28200640 1 -- 172.21.15.86:0/1833533692 shutdown_connections 2024-09-13T16:07:26.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:26.625+0000 7fcd28200640 1 -- 172.21.15.86:0/1833533692 wait complete. 2024-09-13T16:07:26.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:26 smithi139 ceph-mon[35320]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:27.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:26 smithi194 ceph-mon[35694]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:27.430 INFO:tasks.cephadm:Adding mds.a on smithi086 2024-09-13T16:07:27.430 INFO:tasks.cephadm:Adding mds.d on smithi086 2024-09-13T16:07:27.430 INFO:tasks.cephadm:Adding mds.g on smithi086 2024-09-13T16:07:27.430 INFO:tasks.cephadm:Adding mds.j on smithi086 2024-09-13T16:07:27.430 INFO:tasks.cephadm:Adding mds.b on smithi139 2024-09-13T16:07:27.430 INFO:tasks.cephadm:Adding mds.e on smithi139 2024-09-13T16:07:27.430 INFO:tasks.cephadm:Adding mds.h on smithi139 2024-09-13T16:07:27.430 INFO:tasks.cephadm:Adding mds.k on smithi139 2024-09-13T16:07:27.431 INFO:tasks.cephadm:Adding mds.c on smithi194 2024-09-13T16:07:27.431 INFO:tasks.cephadm:Adding mds.f on smithi194 2024-09-13T16:07:27.431 INFO:tasks.cephadm:Adding mds.i on smithi194 2024-09-13T16:07:27.431 INFO:tasks.cephadm:Adding mds.l on smithi194 2024-09-13T16:07:27.431 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi086=a;smithi086=d;smithi086=g;smithi086=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l' 2024-09-13T16:07:27.640 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:07:27.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:27 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1833533692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:07:27.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:27 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1833533692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:07:27.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:27 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1833533692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:07:28.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:28 smithi086 ceph-mon[30379]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:28.897 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:28 smithi194 ceph-mon[35694]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:28.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:28 smithi139 ceph-mon[35320]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:29.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.258+0000 7f56ff0a7640 1 -- 172.21.15.194:0/2091533368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56f81008a0 msgr2=0x7f56f8107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:29.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.258+0000 7f56ff0a7640 1 --2- 172.21.15.194:0/2091533368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56f81008a0 0x7f56f8107130 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009900 tx=0x7f56f002a410 comp rx=0 tx=0).stop 2024-09-13T16:07:29.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.258+0000 7f56ff0a7640 1 -- 172.21.15.194:0/2091533368 shutdown_connections 2024-09-13T16:07:29.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.258+0000 7f56ff0a7640 1 --2- 172.21.15.194:0/2091533368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56f81008a0 0x7f56f8107130 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:29.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.258+0000 7f56ff0a7640 1 --2- 172.21.15.194:0/2091533368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56f80ffee0 0x7f56f8100360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:29.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.258+0000 7f56ff0a7640 1 --2- 172.21.15.194:0/2091533368 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f80fece0 0x7f56f80ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:29.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.258+0000 7f56ff0a7640 1 -- 172.21.15.194:0/2091533368 >> 172.21.15.194:0/2091533368 conn(0x7f56f80fa490 msgr2=0x7f56f80fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:29.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.258+0000 7f56ff0a7640 1 -- 172.21.15.194:0/2091533368 shutdown_connections 2024-09-13T16:07:29.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.258+0000 7f56ff0a7640 1 -- 172.21.15.194:0/2091533368 wait complete. 2024-09-13T16:07:29.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.258+0000 7f56ff0a7640 1 Processor -- start 2024-09-13T16:07:29.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.258+0000 7f56ff0a7640 1 -- start start 2024-09-13T16:07:29.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56ff0a7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f80fece0 0x7f56f8102c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:29.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56ff0a7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56f80ffee0 0x7f56f81012c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:29.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56ff0a7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56f81008a0 0x7f56f8101800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:29.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56ff0a7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f8101f90 con 0x7f56f81008a0 2024-09-13T16:07:29.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56ff0a7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f8102100 con 0x7f56f80fece0 2024-09-13T16:07:29.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56ff0a7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f819ffe0 con 0x7f56f80ffee0 2024-09-13T16:07:29.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56f7fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56f80ffee0 0x7f56f81012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:29.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56f7fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56f80ffee0 0x7f56f81012c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60088/0 (socket says 172.21.15.194:60088) 2024-09-13T16:07:29.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56f7fff640 1 -- 172.21.15.194:0/1832339955 learned_addr learned my addr 172.21.15.194:0/1832339955 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T16:07:29.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56fce43640 1 --2- 172.21.15.194:0/1832339955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f80fece0 0x7f56f8102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:29.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56f7fff640 1 -- 172.21.15.194:0/1832339955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f80fece0 msgr2=0x7f56f8102c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:29.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56f7fff640 1 --2- 172.21.15.194:0/1832339955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f80fece0 0x7f56f8102c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:29.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56f7fff640 1 -- 172.21.15.194:0/1832339955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56f81008a0 msgr2=0x7f56f8101800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:29.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56f7fff640 1 --2- 172.21.15.194:0/1832339955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56f81008a0 0x7f56f8101800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:29.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56f7fff640 1 -- 172.21.15.194:0/1832339955 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f0009560 con 0x7f56f80ffee0 2024-09-13T16:07:29.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56f7fff640 1 --2- 172.21.15.194:0/1832339955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56f80ffee0 0x7f56f81012c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00ba80 tx=0x7f56ec00bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:29.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56f5ffb640 1 -- 172.21.15.194:0/1832339955 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec00cc00 con 0x7f56f80ffee0 2024-09-13T16:07:29.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56f5ffb640 1 -- 172.21.15.194:0/1832339955 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f56ec00cd60 con 0x7f56f80ffee0 2024-09-13T16:07:29.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56ff0a7640 1 -- 172.21.15.194:0/1832339955 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f81a0290 con 0x7f56f80ffee0 2024-09-13T16:07:29.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.259+0000 7f56f5ffb640 1 -- 172.21.15.194:0/1832339955 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec0077d0 con 0x7f56f80ffee0 2024-09-13T16:07:29.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.260+0000 7f56ff0a7640 1 -- 172.21.15.194:0/1832339955 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f81a0860 con 0x7f56f80ffee0 2024-09-13T16:07:29.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.261+0000 7f56ff0a7640 1 -- 172.21.15.194:0/1832339955 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f810a7e0 con 0x7f56f80ffee0 2024-09-13T16:07:29.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.262+0000 7f56f5ffb640 1 -- 172.21.15.194:0/1832339955 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f56ec014a90 con 0x7f56f80ffee0 2024-09-13T16:07:29.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.262+0000 7f56f5ffb640 1 --2- 172.21.15.194:0/1832339955 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f56e00a1100 0x7f56e00a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:29.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.263+0000 7f56f5ffb640 1 -- 172.21.15.194:0/1832339955 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f56ec0cbd50 con 0x7f56f80ffee0 2024-09-13T16:07:29.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.263+0000 7f56fce43640 1 --2- 172.21.15.194:0/1832339955 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f56e00a1100 0x7f56e00a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:29.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.263+0000 7f56fce43640 1 --2- 172.21.15.194:0/1832339955 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f56e00a1100 0x7f56e00a35c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f56f80ffd40 tx=0x7f56e8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:29.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.267+0000 7f56f5ffb640 1 -- 172.21.15.194:0/1832339955 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f56ec0cf030 con 0x7f56f80ffee0 2024-09-13T16:07:29.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.435+0000 7f56ff0a7640 1 -- 172.21.15.194:0/1832339955 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi086=a;smithi086=d;smithi086=g;smithi086=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f56f80686a0 con 0x7f56e00a1100 2024-09-13T16:07:29.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.444+0000 7f56f5ffb640 1 -- 172.21.15.194:0/1832339955 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f56f80686a0 con 0x7f56e00a1100 2024-09-13T16:07:29.446 INFO:teuthology.orchestra.run.smithi194.stdout:Scheduled mds.all update... 2024-09-13T16:07:29.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.447+0000 7f56ff0a7640 1 -- 172.21.15.194:0/1832339955 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f56e00a1100 msgr2=0x7f56e00a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:29.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.447+0000 7f56ff0a7640 1 --2- 172.21.15.194:0/1832339955 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f56e00a1100 0x7f56e00a35c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f56f80ffd40 tx=0x7f56e8008040 comp rx=0 tx=0).stop 2024-09-13T16:07:29.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.447+0000 7f56ff0a7640 1 -- 172.21.15.194:0/1832339955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56f80ffee0 msgr2=0x7f56f81012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:29.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.447+0000 7f56ff0a7640 1 --2- 172.21.15.194:0/1832339955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56f80ffee0 0x7f56f81012c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00ba80 tx=0x7f56ec00bf40 comp rx=0 tx=0).stop 2024-09-13T16:07:29.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.447+0000 7f56ff0a7640 1 -- 172.21.15.194:0/1832339955 shutdown_connections 2024-09-13T16:07:29.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.447+0000 7f56ff0a7640 1 --2- 172.21.15.194:0/1832339955 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f56e00a1100 0x7f56e00a35c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:29.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.447+0000 7f56ff0a7640 1 --2- 172.21.15.194:0/1832339955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56f81008a0 0x7f56f8101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:29.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.447+0000 7f56ff0a7640 1 --2- 172.21.15.194:0/1832339955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56f80ffee0 0x7f56f81012c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:29.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.447+0000 7f56ff0a7640 1 --2- 172.21.15.194:0/1832339955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f80fece0 0x7f56f8102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:29.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.447+0000 7f56ff0a7640 1 -- 172.21.15.194:0/1832339955 >> 172.21.15.194:0/1832339955 conn(0x7f56f80fa490 msgr2=0x7f56f8067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:29.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.447+0000 7f56ff0a7640 1 -- 172.21.15.194:0/1832339955 shutdown_connections 2024-09-13T16:07:29.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T16:07:29.447+0000 7f56ff0a7640 1 -- 172.21.15.194:0/1832339955 wait complete. 2024-09-13T16:07:30.143 DEBUG:teuthology.orchestra.run.smithi086:mds.a> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.a.service 2024-09-13T16:07:30.148 DEBUG:teuthology.orchestra.run.smithi086:mds.d> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.d.service 2024-09-13T16:07:30.193 DEBUG:teuthology.orchestra.run.smithi086:mds.g> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.g.service 2024-09-13T16:07:30.238 DEBUG:teuthology.orchestra.run.smithi086:mds.j> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.j.service 2024-09-13T16:07:30.283 DEBUG:teuthology.orchestra.run.smithi139:mds.b> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.b.service 2024-09-13T16:07:30.286 DEBUG:teuthology.orchestra.run.smithi139:mds.e> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.e.service 2024-09-13T16:07:30.331 DEBUG:teuthology.orchestra.run.smithi139:mds.h> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.h.service 2024-09-13T16:07:30.374 DEBUG:teuthology.orchestra.run.smithi139:mds.k> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.k.service 2024-09-13T16:07:30.417 DEBUG:teuthology.orchestra.run.smithi194:mds.c> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.c.service 2024-09-13T16:07:30.420 DEBUG:teuthology.orchestra.run.smithi194:mds.f> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.f.service 2024-09-13T16:07:30.462 DEBUG:teuthology.orchestra.run.smithi194:mds.i> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.i.service 2024-09-13T16:07:30.505 DEBUG:teuthology.orchestra.run.smithi194:mds.l> sudo journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.l.service 2024-09-13T16:07:30.548 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-13T16:07:30.549 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:07:30.597 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:30 smithi086 ceph-mon[30379]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:30.597 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:30 smithi086 ceph-mon[30379]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi086=a;smithi086=d;smithi086=g;smithi086=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:07:30.597 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:30 smithi086 ceph-mon[30379]: Saving service mds.all spec with placement smithi086=a;smithi086=d;smithi086=g;smithi086=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2024-09-13T16:07:30.597 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:30.598 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:07:30.598 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:30.598 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:07:30.598 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:30.598 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:30.598 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:30.598 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:30 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:30.641 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:30 smithi194 ceph-mon[35694]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:30.641 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:30 smithi194 ceph-mon[35694]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi086=a;smithi086=d;smithi086=g;smithi086=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:07:30.641 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:30 smithi194 ceph-mon[35694]: Saving service mds.all spec with placement smithi086=a;smithi086=d;smithi086=g;smithi086=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2024-09-13T16:07:30.641 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:30.642 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:07:30.642 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:30.642 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:07:30.642 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:30.642 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:30.642 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:30.642 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:30 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:30.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.712+0000 7f2963e00640 1 -- 172.21.15.86:0/2704949332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2964101db0 msgr2=0x7f29641021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:30.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.712+0000 7f2963e00640 1 --2- 172.21.15.86:0/2704949332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2964101db0 0x7f29641021b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2954009be0 tx=0x7f295402a6c0 comp rx=0 tx=0).stop 2024-09-13T16:07:30.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.712+0000 7f2963e00640 1 -- 172.21.15.86:0/2704949332 shutdown_connections 2024-09-13T16:07:30.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.712+0000 7f2963e00640 1 --2- 172.21.15.86:0/2704949332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2964103960 0x7f296410a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:30.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.712+0000 7f2963e00640 1 --2- 172.21.15.86:0/2704949332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2964102fa0 0x7f2964103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:30.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.712+0000 7f2963e00640 1 --2- 172.21.15.86:0/2704949332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2964101db0 0x7f29641021b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:30.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.712+0000 7f2963e00640 1 -- 172.21.15.86:0/2704949332 >> 172.21.15.86:0/2704949332 conn(0x7f29640fd530 msgr2=0x7f29640ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:30.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.712+0000 7f2963e00640 1 -- 172.21.15.86:0/2704949332 shutdown_connections 2024-09-13T16:07:30.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.712+0000 7f2963e00640 1 -- 172.21.15.86:0/2704949332 wait complete. 2024-09-13T16:07:30.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.713+0000 7f2963e00640 1 Processor -- start 2024-09-13T16:07:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.713+0000 7f2963e00640 1 -- start start 2024-09-13T16:07:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.713+0000 7f2963e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2964101db0 0x7f2964197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.713+0000 7f2963e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2964102fa0 0x7f29641983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.713+0000 7f2963e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2964103960 0x7f296419f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.713+0000 7f2963e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296419f990 con 0x7f2964101db0 2024-09-13T16:07:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.713+0000 7f2963e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296419fb00 con 0x7f2964102fa0 2024-09-13T16:07:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.713+0000 7f2963e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296419fcc0 con 0x7f2964103960 2024-09-13T16:07:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.713+0000 7f2962a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2964101db0 0x7f2964197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.714+0000 7f2962a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2964101db0 0x7f2964197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56098/0 (socket says 172.21.15.86:56098) 2024-09-13T16:07:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.714+0000 7f2962a00640 1 -- 172.21.15.86:0/3060715560 learned_addr learned my addr 172.21.15.86:0/3060715560 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:07:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.714+0000 7f2963400640 1 --2- 172.21.15.86:0/3060715560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2964103960 0x7f296419f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.714+0000 7f2962000640 1 --2- 172.21.15.86:0/3060715560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2964102fa0 0x7f29641983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.714+0000 7f2962a00640 1 -- 172.21.15.86:0/3060715560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2964103960 msgr2=0x7f296419f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.714+0000 7f2962a00640 1 --2- 172.21.15.86:0/3060715560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2964103960 0x7f296419f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.714+0000 7f2962a00640 1 -- 172.21.15.86:0/3060715560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2964102fa0 msgr2=0x7f29641983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.714+0000 7f2962a00640 1 --2- 172.21.15.86:0/3060715560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2964102fa0 0x7f29641983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.714+0000 7f2962a00640 1 -- 172.21.15.86:0/3060715560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2950009560 con 0x7f2964101db0 2024-09-13T16:07:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.714+0000 7f2963400640 1 --2- 172.21.15.86:0/3060715560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2964103960 0x7f296419f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:07:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.714+0000 7f2962000640 1 --2- 172.21.15.86:0/3060715560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2964102fa0 0x7f29641983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:07:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.714+0000 7f2962a00640 1 --2- 172.21.15.86:0/3060715560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2964101db0 0x7f2964197ea0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f295402acb0 tx=0x7f2954003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.714+0000 7f295b400640 1 -- 172.21.15.86:0/3060715560 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954003d70 con 0x7f2964101db0 2024-09-13T16:07:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.715+0000 7f2963e00640 1 -- 172.21.15.86:0/3060715560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2954009840 con 0x7f2964101db0 2024-09-13T16:07:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.715+0000 7f295b400640 1 -- 172.21.15.86:0/3060715560 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2954004520 con 0x7f2964101db0 2024-09-13T16:07:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.715+0000 7f295b400640 1 -- 172.21.15.86:0/3060715560 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954031c50 con 0x7f2964101db0 2024-09-13T16:07:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.715+0000 7f2963e00640 1 -- 172.21.15.86:0/3060715560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29641a01a0 con 0x7f2964101db0 2024-09-13T16:07:30.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.716+0000 7f2963e00640 1 -- 172.21.15.86:0/3060715560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29641092e0 con 0x7f2964101db0 2024-09-13T16:07:30.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.717+0000 7f295b400640 1 -- 172.21.15.86:0/3060715560 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2954038070 con 0x7f2964101db0 2024-09-13T16:07:30.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.719+0000 7f295b400640 1 --2- 172.21.15.86:0/3060715560 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f29480a1090 0x7f29480a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:30.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.719+0000 7f295b400640 1 -- 172.21.15.86:0/3060715560 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f29540ecd60 con 0x7f2964101db0 2024-09-13T16:07:30.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.719+0000 7f2962000640 1 --2- 172.21.15.86:0/3060715560 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f29480a1090 0x7f29480a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:30.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.720+0000 7f2962000640 1 --2- 172.21.15.86:0/3060715560 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f29480a1090 0x7f29480a3550 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f29641993b0 tx=0x7f2950009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:30.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.723+0000 7f295b400640 1 -- 172.21.15.86:0/3060715560 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f29540b69a0 con 0x7f2964101db0 2024-09-13T16:07:30.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:30 smithi139 ceph-mon[35320]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:30.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:30 smithi139 ceph-mon[35320]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi086=a;smithi086=d;smithi086=g;smithi086=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:07:30.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:30 smithi139 ceph-mon[35320]: Saving service mds.all spec with placement smithi086=a;smithi086=d;smithi086=g;smithi086=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2024-09-13T16:07:30.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:07:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:07:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:30 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:30.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.893+0000 7f2963e00640 1 -- 172.21.15.86:0/3060715560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f296410d7b0 con 0x7f2964101db0 2024-09-13T16:07:30.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.894+0000 7f295b400640 1 -- 172.21.15.86:0/3060715560 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18411 (secure 0 0 0) 0x7f29540b9fc0 con 0x7f2964101db0 2024-09-13T16:07:30.896 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:07:30.896 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":82,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:07:17.532611+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:07:30.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.896+0000 7f2963e00640 1 -- 172.21.15.86:0/3060715560 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f29480a1090 msgr2=0x7f29480a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:30.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.896+0000 7f2963e00640 1 --2- 172.21.15.86:0/3060715560 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f29480a1090 0x7f29480a3550 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f29641993b0 tx=0x7f2950009260 comp rx=0 tx=0).stop 2024-09-13T16:07:30.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.896+0000 7f2963e00640 1 -- 172.21.15.86:0/3060715560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2964101db0 msgr2=0x7f2964197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:30.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.896+0000 7f2963e00640 1 --2- 172.21.15.86:0/3060715560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2964101db0 0x7f2964197ea0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f295402acb0 tx=0x7f2954003970 comp rx=0 tx=0).stop 2024-09-13T16:07:30.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.896+0000 7f2963e00640 1 -- 172.21.15.86:0/3060715560 shutdown_connections 2024-09-13T16:07:30.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.896+0000 7f2963e00640 1 --2- 172.21.15.86:0/3060715560 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f29480a1090 0x7f29480a3550 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:30.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.896+0000 7f2963e00640 1 --2- 172.21.15.86:0/3060715560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2964103960 0x7f296419f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:30.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.896+0000 7f2963e00640 1 --2- 172.21.15.86:0/3060715560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2964102fa0 0x7f29641983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:30.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.896+0000 7f2963e00640 1 --2- 172.21.15.86:0/3060715560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2964101db0 0x7f2964197ea0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:30.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.896+0000 7f2963e00640 1 -- 172.21.15.86:0/3060715560 >> 172.21.15.86:0/3060715560 conn(0x7f29640fd530 msgr2=0x7f29641064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:30.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.897+0000 7f2963e00640 1 -- 172.21.15.86:0/3060715560 shutdown_connections 2024-09-13T16:07:30.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:30.897+0000 7f2963e00640 1 -- 172.21.15.86:0/3060715560 wait complete. 2024-09-13T16:07:30.916 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:03:27.830423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:07:30.916 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:07:31.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.072+0000 7f1c8ca00640 1 -- 172.21.15.86:0/390174753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c88102f80 msgr2=0x7f1c88103400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:31.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.072+0000 7f1c8ca00640 1 --2- 172.21.15.86:0/390174753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c88102f80 0x7f1c88103400 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009900 tx=0x7f1c7002a400 comp rx=0 tx=0).stop 2024-09-13T16:07:31.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.072+0000 7f1c8ca00640 1 -- 172.21.15.86:0/390174753 shutdown_connections 2024-09-13T16:07:31.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.072+0000 7f1c8ca00640 1 --2- 172.21.15.86:0/390174753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c88103940 0x7f1c8810a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.072+0000 7f1c8ca00640 1 --2- 172.21.15.86:0/390174753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c88102f80 0x7f1c88103400 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.072+0000 7f1c8ca00640 1 --2- 172.21.15.86:0/390174753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c88101e30 0x7f1c88102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.072+0000 7f1c8ca00640 1 -- 172.21.15.86:0/390174753 >> 172.21.15.86:0/390174753 conn(0x7f1c880fd5b0 msgr2=0x7f1c880ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:31.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.072+0000 7f1c8ca00640 1 -- 172.21.15.86:0/390174753 shutdown_connections 2024-09-13T16:07:31.075 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.073+0000 7f1c8ca00640 1 -- 172.21.15.86:0/390174753 wait complete. 2024-09-13T16:07:31.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.073+0000 7f1c8ca00640 1 Processor -- start 2024-09-13T16:07:31.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.073+0000 7f1c8ca00640 1 -- start start 2024-09-13T16:07:31.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.074+0000 7f1c8ca00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c88101e30 0x7f1c88197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:31.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.074+0000 7f1c8ca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c88102f80 0x7f1c88198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:31.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.074+0000 7f1c8ca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c88103940 0x7f1c8819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:31.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.074+0000 7f1c8ca00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8819f9c0 con 0x7f1c88103940 2024-09-13T16:07:31.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.074+0000 7f1c8ca00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8819fb30 con 0x7f1c88101e30 2024-09-13T16:07:31.078 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.074+0000 7f1c8ca00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8819fcf0 con 0x7f1c88102f80 2024-09-13T16:07:31.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.074+0000 7f1c7de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c88102f80 0x7f1c88198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:31.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.074+0000 7f1c87200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c88103940 0x7f1c8819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:31.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.074+0000 7f1c7de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c88102f80 0x7f1c88198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:56180/0 (socket says 172.21.15.86:56180) 2024-09-13T16:07:31.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.074+0000 7f1c7de00640 1 -- 172.21.15.86:0/423756913 learned_addr learned my addr 172.21.15.86:0/423756913 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:07:31.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.074+0000 7f1c86800640 1 --2- 172.21.15.86:0/423756913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c88101e30 0x7f1c88197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:31.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.074+0000 7f1c87200640 1 -- 172.21.15.86:0/423756913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c88102f80 msgr2=0x7f1c88198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:31.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.074+0000 7f1c87200640 1 --2- 172.21.15.86:0/423756913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c88102f80 0x7f1c88198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.074+0000 7f1c87200640 1 -- 172.21.15.86:0/423756913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c88101e30 msgr2=0x7f1c88197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:31.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.074+0000 7f1c87200640 1 --2- 172.21.15.86:0/423756913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c88101e30 0x7f1c88197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.074+0000 7f1c87200640 1 -- 172.21.15.86:0/423756913 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c70009560 con 0x7f1c88103940 2024-09-13T16:07:31.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.074+0000 7f1c86800640 1 --2- 172.21.15.86:0/423756913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c88101e30 0x7f1c88197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:07:31.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.075+0000 7f1c87200640 1 --2- 172.21.15.86:0/423756913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c88103940 0x7f1c8819f480 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009fd0 tx=0x7f1c8000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:31.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.075+0000 7f1c7fe00640 1 -- 172.21.15.86:0/423756913 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8000ce20 con 0x7f1c88103940 2024-09-13T16:07:31.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.075+0000 7f1c7fe00640 1 -- 172.21.15.86:0/423756913 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1c80005020 con 0x7f1c88103940 2024-09-13T16:07:31.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.075+0000 7f1c8ca00640 1 -- 172.21.15.86:0/423756913 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8819ffd0 con 0x7f1c88103940 2024-09-13T16:07:31.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.075+0000 7f1c7fe00640 1 -- 172.21.15.86:0/423756913 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c80010690 con 0x7f1c88103940 2024-09-13T16:07:31.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.075+0000 7f1c8ca00640 1 -- 172.21.15.86:0/423756913 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c881a0450 con 0x7f1c88103940 2024-09-13T16:07:31.080 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.076+0000 7f1c8ca00640 1 -- 172.21.15.86:0/423756913 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c881091e0 con 0x7f1c88103940 2024-09-13T16:07:31.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.078+0000 7f1c7fe00640 1 -- 172.21.15.86:0/423756913 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1c80005500 con 0x7f1c88103940 2024-09-13T16:07:31.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.079+0000 7f1c7fe00640 1 --2- 172.21.15.86:0/423756913 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1c6c0a1110 0x7f1c6c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:31.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.079+0000 7f1c7fe00640 1 -- 172.21.15.86:0/423756913 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1c80014070 con 0x7f1c88103940 2024-09-13T16:07:31.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.079+0000 7f1c86800640 1 --2- 172.21.15.86:0/423756913 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1c6c0a1110 0x7f1c6c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:31.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.080+0000 7f1c86800640 1 --2- 172.21.15.86:0/423756913 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1c6c0a1110 0x7f1c6c0a35d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009c20 tx=0x7f1c78005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:31.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.083+0000 7f1c7fe00640 1 -- 172.21.15.86:0/423756913 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1c80096810 con 0x7f1c88103940 2024-09-13T16:07:31.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.250+0000 7f1c8ca00640 1 -- 172.21.15.86:0/423756913 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c88108c50 con 0x7f1c88103940 2024-09-13T16:07:31.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.251+0000 7f1c7fe00640 1 -- 172.21.15.86:0/423756913 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c80005190 con 0x7f1c88103940 2024-09-13T16:07:31.252 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-09-13T16:07:31.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.252+0000 7f1c8ca00640 1 -- 172.21.15.86:0/423756913 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1c6c0a1110 msgr2=0x7f1c6c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:31.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.252+0000 7f1c8ca00640 1 --2- 172.21.15.86:0/423756913 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1c6c0a1110 0x7f1c6c0a35d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009c20 tx=0x7f1c78005f90 comp rx=0 tx=0).stop 2024-09-13T16:07:31.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.252+0000 7f1c8ca00640 1 -- 172.21.15.86:0/423756913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c88103940 msgr2=0x7f1c8819f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:31.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.252+0000 7f1c8ca00640 1 --2- 172.21.15.86:0/423756913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c88103940 0x7f1c8819f480 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009fd0 tx=0x7f1c8000ef10 comp rx=0 tx=0).stop 2024-09-13T16:07:31.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.253+0000 7f1c8ca00640 1 -- 172.21.15.86:0/423756913 shutdown_connections 2024-09-13T16:07:31.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.253+0000 7f1c8ca00640 1 --2- 172.21.15.86:0/423756913 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1c6c0a1110 0x7f1c6c0a35d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.253+0000 7f1c8ca00640 1 --2- 172.21.15.86:0/423756913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c88103940 0x7f1c8819f480 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.253+0000 7f1c8ca00640 1 --2- 172.21.15.86:0/423756913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c88102f80 0x7f1c88198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.253+0000 7f1c8ca00640 1 --2- 172.21.15.86:0/423756913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c88101e30 0x7f1c88197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.253+0000 7f1c8ca00640 1 -- 172.21.15.86:0/423756913 >> 172.21.15.86:0/423756913 conn(0x7f1c880fd5b0 msgr2=0x7f1c881063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:31.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.253+0000 7f1c8ca00640 1 -- 172.21.15.86:0/423756913 shutdown_connections 2024-09-13T16:07:31.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.253+0000 7f1c8ca00640 1 -- 172.21.15.86:0/423756913 wait complete. 2024-09-13T16:07:31.271 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:07:31.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.424+0000 7ff230800640 1 -- 172.21.15.86:0/2842792349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff228103190 msgr2=0x7ff228103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:31.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.424+0000 7ff230800640 1 --2- 172.21.15.86:0/2842792349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff228103190 0x7ff228103610 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff218009900 tx=0x7ff21802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.424+0000 7ff230800640 1 -- 172.21.15.86:0/2842792349 shutdown_connections 2024-09-13T16:07:31.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.424+0000 7ff230800640 1 --2- 172.21.15.86:0/2842792349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff228103b50 0x7ff22810a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.424+0000 7ff230800640 1 --2- 172.21.15.86:0/2842792349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff228103190 0x7ff228103610 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.424+0000 7ff230800640 1 --2- 172.21.15.86:0/2842792349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff228101fa0 0x7ff2281023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.424+0000 7ff230800640 1 -- 172.21.15.86:0/2842792349 >> 172.21.15.86:0/2842792349 conn(0x7ff2280fd700 msgr2=0x7ff2280ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:31.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.424+0000 7ff230800640 1 -- 172.21.15.86:0/2842792349 shutdown_connections 2024-09-13T16:07:31.426 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.424+0000 7ff230800640 1 -- 172.21.15.86:0/2842792349 wait complete. 2024-09-13T16:07:31.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.425+0000 7ff230800640 1 Processor -- start 2024-09-13T16:07:31.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.425+0000 7ff230800640 1 -- start start 2024-09-13T16:07:31.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.425+0000 7ff230800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff228101fa0 0x7ff228198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:31.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.425+0000 7ff230800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff228103190 0x7ff2281985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:31.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.425+0000 7ff230800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff228103b50 0x7ff22819f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:31.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.425+0000 7ff230800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22819fb70 con 0x7ff228103190 2024-09-13T16:07:31.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.425+0000 7ff230800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22819fce0 con 0x7ff228103b50 2024-09-13T16:07:31.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.425+0000 7ff230800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22819fea0 con 0x7ff228101fa0 2024-09-13T16:07:31.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.425+0000 7ff22de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff228101fa0 0x7ff228198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:31.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.425+0000 7ff22d400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff228103190 0x7ff2281985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:31.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.425+0000 7ff22de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff228101fa0 0x7ff228198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:56206/0 (socket says 172.21.15.86:56206) 2024-09-13T16:07:31.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.425+0000 7ff22de00640 1 -- 172.21.15.86:0/2670754817 learned_addr learned my addr 172.21.15.86:0/2670754817 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:07:31.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.425+0000 7ff22e800640 1 --2- 172.21.15.86:0/2670754817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff228103b50 0x7ff22819f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:31.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.426+0000 7ff22de00640 1 -- 172.21.15.86:0/2670754817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff228103b50 msgr2=0x7ff22819f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:31.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.426+0000 7ff22de00640 1 --2- 172.21.15.86:0/2670754817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff228103b50 0x7ff22819f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.426+0000 7ff22de00640 1 -- 172.21.15.86:0/2670754817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff228103190 msgr2=0x7ff2281985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:31.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.426+0000 7ff22de00640 1 --2- 172.21.15.86:0/2670754817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff228103190 0x7ff2281985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.426+0000 7ff22de00640 1 -- 172.21.15.86:0/2670754817 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff218009560 con 0x7ff228101fa0 2024-09-13T16:07:31.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.426+0000 7ff22e800640 1 --2- 172.21.15.86:0/2670754817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff228103b50 0x7ff22819f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:07:31.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.426+0000 7ff22de00640 1 --2- 172.21.15.86:0/2670754817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff228101fa0 0x7ff228198080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00e9c0 tx=0x7ff21c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:31.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.426+0000 7ff222a00640 1 -- 172.21.15.86:0/2670754817 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c009700 con 0x7ff228101fa0 2024-09-13T16:07:31.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.426+0000 7ff222a00640 1 -- 172.21.15.86:0/2670754817 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff21c00cd80 con 0x7ff228101fa0 2024-09-13T16:07:31.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.426+0000 7ff222a00640 1 -- 172.21.15.86:0/2670754817 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c010430 con 0x7ff228101fa0 2024-09-13T16:07:31.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.426+0000 7ff230800640 1 -- 172.21.15.86:0/2670754817 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2281a0180 con 0x7ff228101fa0 2024-09-13T16:07:31.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.426+0000 7ff230800640 1 -- 172.21.15.86:0/2670754817 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2281a0660 con 0x7ff228101fa0 2024-09-13T16:07:31.430 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.427+0000 7ff230800640 1 -- 172.21.15.86:0/2670754817 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2281093b0 con 0x7ff228101fa0 2024-09-13T16:07:31.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.429+0000 7ff222a00640 1 -- 172.21.15.86:0/2670754817 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff21c003680 con 0x7ff228101fa0 2024-09-13T16:07:31.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.430+0000 7ff222a00640 1 --2- 172.21.15.86:0/2670754817 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff2100a1110 0x7ff2100a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:31.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.431+0000 7ff222a00640 1 -- 172.21.15.86:0/2670754817 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff21c014070 con 0x7ff228101fa0 2024-09-13T16:07:31.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.431+0000 7ff22d400640 1 --2- 172.21.15.86:0/2670754817 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff2100a1110 0x7ff2100a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:31.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.431+0000 7ff22d400640 1 --2- 172.21.15.86:0/2670754817 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff2100a1110 0x7ff2100a35d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff218005ab0 tx=0x7ff218005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:31.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.433+0000 7ff222a00640 1 -- 172.21.15.86:0/2670754817 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff21c096c20 con 0x7ff228101fa0 2024-09-13T16:07:31.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:31 smithi086 ceph-mon[30379]: Deploying daemon mds.l on smithi194 2024-09-13T16:07:31.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:31 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3060715560' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:07:31.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:31 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/423756913' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:07:31.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.640+0000 7ff230800640 1 -- 172.21.15.86:0/2670754817 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff22810d9d0 con 0x7ff228101fa0 2024-09-13T16:07:31.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.641+0000 7ff222a00640 1 -- 172.21.15.86:0/2670754817 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7ff21c09a240 con 0x7ff228101fa0 2024-09-13T16:07:31.645 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:07:31.645 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-13T16:07:31.646 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 1 2024-09-13T16:07:31.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.643+0000 7ff230800640 1 -- 172.21.15.86:0/2670754817 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff2100a1110 msgr2=0x7ff2100a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:31.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.643+0000 7ff230800640 1 --2- 172.21.15.86:0/2670754817 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff2100a1110 0x7ff2100a35d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff218005ab0 tx=0x7ff218005a20 comp rx=0 tx=0).stop 2024-09-13T16:07:31.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.643+0000 7ff230800640 1 -- 172.21.15.86:0/2670754817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff228101fa0 msgr2=0x7ff228198080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:31.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.643+0000 7ff230800640 1 --2- 172.21.15.86:0/2670754817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff228101fa0 0x7ff228198080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00e9c0 tx=0x7ff21c00ee80 comp rx=0 tx=0).stop 2024-09-13T16:07:31.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.643+0000 7ff230800640 1 -- 172.21.15.86:0/2670754817 shutdown_connections 2024-09-13T16:07:31.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.643+0000 7ff230800640 1 --2- 172.21.15.86:0/2670754817 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff2100a1110 0x7ff2100a35d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.643+0000 7ff230800640 1 --2- 172.21.15.86:0/2670754817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff228103b50 0x7ff22819f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.643+0000 7ff230800640 1 --2- 172.21.15.86:0/2670754817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff228103190 0x7ff2281985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.643+0000 7ff230800640 1 --2- 172.21.15.86:0/2670754817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff228101fa0 0x7ff228198080 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:31.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.643+0000 7ff230800640 1 -- 172.21.15.86:0/2670754817 >> 172.21.15.86:0/2670754817 conn(0x7ff2280fd700 msgr2=0x7ff228106580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:31.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.643+0000 7ff230800640 1 -- 172.21.15.86:0/2670754817 shutdown_connections 2024-09-13T16:07:31.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:31.643+0000 7ff230800640 1 -- 172.21.15.86:0/2670754817 wait complete. 2024-09-13T16:07:31.716 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:31 smithi194 ceph-mon[35694]: Deploying daemon mds.l on smithi194 2024-09-13T16:07:31.716 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:31 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3060715560' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:07:31.716 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:31 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/423756913' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:07:31.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:31 smithi139 ceph-mon[35320]: Deploying daemon mds.l on smithi194 2024-09-13T16:07:31.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:31 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3060715560' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:07:31.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:31 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/423756913' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:07:32.005 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 13 16:07:31 smithi194 systemd[1]: Starting Ceph mds.l for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:07:32.351 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 13 16:07:32 smithi194 podman[65812]: 2024-09-13 16:07:32.097430452 +0000 UTC m=+0.102746282 container create e07125f3cb3c1a2bbc57d68d32183558cd4f8898a62e9632b04e764221fd7263 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD) 2024-09-13T16:07:32.351 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 13 16:07:32 smithi194 podman[65812]: 2024-09-13 16:07:32.010606435 +0000 UTC m=+0.015922273 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:07:32.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:32 smithi139 ceph-mon[35320]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:32 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2670754817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:32 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.194:6832/750435531,v1:172.21.15.194:6833/750435531] up:boot 2024-09-13T16:07:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:32 smithi139 ceph-mon[35320]: fsmap 1 up:standby 2024-09-13T16:07:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:32 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T16:07:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:32 smithi194 ceph-mon[35694]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:32 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2670754817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:32 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.194:6832/750435531,v1:172.21.15.194:6833/750435531] up:boot 2024-09-13T16:07:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:32 smithi194 ceph-mon[35694]: fsmap 1 up:standby 2024-09-13T16:07:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:32 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T16:07:32.755 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 13 16:07:32 smithi194 podman[65812]: 2024-09-13 16:07:32.350332357 +0000 UTC m=+0.355648185 container init e07125f3cb3c1a2bbc57d68d32183558cd4f8898a62e9632b04e764221fd7263 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-l, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:07:32.755 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 13 16:07:32 smithi194 podman[65812]: 2024-09-13 16:07:32.35318943 +0000 UTC m=+0.358505266 container start e07125f3cb3c1a2bbc57d68d32183558cd4f8898a62e9632b04e764221fd7263 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-13T16:07:32.755 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 13 16:07:32 smithi194 ceph-mds[65831]: -- 172.21.15.194:0/2818723874 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5607813dcd00 con 0x5607813b1000 2024-09-13T16:07:32.755 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 13 16:07:32 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-l[65827]: starting mds.l at 2024-09-13T16:07:32.756 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 13 16:07:32 smithi194 bash[65812]: e07125f3cb3c1a2bbc57d68d32183558cd4f8898a62e9632b04e764221fd7263 2024-09-13T16:07:32.756 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 13 16:07:32 smithi194 systemd[1]: Started Ceph mds.l for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:07:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:32 smithi086 ceph-mon[30379]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:32 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2670754817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:32 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.194:6832/750435531,v1:172.21.15.194:6833/750435531] up:boot 2024-09-13T16:07:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:32 smithi086 ceph-mon[30379]: fsmap 1 up:standby 2024-09-13T16:07:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:32 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T16:07:33.662 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:07:33.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:33 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:33.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:33 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:33.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:33 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:33.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:33 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:33.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:33 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:33.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:33 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:33.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:33 smithi139 ceph-mon[35320]: Deploying daemon mds.k on smithi139 2024-09-13T16:07:33.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:33 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:33.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:33 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:33.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:33 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:33.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:33 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:33.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:33 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:33.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:33 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:33.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:33 smithi194 ceph-mon[35694]: Deploying daemon mds.k on smithi139 2024-09-13T16:07:33.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.825+0000 7fc1f0400640 1 -- 172.21.15.86:0/2360478149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1e8103130 msgr2=0x7fc1e8105520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:33.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.825+0000 7fc1f0400640 1 --2- 172.21.15.86:0/2360478149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1e8103130 0x7fc1e8105520 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4009900 tx=0x7fc1d402a410 comp rx=0 tx=0).stop 2024-09-13T16:07:33.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.825+0000 7fc1f0400640 1 -- 172.21.15.86:0/2360478149 shutdown_connections 2024-09-13T16:07:33.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.825+0000 7fc1f0400640 1 --2- 172.21.15.86:0/2360478149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e8105a60 0x7fc1e8107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:33.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.825+0000 7fc1f0400640 1 --2- 172.21.15.86:0/2360478149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1e8103130 0x7fc1e8105520 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:33.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.825+0000 7fc1f0400640 1 --2- 172.21.15.86:0/2360478149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1e8100800 0x7fc1e8102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:33.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.825+0000 7fc1f0400640 1 -- 172.21.15.86:0/2360478149 >> 172.21.15.86:0/2360478149 conn(0x7fc1e80fa3e0 msgr2=0x7fc1e80fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:33.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.826+0000 7fc1f0400640 1 -- 172.21.15.86:0/2360478149 shutdown_connections 2024-09-13T16:07:33.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.826+0000 7fc1f0400640 1 -- 172.21.15.86:0/2360478149 wait complete. 2024-09-13T16:07:33.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.826+0000 7fc1f0400640 1 Processor -- start 2024-09-13T16:07:33.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.827+0000 7fc1f0400640 1 -- start start 2024-09-13T16:07:33.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.827+0000 7fc1f0400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e8100800 0x7fc1e81980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:33.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.827+0000 7fc1f0400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1e8103130 0x7fc1e8198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:33.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.827+0000 7fc1f0400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1e8105a60 0x7fc1e819f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:33.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.827+0000 7fc1f0400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e819fbc0 con 0x7fc1e8103130 2024-09-13T16:07:33.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.827+0000 7fc1f0400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e819fd30 con 0x7fc1e8105a60 2024-09-13T16:07:33.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.827+0000 7fc1f0400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e819fef0 con 0x7fc1e8100800 2024-09-13T16:07:33.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.827+0000 7fc1ed000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1e8103130 0x7fc1e8198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:33.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.827+0000 7fc1ed000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1e8103130 0x7fc1e8198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37464/0 (socket says 172.21.15.86:37464) 2024-09-13T16:07:33.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.827+0000 7fc1ed000640 1 -- 172.21.15.86:0/2239105370 learned_addr learned my addr 172.21.15.86:0/2239105370 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:07:33.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.827+0000 7fc1eda00640 1 --2- 172.21.15.86:0/2239105370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e8100800 0x7fc1e81980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:33.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.827+0000 7fc1ee400640 1 --2- 172.21.15.86:0/2239105370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1e8105a60 0x7fc1e819f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:33.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.827+0000 7fc1ed000640 1 -- 172.21.15.86:0/2239105370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e8100800 msgr2=0x7fc1e81980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:33.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.827+0000 7fc1ed000640 1 --2- 172.21.15.86:0/2239105370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e8100800 0x7fc1e81980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:33.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.828+0000 7fc1ed000640 1 -- 172.21.15.86:0/2239105370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1e8105a60 msgr2=0x7fc1e819f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:33.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.828+0000 7fc1ed000640 1 --2- 172.21.15.86:0/2239105370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1e8105a60 0x7fc1e819f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:33.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.828+0000 7fc1ed000640 1 -- 172.21.15.86:0/2239105370 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d4009560 con 0x7fc1e8103130 2024-09-13T16:07:33.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.828+0000 7fc1ed000640 1 --2- 172.21.15.86:0/2239105370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1e8103130 0x7fc1e8198610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4031510 tx=0x7fc1d4004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:33.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.828+0000 7fc1e6000640 1 -- 172.21.15.86:0/2239105370 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4005210 con 0x7fc1e8103130 2024-09-13T16:07:33.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.828+0000 7fc1e6000640 1 -- 172.21.15.86:0/2239105370 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc1d4004ba0 con 0x7fc1e8103130 2024-09-13T16:07:33.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.828+0000 7fc1f0400640 1 -- 172.21.15.86:0/2239105370 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e81a0170 con 0x7fc1e8103130 2024-09-13T16:07:33.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.828+0000 7fc1e6000640 1 -- 172.21.15.86:0/2239105370 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4003b20 con 0x7fc1e8103130 2024-09-13T16:07:33.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.828+0000 7fc1f0400640 1 -- 172.21.15.86:0/2239105370 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e81a0620 con 0x7fc1e8103130 2024-09-13T16:07:33.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.829+0000 7fc1f0400640 1 -- 172.21.15.86:0/2239105370 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e81075d0 con 0x7fc1e8103130 2024-09-13T16:07:33.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.831+0000 7fc1e6000640 1 -- 172.21.15.86:0/2239105370 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc1d4004d10 con 0x7fc1e8103130 2024-09-13T16:07:33.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.833+0000 7fc1e6000640 1 --2- 172.21.15.86:0/2239105370 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc1d00a1090 0x7fc1d00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:33.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.833+0000 7fc1e6000640 1 -- 172.21.15.86:0/2239105370 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc1d40ed4d0 con 0x7fc1e8103130 2024-09-13T16:07:33.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.833+0000 7fc1eda00640 1 --2- 172.21.15.86:0/2239105370 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc1d00a1090 0x7fc1d00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:33.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.834+0000 7fc1eda00640 1 --2- 172.21.15.86:0/2239105370 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc1d00a1090 0x7fc1d00a3550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc005d00 tx=0x7fc1dc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:33.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:33.835+0000 7fc1e6000640 1 -- 172.21.15.86:0/2239105370 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc1d40b7110 con 0x7fc1e8103130 2024-09-13T16:07:33.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:33.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:33.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:33.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:33.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:33.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:33 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:33.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:33 smithi086 ceph-mon[30379]: Deploying daemon mds.k on smithi139 2024-09-13T16:07:34.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:34.043+0000 7fc1f0400640 1 -- 172.21.15.86:0/2239105370 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1e810b7b0 con 0x7fc1e8103130 2024-09-13T16:07:34.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:34.043+0000 7fc1e6000640 1 -- 172.21.15.86:0/2239105370 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1257 (secure 0 0 0) 0x7fc1d4035500 con 0x7fc1e8103130 2024-09-13T16:07:34.044 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:07:34.044 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T16:07:34.044 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 2 2024-09-13T16:07:34.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:34.045+0000 7fc1f0400640 1 -- 172.21.15.86:0/2239105370 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc1d00a1090 msgr2=0x7fc1d00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:34.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:34.045+0000 7fc1f0400640 1 --2- 172.21.15.86:0/2239105370 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc1d00a1090 0x7fc1d00a3550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc005d00 tx=0x7fc1dc00b410 comp rx=0 tx=0).stop 2024-09-13T16:07:34.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:34.045+0000 7fc1f0400640 1 -- 172.21.15.86:0/2239105370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1e8103130 msgr2=0x7fc1e8198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:34.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:34.045+0000 7fc1f0400640 1 --2- 172.21.15.86:0/2239105370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1e8103130 0x7fc1e8198610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4031510 tx=0x7fc1d4004360 comp rx=0 tx=0).stop 2024-09-13T16:07:34.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:34.045+0000 7fc1f0400640 1 -- 172.21.15.86:0/2239105370 shutdown_connections 2024-09-13T16:07:34.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:34.045+0000 7fc1f0400640 1 --2- 172.21.15.86:0/2239105370 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc1d00a1090 0x7fc1d00a3550 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:34.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:34.045+0000 7fc1f0400640 1 --2- 172.21.15.86:0/2239105370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1e8105a60 0x7fc1e819f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:34.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:34.045+0000 7fc1f0400640 1 --2- 172.21.15.86:0/2239105370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1e8103130 0x7fc1e8198610 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:34.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:34.045+0000 7fc1f0400640 1 --2- 172.21.15.86:0/2239105370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e8100800 0x7fc1e81980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:34.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:34.045+0000 7fc1f0400640 1 -- 172.21.15.86:0/2239105370 >> 172.21.15.86:0/2239105370 conn(0x7fc1e80fa3e0 msgr2=0x7fc1e80fffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:34.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:34.045+0000 7fc1f0400640 1 -- 172.21.15.86:0/2239105370 shutdown_connections 2024-09-13T16:07:34.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:34.045+0000 7fc1f0400640 1 -- 172.21.15.86:0/2239105370 wait complete. 2024-09-13T16:07:34.511 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 13 16:07:34 smithi139 systemd[1]: Starting Ceph mds.k for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:07:34.776 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:34 smithi139 ceph-mon[35320]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:34.776 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:34 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2239105370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:34.776 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 13 16:07:34 smithi139 podman[63688]: 2024-09-13 16:07:34.54555923 +0000 UTC m=+0.016382657 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:07:34.776 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 13 16:07:34 smithi139 podman[63688]: 2024-09-13 16:07:34.657469914 +0000 UTC m=+0.128293343 container create 3b9d6f6c9c884f6a8707bf2dc9545e6a8f0bf8e3ab9d00546971b0b1a25d05dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-13T16:07:34.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:34 smithi086 ceph-mon[30379]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:34.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:34 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2239105370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:35.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:34 smithi194 ceph-mon[35694]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:35.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:34 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2239105370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:35.044 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 13 16:07:34 smithi139 podman[63688]: 2024-09-13 16:07:34.952006376 +0000 UTC m=+0.422829806 container init 3b9d6f6c9c884f6a8707bf2dc9545e6a8f0bf8e3ab9d00546971b0b1a25d05dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-13T16:07:35.044 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 13 16:07:34 smithi139 podman[63688]: 2024-09-13 16:07:34.954855146 +0000 UTC m=+0.425678574 container start 3b9d6f6c9c884f6a8707bf2dc9545e6a8f0bf8e3ab9d00546971b0b1a25d05dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-k, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:07:35.044 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 13 16:07:34 smithi139 ceph-mds[63707]: -- 172.21.15.139:0/2241660018 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5597ad894d00 con 0x5597ad869000 2024-09-13T16:07:35.044 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 13 16:07:34 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-k[63703]: starting mds.k at 2024-09-13T16:07:35.498 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 13 16:07:35 smithi139 bash[63688]: 3b9d6f6c9c884f6a8707bf2dc9545e6a8f0bf8e3ab9d00546971b0b1a25d05dc 2024-09-13T16:07:35.498 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 13 16:07:35 smithi139 systemd[1]: Started Ceph mds.k for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:07:36.064 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:07:36.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.223+0000 7fe25dc00640 1 -- 172.21.15.86:0/1495270743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe258103960 msgr2=0x7fe25810a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:36.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.223+0000 7fe25dc00640 1 --2- 172.21.15.86:0/1495270743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe258103960 0x7fe25810a1f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe250009900 tx=0x7fe25002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:07:36.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.223+0000 7fe25dc00640 1 -- 172.21.15.86:0/1495270743 shutdown_connections 2024-09-13T16:07:36.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.223+0000 7fe25dc00640 1 --2- 172.21.15.86:0/1495270743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe258103960 0x7fe25810a1f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:36.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.223+0000 7fe25dc00640 1 --2- 172.21.15.86:0/1495270743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe258102fa0 0x7fe258103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:36.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.223+0000 7fe25dc00640 1 --2- 172.21.15.86:0/1495270743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe258101db0 0x7fe2581021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:36.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.223+0000 7fe25dc00640 1 -- 172.21.15.86:0/1495270743 >> 172.21.15.86:0/1495270743 conn(0x7fe2580fd530 msgr2=0x7fe2580ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:36.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.223+0000 7fe25dc00640 1 -- 172.21.15.86:0/1495270743 shutdown_connections 2024-09-13T16:07:36.225 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.223+0000 7fe25dc00640 1 -- 172.21.15.86:0/1495270743 wait complete. 2024-09-13T16:07:36.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.224+0000 7fe25dc00640 1 Processor -- start 2024-09-13T16:07:36.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.224+0000 7fe25dc00640 1 -- start start 2024-09-13T16:07:36.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.225+0000 7fe25dc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe258101db0 0x7fe258197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:36.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.225+0000 7fe25dc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe258102fa0 0x7fe258198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:36.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.225+0000 7fe25dc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe258103960 0x7fe25819f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:36.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.225+0000 7fe25dc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25819f930 con 0x7fe258103960 2024-09-13T16:07:36.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.225+0000 7fe25dc00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25819faa0 con 0x7fe258102fa0 2024-09-13T16:07:36.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.225+0000 7fe25dc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25819fc60 con 0x7fe258101db0 2024-09-13T16:07:36.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.225+0000 7fe24f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe258102fa0 0x7fe258198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:36.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.225+0000 7fe25d200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe258103960 0x7fe25819f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:36.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.225+0000 7fe24f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe258102fa0 0x7fe258198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:56140/0 (socket says 172.21.15.86:56140) 2024-09-13T16:07:36.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.225+0000 7fe24f400640 1 -- 172.21.15.86:0/2194966844 learned_addr learned my addr 172.21.15.86:0/2194966844 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:07:36.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.225+0000 7fe257e00640 1 --2- 172.21.15.86:0/2194966844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe258101db0 0x7fe258197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:36.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.225+0000 7fe24f400640 1 -- 172.21.15.86:0/2194966844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe258101db0 msgr2=0x7fe258197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:36.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.225+0000 7fe24f400640 1 --2- 172.21.15.86:0/2194966844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe258101db0 0x7fe258197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:36.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.225+0000 7fe24f400640 1 -- 172.21.15.86:0/2194966844 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe258103960 msgr2=0x7fe25819f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:36.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.225+0000 7fe24f400640 1 --2- 172.21.15.86:0/2194966844 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe258103960 0x7fe25819f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:36.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.225+0000 7fe24f400640 1 -- 172.21.15.86:0/2194966844 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe250009560 con 0x7fe258102fa0 2024-09-13T16:07:36.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.225+0000 7fe257e00640 1 --2- 172.21.15.86:0/2194966844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe258101db0 0x7fe258197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:07:36.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.226+0000 7fe24f400640 1 --2- 172.21.15.86:0/2194966844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe258102fa0 0x7fe258198380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe24000e9f0 tx=0x7fe24000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:36.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.226+0000 7fe255600640 1 -- 172.21.15.86:0/2194966844 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe240009700 con 0x7fe258102fa0 2024-09-13T16:07:36.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.226+0000 7fe255600640 1 -- 172.21.15.86:0/2194966844 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe24000cd80 con 0x7fe258102fa0 2024-09-13T16:07:36.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.226+0000 7fe25dc00640 1 -- 172.21.15.86:0/2194966844 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25819ff40 con 0x7fe258102fa0 2024-09-13T16:07:36.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.226+0000 7fe255600640 1 -- 172.21.15.86:0/2194966844 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe240018920 con 0x7fe258102fa0 2024-09-13T16:07:36.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.226+0000 7fe25dc00640 1 -- 172.21.15.86:0/2194966844 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2581a03c0 con 0x7fe258102fa0 2024-09-13T16:07:36.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.227+0000 7fe25dc00640 1 -- 172.21.15.86:0/2194966844 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe258109210 con 0x7fe258102fa0 2024-09-13T16:07:36.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.229+0000 7fe255600640 1 -- 172.21.15.86:0/2194966844 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe240018a80 con 0x7fe258102fa0 2024-09-13T16:07:36.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.230+0000 7fe255600640 1 --2- 172.21.15.86:0/2194966844 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe23c0a1090 0x7fe23c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:36.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.230+0000 7fe255600640 1 -- 172.21.15.86:0/2194966844 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe240014070 con 0x7fe258102fa0 2024-09-13T16:07:36.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.230+0000 7fe257e00640 1 --2- 172.21.15.86:0/2194966844 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe23c0a1090 0x7fe23c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:36.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.231+0000 7fe257e00640 1 --2- 172.21.15.86:0/2194966844 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe23c0a1090 0x7fe23c0a3550 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe258102e00 tx=0x7fe248009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:36.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.232+0000 7fe255600640 1 -- 172.21.15.86:0/2194966844 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe240096410 con 0x7fe258102fa0 2024-09-13T16:07:36.362 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:36 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:36.362 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:36 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:36.362 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:36 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:36.362 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:36 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:36.362 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:36 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:36.362 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:36 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:36.362 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:36 smithi139 ceph-mon[35320]: Deploying daemon mds.j on smithi086 2024-09-13T16:07:36.363 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:36 smithi139 ceph-mon[35320]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:36.363 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:36 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.139:6832/1329253837,v1:172.21.15.139:6833/1329253837] up:boot 2024-09-13T16:07:36.363 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:36 smithi139 ceph-mon[35320]: fsmap 2 up:standby 2024-09-13T16:07:36.363 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:36 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T16:07:36.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:36.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:36.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:36.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:36.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:36.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:36.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:36 smithi086 ceph-mon[30379]: Deploying daemon mds.j on smithi086 2024-09-13T16:07:36.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:36 smithi086 ceph-mon[30379]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:36.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:36 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.139:6832/1329253837,v1:172.21.15.139:6833/1329253837] up:boot 2024-09-13T16:07:36.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:36 smithi086 ceph-mon[30379]: fsmap 2 up:standby 2024-09-13T16:07:36.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T16:07:36.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.442+0000 7fe25dc00640 1 -- 172.21.15.86:0/2194966844 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe25810d840 con 0x7fe258102fa0 2024-09-13T16:07:36.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.442+0000 7fe255600640 1 -- 172.21.15.86:0/2194966844 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2017 (secure 0 0 0) 0x7fe240099a30 con 0x7fe258102fa0 2024-09-13T16:07:36.443 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:07:36.443 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T16:07:36.443 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 3 2024-09-13T16:07:36.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.445+0000 7fe25dc00640 1 -- 172.21.15.86:0/2194966844 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe23c0a1090 msgr2=0x7fe23c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:36.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.445+0000 7fe25dc00640 1 --2- 172.21.15.86:0/2194966844 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe23c0a1090 0x7fe23c0a3550 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe258102e00 tx=0x7fe248009500 comp rx=0 tx=0).stop 2024-09-13T16:07:36.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.445+0000 7fe25dc00640 1 -- 172.21.15.86:0/2194966844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe258102fa0 msgr2=0x7fe258198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:36.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.445+0000 7fe25dc00640 1 --2- 172.21.15.86:0/2194966844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe258102fa0 0x7fe258198380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe24000e9f0 tx=0x7fe24000eeb0 comp rx=0 tx=0).stop 2024-09-13T16:07:36.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.445+0000 7fe25dc00640 1 -- 172.21.15.86:0/2194966844 shutdown_connections 2024-09-13T16:07:36.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.445+0000 7fe25dc00640 1 --2- 172.21.15.86:0/2194966844 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe23c0a1090 0x7fe23c0a3550 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:36.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.445+0000 7fe25dc00640 1 --2- 172.21.15.86:0/2194966844 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe258103960 0x7fe25819f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:36.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.445+0000 7fe25dc00640 1 --2- 172.21.15.86:0/2194966844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe258102fa0 0x7fe258198380 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:36.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.445+0000 7fe25dc00640 1 --2- 172.21.15.86:0/2194966844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe258101db0 0x7fe258197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:36.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.445+0000 7fe25dc00640 1 -- 172.21.15.86:0/2194966844 >> 172.21.15.86:0/2194966844 conn(0x7fe2580fd530 msgr2=0x7fe2581063e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:36.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.445+0000 7fe25dc00640 1 -- 172.21.15.86:0/2194966844 shutdown_connections 2024-09-13T16:07:36.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:36.445+0000 7fe25dc00640 1 -- 172.21.15.86:0/2194966844 wait complete. 2024-09-13T16:07:36.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:36 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:36.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:36 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:36.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:36 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:36.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:36 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:36.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:36 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:36.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:36 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:36.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:36 smithi194 ceph-mon[35694]: Deploying daemon mds.j on smithi086 2024-09-13T16:07:36.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:36 smithi194 ceph-mon[35694]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:36.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:36 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.139:6832/1329253837,v1:172.21.15.139:6833/1329253837] up:boot 2024-09-13T16:07:36.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:36 smithi194 ceph-mon[35694]: fsmap 2 up:standby 2024-09-13T16:07:36.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:36 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T16:07:37.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:37 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2194966844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:37.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:37 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2194966844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:37.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:37 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2194966844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:37.946 INFO:journalctl@ceph.mds.j.smithi086.stdout:Sep 13 16:07:37 smithi086 systemd[1]: Starting Ceph mds.j for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:07:38.230 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:38 smithi086 ceph-mon[30379]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:38.230 INFO:journalctl@ceph.mds.j.smithi086.stdout:Sep 13 16:07:37 smithi086 podman[69605]: 2024-09-13 16:07:37.848801877 +0000 UTC m=+0.027470160 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:07:38.230 INFO:journalctl@ceph.mds.j.smithi086.stdout:Sep 13 16:07:37 smithi086 podman[69605]: 2024-09-13 16:07:37.976555313 +0000 UTC m=+0.155223617 container create 5d04c9426c8b6954eefba84d2581898c88518b7fa4332be985b2e08f358c5984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-j, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-13T16:07:38.230 INFO:journalctl@ceph.mds.j.smithi086.stdout:Sep 13 16:07:38 smithi086 podman[69605]: 2024-09-13 16:07:38.229542406 +0000 UTC m=+0.408210672 container init 5d04c9426c8b6954eefba84d2581898c88518b7fa4332be985b2e08f358c5984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-j, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=) 2024-09-13T16:07:38.462 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:07:38.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:38 smithi139 ceph-mon[35320]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:38.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:38 smithi194 ceph-mon[35694]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:38.516 INFO:journalctl@ceph.mds.j.smithi086.stdout:Sep 13 16:07:38 smithi086 podman[69605]: 2024-09-13 16:07:38.235970133 +0000 UTC m=+0.414638409 container start 5d04c9426c8b6954eefba84d2581898c88518b7fa4332be985b2e08f358c5984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-13T16:07:38.517 INFO:journalctl@ceph.mds.j.smithi086.stdout:Sep 13 16:07:38 smithi086 ceph-mds[69624]: -- 172.21.15.86:0/2587388726 <== mon.0 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e39f9b2d00 con 0x55e39f986800 2024-09-13T16:07:38.517 INFO:journalctl@ceph.mds.j.smithi086.stdout:Sep 13 16:07:38 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-j[69620]: starting mds.j at 2024-09-13T16:07:38.517 INFO:journalctl@ceph.mds.j.smithi086.stdout:Sep 13 16:07:38 smithi086 bash[69605]: 5d04c9426c8b6954eefba84d2581898c88518b7fa4332be985b2e08f358c5984 2024-09-13T16:07:38.517 INFO:journalctl@ceph.mds.j.smithi086.stdout:Sep 13 16:07:38 smithi086 systemd[1]: Started Ceph mds.j for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:07:38.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.627+0000 7f1b53200640 1 -- 172.21.15.86:0/3868820727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b54100da0 msgr2=0x7f1b54101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:38.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.627+0000 7f1b53200640 1 --2- 172.21.15.86:0/3868820727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b54100da0 0x7f1b54101220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c009900 tx=0x7f1b3c02a410 comp rx=0 tx=0).stop 2024-09-13T16:07:38.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.627+0000 7f1b53200640 1 -- 172.21.15.86:0/3868820727 shutdown_connections 2024-09-13T16:07:38.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.627+0000 7f1b53200640 1 --2- 172.21.15.86:0/3868820727 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b54101760 0x7f1b54107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:38.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.627+0000 7f1b53200640 1 --2- 172.21.15.86:0/3868820727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b54100da0 0x7f1b54101220 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:38.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.627+0000 7f1b53200640 1 --2- 172.21.15.86:0/3868820727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b540ffbb0 0x7f1b540fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:38.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.627+0000 7f1b53200640 1 -- 172.21.15.86:0/3868820727 >> 172.21.15.86:0/3868820727 conn(0x7f1b540fb330 msgr2=0x7f1b540fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:38.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.627+0000 7f1b53200640 1 -- 172.21.15.86:0/3868820727 shutdown_connections 2024-09-13T16:07:38.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.627+0000 7f1b53200640 1 -- 172.21.15.86:0/3868820727 wait complete. 2024-09-13T16:07:38.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.628+0000 7f1b53200640 1 Processor -- start 2024-09-13T16:07:38.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.628+0000 7f1b53200640 1 -- start start 2024-09-13T16:07:38.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.629+0000 7f1b53200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b540ffbb0 0x7f1b54197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:38.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.629+0000 7f1b53200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b54100da0 0x7f1b54198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:38.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.629+0000 7f1b53200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b54101760 0x7f1b5419f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:38.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.629+0000 7f1b53200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5419f9c0 con 0x7f1b54100da0 2024-09-13T16:07:38.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.629+0000 7f1b53200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5419fb30 con 0x7f1b540ffbb0 2024-09-13T16:07:38.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.629+0000 7f1b53200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5419fcf0 con 0x7f1b54101760 2024-09-13T16:07:38.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.629+0000 7f1b4be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b54100da0 0x7f1b54198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:38.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.629+0000 7f1b4be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b54100da0 0x7f1b54198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37536/0 (socket says 172.21.15.86:37536) 2024-09-13T16:07:38.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.629+0000 7f1b4be00640 1 -- 172.21.15.86:0/4020935115 learned_addr learned my addr 172.21.15.86:0/4020935115 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:07:38.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.629+0000 7f1b51e00640 1 --2- 172.21.15.86:0/4020935115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b540ffbb0 0x7f1b54197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:38.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.629+0000 7f1b52800640 1 --2- 172.21.15.86:0/4020935115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b54101760 0x7f1b5419f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:38.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.629+0000 7f1b4be00640 1 -- 172.21.15.86:0/4020935115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b54101760 msgr2=0x7f1b5419f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:38.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.629+0000 7f1b4be00640 1 --2- 172.21.15.86:0/4020935115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b54101760 0x7f1b5419f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:38.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.629+0000 7f1b4be00640 1 -- 172.21.15.86:0/4020935115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b540ffbb0 msgr2=0x7f1b54197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:38.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.629+0000 7f1b4be00640 1 --2- 172.21.15.86:0/4020935115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b540ffbb0 0x7f1b54197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:38.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.629+0000 7f1b4be00640 1 -- 172.21.15.86:0/4020935115 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c009560 con 0x7f1b54100da0 2024-09-13T16:07:38.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.630+0000 7f1b4be00640 1 --2- 172.21.15.86:0/4020935115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b54100da0 0x7f1b54198410 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c031510 tx=0x7f1b3c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:38.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.630+0000 7f1b4aa00640 1 -- 172.21.15.86:0/4020935115 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c004b50 con 0x7f1b54100da0 2024-09-13T16:07:38.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.630+0000 7f1b53200640 1 -- 172.21.15.86:0/4020935115 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b5419ff70 con 0x7f1b54100da0 2024-09-13T16:07:38.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.630+0000 7f1b4aa00640 1 -- 172.21.15.86:0/4020935115 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1b3c004cb0 con 0x7f1b54100da0 2024-09-13T16:07:38.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.630+0000 7f1b4aa00640 1 -- 172.21.15.86:0/4020935115 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c031ba0 con 0x7f1b54100da0 2024-09-13T16:07:38.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.630+0000 7f1b53200640 1 -- 172.21.15.86:0/4020935115 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b541a0390 con 0x7f1b54100da0 2024-09-13T16:07:38.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.631+0000 7f1b53200640 1 -- 172.21.15.86:0/4020935115 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5410b640 con 0x7f1b54100da0 2024-09-13T16:07:38.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.633+0000 7f1b4aa00640 1 -- 172.21.15.86:0/4020935115 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1b3c031d00 con 0x7f1b54100da0 2024-09-13T16:07:38.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.634+0000 7f1b4aa00640 1 --2- 172.21.15.86:0/4020935115 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1b380a1090 0x7f1b380a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:38.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.634+0000 7f1b4aa00640 1 -- 172.21.15.86:0/4020935115 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1b3c0ed3c0 con 0x7f1b54100da0 2024-09-13T16:07:38.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.634+0000 7f1b51e00640 1 --2- 172.21.15.86:0/4020935115 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1b380a1090 0x7f1b380a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:38.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.635+0000 7f1b51e00640 1 --2- 172.21.15.86:0/4020935115 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1b380a1090 0x7f1b380a3550 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1b54100c00 tx=0x7f1b44005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:38.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.637+0000 7f1b4aa00640 1 -- 172.21.15.86:0/4020935115 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1b3c0b6f50 con 0x7f1b54100da0 2024-09-13T16:07:38.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.900+0000 7f1b53200640 1 -- 172.21.15.86:0/4020935115 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b5410b850 con 0x7f1b54100da0 2024-09-13T16:07:38.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.901+0000 7f1b4aa00640 1 -- 172.21.15.86:0/4020935115 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2017 (secure 0 0 0) 0x7f1b3c035800 con 0x7f1b54100da0 2024-09-13T16:07:38.902 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:07:38.902 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T16:07:38.902 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 3 2024-09-13T16:07:38.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.903+0000 7f1b53200640 1 -- 172.21.15.86:0/4020935115 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1b380a1090 msgr2=0x7f1b380a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:38.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.903+0000 7f1b53200640 1 --2- 172.21.15.86:0/4020935115 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1b380a1090 0x7f1b380a3550 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1b54100c00 tx=0x7f1b44005f90 comp rx=0 tx=0).stop 2024-09-13T16:07:38.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.903+0000 7f1b53200640 1 -- 172.21.15.86:0/4020935115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b54100da0 msgr2=0x7f1b54198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:38.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.903+0000 7f1b53200640 1 --2- 172.21.15.86:0/4020935115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b54100da0 0x7f1b54198410 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c031510 tx=0x7f1b3c0055a0 comp rx=0 tx=0).stop 2024-09-13T16:07:38.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.903+0000 7f1b53200640 1 -- 172.21.15.86:0/4020935115 shutdown_connections 2024-09-13T16:07:38.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.903+0000 7f1b53200640 1 --2- 172.21.15.86:0/4020935115 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1b380a1090 0x7f1b380a3550 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:38.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.903+0000 7f1b53200640 1 --2- 172.21.15.86:0/4020935115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b54101760 0x7f1b5419f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:38.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.903+0000 7f1b53200640 1 --2- 172.21.15.86:0/4020935115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b54100da0 0x7f1b54198410 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:38.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.903+0000 7f1b53200640 1 --2- 172.21.15.86:0/4020935115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b540ffbb0 0x7f1b54197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:38.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.903+0000 7f1b53200640 1 -- 172.21.15.86:0/4020935115 >> 172.21.15.86:0/4020935115 conn(0x7f1b540fb330 msgr2=0x7f1b541065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:38.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.903+0000 7f1b53200640 1 -- 172.21.15.86:0/4020935115 shutdown_connections 2024-09-13T16:07:38.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:38.903+0000 7f1b53200640 1 -- 172.21.15.86:0/4020935115 wait complete. 2024-09-13T16:07:39.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:39 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:39.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:39 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:39.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:39 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:39.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:39 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:39.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:39 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:39.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:39 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:39.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:39 smithi086 ceph-mon[30379]: Deploying daemon mds.d on smithi086 2024-09-13T16:07:39.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:39 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/4020935115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:39.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:39 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.86:6834/3476661600,v1:172.21.15.86:6835/3476661600] up:boot 2024-09-13T16:07:39.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:39 smithi086 ceph-mon[30379]: fsmap 3 up:standby 2024-09-13T16:07:39.616 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:39 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T16:07:39.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:39 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:39.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:39 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:39.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:39 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:39.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:39 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:39.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:39 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:39.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:39 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:39.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:39 smithi139 ceph-mon[35320]: Deploying daemon mds.d on smithi086 2024-09-13T16:07:39.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:39 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/4020935115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:39.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:39 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.86:6834/3476661600,v1:172.21.15.86:6835/3476661600] up:boot 2024-09-13T16:07:39.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:39 smithi139 ceph-mon[35320]: fsmap 3 up:standby 2024-09-13T16:07:39.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:39 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T16:07:39.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:39 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:39.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:39 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:39.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:39 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:39.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:39 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:39.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:39 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:39.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:39 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:39.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:39 smithi194 ceph-mon[35694]: Deploying daemon mds.d on smithi086 2024-09-13T16:07:39.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:39 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/4020935115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:39.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:39 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.86:6834/3476661600,v1:172.21.15.86:6835/3476661600] up:boot 2024-09-13T16:07:39.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:39 smithi194 ceph-mon[35694]: fsmap 3 up:standby 2024-09-13T16:07:39.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:39 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T16:07:40.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:40 smithi086 ceph-mon[30379]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:40.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:40 smithi139 ceph-mon[35320]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:40.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:40 smithi194 ceph-mon[35694]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:40.922 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:07:41.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.090+0000 7f853b200640 1 -- 172.21.15.86:0/857698082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f853c100da0 msgr2=0x7f853c101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:41.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.090+0000 7f853b200640 1 --2- 172.21.15.86:0/857698082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f853c100da0 0x7f853c101220 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8528009900 tx=0x7f852802a410 comp rx=0 tx=0).stop 2024-09-13T16:07:41.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.090+0000 7f853b200640 1 -- 172.21.15.86:0/857698082 shutdown_connections 2024-09-13T16:07:41.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.090+0000 7f853b200640 1 --2- 172.21.15.86:0/857698082 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f853c101760 0x7f853c107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.090+0000 7f853b200640 1 --2- 172.21.15.86:0/857698082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f853c100da0 0x7f853c101220 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.090+0000 7f853b200640 1 --2- 172.21.15.86:0/857698082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f853c0ffbb0 0x7f853c0fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.090+0000 7f853b200640 1 -- 172.21.15.86:0/857698082 >> 172.21.15.86:0/857698082 conn(0x7f853c0fb330 msgr2=0x7f853c0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:41.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.090+0000 7f853b200640 1 -- 172.21.15.86:0/857698082 shutdown_connections 2024-09-13T16:07:41.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.090+0000 7f853b200640 1 -- 172.21.15.86:0/857698082 wait complete. 2024-09-13T16:07:41.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.091+0000 7f853b200640 1 Processor -- start 2024-09-13T16:07:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.091+0000 7f853b200640 1 -- start start 2024-09-13T16:07:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.091+0000 7f853b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f853c0ffbb0 0x7f853c195c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.091+0000 7f853b200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f853c100da0 0x7f853c1961d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.091+0000 7f853b200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f853c101760 0x7f853c19d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.091+0000 7f853b200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c19d7a0 con 0x7f853c100da0 2024-09-13T16:07:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.091+0000 7f853b200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c19d910 con 0x7f853c101760 2024-09-13T16:07:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.092+0000 7f853b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c19dad0 con 0x7f853c0ffbb0 2024-09-13T16:07:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.092+0000 7f8539400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f853c100da0 0x7f853c1961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.092+0000 7f8539e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f853c0ffbb0 0x7f853c195c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.092+0000 7f8539e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f853c0ffbb0 0x7f853c195c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:52530/0 (socket says 172.21.15.86:52530) 2024-09-13T16:07:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.092+0000 7f8539400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f853c100da0 0x7f853c1961d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37562/0 (socket says 172.21.15.86:37562) 2024-09-13T16:07:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.092+0000 7f8539e00640 1 -- 172.21.15.86:0/133230097 learned_addr learned my addr 172.21.15.86:0/133230097 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:07:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.092+0000 7f853a800640 1 --2- 172.21.15.86:0/133230097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f853c101760 0x7f853c19d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.092+0000 7f8539e00640 1 -- 172.21.15.86:0/133230097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f853c101760 msgr2=0x7f853c19d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.092+0000 7f8539e00640 1 --2- 172.21.15.86:0/133230097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f853c101760 0x7f853c19d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.092+0000 7f8539e00640 1 -- 172.21.15.86:0/133230097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f853c100da0 msgr2=0x7f853c1961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.092+0000 7f8539e00640 1 --2- 172.21.15.86:0/133230097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f853c100da0 0x7f853c1961d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.092+0000 7f8539e00640 1 -- 172.21.15.86:0/133230097 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8528009560 con 0x7f853c0ffbb0 2024-09-13T16:07:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.093+0000 7f8539e00640 1 --2- 172.21.15.86:0/133230097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f853c0ffbb0 0x7f853c195c90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f852c00e9c0 tx=0x7f852c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.093+0000 7f8532a00640 1 -- 172.21.15.86:0/133230097 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c009700 con 0x7f853c0ffbb0 2024-09-13T16:07:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.093+0000 7f853b200640 1 -- 172.21.15.86:0/133230097 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853c19ddb0 con 0x7f853c0ffbb0 2024-09-13T16:07:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.093+0000 7f8532a00640 1 -- 172.21.15.86:0/133230097 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f852c00cd80 con 0x7f853c0ffbb0 2024-09-13T16:07:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.093+0000 7f8532a00640 1 -- 172.21.15.86:0/133230097 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c010430 con 0x7f853c0ffbb0 2024-09-13T16:07:41.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.093+0000 7f853b200640 1 -- 172.21.15.86:0/133230097 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853c19e1d0 con 0x7f853c0ffbb0 2024-09-13T16:07:41.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.094+0000 7f853b200640 1 -- 172.21.15.86:0/133230097 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f853c106fe0 con 0x7f853c0ffbb0 2024-09-13T16:07:41.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.096+0000 7f8532a00640 1 -- 172.21.15.86:0/133230097 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f852c003680 con 0x7f853c0ffbb0 2024-09-13T16:07:41.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.097+0000 7f8532a00640 1 --2- 172.21.15.86:0/133230097 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f85200a1090 0x7f85200a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.098+0000 7f8532a00640 1 -- 172.21.15.86:0/133230097 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f852c014070 con 0x7f853c0ffbb0 2024-09-13T16:07:41.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.098+0000 7f8539400640 1 --2- 172.21.15.86:0/133230097 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f85200a1090 0x7f85200a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.099+0000 7f8539400640 1 --2- 172.21.15.86:0/133230097 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f85200a1090 0x7f85200a3550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8528005ab0 tx=0x7f8528005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:41.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.099+0000 7f8532a00640 1 -- 172.21.15.86:0/133230097 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f852c096610 con 0x7f853c0ffbb0 2024-09-13T16:07:41.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.328+0000 7f853b200640 1 -- 172.21.15.86:0/133230097 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f853c10b640 con 0x7f853c0ffbb0 2024-09-13T16:07:41.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.329+0000 7f8532a00640 1 -- 172.21.15.86:0/133230097 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2774 (secure 0 0 0) 0x7f852c099c30 con 0x7f853c0ffbb0 2024-09-13T16:07:41.331 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:07:41.331 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T16:07:41.331 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 4 2024-09-13T16:07:41.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.331+0000 7f853b200640 1 -- 172.21.15.86:0/133230097 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f85200a1090 msgr2=0x7f85200a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:41.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.331+0000 7f853b200640 1 --2- 172.21.15.86:0/133230097 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f85200a1090 0x7f85200a3550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8528005ab0 tx=0x7f8528005a20 comp rx=0 tx=0).stop 2024-09-13T16:07:41.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.331+0000 7f853b200640 1 -- 172.21.15.86:0/133230097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f853c0ffbb0 msgr2=0x7f853c195c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:41.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.331+0000 7f853b200640 1 --2- 172.21.15.86:0/133230097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f853c0ffbb0 0x7f853c195c90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f852c00e9c0 tx=0x7f852c00ee80 comp rx=0 tx=0).stop 2024-09-13T16:07:41.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.331+0000 7f853b200640 1 -- 172.21.15.86:0/133230097 shutdown_connections 2024-09-13T16:07:41.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.331+0000 7f853b200640 1 --2- 172.21.15.86:0/133230097 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f85200a1090 0x7f85200a3550 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.331+0000 7f853b200640 1 --2- 172.21.15.86:0/133230097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f853c101760 0x7f853c19d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.331+0000 7f853b200640 1 --2- 172.21.15.86:0/133230097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f853c100da0 0x7f853c1961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.331+0000 7f853b200640 1 --2- 172.21.15.86:0/133230097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f853c0ffbb0 0x7f853c195c90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.331+0000 7f853b200640 1 -- 172.21.15.86:0/133230097 >> 172.21.15.86:0/133230097 conn(0x7f853c0fb330 msgr2=0x7f853c1041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:41.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.331+0000 7f853b200640 1 -- 172.21.15.86:0/133230097 shutdown_connections 2024-09-13T16:07:41.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:41.331+0000 7f853b200640 1 -- 172.21.15.86:0/133230097 wait complete. 2024-09-13T16:07:41.585 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:41 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/133230097' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:41.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:41 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/133230097' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:41.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:41 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/133230097' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:41.865 INFO:journalctl@ceph.mds.d.smithi086.stdout:Sep 13 16:07:41 smithi086 systemd[1]: Started Ceph mds.d for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:07:42.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:42 smithi139 ceph-mon[35320]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:42.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:42 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:42.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:42 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:42.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:42 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:42.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:42 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:42.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:42 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:42.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:42 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:42.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:42 smithi194 ceph-mon[35694]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:42.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:42 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:42.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:42 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:42.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:42 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:42.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:42 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:42.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:42 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:42.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:42 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:42 smithi086 ceph-mon[30379]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:42.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:43.351 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:07:43.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.516+0000 7f4549e00640 1 -- 172.21.15.86:0/3992126657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4544101950 msgr2=0x7f45441081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:43.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.516+0000 7f4549e00640 1 --2- 172.21.15.86:0/3992126657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4544101950 0x7f45441081e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f453c009ca0 tx=0x7f453c02a8c0 comp rx=0 tx=0).stop 2024-09-13T16:07:43.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.516+0000 7f4549e00640 1 -- 172.21.15.86:0/3992126657 shutdown_connections 2024-09-13T16:07:43.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.516+0000 7f4549e00640 1 --2- 172.21.15.86:0/3992126657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4544101950 0x7f45441081e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:43.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.516+0000 7f4549e00640 1 --2- 172.21.15.86:0/3992126657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4544100f90 0x7f4544101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:43.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.516+0000 7f4549e00640 1 --2- 172.21.15.86:0/3992126657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45440ffda0 0x7f45441001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:43.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.516+0000 7f4549e00640 1 -- 172.21.15.86:0/3992126657 >> 172.21.15.86:0/3992126657 conn(0x7f45440fb520 msgr2=0x7f45440fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:43.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.516+0000 7f4549e00640 1 -- 172.21.15.86:0/3992126657 shutdown_connections 2024-09-13T16:07:43.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.516+0000 7f4549e00640 1 -- 172.21.15.86:0/3992126657 wait complete. 2024-09-13T16:07:43.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.517+0000 7f4549e00640 1 Processor -- start 2024-09-13T16:07:43.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.517+0000 7f4549e00640 1 -- start start 2024-09-13T16:07:43.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.517+0000 7f4549e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45440ffda0 0x7f4544195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:43.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.517+0000 7f4549e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4544100f90 0x7f45441963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:43.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.517+0000 7f4549e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4544101950 0x7f454419d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:43.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.517+0000 7f4549e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454419d950 con 0x7f4544100f90 2024-09-13T16:07:43.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.517+0000 7f4549e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454419dac0 con 0x7f45440ffda0 2024-09-13T16:07:43.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.517+0000 7f4549e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454419dc80 con 0x7f4544101950 2024-09-13T16:07:43.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.517+0000 7f4542a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45440ffda0 0x7f4544195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:43.521 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.517+0000 7f453be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4544100f90 0x7f45441963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:43.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.517+0000 7f4542a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45440ffda0 0x7f4544195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:40430/0 (socket says 172.21.15.86:40430) 2024-09-13T16:07:43.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.517+0000 7f4542a00640 1 -- 172.21.15.86:0/3693667116 learned_addr learned my addr 172.21.15.86:0/3693667116 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:07:43.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.518+0000 7f4543400640 1 --2- 172.21.15.86:0/3693667116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4544101950 0x7f454419d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:43.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.518+0000 7f4542a00640 1 -- 172.21.15.86:0/3693667116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4544101950 msgr2=0x7f454419d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:43.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.518+0000 7f4542a00640 1 --2- 172.21.15.86:0/3693667116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4544101950 0x7f454419d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:43.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.518+0000 7f4542a00640 1 -- 172.21.15.86:0/3693667116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4544100f90 msgr2=0x7f45441963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:43.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.518+0000 7f4542a00640 1 --2- 172.21.15.86:0/3693667116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4544100f90 0x7f45441963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:43.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.518+0000 7f4542a00640 1 -- 172.21.15.86:0/3693667116 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c009900 con 0x7f45440ffda0 2024-09-13T16:07:43.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.518+0000 7f453be00640 1 --2- 172.21.15.86:0/3693667116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4544100f90 0x7f45441963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:07:43.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.518+0000 7f4542a00640 1 --2- 172.21.15.86:0/3693667116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45440ffda0 0x7f4544195e60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f453400e9c0 tx=0x7f453400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:43.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.518+0000 7f4548a00640 1 -- 172.21.15.86:0/3693667116 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4534009700 con 0x7f45440ffda0 2024-09-13T16:07:43.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.518+0000 7f4548a00640 1 -- 172.21.15.86:0/3693667116 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f453400cd80 con 0x7f45440ffda0 2024-09-13T16:07:43.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.518+0000 7f4548a00640 1 -- 172.21.15.86:0/3693667116 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4534010430 con 0x7f45440ffda0 2024-09-13T16:07:43.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.518+0000 7f4549e00640 1 -- 172.21.15.86:0/3693667116 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454419df60 con 0x7f45440ffda0 2024-09-13T16:07:43.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.519+0000 7f4549e00640 1 -- 172.21.15.86:0/3693667116 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454419e330 con 0x7f45440ffda0 2024-09-13T16:07:43.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.519+0000 7f4549e00640 1 -- 172.21.15.86:0/3693667116 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45441001a0 con 0x7f45440ffda0 2024-09-13T16:07:43.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.521+0000 7f4548a00640 1 -- 172.21.15.86:0/3693667116 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4534003680 con 0x7f45440ffda0 2024-09-13T16:07:43.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.522+0000 7f4548a00640 1 --2- 172.21.15.86:0/3693667116 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f45280a1090 0x7f45280a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:43.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.523+0000 7f4548a00640 1 -- 172.21.15.86:0/3693667116 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4534014070 con 0x7f45440ffda0 2024-09-13T16:07:43.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.523+0000 7f453be00640 1 --2- 172.21.15.86:0/3693667116 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f45280a1090 0x7f45280a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:43.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.523+0000 7f453be00640 1 --2- 172.21.15.86:0/3693667116 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f45280a1090 0x7f45280a3550 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4544197370 tx=0x7f452c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:43.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.526+0000 7f4548a00640 1 -- 172.21.15.86:0/3693667116 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4534096590 con 0x7f45440ffda0 2024-09-13T16:07:43.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.730+0000 7f4549e00640 1 -- 172.21.15.86:0/3693667116 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4544107130 con 0x7f45440ffda0 2024-09-13T16:07:43.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.730+0000 7f4548a00640 1 -- 172.21.15.86:0/3693667116 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3528 (secure 0 0 0) 0x7f4534094e60 con 0x7f45440ffda0 2024-09-13T16:07:43.732 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:07:43.732 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[]} 2024-09-13T16:07:43.733 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 5 2024-09-13T16:07:43.733 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:43 smithi139 ceph-mon[35320]: Deploying daemon mds.e on smithi139 2024-09-13T16:07:43.733 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:43 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.86:6836/396399488,v1:172.21.15.86:6837/396399488] up:boot 2024-09-13T16:07:43.733 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:43 smithi139 ceph-mon[35320]: fsmap 4 up:standby 2024-09-13T16:07:43.733 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:43 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T16:07:43.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.732+0000 7f4549e00640 1 -- 172.21.15.86:0/3693667116 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f45280a1090 msgr2=0x7f45280a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:43.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.733+0000 7f4549e00640 1 --2- 172.21.15.86:0/3693667116 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f45280a1090 0x7f45280a3550 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4544197370 tx=0x7f452c00b410 comp rx=0 tx=0).stop 2024-09-13T16:07:43.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.733+0000 7f4549e00640 1 -- 172.21.15.86:0/3693667116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45440ffda0 msgr2=0x7f4544195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:43.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.733+0000 7f4549e00640 1 --2- 172.21.15.86:0/3693667116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45440ffda0 0x7f4544195e60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f453400e9c0 tx=0x7f453400ee80 comp rx=0 tx=0).stop 2024-09-13T16:07:43.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.733+0000 7f4549e00640 1 -- 172.21.15.86:0/3693667116 shutdown_connections 2024-09-13T16:07:43.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.733+0000 7f4549e00640 1 --2- 172.21.15.86:0/3693667116 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f45280a1090 0x7f45280a3550 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:43.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.733+0000 7f4549e00640 1 --2- 172.21.15.86:0/3693667116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4544101950 0x7f454419d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:43.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.733+0000 7f4549e00640 1 --2- 172.21.15.86:0/3693667116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4544100f90 0x7f45441963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:43.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.733+0000 7f4549e00640 1 --2- 172.21.15.86:0/3693667116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45440ffda0 0x7f4544195e60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:43.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.733+0000 7f4549e00640 1 -- 172.21.15.86:0/3693667116 >> 172.21.15.86:0/3693667116 conn(0x7f45440fb520 msgr2=0x7f4544104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:43.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.733+0000 7f4549e00640 1 -- 172.21.15.86:0/3693667116 shutdown_connections 2024-09-13T16:07:43.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:43.733+0000 7f4549e00640 1 -- 172.21.15.86:0/3693667116 wait complete. 2024-09-13T16:07:43.749 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:43 smithi086 ceph-mon[30379]: Deploying daemon mds.e on smithi139 2024-09-13T16:07:43.749 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:43 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.86:6836/396399488,v1:172.21.15.86:6837/396399488] up:boot 2024-09-13T16:07:43.749 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:43 smithi086 ceph-mon[30379]: fsmap 4 up:standby 2024-09-13T16:07:43.749 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:43 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T16:07:43.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:43 smithi194 ceph-mon[35694]: Deploying daemon mds.e on smithi139 2024-09-13T16:07:43.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:43 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.86:6836/396399488,v1:172.21.15.86:6837/396399488] up:boot 2024-09-13T16:07:43.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:43 smithi194 ceph-mon[35694]: fsmap 4 up:standby 2024-09-13T16:07:43.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:43 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T16:07:43.998 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 13 16:07:43 smithi139 podman[64003]: 2024-09-13 16:07:43.95380951 +0000 UTC m=+0.122209672 container create 3be8561daa2eb90ff990739303aa7a51dabaf014f1f9557057d9252e80b21092 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-13T16:07:44.440 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 13 16:07:44 smithi139 podman[64003]: 2024-09-13 16:07:44.20625689 +0000 UTC m=+0.374657015 container init 3be8561daa2eb90ff990739303aa7a51dabaf014f1f9557057d9252e80b21092 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-e, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-13T16:07:44.441 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 13 16:07:44 smithi139 podman[64003]: 2024-09-13 16:07:44.209096248 +0000 UTC m=+0.377496371 container start 3be8561daa2eb90ff990739303aa7a51dabaf014f1f9557057d9252e80b21092 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T16:07:44.441 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 13 16:07:44 smithi139 ceph-mds[64022]: -- 172.21.15.139:0/1649390827 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5624b3b7ed00 con 0x5624b3b53400 2024-09-13T16:07:44.441 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 13 16:07:44 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-e[64018]: starting mds.e at 2024-09-13T16:07:44.441 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 13 16:07:44 smithi139 bash[64003]: 3be8561daa2eb90ff990739303aa7a51dabaf014f1f9557057d9252e80b21092 2024-09-13T16:07:44.441 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 13 16:07:44 smithi139 systemd[1]: Started Ceph mds.e for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:07:44.740 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:44 smithi194 ceph-mon[35694]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:44.740 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:44 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3693667116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:44.740 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:44 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:44.741 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:44 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:44.741 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:44 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:44.741 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:44 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:44.741 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:44 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:44.741 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:44 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:44.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:44 smithi139 ceph-mon[35320]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:44.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:44 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3693667116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:44.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:44 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:44.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:44 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:44.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:44 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:44.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:44 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:44.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:44 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:44.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:44 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:44.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:44 smithi086 ceph-mon[30379]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:44.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:44 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3693667116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:44.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:44 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:44.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:44 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:44.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:44 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:44.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:44 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:44.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:44 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:44.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:44 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:45.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:45 smithi139 ceph-mon[35320]: Deploying daemon mds.f on smithi194 2024-09-13T16:07:45.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:45 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.139:6834/1036892520,v1:172.21.15.139:6835/1036892520] up:boot 2024-09-13T16:07:45.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:45 smithi139 ceph-mon[35320]: fsmap 5 up:standby 2024-09-13T16:07:45.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:45 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T16:07:45.752 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:07:45.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:45 smithi194 ceph-mon[35694]: Deploying daemon mds.f on smithi194 2024-09-13T16:07:45.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:45 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.139:6834/1036892520,v1:172.21.15.139:6835/1036892520] up:boot 2024-09-13T16:07:45.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:45 smithi194 ceph-mon[35694]: fsmap 5 up:standby 2024-09-13T16:07:45.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:45 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T16:07:45.774 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:45 smithi086 ceph-mon[30379]: Deploying daemon mds.f on smithi194 2024-09-13T16:07:45.774 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:45 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.139:6834/1036892520,v1:172.21.15.139:6835/1036892520] up:boot 2024-09-13T16:07:45.774 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:45 smithi086 ceph-mon[30379]: fsmap 5 up:standby 2024-09-13T16:07:45.775 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:45 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T16:07:45.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.919+0000 7f638fe00640 1 -- 172.21.15.86:0/4285518940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63900ffbb0 msgr2=0x7f63900fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:45.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.919+0000 7f638fe00640 1 --2- 172.21.15.86:0/4285518940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63900ffbb0 0x7f63900fffb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6380009900 tx=0x7f638002a410 comp rx=0 tx=0).stop 2024-09-13T16:07:45.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.919+0000 7f638fe00640 1 -- 172.21.15.86:0/4285518940 shutdown_connections 2024-09-13T16:07:45.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.919+0000 7f638fe00640 1 --2- 172.21.15.86:0/4285518940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6390101760 0x7f6390107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:45.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.919+0000 7f638fe00640 1 --2- 172.21.15.86:0/4285518940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6390100da0 0x7f6390101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:45.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.919+0000 7f638fe00640 1 --2- 172.21.15.86:0/4285518940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63900ffbb0 0x7f63900fffb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:45.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.919+0000 7f638fe00640 1 -- 172.21.15.86:0/4285518940 >> 172.21.15.86:0/4285518940 conn(0x7f63900fb330 msgr2=0x7f63900fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:45.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.920+0000 7f638fe00640 1 -- 172.21.15.86:0/4285518940 shutdown_connections 2024-09-13T16:07:45.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.920+0000 7f638fe00640 1 -- 172.21.15.86:0/4285518940 wait complete. 2024-09-13T16:07:45.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.920+0000 7f638fe00640 1 Processor -- start 2024-09-13T16:07:45.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.921+0000 7f638fe00640 1 -- start start 2024-09-13T16:07:45.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.921+0000 7f638fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63900ffbb0 0x7f6390197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:45.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.921+0000 7f638fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6390100da0 0x7f63901983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:45.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.921+0000 7f638fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6390101760 0x7f639019f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:45.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.921+0000 7f638fe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639019f980 con 0x7f63900ffbb0 2024-09-13T16:07:45.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.921+0000 7f638fe00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639019faf0 con 0x7f6390101760 2024-09-13T16:07:45.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.921+0000 7f638fe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639019fcb0 con 0x7f6390100da0 2024-09-13T16:07:45.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.921+0000 7f638ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63900ffbb0 0x7f6390197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:45.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.921+0000 7f638ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63900ffbb0 0x7f6390197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47792/0 (socket says 172.21.15.86:47792) 2024-09-13T16:07:45.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.921+0000 7f638ea00640 1 -- 172.21.15.86:0/734293628 learned_addr learned my addr 172.21.15.86:0/734293628 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:07:45.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.921+0000 7f638e000640 1 --2- 172.21.15.86:0/734293628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6390100da0 0x7f63901983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:45.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.921+0000 7f638f400640 1 --2- 172.21.15.86:0/734293628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6390101760 0x7f639019f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:45.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.921+0000 7f638ea00640 1 -- 172.21.15.86:0/734293628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6390100da0 msgr2=0x7f63901983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:45.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.921+0000 7f638ea00640 1 --2- 172.21.15.86:0/734293628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6390100da0 0x7f63901983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:45.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.921+0000 7f638ea00640 1 -- 172.21.15.86:0/734293628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6390101760 msgr2=0x7f639019f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:45.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.921+0000 7f638ea00640 1 --2- 172.21.15.86:0/734293628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6390101760 0x7f639019f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:45.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.922+0000 7f638ea00640 1 -- 172.21.15.86:0/734293628 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6380009560 con 0x7f63900ffbb0 2024-09-13T16:07:45.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.922+0000 7f638ea00640 1 --2- 172.21.15.86:0/734293628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63900ffbb0 0x7f6390197e90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6380031510 tx=0x7f6380004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:45.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.922+0000 7f6387400640 1 -- 172.21.15.86:0/734293628 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6380005000 con 0x7f63900ffbb0 2024-09-13T16:07:45.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.922+0000 7f6387400640 1 -- 172.21.15.86:0/734293628 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f63800046c0 con 0x7f63900ffbb0 2024-09-13T16:07:45.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.922+0000 7f638fe00640 1 -- 172.21.15.86:0/734293628 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639019ff30 con 0x7f63900ffbb0 2024-09-13T16:07:45.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.922+0000 7f6387400640 1 -- 172.21.15.86:0/734293628 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6380003a10 con 0x7f63900ffbb0 2024-09-13T16:07:45.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.922+0000 7f638fe00640 1 -- 172.21.15.86:0/734293628 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63901a0300 con 0x7f63900ffbb0 2024-09-13T16:07:45.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.923+0000 7f638fe00640 1 -- 172.21.15.86:0/734293628 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f639010b5f0 con 0x7f63900ffbb0 2024-09-13T16:07:45.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.927+0000 7f6387400640 1 -- 172.21.15.86:0/734293628 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6380004bc0 con 0x7f63900ffbb0 2024-09-13T16:07:45.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.928+0000 7f6387400640 1 --2- 172.21.15.86:0/734293628 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f63740a1090 0x7f63740a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:45.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.928+0000 7f6387400640 1 -- 172.21.15.86:0/734293628 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f63800ed610 con 0x7f63900ffbb0 2024-09-13T16:07:45.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.928+0000 7f638e000640 1 --2- 172.21.15.86:0/734293628 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f63740a1090 0x7f63740a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:45.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.929+0000 7f638e000640 1 --2- 172.21.15.86:0/734293628 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f63740a1090 0x7f63740a3550 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f63901993a0 tx=0x7f637c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:45.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:45.931+0000 7f6387400640 1 -- 172.21.15.86:0/734293628 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f63800b72f0 con 0x7f63900ffbb0 2024-09-13T16:07:46.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:46.146+0000 7f638fe00640 1 -- 172.21.15.86:0/734293628 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63901a04f0 con 0x7f63900ffbb0 2024-09-13T16:07:46.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:46.146+0000 7f6387400640 1 -- 172.21.15.86:0/734293628 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4288 (secure 0 0 0) 0x7f63800ba910 con 0x7f63900ffbb0 2024-09-13T16:07:46.149 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:07:46.149 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2024-09-13T16:07:46.150 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 6 2024-09-13T16:07:46.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:46.148+0000 7f638fe00640 1 -- 172.21.15.86:0/734293628 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f63740a1090 msgr2=0x7f63740a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:46.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:46.148+0000 7f638fe00640 1 --2- 172.21.15.86:0/734293628 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f63740a1090 0x7f63740a3550 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f63901993a0 tx=0x7f637c005f90 comp rx=0 tx=0).stop 2024-09-13T16:07:46.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:46.148+0000 7f638fe00640 1 -- 172.21.15.86:0/734293628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63900ffbb0 msgr2=0x7f6390197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:46.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:46.148+0000 7f638fe00640 1 --2- 172.21.15.86:0/734293628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63900ffbb0 0x7f6390197e90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6380031510 tx=0x7f6380004270 comp rx=0 tx=0).stop 2024-09-13T16:07:46.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:46.149+0000 7f638fe00640 1 -- 172.21.15.86:0/734293628 shutdown_connections 2024-09-13T16:07:46.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:46.149+0000 7f638fe00640 1 --2- 172.21.15.86:0/734293628 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f63740a1090 0x7f63740a3550 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:46.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:46.149+0000 7f638fe00640 1 --2- 172.21.15.86:0/734293628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6390101760 0x7f639019f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:46.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:46.149+0000 7f638fe00640 1 --2- 172.21.15.86:0/734293628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6390100da0 0x7f63901983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:46.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:46.149+0000 7f638fe00640 1 --2- 172.21.15.86:0/734293628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63900ffbb0 0x7f6390197e90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:46.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:46.149+0000 7f638fe00640 1 -- 172.21.15.86:0/734293628 >> 172.21.15.86:0/734293628 conn(0x7f63900fb330 msgr2=0x7f6390106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:46.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:46.149+0000 7f638fe00640 1 -- 172.21.15.86:0/734293628 shutdown_connections 2024-09-13T16:07:46.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:46.149+0000 7f638fe00640 1 -- 172.21.15.86:0/734293628 wait complete. 2024-09-13T16:07:46.442 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:07:46 smithi194 systemd[1]: Starting Ceph mds.f for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:07:46.704 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:46 smithi194 ceph-mon[35694]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:46.704 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:46 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/734293628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:46.705 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:07:46 smithi194 podman[66113]: 2024-09-13 16:07:46.343232335 +0000 UTC m=+0.015808835 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:07:46.705 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:07:46 smithi194 podman[66113]: 2024-09-13 16:07:46.459377452 +0000 UTC m=+0.131953941 container create 0154c4ab9fa0fdc3056dc293026098f5d657de7f8f8cea6c9666eb92cc547afd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-f, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-13T16:07:46.705 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:07:46 smithi194 podman[66113]: 2024-09-13 16:07:46.703919333 +0000 UTC m=+0.376495828 container init 0154c4ab9fa0fdc3056dc293026098f5d657de7f8f8cea6c9666eb92cc547afd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-13T16:07:46.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:46 smithi139 ceph-mon[35320]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:46.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:46 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/734293628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:46.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:46 smithi086 ceph-mon[30379]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:46.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:46 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/734293628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:47.005 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:07:46 smithi194 podman[66113]: 2024-09-13 16:07:46.706926236 +0000 UTC m=+0.379502733 container start 0154c4ab9fa0fdc3056dc293026098f5d657de7f8f8cea6c9666eb92cc547afd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-f, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:07:47.005 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:07:46 smithi194 ceph-mds[66132]: -- 172.21.15.194:0/661354116 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fd701f0d00 con 0x55fd701c4800 2024-09-13T16:07:47.005 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:07:46 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-f[66128]: starting mds.f at 2024-09-13T16:07:47.005 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:07:46 smithi194 bash[66113]: 0154c4ab9fa0fdc3056dc293026098f5d657de7f8f8cea6c9666eb92cc547afd 2024-09-13T16:07:47.005 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:07:46 smithi194 systemd[1]: Started Ceph mds.f for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:07:48.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:47 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:48.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:47 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:48.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:47 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:48.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:47 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:48.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:47 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:48.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:47 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:48.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:47 smithi086 ceph-mon[30379]: Deploying daemon mds.c on smithi194 2024-09-13T16:07:48.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:47 smithi086 ceph-mon[30379]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:48.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:47 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.194:6834/1370900762,v1:172.21.15.194:6835/1370900762] up:boot 2024-09-13T16:07:48.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:47 smithi086 ceph-mon[30379]: fsmap 6 up:standby 2024-09-13T16:07:48.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:47 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T16:07:48.168 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:07:48.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:47 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:48.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:47 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:48.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:47 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:48.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:47 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:48.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:47 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:48.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:47 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:48.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:47 smithi139 ceph-mon[35320]: Deploying daemon mds.c on smithi194 2024-09-13T16:07:48.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:47 smithi139 ceph-mon[35320]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:48.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:47 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.194:6834/1370900762,v1:172.21.15.194:6835/1370900762] up:boot 2024-09-13T16:07:48.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:47 smithi139 ceph-mon[35320]: fsmap 6 up:standby 2024-09-13T16:07:48.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:47 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T16:07:48.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:47 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:48.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:47 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:48.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:47 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:48.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:47 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:48.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:47 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:48.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:47 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:48.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:47 smithi194 ceph-mon[35694]: Deploying daemon mds.c on smithi194 2024-09-13T16:07:48.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:47 smithi194 ceph-mon[35694]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:48.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:47 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.194:6834/1370900762,v1:172.21.15.194:6835/1370900762] up:boot 2024-09-13T16:07:48.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:47 smithi194 ceph-mon[35694]: fsmap 6 up:standby 2024-09-13T16:07:48.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:47 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T16:07:48.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.329+0000 7f5936200640 1 -- 172.21.15.86:0/1508038380 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5930103190 msgr2=0x7f5930103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:48.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.329+0000 7f5936200640 1 --2- 172.21.15.86:0/1508038380 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5930103190 0x7f5930103610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f591c009900 tx=0x7f591c02a410 comp rx=0 tx=0).stop 2024-09-13T16:07:48.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.329+0000 7f5936200640 1 -- 172.21.15.86:0/1508038380 shutdown_connections 2024-09-13T16:07:48.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.329+0000 7f5936200640 1 --2- 172.21.15.86:0/1508038380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5930103b50 0x7f593010a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:48.331 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.329+0000 7f5936200640 1 --2- 172.21.15.86:0/1508038380 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5930103190 0x7f5930103610 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:48.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.329+0000 7f5936200640 1 --2- 172.21.15.86:0/1508038380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5930101fa0 0x7f59301023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:48.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.329+0000 7f5936200640 1 -- 172.21.15.86:0/1508038380 >> 172.21.15.86:0/1508038380 conn(0x7f59300fd700 msgr2=0x7f59300ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:48.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.329+0000 7f5936200640 1 -- 172.21.15.86:0/1508038380 shutdown_connections 2024-09-13T16:07:48.332 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.329+0000 7f5936200640 1 -- 172.21.15.86:0/1508038380 wait complete. 2024-09-13T16:07:48.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.330+0000 7f5936200640 1 Processor -- start 2024-09-13T16:07:48.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.330+0000 7f5936200640 1 -- start start 2024-09-13T16:07:48.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.330+0000 7f5936200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5930101fa0 0x7f5930198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:48.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.330+0000 7f5936200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5930103190 0x7f5930198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:48.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.330+0000 7f5936200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5930103b50 0x7f593019f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:48.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.330+0000 7f5936200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593019fb30 con 0x7f5930101fa0 2024-09-13T16:07:48.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.330+0000 7f5936200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593019fca0 con 0x7f5930103190 2024-09-13T16:07:48.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.330+0000 7f5936200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593019fe60 con 0x7f5930103b50 2024-09-13T16:07:48.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.330+0000 7f592f400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5930101fa0 0x7f5930198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:48.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.331+0000 7f592f400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5930101fa0 0x7f5930198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47806/0 (socket says 172.21.15.86:47806) 2024-09-13T16:07:48.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.331+0000 7f592f400640 1 -- 172.21.15.86:0/3154103774 learned_addr learned my addr 172.21.15.86:0/3154103774 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:07:48.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.331+0000 7f592ea00640 1 --2- 172.21.15.86:0/3154103774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5930103190 0x7f5930198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:48.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.331+0000 7f592fe00640 1 --2- 172.21.15.86:0/3154103774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5930103b50 0x7f593019f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:48.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.331+0000 7f592f400640 1 -- 172.21.15.86:0/3154103774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5930103b50 msgr2=0x7f593019f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:48.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.331+0000 7f592f400640 1 --2- 172.21.15.86:0/3154103774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5930103b50 0x7f593019f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:48.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.331+0000 7f592f400640 1 -- 172.21.15.86:0/3154103774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5930103190 msgr2=0x7f5930198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:48.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.331+0000 7f592f400640 1 --2- 172.21.15.86:0/3154103774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5930103190 0x7f5930198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:48.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.331+0000 7f592f400640 1 -- 172.21.15.86:0/3154103774 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c009560 con 0x7f5930101fa0 2024-09-13T16:07:48.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.331+0000 7f592f400640 1 --2- 172.21.15.86:0/3154103774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5930101fa0 0x7f5930198040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f592000e9c0 tx=0x7f592000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:48.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.331+0000 7f5927e00640 1 -- 172.21.15.86:0/3154103774 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920009700 con 0x7f5930101fa0 2024-09-13T16:07:48.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.331+0000 7f5936200640 1 -- 172.21.15.86:0/3154103774 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59301a0140 con 0x7f5930101fa0 2024-09-13T16:07:48.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.331+0000 7f5927e00640 1 -- 172.21.15.86:0/3154103774 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f592000cd80 con 0x7f5930101fa0 2024-09-13T16:07:48.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.332+0000 7f5927e00640 1 -- 172.21.15.86:0/3154103774 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920018430 con 0x7f5930101fa0 2024-09-13T16:07:48.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.332+0000 7f5936200640 1 -- 172.21.15.86:0/3154103774 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59301a0670 con 0x7f5930101fa0 2024-09-13T16:07:48.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.333+0000 7f5936200640 1 -- 172.21.15.86:0/3154103774 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5930109390 con 0x7f5930101fa0 2024-09-13T16:07:48.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.335+0000 7f5927e00640 1 -- 172.21.15.86:0/3154103774 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5920003680 con 0x7f5930101fa0 2024-09-13T16:07:48.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.337+0000 7f5927e00640 1 --2- 172.21.15.86:0/3154103774 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f59140a1090 0x7f59140a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:48.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.337+0000 7f5927e00640 1 -- 172.21.15.86:0/3154103774 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5920014070 con 0x7f5930101fa0 2024-09-13T16:07:48.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.337+0000 7f592ea00640 1 --2- 172.21.15.86:0/3154103774 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f59140a1090 0x7f59140a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:48.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.338+0000 7f592ea00640 1 --2- 172.21.15.86:0/3154103774 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f59140a1090 0x7f59140a3550 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f591c031510 tx=0x7f591c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:48.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.341+0000 7f5927e00640 1 -- 172.21.15.86:0/3154103774 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5920096430 con 0x7f5930101fa0 2024-09-13T16:07:48.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.546+0000 7f5936200640 1 -- 172.21.15.86:0/3154103774 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f593010d9a0 con 0x7f5930101fa0 2024-09-13T16:07:48.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.546+0000 7f5927e00640 1 -- 172.21.15.86:0/3154103774 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5048 (secure 0 0 0) 0x7f5920099a50 con 0x7f5930101fa0 2024-09-13T16:07:48.548 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:07:48.548 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1370900762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1370900762},{"type":"v1","addr":"172.21.15.194:6835","nonce":1370900762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2024-09-13T16:07:48.549 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 7 2024-09-13T16:07:48.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.548+0000 7f5936200640 1 -- 172.21.15.86:0/3154103774 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f59140a1090 msgr2=0x7f59140a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:48.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.548+0000 7f5936200640 1 --2- 172.21.15.86:0/3154103774 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f59140a1090 0x7f59140a3550 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f591c031510 tx=0x7f591c0058d0 comp rx=0 tx=0).stop 2024-09-13T16:07:48.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.548+0000 7f5936200640 1 -- 172.21.15.86:0/3154103774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5930101fa0 msgr2=0x7f5930198040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:48.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.548+0000 7f5936200640 1 --2- 172.21.15.86:0/3154103774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5930101fa0 0x7f5930198040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f592000e9c0 tx=0x7f592000ee80 comp rx=0 tx=0).stop 2024-09-13T16:07:48.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.548+0000 7f5936200640 1 -- 172.21.15.86:0/3154103774 shutdown_connections 2024-09-13T16:07:48.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.548+0000 7f5936200640 1 --2- 172.21.15.86:0/3154103774 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f59140a1090 0x7f59140a3550 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:48.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.548+0000 7f5936200640 1 --2- 172.21.15.86:0/3154103774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5930103b50 0x7f593019f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:48.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.548+0000 7f5936200640 1 --2- 172.21.15.86:0/3154103774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5930103190 0x7f5930198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:48.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.548+0000 7f5936200640 1 --2- 172.21.15.86:0/3154103774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5930101fa0 0x7f5930198040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:48.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.548+0000 7f5936200640 1 -- 172.21.15.86:0/3154103774 >> 172.21.15.86:0/3154103774 conn(0x7f59300fd700 msgr2=0x7f5930106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:48.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.549+0000 7f5936200640 1 -- 172.21.15.86:0/3154103774 shutdown_connections 2024-09-13T16:07:48.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:48.549+0000 7f5936200640 1 -- 172.21.15.86:0/3154103774 wait complete. 2024-09-13T16:07:49.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:48 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3154103774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:49.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:48 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3154103774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:49.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:48 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3154103774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:49.755 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 13 16:07:49 smithi194 systemd[1]: Started Ceph mds.c for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:07:50.566 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:07:50.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.730+0000 7f9945000640 1 -- 172.21.15.86:0/1093290184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99400744f0 msgr2=0x7f9940072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:50.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.730+0000 7f9945000640 1 --2- 172.21.15.86:0/1093290184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99400744f0 0x7f9940072940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9930009900 tx=0x7f993002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:07:50.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.730+0000 7f9945000640 1 -- 172.21.15.86:0/1093290184 shutdown_connections 2024-09-13T16:07:50.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.730+0000 7f9945000640 1 --2- 172.21.15.86:0/1093290184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f994010c370 0x7f994010e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:50.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.730+0000 7f9945000640 1 --2- 172.21.15.86:0/1093290184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9940072f10 0x7f9940073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:50.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.730+0000 7f9945000640 1 --2- 172.21.15.86:0/1093290184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99400744f0 0x7f9940072940 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:50.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.730+0000 7f9945000640 1 -- 172.21.15.86:0/1093290184 >> 172.21.15.86:0/1093290184 conn(0x7f99400fb520 msgr2=0x7f99400fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:50.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.730+0000 7f9945000640 1 -- 172.21.15.86:0/1093290184 shutdown_connections 2024-09-13T16:07:50.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.730+0000 7f9945000640 1 -- 172.21.15.86:0/1093290184 wait complete. 2024-09-13T16:07:50.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.731+0000 7f9945000640 1 Processor -- start 2024-09-13T16:07:50.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.731+0000 7f9945000640 1 -- start start 2024-09-13T16:07:50.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.731+0000 7f9945000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9940072f10 0x7f994019c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:50.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.731+0000 7f9945000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99400744f0 0x7f994019c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:50.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.731+0000 7f9945000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f994010c370 0x7f99401a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:50.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.731+0000 7f9945000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99401a3f90 con 0x7f994010c370 2024-09-13T16:07:50.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.731+0000 7f9945000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99401a4100 con 0x7f9940072f10 2024-09-13T16:07:50.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.731+0000 7f9945000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99401a42c0 con 0x7f99400744f0 2024-09-13T16:07:50.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.732+0000 7f993de00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9940072f10 0x7f994019c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:50.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.732+0000 7f993de00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9940072f10 0x7f994019c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:40496/0 (socket says 172.21.15.86:40496) 2024-09-13T16:07:50.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.732+0000 7f993de00640 1 -- 172.21.15.86:0/1003242514 learned_addr learned my addr 172.21.15.86:0/1003242514 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:07:50.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.732+0000 7f993e800640 1 --2- 172.21.15.86:0/1003242514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f994010c370 0x7f99401a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:50.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.732+0000 7f993d400640 1 --2- 172.21.15.86:0/1003242514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99400744f0 0x7f994019c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:50.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.732+0000 7f993de00640 1 -- 172.21.15.86:0/1003242514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99400744f0 msgr2=0x7f994019c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:50.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.732+0000 7f993de00640 1 --2- 172.21.15.86:0/1003242514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99400744f0 0x7f994019c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:50.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.732+0000 7f993de00640 1 -- 172.21.15.86:0/1003242514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f994010c370 msgr2=0x7f99401a3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:50.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.732+0000 7f993de00640 1 --2- 172.21.15.86:0/1003242514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f994010c370 0x7f99401a3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:50.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.732+0000 7f993de00640 1 -- 172.21.15.86:0/1003242514 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c009490 con 0x7f9940072f10 2024-09-13T16:07:50.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.732+0000 7f993e800640 1 --2- 172.21.15.86:0/1003242514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f994010c370 0x7f99401a3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:07:50.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.732+0000 7f993de00640 1 --2- 172.21.15.86:0/1003242514 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9940072f10 0x7f994019c4a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9930031510 tx=0x7f99300055a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:50.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.733+0000 7f9936a00640 1 -- 172.21.15.86:0/1003242514 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9930004b50 con 0x7f9940072f10 2024-09-13T16:07:50.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.733+0000 7f9945000640 1 -- 172.21.15.86:0/1003242514 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9930009560 con 0x7f9940072f10 2024-09-13T16:07:50.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.733+0000 7f9936a00640 1 -- 172.21.15.86:0/1003242514 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9930004cb0 con 0x7f9940072f10 2024-09-13T16:07:50.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.733+0000 7f9936a00640 1 -- 172.21.15.86:0/1003242514 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9930031ba0 con 0x7f9940072f10 2024-09-13T16:07:50.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.733+0000 7f9945000640 1 -- 172.21.15.86:0/1003242514 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99401a4860 con 0x7f9940072f10 2024-09-13T16:07:50.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.734+0000 7f9945000640 1 -- 172.21.15.86:0/1003242514 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9940101d10 con 0x7f9940072f10 2024-09-13T16:07:50.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.735+0000 7f9936a00640 1 -- 172.21.15.86:0/1003242514 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9930031d00 con 0x7f9940072f10 2024-09-13T16:07:50.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.737+0000 7f9936a00640 1 --2- 172.21.15.86:0/1003242514 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f99240a1090 0x7f99240a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:50.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.737+0000 7f9936a00640 1 -- 172.21.15.86:0/1003242514 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f99300ed3b0 con 0x7f9940072f10 2024-09-13T16:07:50.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.737+0000 7f993d400640 1 --2- 172.21.15.86:0/1003242514 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f99240a1090 0x7f99240a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:50.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.737+0000 7f993d400640 1 --2- 172.21.15.86:0/1003242514 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f99240a1090 0x7f99240a3550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f994019d9b0 tx=0x7f992c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:50.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.741+0000 7f9936a00640 1 -- 172.21.15.86:0/1003242514 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f99300b6ff0 con 0x7f9940072f10 2024-09-13T16:07:50.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:50 smithi139 ceph-mon[35320]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:50.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:50 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:50.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:50 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:50.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:50 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:50.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:50 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:50.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:50 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:50.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:50 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:50.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:50 smithi139 ceph-mon[35320]: Deploying daemon mds.h on smithi139 2024-09-13T16:07:50.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:50 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.194:6836/2460451799,v1:172.21.15.194:6837/2460451799] up:boot 2024-09-13T16:07:50.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:50 smithi139 ceph-mon[35320]: fsmap 7 up:standby 2024-09-13T16:07:50.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:50 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T16:07:50.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:50 smithi194 ceph-mon[35694]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:50.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:50 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:50.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:50 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:50.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:50 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:50.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:50 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:50.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:50 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:50.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:50 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:50.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:50 smithi194 ceph-mon[35694]: Deploying daemon mds.h on smithi139 2024-09-13T16:07:50.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:50 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.194:6836/2460451799,v1:172.21.15.194:6837/2460451799] up:boot 2024-09-13T16:07:50.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:50 smithi194 ceph-mon[35694]: fsmap 7 up:standby 2024-09-13T16:07:50.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:50 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T16:07:50.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:50 smithi086 ceph-mon[30379]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:50.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:50 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:50.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:50 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:50.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:50 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:50.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:50 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:50.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:50 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:50.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:50 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:50.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:50 smithi086 ceph-mon[30379]: Deploying daemon mds.h on smithi139 2024-09-13T16:07:50.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:50 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.194:6836/2460451799,v1:172.21.15.194:6837/2460451799] up:boot 2024-09-13T16:07:50.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:50 smithi086 ceph-mon[30379]: fsmap 7 up:standby 2024-09-13T16:07:50.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:50 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T16:07:50.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.947+0000 7f9945000640 1 -- 172.21.15.86:0/1003242514 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9940111e00 con 0x7f9940072f10 2024-09-13T16:07:50.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.948+0000 7f9936a00640 1 -- 172.21.15.86:0/1003242514 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5808 (secure 0 0 0) 0x7f9940111e00 con 0x7f9940072f10 2024-09-13T16:07:50.950 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:07:50.950 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1370900762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1370900762},{"type":"v1","addr":"172.21.15.194:6835","nonce":1370900762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2460451799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":2460451799},{"type":"v1","addr":"172.21.15.194:6837","nonce":2460451799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2024-09-13T16:07:50.950 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 8 2024-09-13T16:07:50.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.950+0000 7f9945000640 1 -- 172.21.15.86:0/1003242514 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f99240a1090 msgr2=0x7f99240a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:50.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.950+0000 7f9945000640 1 --2- 172.21.15.86:0/1003242514 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f99240a1090 0x7f99240a3550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f994019d9b0 tx=0x7f992c005f90 comp rx=0 tx=0).stop 2024-09-13T16:07:50.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.950+0000 7f9945000640 1 -- 172.21.15.86:0/1003242514 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9940072f10 msgr2=0x7f994019c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:50.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.950+0000 7f9945000640 1 --2- 172.21.15.86:0/1003242514 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9940072f10 0x7f994019c4a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9930031510 tx=0x7f99300055a0 comp rx=0 tx=0).stop 2024-09-13T16:07:50.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.951+0000 7f9945000640 1 -- 172.21.15.86:0/1003242514 shutdown_connections 2024-09-13T16:07:50.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.951+0000 7f9945000640 1 --2- 172.21.15.86:0/1003242514 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f99240a1090 0x7f99240a3550 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:50.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.951+0000 7f9945000640 1 --2- 172.21.15.86:0/1003242514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f994010c370 0x7f99401a3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:50.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.951+0000 7f9945000640 1 --2- 172.21.15.86:0/1003242514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99400744f0 0x7f994019c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:50.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.951+0000 7f9945000640 1 --2- 172.21.15.86:0/1003242514 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9940072f10 0x7f994019c4a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:50.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.951+0000 7f9945000640 1 -- 172.21.15.86:0/1003242514 >> 172.21.15.86:0/1003242514 conn(0x7f99400fb520 msgr2=0x7f99400fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:50.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.951+0000 7f9945000640 1 -- 172.21.15.86:0/1003242514 shutdown_connections 2024-09-13T16:07:50.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:50.951+0000 7f9945000640 1 -- 172.21.15.86:0/1003242514 wait complete. 2024-09-13T16:07:51.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:51 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1003242514' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:51.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:51 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1003242514' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:51.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:51 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1003242514' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:52.248 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 13 16:07:51 smithi139 systemd[1]: Started Ceph mds.h for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:07:52.713 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:52 smithi194 ceph-mon[35694]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:52.713 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:52.713 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:52.713 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:52.713 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:52.713 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:52.714 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:52 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:52.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:52 smithi139 ceph-mon[35320]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:52.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:52 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:52.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:52 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:52.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:52 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:52.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:52 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:52.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:52 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:52.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:52 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:52.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:52 smithi086 ceph-mon[30379]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:52.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:52.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:52.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:52.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:52.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:52.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:52 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:52.969 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:07:53.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.131+0000 7f7f19200640 1 -- 172.21.15.86:0/1840404294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f14103b50 msgr2=0x7f7f1410a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:53.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.131+0000 7f7f19200640 1 --2- 172.21.15.86:0/1840404294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f14103b50 0x7f7f1410a3e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c009ca0 tx=0x7f7f0c02a8c0 comp rx=0 tx=0).stop 2024-09-13T16:07:53.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.131+0000 7f7f19200640 1 -- 172.21.15.86:0/1840404294 shutdown_connections 2024-09-13T16:07:53.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.131+0000 7f7f19200640 1 --2- 172.21.15.86:0/1840404294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f14103b50 0x7f7f1410a3e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:53.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.131+0000 7f7f19200640 1 --2- 172.21.15.86:0/1840404294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f14103190 0x7f7f14103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:53.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.131+0000 7f7f19200640 1 --2- 172.21.15.86:0/1840404294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f14101fa0 0x7f7f141023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:53.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.131+0000 7f7f19200640 1 -- 172.21.15.86:0/1840404294 >> 172.21.15.86:0/1840404294 conn(0x7f7f140fd700 msgr2=0x7f7f140ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:53.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.131+0000 7f7f19200640 1 -- 172.21.15.86:0/1840404294 shutdown_connections 2024-09-13T16:07:53.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.131+0000 7f7f19200640 1 -- 172.21.15.86:0/1840404294 wait complete. 2024-09-13T16:07:53.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.132+0000 7f7f19200640 1 Processor -- start 2024-09-13T16:07:53.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.132+0000 7f7f19200640 1 -- start start 2024-09-13T16:07:53.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.133+0000 7f7f19200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f14101fa0 0x7f7f14197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:53.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.133+0000 7f7f19200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f14103190 0x7f7f14198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:53.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.133+0000 7f7f19200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f14103b50 0x7f7f1419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:53.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.133+0000 7f7f19200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1419fac0 con 0x7f7f14101fa0 2024-09-13T16:07:53.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.133+0000 7f7f19200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1419fc30 con 0x7f7f14103190 2024-09-13T16:07:53.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.133+0000 7f7f19200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1419fdf0 con 0x7f7f14103b50 2024-09-13T16:07:53.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.133+0000 7f7f11e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f14101fa0 0x7f7f14197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:53.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.133+0000 7f7f11e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f14101fa0 0x7f7f14197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40970/0 (socket says 172.21.15.86:40970) 2024-09-13T16:07:53.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.133+0000 7f7f11e00640 1 -- 172.21.15.86:0/2058402059 learned_addr learned my addr 172.21.15.86:0/2058402059 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:07:53.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.133+0000 7f7f12800640 1 --2- 172.21.15.86:0/2058402059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f14103b50 0x7f7f1419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:53.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.133+0000 7f7f11400640 1 --2- 172.21.15.86:0/2058402059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f14103190 0x7f7f14198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:53.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.133+0000 7f7f11e00640 1 -- 172.21.15.86:0/2058402059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f14103b50 msgr2=0x7f7f1419f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:53.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.133+0000 7f7f11e00640 1 --2- 172.21.15.86:0/2058402059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f14103b50 0x7f7f1419f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:53.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.133+0000 7f7f11e00640 1 -- 172.21.15.86:0/2058402059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f14103190 msgr2=0x7f7f14198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:53.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.133+0000 7f7f11e00640 1 --2- 172.21.15.86:0/2058402059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f14103190 0x7f7f14198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:53.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.133+0000 7f7f11e00640 1 -- 172.21.15.86:0/2058402059 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c009900 con 0x7f7f14101fa0 2024-09-13T16:07:53.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.133+0000 7f7f12800640 1 --2- 172.21.15.86:0/2058402059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f14103b50 0x7f7f1419f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:07:53.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.133+0000 7f7f11e00640 1 --2- 172.21.15.86:0/2058402059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f14101fa0 0x7f7f14197fd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400e9c0 tx=0x7f7f0400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:53.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.134+0000 7f7f0aa00640 1 -- 172.21.15.86:0/2058402059 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f040096e0 con 0x7f7f14101fa0 2024-09-13T16:07:53.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.134+0000 7f7f0aa00640 1 -- 172.21.15.86:0/2058402059 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7f0400cd80 con 0x7f7f14101fa0 2024-09-13T16:07:53.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.134+0000 7f7f0aa00640 1 -- 172.21.15.86:0/2058402059 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04010430 con 0x7f7f14101fa0 2024-09-13T16:07:53.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.134+0000 7f7f19200640 1 -- 172.21.15.86:0/2058402059 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f141a00d0 con 0x7f7f14101fa0 2024-09-13T16:07:53.137 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.134+0000 7f7f19200640 1 -- 172.21.15.86:0/2058402059 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f141a0590 con 0x7f7f14101fa0 2024-09-13T16:07:53.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.135+0000 7f7f19200640 1 -- 172.21.15.86:0/2058402059 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f141092e0 con 0x7f7f14101fa0 2024-09-13T16:07:53.138 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.137+0000 7f7f0aa00640 1 -- 172.21.15.86:0/2058402059 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7f04003680 con 0x7f7f14101fa0 2024-09-13T16:07:53.140 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.139+0000 7f7f0aa00640 1 --2- 172.21.15.86:0/2058402059 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7ef80a1110 0x7f7ef80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:53.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.139+0000 7f7f0aa00640 1 -- 172.21.15.86:0/2058402059 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7f04014070 con 0x7f7f14101fa0 2024-09-13T16:07:53.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.139+0000 7f7f11400640 1 --2- 172.21.15.86:0/2058402059 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7ef80a1110 0x7f7ef80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:53.141 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.140+0000 7f7f11400640 1 --2- 172.21.15.86:0/2058402059 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7ef80a1110 0x7f7ef80a35d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7f141994e0 tx=0x7f7f00005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:53.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.143+0000 7f7f0aa00640 1 -- 172.21.15.86:0/2058402059 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7f040964f0 con 0x7f7f14101fa0 2024-09-13T16:07:53.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.348+0000 7f7f19200640 1 -- 172.21.15.86:0/2058402059 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f1410d9a0 con 0x7f7f14101fa0 2024-09-13T16:07:53.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.349+0000 7f7f0aa00640 1 -- 172.21.15.86:0/2058402059 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6568 (secure 0 0 0) 0x7f7f04099b10 con 0x7f7f14101fa0 2024-09-13T16:07:53.353 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:07:53.353 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1370900762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1370900762},{"type":"v1","addr":"172.21.15.194:6835","nonce":1370900762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2460451799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":2460451799},{"type":"v1","addr":"172.21.15.194:6837","nonce":2460451799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24530,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2399531832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2399531832},{"type":"v1","addr":"172.21.15.139:6837","nonce":2399531832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2024-09-13T16:07:53.354 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 9 2024-09-13T16:07:53.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.351+0000 7f7f19200640 1 -- 172.21.15.86:0/2058402059 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7ef80a1110 msgr2=0x7f7ef80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:53.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.351+0000 7f7f19200640 1 --2- 172.21.15.86:0/2058402059 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7ef80a1110 0x7f7ef80a35d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7f141994e0 tx=0x7f7f00005f90 comp rx=0 tx=0).stop 2024-09-13T16:07:53.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.351+0000 7f7f19200640 1 -- 172.21.15.86:0/2058402059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f14101fa0 msgr2=0x7f7f14197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:53.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.351+0000 7f7f19200640 1 --2- 172.21.15.86:0/2058402059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f14101fa0 0x7f7f14197fd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400e9c0 tx=0x7f7f0400ee80 comp rx=0 tx=0).stop 2024-09-13T16:07:53.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.351+0000 7f7f19200640 1 -- 172.21.15.86:0/2058402059 shutdown_connections 2024-09-13T16:07:53.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.351+0000 7f7f19200640 1 --2- 172.21.15.86:0/2058402059 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7ef80a1110 0x7f7ef80a35d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:53.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.351+0000 7f7f19200640 1 --2- 172.21.15.86:0/2058402059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f14103b50 0x7f7f1419f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:53.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.351+0000 7f7f19200640 1 --2- 172.21.15.86:0/2058402059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f14103190 0x7f7f14198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:53.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.351+0000 7f7f19200640 1 --2- 172.21.15.86:0/2058402059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f14101fa0 0x7f7f14197fd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:53.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.351+0000 7f7f19200640 1 -- 172.21.15.86:0/2058402059 >> 172.21.15.86:0/2058402059 conn(0x7f7f140fd700 msgr2=0x7f7f141064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:53.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.351+0000 7f7f19200640 1 -- 172.21.15.86:0/2058402059 shutdown_connections 2024-09-13T16:07:53.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:53.351+0000 7f7f19200640 1 -- 172.21.15.86:0/2058402059 wait complete. 2024-09-13T16:07:53.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:53 smithi139 ceph-mon[35320]: Deploying daemon mds.i on smithi194 2024-09-13T16:07:53.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:53 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] up:boot 2024-09-13T16:07:53.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:53 smithi139 ceph-mon[35320]: fsmap 8 up:standby 2024-09-13T16:07:53.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:53 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T16:07:53.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:53 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2058402059' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:53.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:53 smithi194 ceph-mon[35694]: Deploying daemon mds.i on smithi194 2024-09-13T16:07:53.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:53 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] up:boot 2024-09-13T16:07:53.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:53 smithi194 ceph-mon[35694]: fsmap 8 up:standby 2024-09-13T16:07:53.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:53 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T16:07:53.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:53 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2058402059' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:53.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:53 smithi086 ceph-mon[30379]: Deploying daemon mds.i on smithi194 2024-09-13T16:07:53.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:53 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] up:boot 2024-09-13T16:07:53.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:53 smithi086 ceph-mon[30379]: fsmap 8 up:standby 2024-09-13T16:07:53.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:53 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T16:07:53.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:53 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2058402059' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:54.197 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:07:53 smithi194 systemd[1]: Starting Ceph mds.i for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:07:54.459 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:07:54 smithi194 podman[66728]: 2024-09-13 16:07:54.09859534 +0000 UTC m=+0.016768694 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:07:54.459 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:07:54 smithi194 podman[66728]: 2024-09-13 16:07:54.229607084 +0000 UTC m=+0.147780428 container create 2f6ddfb9e971432d798b508676e5b6cebaffc935030232d26f89202a50273a80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-i, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T16:07:54.460 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:07:54 smithi194 podman[66728]: 2024-09-13 16:07:54.440532824 +0000 UTC m=+0.358706165 container init 2f6ddfb9e971432d798b508676e5b6cebaffc935030232d26f89202a50273a80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-i, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-13T16:07:54.460 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:07:54 smithi194 podman[66728]: 2024-09-13 16:07:54.44338929 +0000 UTC m=+0.361562638 container start 2f6ddfb9e971432d798b508676e5b6cebaffc935030232d26f89202a50273a80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-i, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-13T16:07:54.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:54 smithi139 ceph-mon[35320]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:54.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:54 smithi194 ceph-mon[35694]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:54.755 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:07:54 smithi194 ceph-mds[66747]: -- 172.21.15.194:0/2384768274 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c77a5e2d00 con 0x55c77a5b6800 2024-09-13T16:07:54.755 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:07:54 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-i[66743]: starting mds.i at 2024-09-13T16:07:54.755 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:07:54 smithi194 bash[66728]: 2f6ddfb9e971432d798b508676e5b6cebaffc935030232d26f89202a50273a80 2024-09-13T16:07:54.755 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:07:54 smithi194 systemd[1]: Started Ceph mds.i for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:07:54.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:54 smithi086 ceph-mon[30379]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:55.369 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:07:55.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.530+0000 7f22fb000640 1 -- 172.21.15.86:0/1995661782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22f4101770 msgr2=0x7f22f4108000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:55.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.530+0000 7f22fb000640 1 --2- 172.21.15.86:0/1995661782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22f4101770 0x7f22f4108000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f22ec009ca0 tx=0x7f22ec02a8c0 comp rx=0 tx=0).stop 2024-09-13T16:07:55.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.530+0000 7f22fb000640 1 -- 172.21.15.86:0/1995661782 shutdown_connections 2024-09-13T16:07:55.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.530+0000 7f22fb000640 1 --2- 172.21.15.86:0/1995661782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22f4101770 0x7f22f4108000 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:55.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.530+0000 7f22fb000640 1 --2- 172.21.15.86:0/1995661782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22f4100db0 0x7f22f4101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:55.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.530+0000 7f22fb000640 1 --2- 172.21.15.86:0/1995661782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f40ffbc0 0x7f22f40fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:55.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.530+0000 7f22fb000640 1 -- 172.21.15.86:0/1995661782 >> 172.21.15.86:0/1995661782 conn(0x7f22f40fb360 msgr2=0x7f22f40fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:55.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.530+0000 7f22fb000640 1 -- 172.21.15.86:0/1995661782 shutdown_connections 2024-09-13T16:07:55.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.530+0000 7f22fb000640 1 -- 172.21.15.86:0/1995661782 wait complete. 2024-09-13T16:07:55.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.531+0000 7f22fb000640 1 Processor -- start 2024-09-13T16:07:55.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.531+0000 7f22fb000640 1 -- start start 2024-09-13T16:07:55.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.531+0000 7f22fb000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f40ffbc0 0x7f22f4197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:55.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.531+0000 7f22fb000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22f4100db0 0x7f22f41983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:55.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.531+0000 7f22fb000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22f4101770 0x7f22f419f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:55.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.531+0000 7f22fb000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f419f950 con 0x7f22f4100db0 2024-09-13T16:07:55.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.531+0000 7f22fb000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f419fac0 con 0x7f22f4101770 2024-09-13T16:07:55.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.531+0000 7f22fb000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f419fc80 con 0x7f22f40ffbc0 2024-09-13T16:07:55.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.531+0000 7f22f9200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22f4100db0 0x7f22f41983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:55.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.532+0000 7f22f9c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f40ffbc0 0x7f22f4197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:55.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.532+0000 7f22f9200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22f4100db0 0x7f22f41983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40990/0 (socket says 172.21.15.86:40990) 2024-09-13T16:07:55.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.532+0000 7f22f9200640 1 -- 172.21.15.86:0/1732772321 learned_addr learned my addr 172.21.15.86:0/1732772321 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:07:55.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.532+0000 7f22fa600640 1 --2- 172.21.15.86:0/1732772321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22f4101770 0x7f22f419f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:55.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.532+0000 7f22f9200640 1 -- 172.21.15.86:0/1732772321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f40ffbc0 msgr2=0x7f22f4197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:55.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.532+0000 7f22f9200640 1 --2- 172.21.15.86:0/1732772321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f40ffbc0 0x7f22f4197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:55.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.532+0000 7f22f9200640 1 -- 172.21.15.86:0/1732772321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22f4101770 msgr2=0x7f22f419f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:55.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.532+0000 7f22f9200640 1 --2- 172.21.15.86:0/1732772321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22f4101770 0x7f22f419f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:55.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.532+0000 7f22f9200640 1 -- 172.21.15.86:0/1732772321 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e0009490 con 0x7f22f4100db0 2024-09-13T16:07:55.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.532+0000 7f22f9c00640 1 --2- 172.21.15.86:0/1732772321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f40ffbc0 0x7f22f4197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:07:55.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.532+0000 7f22f9200640 1 --2- 172.21.15.86:0/1732772321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22f4100db0 0x7f22f41983a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f22e000ea60 tx=0x7f22e000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:55.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.532+0000 7f22f2000640 1 -- 172.21.15.86:0/1732772321 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e000cde0 con 0x7f22f4100db0 2024-09-13T16:07:55.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.532+0000 7f22f2000640 1 -- 172.21.15.86:0/1732772321 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f22e00035f0 con 0x7f22f4100db0 2024-09-13T16:07:55.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.532+0000 7f22fb000640 1 -- 172.21.15.86:0/1732772321 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ec009900 con 0x7f22f4100db0 2024-09-13T16:07:55.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.533+0000 7f22f2000640 1 -- 172.21.15.86:0/1732772321 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e0010690 con 0x7f22f4100db0 2024-09-13T16:07:55.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.533+0000 7f22fb000640 1 -- 172.21.15.86:0/1732772321 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f41a0280 con 0x7f22f4100db0 2024-09-13T16:07:55.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.534+0000 7f22fb000640 1 -- 172.21.15.86:0/1732772321 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f410b650 con 0x7f22f4100db0 2024-09-13T16:07:55.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.536+0000 7f22f2000640 1 -- 172.21.15.86:0/1732772321 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f22e0003af0 con 0x7f22f4100db0 2024-09-13T16:07:55.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.537+0000 7f22f2000640 1 --2- 172.21.15.86:0/1732772321 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f22dc0a1090 0x7f22dc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:55.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.537+0000 7f22f2000640 1 -- 172.21.15.86:0/1732772321 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f22e0014070 con 0x7f22f4100db0 2024-09-13T16:07:55.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.537+0000 7f22f9c00640 1 --2- 172.21.15.86:0/1732772321 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f22dc0a1090 0x7f22dc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:55.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.538+0000 7f22f9c00640 1 --2- 172.21.15.86:0/1732772321 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f22dc0a1090 0x7f22dc0a3550 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f22f4100c10 tx=0x7f22e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:55.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.541+0000 7f22f2000640 1 -- 172.21.15.86:0/1732772321 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f22e0096500 con 0x7f22f4100db0 2024-09-13T16:07:55.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:55 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:55.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:55 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:55.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:55 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:55.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:55 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:55.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:55 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:55.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:55 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:55.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:55 smithi139 ceph-mon[35320]: Deploying daemon mds.g on smithi086 2024-09-13T16:07:55.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:55 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] up:boot 2024-09-13T16:07:55.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:55 smithi139 ceph-mon[35320]: fsmap 9 up:standby 2024-09-13T16:07:55.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:55 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T16:07:55.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.758+0000 7f22fb000640 1 -- 172.21.15.86:0/1732772321 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22f410b860 con 0x7f22f4100db0 2024-09-13T16:07:55.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.759+0000 7f22f2000640 1 -- 172.21.15.86:0/1732772321 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7330 (secure 0 0 0) 0x7f22e0099b20 con 0x7f22f4100db0 2024-09-13T16:07:55.762 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:07:55.762 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1370900762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1370900762},{"type":"v1","addr":"172.21.15.194:6835","nonce":1370900762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2460451799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":2460451799},{"type":"v1","addr":"172.21.15.194:6837","nonce":2460451799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24530,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2399531832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2399531832},{"type":"v1","addr":"172.21.15.139:6837","nonce":2399531832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24544,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/3799859182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3799859182},{"type":"v1","addr":"172.21.15.194:6839","nonce":3799859182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-09-13T16:07:55.762 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 10 2024-09-13T16:07:55.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.761+0000 7f22fb000640 1 -- 172.21.15.86:0/1732772321 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f22dc0a1090 msgr2=0x7f22dc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:55.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.761+0000 7f22fb000640 1 --2- 172.21.15.86:0/1732772321 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f22dc0a1090 0x7f22dc0a3550 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f22f4100c10 tx=0x7f22e8005f90 comp rx=0 tx=0).stop 2024-09-13T16:07:55.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.761+0000 7f22fb000640 1 -- 172.21.15.86:0/1732772321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22f4100db0 msgr2=0x7f22f41983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:55.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.761+0000 7f22fb000640 1 --2- 172.21.15.86:0/1732772321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22f4100db0 0x7f22f41983a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f22e000ea60 tx=0x7f22e000ef20 comp rx=0 tx=0).stop 2024-09-13T16:07:55.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.761+0000 7f22fb000640 1 -- 172.21.15.86:0/1732772321 shutdown_connections 2024-09-13T16:07:55.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.761+0000 7f22fb000640 1 --2- 172.21.15.86:0/1732772321 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f22dc0a1090 0x7f22dc0a3550 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:55.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.761+0000 7f22fb000640 1 --2- 172.21.15.86:0/1732772321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22f4101770 0x7f22f419f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:55.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.761+0000 7f22fb000640 1 --2- 172.21.15.86:0/1732772321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22f4100db0 0x7f22f41983a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:55.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.761+0000 7f22fb000640 1 --2- 172.21.15.86:0/1732772321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f40ffbc0 0x7f22f4197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:55.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.761+0000 7f22fb000640 1 -- 172.21.15.86:0/1732772321 >> 172.21.15.86:0/1732772321 conn(0x7f22f40fb360 msgr2=0x7f22f40726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:55.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.761+0000 7f22fb000640 1 -- 172.21.15.86:0/1732772321 shutdown_connections 2024-09-13T16:07:55.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:55.761+0000 7f22fb000640 1 -- 172.21.15.86:0/1732772321 wait complete. 2024-09-13T16:07:55.778 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:55 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:55.778 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:55 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:55.778 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:55 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:55.778 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:55 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:55.778 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:55 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:55.778 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:55 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:55.779 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:55 smithi086 ceph-mon[30379]: Deploying daemon mds.g on smithi086 2024-09-13T16:07:55.779 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:55 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] up:boot 2024-09-13T16:07:55.779 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:55 smithi086 ceph-mon[30379]: fsmap 9 up:standby 2024-09-13T16:07:55.779 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:55 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T16:07:56.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:55 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:56.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:55 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:56.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:55 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:56.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:55 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:56.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:55 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:56.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:55 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:56.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:55 smithi194 ceph-mon[35694]: Deploying daemon mds.g on smithi086 2024-09-13T16:07:56.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:55 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] up:boot 2024-09-13T16:07:56.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:55 smithi194 ceph-mon[35694]: fsmap 9 up:standby 2024-09-13T16:07:56.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:55 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T16:07:56.704 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:56 smithi086 ceph-mon[30379]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:56.705 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:56 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1732772321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:56.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:56 smithi139 ceph-mon[35320]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:56.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:56 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1732772321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:57.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:56 smithi194 ceph-mon[35694]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:57.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:56 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1732772321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:57.365 INFO:journalctl@ceph.mds.g.smithi086.stdout:Sep 13 16:07:57 smithi086 systemd[1]: Starting Ceph mds.g for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:07:57.767 INFO:journalctl@ceph.mds.g.smithi086.stdout:Sep 13 16:07:57 smithi086 podman[70547]: 2024-09-13 16:07:57.334478896 +0000 UTC m=+0.027875300 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:07:57.767 INFO:journalctl@ceph.mds.g.smithi086.stdout:Sep 13 16:07:57 smithi086 podman[70547]: 2024-09-13 16:07:57.47972868 +0000 UTC m=+0.173125070 container create cfdfe5005aa7807c18ffb7560bca10e780fd746265d78c56976f242af3d62c67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-g, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-13T16:07:57.767 INFO:journalctl@ceph.mds.g.smithi086.stdout:Sep 13 16:07:57 smithi086 podman[70547]: 2024-09-13 16:07:57.766361077 +0000 UTC m=+0.459757480 container init cfdfe5005aa7807c18ffb7560bca10e780fd746265d78c56976f242af3d62c67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-g, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:07:57.781 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:07:57.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.944+0000 7f018a600640 1 -- 172.21.15.86:0/732558433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01840ffdb0 msgr2=0x7f01841001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:57.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.944+0000 7f018a600640 1 --2- 172.21.15.86:0/732558433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01840ffdb0 0x7f01841001b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0174009900 tx=0x7f017402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:07:57.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.944+0000 7f018a600640 1 -- 172.21.15.86:0/732558433 shutdown_connections 2024-09-13T16:07:57.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.944+0000 7f018a600640 1 --2- 172.21.15.86:0/732558433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0184101960 0x7f01841081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:57.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.944+0000 7f018a600640 1 --2- 172.21.15.86:0/732558433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0184100fa0 0x7f0184101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:57.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.944+0000 7f018a600640 1 --2- 172.21.15.86:0/732558433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01840ffdb0 0x7f01841001b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:57.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.944+0000 7f018a600640 1 -- 172.21.15.86:0/732558433 >> 172.21.15.86:0/732558433 conn(0x7f01840fb510 msgr2=0x7f01840fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:57.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.944+0000 7f018a600640 1 -- 172.21.15.86:0/732558433 shutdown_connections 2024-09-13T16:07:57.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.944+0000 7f018a600640 1 -- 172.21.15.86:0/732558433 wait complete. 2024-09-13T16:07:57.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.945+0000 7f018a600640 1 Processor -- start 2024-09-13T16:07:57.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.945+0000 7f018a600640 1 -- start start 2024-09-13T16:07:57.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.946+0000 7f018a600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01840ffdb0 0x7f0184198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:57.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.946+0000 7f018a600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0184100fa0 0x7f01841985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:57.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.946+0000 7f018a600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0184101960 0x7f018419f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:57.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.946+0000 7f018a600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018419fb80 con 0x7f01840ffdb0 2024-09-13T16:07:57.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.946+0000 7f018a600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018419fcf0 con 0x7f0184101960 2024-09-13T16:07:57.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.946+0000 7f018a600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018419feb0 con 0x7f0184100fa0 2024-09-13T16:07:57.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.946+0000 7f0183400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01840ffdb0 0x7f0184198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:57.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.946+0000 7f0183400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01840ffdb0 0x7f0184198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41034/0 (socket says 172.21.15.86:41034) 2024-09-13T16:07:57.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.946+0000 7f0183400640 1 -- 172.21.15.86:0/606541765 learned_addr learned my addr 172.21.15.86:0/606541765 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:07:57.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.946+0000 7f0182a00640 1 --2- 172.21.15.86:0/606541765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0184100fa0 0x7f01841985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:57.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.946+0000 7f0183e00640 1 --2- 172.21.15.86:0/606541765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0184101960 0x7f018419f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:57.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.946+0000 7f0183400640 1 -- 172.21.15.86:0/606541765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0184100fa0 msgr2=0x7f01841985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:57.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.946+0000 7f0183400640 1 --2- 172.21.15.86:0/606541765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0184100fa0 0x7f01841985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:57.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.946+0000 7f0183400640 1 -- 172.21.15.86:0/606541765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0184101960 msgr2=0x7f018419f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:57.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.946+0000 7f0183400640 1 --2- 172.21.15.86:0/606541765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0184101960 0x7f018419f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:57.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.946+0000 7f0183400640 1 -- 172.21.15.86:0/606541765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0174009560 con 0x7f01840ffdb0 2024-09-13T16:07:57.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.947+0000 7f0183400640 1 --2- 172.21.15.86:0/606541765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01840ffdb0 0x7f0184198090 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0174031510 tx=0x7f0174004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:57.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.947+0000 7f017be00640 1 -- 172.21.15.86:0/606541765 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174005000 con 0x7f01840ffdb0 2024-09-13T16:07:57.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.947+0000 7f018a600640 1 -- 172.21.15.86:0/606541765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01841a0130 con 0x7f01840ffdb0 2024-09-13T16:07:57.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.947+0000 7f018a600640 1 -- 172.21.15.86:0/606541765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01841a0630 con 0x7f01840ffdb0 2024-09-13T16:07:57.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.947+0000 7f017be00640 1 -- 172.21.15.86:0/606541765 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f01740046c0 con 0x7f01840ffdb0 2024-09-13T16:07:57.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.947+0000 7f017be00640 1 -- 172.21.15.86:0/606541765 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174003a10 con 0x7f01840ffdb0 2024-09-13T16:07:57.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.948+0000 7f018a600640 1 -- 172.21.15.86:0/606541765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f018410b7f0 con 0x7f01840ffdb0 2024-09-13T16:07:57.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.950+0000 7f017be00640 1 -- 172.21.15.86:0/606541765 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0174004bc0 con 0x7f01840ffdb0 2024-09-13T16:07:57.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.952+0000 7f017be00640 1 --2- 172.21.15.86:0/606541765 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f01680a1110 0x7f01680a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:57.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.952+0000 7f017be00640 1 -- 172.21.15.86:0/606541765 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f01740ed5c0 con 0x7f01840ffdb0 2024-09-13T16:07:57.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.952+0000 7f0182a00640 1 --2- 172.21.15.86:0/606541765 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f01680a1110 0x7f01680a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:57.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.953+0000 7f0182a00640 1 --2- 172.21.15.86:0/606541765 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f01680a1110 0x7f01680a35d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f01841995a0 tx=0x7f0170005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:57.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:57.958+0000 7f017be00640 1 -- 172.21.15.86:0/606541765 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f01740b72a0 con 0x7f01840ffdb0 2024-09-13T16:07:58.115 INFO:journalctl@ceph.mds.g.smithi086.stdout:Sep 13 16:07:57 smithi086 podman[70547]: 2024-09-13 16:07:57.773124735 +0000 UTC m=+0.466521135 container start cfdfe5005aa7807c18ffb7560bca10e780fd746265d78c56976f242af3d62c67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-09-13T16:07:58.115 INFO:journalctl@ceph.mds.g.smithi086.stdout:Sep 13 16:07:57 smithi086 ceph-mds[70568]: -- 172.21.15.86:0/1480763317 <== mon.0 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556452c2ed00 con 0x556452c03000 2024-09-13T16:07:58.115 INFO:journalctl@ceph.mds.g.smithi086.stdout:Sep 13 16:07:57 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-g[70564]: starting mds.g at 2024-09-13T16:07:58.115 INFO:journalctl@ceph.mds.g.smithi086.stdout:Sep 13 16:07:57 smithi086 bash[70547]: cfdfe5005aa7807c18ffb7560bca10e780fd746265d78c56976f242af3d62c67 2024-09-13T16:07:58.116 INFO:journalctl@ceph.mds.g.smithi086.stdout:Sep 13 16:07:57 smithi086 systemd[1]: Started Ceph mds.g for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:07:58.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:58.179+0000 7f018a600640 1 -- 172.21.15.86:0/606541765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f018410b9b0 con 0x7f01840ffdb0 2024-09-13T16:07:58.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:58.179+0000 7f017be00640 1 -- 172.21.15.86:0/606541765 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7330 (secure 0 0 0) 0x7f01740ba8c0 con 0x7f01840ffdb0 2024-09-13T16:07:58.181 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:07:58.181 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1370900762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1370900762},{"type":"v1","addr":"172.21.15.194:6835","nonce":1370900762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2460451799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":2460451799},{"type":"v1","addr":"172.21.15.194:6837","nonce":2460451799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24530,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2399531832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2399531832},{"type":"v1","addr":"172.21.15.139:6837","nonce":2399531832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24544,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/3799859182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3799859182},{"type":"v1","addr":"172.21.15.194:6839","nonce":3799859182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-09-13T16:07:58.181 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 10 2024-09-13T16:07:58.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:58.181+0000 7f018a600640 1 -- 172.21.15.86:0/606541765 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f01680a1110 msgr2=0x7f01680a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:58.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:58.181+0000 7f018a600640 1 --2- 172.21.15.86:0/606541765 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f01680a1110 0x7f01680a35d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f01841995a0 tx=0x7f0170005f90 comp rx=0 tx=0).stop 2024-09-13T16:07:58.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:58.181+0000 7f018a600640 1 -- 172.21.15.86:0/606541765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01840ffdb0 msgr2=0x7f0184198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:58.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:58.181+0000 7f018a600640 1 --2- 172.21.15.86:0/606541765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01840ffdb0 0x7f0184198090 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0174031510 tx=0x7f0174004270 comp rx=0 tx=0).stop 2024-09-13T16:07:58.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:58.181+0000 7f018a600640 1 -- 172.21.15.86:0/606541765 shutdown_connections 2024-09-13T16:07:58.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:58.181+0000 7f018a600640 1 --2- 172.21.15.86:0/606541765 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f01680a1110 0x7f01680a35d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:58.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:58.181+0000 7f018a600640 1 --2- 172.21.15.86:0/606541765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0184101960 0x7f018419f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:58.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:58.181+0000 7f018a600640 1 --2- 172.21.15.86:0/606541765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0184100fa0 0x7f01841985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:58.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:58.181+0000 7f018a600640 1 --2- 172.21.15.86:0/606541765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01840ffdb0 0x7f0184198090 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:58.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:58.182+0000 7f018a600640 1 -- 172.21.15.86:0/606541765 >> 172.21.15.86:0/606541765 conn(0x7f01840fb510 msgr2=0x7f0184106770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:58.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:58.182+0000 7f018a600640 1 -- 172.21.15.86:0/606541765 shutdown_connections 2024-09-13T16:07:58.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:07:58.182+0000 7f018a600640 1 -- 172.21.15.86:0/606541765 wait complete. 2024-09-13T16:07:58.820 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:58 smithi086 ceph-mon[30379]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:58.821 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:58 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:58.821 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:58 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:58.821 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:58 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:58.821 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:58 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:58.821 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:58 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:58.821 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:58 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:58.821 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:58 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/606541765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:58.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:58 smithi139 ceph-mon[35320]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:58.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:58 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:58.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:58 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:58.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:58 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:58.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:58 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:58.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:58 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:58.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:58 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:58.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:58 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/606541765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:59.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:58 smithi194 ceph-mon[35694]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:07:59.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:58 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:59.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:58 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:59.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:58 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:07:59.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:58 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:07:59.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:58 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:07:59.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:58 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:59.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:58 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/606541765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:07:59.775 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:59 smithi086 ceph-mon[30379]: Deploying daemon mds.a on smithi086 2024-09-13T16:07:59.775 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:59 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.86:6838/1509120923,v1:172.21.15.86:6839/1509120923] up:boot 2024-09-13T16:07:59.775 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:59 smithi086 ceph-mon[30379]: fsmap 10 up:standby 2024-09-13T16:07:59.775 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:07:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T16:07:59.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:59 smithi139 ceph-mon[35320]: Deploying daemon mds.a on smithi086 2024-09-13T16:07:59.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:59 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.86:6838/1509120923,v1:172.21.15.86:6839/1509120923] up:boot 2024-09-13T16:07:59.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:59 smithi139 ceph-mon[35320]: fsmap 10 up:standby 2024-09-13T16:07:59.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:07:59 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T16:08:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:59 smithi194 ceph-mon[35694]: Deploying daemon mds.a on smithi086 2024-09-13T16:08:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:59 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.86:6838/1509120923,v1:172.21.15.86:6839/1509120923] up:boot 2024-09-13T16:08:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:59 smithi194 ceph-mon[35694]: fsmap 10 up:standby 2024-09-13T16:08:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:07:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T16:08:00.201 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:08:00.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.541+0000 7fa61e600640 1 -- 172.21.15.86:0/3085448224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6180ffbb0 msgr2=0x7fa6180fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:00.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.541+0000 7fa61e600640 1 --2- 172.21.15.86:0/3085448224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6180ffbb0 0x7fa6180fffb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009900 tx=0x7fa60c02a3f0 comp rx=0 tx=0).stop 2024-09-13T16:08:00.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.542+0000 7fa61e600640 1 -- 172.21.15.86:0/3085448224 shutdown_connections 2024-09-13T16:08:00.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.542+0000 7fa61e600640 1 --2- 172.21.15.86:0/3085448224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa618101760 0x7fa618107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:00.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.542+0000 7fa61e600640 1 --2- 172.21.15.86:0/3085448224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa618100da0 0x7fa618101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:00.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.542+0000 7fa61e600640 1 --2- 172.21.15.86:0/3085448224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6180ffbb0 0x7fa6180fffb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:00.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.542+0000 7fa61e600640 1 -- 172.21.15.86:0/3085448224 >> 172.21.15.86:0/3085448224 conn(0x7fa6180fb330 msgr2=0x7fa6180fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:00.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.542+0000 7fa61e600640 1 -- 172.21.15.86:0/3085448224 shutdown_connections 2024-09-13T16:08:00.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.542+0000 7fa61e600640 1 -- 172.21.15.86:0/3085448224 wait complete. 2024-09-13T16:08:00.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.543+0000 7fa61e600640 1 Processor -- start 2024-09-13T16:08:00.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.543+0000 7fa61e600640 1 -- start start 2024-09-13T16:08:00.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.543+0000 7fa61e600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6180ffbb0 0x7fa618197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:00.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.543+0000 7fa61e600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa618100da0 0x7fa618198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:00.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.543+0000 7fa61e600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa618101760 0x7fa61819f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:00.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.543+0000 7fa61e600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61819fa00 con 0x7fa6180ffbb0 2024-09-13T16:08:00.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.543+0000 7fa61e600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61819fb70 con 0x7fa618101760 2024-09-13T16:08:00.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.543+0000 7fa61e600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61819fd30 con 0x7fa618100da0 2024-09-13T16:08:00.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.543+0000 7fa61d200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6180ffbb0 0x7fa618197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:00.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.543+0000 7fa61dc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa618101760 0x7fa61819f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:00.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.543+0000 7fa61d200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6180ffbb0 0x7fa618197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41052/0 (socket says 172.21.15.86:41052) 2024-09-13T16:08:00.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.543+0000 7fa61d200640 1 -- 172.21.15.86:0/214650681 learned_addr learned my addr 172.21.15.86:0/214650681 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:00.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.543+0000 7fa617e00640 1 --2- 172.21.15.86:0/214650681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa618100da0 0x7fa618198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:00.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.544+0000 7fa61dc00640 1 -- 172.21.15.86:0/214650681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa618100da0 msgr2=0x7fa618198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:00.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.544+0000 7fa61dc00640 1 --2- 172.21.15.86:0/214650681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa618100da0 0x7fa618198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:00.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.544+0000 7fa61dc00640 1 -- 172.21.15.86:0/214650681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6180ffbb0 msgr2=0x7fa618197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:00.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.544+0000 7fa61dc00640 1 --2- 172.21.15.86:0/214650681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6180ffbb0 0x7fa618197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:00.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.544+0000 7fa61dc00640 1 -- 172.21.15.86:0/214650681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c009560 con 0x7fa618101760 2024-09-13T16:08:00.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.544+0000 7fa617e00640 1 --2- 172.21.15.86:0/214650681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa618100da0 0x7fa618198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:00.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.544+0000 7fa61dc00640 1 --2- 172.21.15.86:0/214650681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa618101760 0x7fa61819f4c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa610009fd0 tx=0x7fa61000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:00.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.544+0000 7fa615600640 1 -- 172.21.15.86:0/214650681 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61000ce20 con 0x7fa618101760 2024-09-13T16:08:00.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.544+0000 7fa615600640 1 -- 172.21.15.86:0/214650681 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa610005020 con 0x7fa618101760 2024-09-13T16:08:00.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.544+0000 7fa61e600640 1 -- 172.21.15.86:0/214650681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61819ffb0 con 0x7fa618101760 2024-09-13T16:08:00.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.544+0000 7fa615600640 1 -- 172.21.15.86:0/214650681 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610010690 con 0x7fa618101760 2024-09-13T16:08:00.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.544+0000 7fa61e600640 1 -- 172.21.15.86:0/214650681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6181a0490 con 0x7fa618101760 2024-09-13T16:08:00.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.545+0000 7fa61e600640 1 -- 172.21.15.86:0/214650681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61810b640 con 0x7fa618101760 2024-09-13T16:08:00.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.547+0000 7fa615600640 1 -- 172.21.15.86:0/214650681 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa610005500 con 0x7fa618101760 2024-09-13T16:08:00.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.548+0000 7fa615600640 1 --2- 172.21.15.86:0/214650681 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa6000a1090 0x7fa6000a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:00.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.549+0000 7fa615600640 1 -- 172.21.15.86:0/214650681 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa610014070 con 0x7fa618101760 2024-09-13T16:08:00.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.549+0000 7fa61d200640 1 --2- 172.21.15.86:0/214650681 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa6000a1090 0x7fa6000a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:00.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.549+0000 7fa61d200640 1 --2- 172.21.15.86:0/214650681 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa6000a1090 0x7fa6000a3550 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa60c006010 tx=0x7fa60c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:00.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.551+0000 7fa615600640 1 -- 172.21.15.86:0/214650681 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa610096720 con 0x7fa618101760 2024-09-13T16:08:00.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.787+0000 7fa61e600640 1 -- 172.21.15.86:0/214650681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6181a0710 con 0x7fa618101760 2024-09-13T16:08:00.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.788+0000 7fa615600640 1 -- 172.21.15.86:0/214650681 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8088 (secure 0 0 0) 0x7fa6181a0710 con 0x7fa618101760 2024-09-13T16:08:00.790 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:00.790 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14508,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1509120923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1509120923},{"type":"v1","addr":"172.21.15.86:6839","nonce":1509120923}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1370900762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1370900762},{"type":"v1","addr":"172.21.15.194:6835","nonce":1370900762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2460451799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":2460451799},{"type":"v1","addr":"172.21.15.194:6837","nonce":2460451799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24530,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2399531832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2399531832},{"type":"v1","addr":"172.21.15.139:6837","nonce":2399531832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24544,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/3799859182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3799859182},{"type":"v1","addr":"172.21.15.194:6839","nonce":3799859182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-09-13T16:08:00.790 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 11 2024-09-13T16:08:00.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.790+0000 7fa61e600640 1 -- 172.21.15.86:0/214650681 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa6000a1090 msgr2=0x7fa6000a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:00.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.790+0000 7fa61e600640 1 --2- 172.21.15.86:0/214650681 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa6000a1090 0x7fa6000a3550 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa60c006010 tx=0x7fa60c005a20 comp rx=0 tx=0).stop 2024-09-13T16:08:00.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.790+0000 7fa61e600640 1 -- 172.21.15.86:0/214650681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa618101760 msgr2=0x7fa61819f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:00.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.790+0000 7fa61e600640 1 --2- 172.21.15.86:0/214650681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa618101760 0x7fa61819f4c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa610009fd0 tx=0x7fa61000ef10 comp rx=0 tx=0).stop 2024-09-13T16:08:00.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.790+0000 7fa61e600640 1 -- 172.21.15.86:0/214650681 shutdown_connections 2024-09-13T16:08:00.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.790+0000 7fa61e600640 1 --2- 172.21.15.86:0/214650681 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa6000a1090 0x7fa6000a3550 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:00.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.790+0000 7fa61e600640 1 --2- 172.21.15.86:0/214650681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa618101760 0x7fa61819f4c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:00.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.790+0000 7fa61e600640 1 --2- 172.21.15.86:0/214650681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa618100da0 0x7fa618198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:00.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.790+0000 7fa61e600640 1 --2- 172.21.15.86:0/214650681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6180ffbb0 0x7fa618197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:00.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.790+0000 7fa61e600640 1 -- 172.21.15.86:0/214650681 >> 172.21.15.86:0/214650681 conn(0x7fa6180fb330 msgr2=0x7fa6180726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:00.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.790+0000 7fa61e600640 1 -- 172.21.15.86:0/214650681 shutdown_connections 2024-09-13T16:08:00.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:00.790+0000 7fa61e600640 1 -- 172.21.15.86:0/214650681 wait complete. 2024-09-13T16:08:00.803 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:00 smithi086 ceph-mon[30379]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:08:00.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:00 smithi194 ceph-mon[35694]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:08:00.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:00 smithi139 ceph-mon[35320]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:08:01.106 INFO:journalctl@ceph.mds.a.smithi086.stdout:Sep 13 16:08:00 smithi086 podman[70930]: 2024-09-13 16:08:00.835568658 +0000 UTC m=+0.156519168 container create c0475bdd96afce526eb6477aa45bbfde01555051200e7b96445d7f8b6a7f257d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-a, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-13T16:08:01.106 INFO:journalctl@ceph.mds.a.smithi086.stdout:Sep 13 16:08:01 smithi086 podman[70930]: 2024-09-13 16:08:01.105042026 +0000 UTC m=+0.425992527 container init c0475bdd96afce526eb6477aa45bbfde01555051200e7b96445d7f8b6a7f257d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-a, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-13T16:08:01.365 INFO:journalctl@ceph.mds.a.smithi086.stdout:Sep 13 16:08:01 smithi086 podman[70930]: 2024-09-13 16:08:01.111261769 +0000 UTC m=+0.432212279 container start c0475bdd96afce526eb6477aa45bbfde01555051200e7b96445d7f8b6a7f257d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-13T16:08:01.365 INFO:journalctl@ceph.mds.a.smithi086.stdout:Sep 13 16:08:01 smithi086 ceph-mds[70951]: -- 172.21.15.86:0/3072599730 <== mon.0 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5561f4544d00 con 0x5561f4519400 2024-09-13T16:08:01.366 INFO:journalctl@ceph.mds.a.smithi086.stdout:Sep 13 16:08:01 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-a[70947]: starting mds.a at 2024-09-13T16:08:01.366 INFO:journalctl@ceph.mds.a.smithi086.stdout:Sep 13 16:08:01 smithi086 bash[70930]: c0475bdd96afce526eb6477aa45bbfde01555051200e7b96445d7f8b6a7f257d 2024-09-13T16:08:01.366 INFO:journalctl@ceph.mds.a.smithi086.stdout:Sep 13 16:08:01 smithi086 systemd[1]: Started Ceph mds.a for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:08:01.922 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:01 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/214650681' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:08:01.923 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:01.923 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:01.923 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:01.923 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:08:01.923 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:08:01.923 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:01 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:08:02.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:01 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/214650681' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:08:02.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:01 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:02.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:01 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:02.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:01 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:02.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:01 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:08:02.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:01 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:08:02.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:01 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:08:02.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:01 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/214650681' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:08:02.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:01 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:02.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:01 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:02.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:01 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:02.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:01 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:08:02.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:01 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:08:02.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:01 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:08:02.809 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:08:02.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.973+0000 7ff778c00640 1 -- 172.21.15.86:0/933835935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff774103190 msgr2=0x7ff774103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:02.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.973+0000 7ff778c00640 1 --2- 172.21.15.86:0/933835935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff774103190 0x7ff774103610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff760009900 tx=0x7ff76002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:08:02.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.973+0000 7ff778c00640 1 -- 172.21.15.86:0/933835935 shutdown_connections 2024-09-13T16:08:02.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.973+0000 7ff778c00640 1 --2- 172.21.15.86:0/933835935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff774103b50 0x7ff77410a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:02.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.973+0000 7ff778c00640 1 --2- 172.21.15.86:0/933835935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff774103190 0x7ff774103610 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:02.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.973+0000 7ff778c00640 1 --2- 172.21.15.86:0/933835935 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff774101fa0 0x7ff7741023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:02.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.973+0000 7ff778c00640 1 -- 172.21.15.86:0/933835935 >> 172.21.15.86:0/933835935 conn(0x7ff7740fd700 msgr2=0x7ff7740ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:02.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.973+0000 7ff778c00640 1 -- 172.21.15.86:0/933835935 shutdown_connections 2024-09-13T16:08:02.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.973+0000 7ff778c00640 1 -- 172.21.15.86:0/933835935 wait complete. 2024-09-13T16:08:02.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.974+0000 7ff778c00640 1 Processor -- start 2024-09-13T16:08:02.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.974+0000 7ff778c00640 1 -- start start 2024-09-13T16:08:02.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.974+0000 7ff778c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff774101fa0 0x7ff774198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:02.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.974+0000 7ff778c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff774103190 0x7ff7741985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:02.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.974+0000 7ff778c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff774103b50 0x7ff77419f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:02.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.974+0000 7ff778c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77419fb80 con 0x7ff774103190 2024-09-13T16:08:02.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.974+0000 7ff778c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77419fcf0 con 0x7ff774103b50 2024-09-13T16:08:02.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.974+0000 7ff778c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77419feb0 con 0x7ff774101fa0 2024-09-13T16:08:02.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.974+0000 7ff771e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff774101fa0 0x7ff774198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:02.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.974+0000 7ff771400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff774103190 0x7ff7741985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:02.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.974+0000 7ff771e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff774101fa0 0x7ff774198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:52720/0 (socket says 172.21.15.86:52720) 2024-09-13T16:08:02.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.974+0000 7ff771e00640 1 -- 172.21.15.86:0/3742048691 learned_addr learned my addr 172.21.15.86:0/3742048691 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:02.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.975+0000 7ff772800640 1 --2- 172.21.15.86:0/3742048691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff774103b50 0x7ff77419f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:02.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.975+0000 7ff772800640 1 -- 172.21.15.86:0/3742048691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff774101fa0 msgr2=0x7ff774198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:02.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.975+0000 7ff772800640 1 --2- 172.21.15.86:0/3742048691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff774101fa0 0x7ff774198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:02.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.975+0000 7ff772800640 1 -- 172.21.15.86:0/3742048691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff774103190 msgr2=0x7ff7741985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:02.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.975+0000 7ff772800640 1 --2- 172.21.15.86:0/3742048691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff774103190 0x7ff7741985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:02.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.975+0000 7ff772800640 1 -- 172.21.15.86:0/3742048691 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff764009490 con 0x7ff774103b50 2024-09-13T16:08:02.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.975+0000 7ff772800640 1 --2- 172.21.15.86:0/3742048691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff774103b50 0x7ff77419f640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009fd0 tx=0x7ff76c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:02.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.975+0000 7ff76aa00640 1 -- 172.21.15.86:0/3742048691 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c00ce20 con 0x7ff774103b50 2024-09-13T16:08:02.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.975+0000 7ff778c00640 1 -- 172.21.15.86:0/3742048691 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff760009560 con 0x7ff774103b50 2024-09-13T16:08:02.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.975+0000 7ff76aa00640 1 -- 172.21.15.86:0/3742048691 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff76c005020 con 0x7ff774103b50 2024-09-13T16:08:02.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.975+0000 7ff76aa00640 1 -- 172.21.15.86:0/3742048691 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c010690 con 0x7ff774103b50 2024-09-13T16:08:02.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.976+0000 7ff778c00640 1 -- 172.21.15.86:0/3742048691 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7741a0530 con 0x7ff774103b50 2024-09-13T16:08:02.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.976+0000 7ff778c00640 1 -- 172.21.15.86:0/3742048691 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff774109390 con 0x7ff774103b50 2024-09-13T16:08:02.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.978+0000 7ff76aa00640 1 -- 172.21.15.86:0/3742048691 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff76c005500 con 0x7ff774103b50 2024-09-13T16:08:02.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.979+0000 7ff76aa00640 1 --2- 172.21.15.86:0/3742048691 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff7580a1110 0x7ff7580a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:02.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.980+0000 7ff76aa00640 1 -- 172.21.15.86:0/3742048691 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff76c014070 con 0x7ff774103b50 2024-09-13T16:08:02.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.980+0000 7ff771e00640 1 --2- 172.21.15.86:0/3742048691 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff7580a1110 0x7ff7580a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:02.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.980+0000 7ff771e00640 1 --2- 172.21.15.86:0/3742048691 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff7580a1110 0x7ff7580a35d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff7640058c0 tx=0x7ff764005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:02.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:02.981+0000 7ff76aa00640 1 -- 172.21.15.86:0/3742048691 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff76c0966d0 con 0x7ff774103b50 2024-09-13T16:08:02.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:02 smithi139 ceph-mon[35320]: Deploying daemon mds.b on smithi139 2024-09-13T16:08:02.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:02 smithi139 ceph-mon[35320]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:08:02.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:02 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.86:6840/1971775519,v1:172.21.15.86:6841/1971775519] up:boot 2024-09-13T16:08:02.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:02 smithi139 ceph-mon[35320]: fsmap 11 up:standby 2024-09-13T16:08:02.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:02 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T16:08:03.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:02 smithi194 ceph-mon[35694]: Deploying daemon mds.b on smithi139 2024-09-13T16:08:03.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:02 smithi194 ceph-mon[35694]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:08:03.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:02 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.86:6840/1971775519,v1:172.21.15.86:6841/1971775519] up:boot 2024-09-13T16:08:03.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:02 smithi194 ceph-mon[35694]: fsmap 11 up:standby 2024-09-13T16:08:03.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:02 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T16:08:03.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:02 smithi086 ceph-mon[30379]: Deploying daemon mds.b on smithi139 2024-09-13T16:08:03.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:02 smithi086 ceph-mon[30379]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:08:03.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:02 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.86:6840/1971775519,v1:172.21.15.86:6841/1971775519] up:boot 2024-09-13T16:08:03.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:02 smithi086 ceph-mon[30379]: fsmap 11 up:standby 2024-09-13T16:08:03.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:02 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T16:08:03.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:03.184+0000 7ff778c00640 1 -- 172.21.15.86:0/3742048691 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff77410d9f0 con 0x7ff774103b50 2024-09-13T16:08:03.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:03.185+0000 7ff76aa00640 1 -- 172.21.15.86:0/3742048691 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8846 (secure 0 0 0) 0x7ff76c005190 con 0x7ff774103b50 2024-09-13T16:08:03.187 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:03.187 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14508,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1509120923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1509120923},{"type":"v1","addr":"172.21.15.86:6839","nonce":1509120923}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6841/1971775519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":1971775519},{"type":"v1","addr":"172.21.15.86:6841","nonce":1971775519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1370900762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1370900762},{"type":"v1","addr":"172.21.15.194:6835","nonce":1370900762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2460451799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":2460451799},{"type":"v1","addr":"172.21.15.194:6837","nonce":2460451799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24530,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2399531832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2399531832},{"type":"v1","addr":"172.21.15.139:6837","nonce":2399531832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24544,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/3799859182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3799859182},{"type":"v1","addr":"172.21.15.194:6839","nonce":3799859182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-09-13T16:08:03.187 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 12 2024-09-13T16:08:03.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:03.187+0000 7ff778c00640 1 -- 172.21.15.86:0/3742048691 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff7580a1110 msgr2=0x7ff7580a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:03.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:03.187+0000 7ff778c00640 1 --2- 172.21.15.86:0/3742048691 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff7580a1110 0x7ff7580a35d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff7640058c0 tx=0x7ff764005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:03.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:03.187+0000 7ff778c00640 1 -- 172.21.15.86:0/3742048691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff774103b50 msgr2=0x7ff77419f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:03.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:03.187+0000 7ff778c00640 1 --2- 172.21.15.86:0/3742048691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff774103b50 0x7ff77419f640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009fd0 tx=0x7ff76c00ef10 comp rx=0 tx=0).stop 2024-09-13T16:08:03.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:03.187+0000 7ff778c00640 1 -- 172.21.15.86:0/3742048691 shutdown_connections 2024-09-13T16:08:03.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:03.187+0000 7ff778c00640 1 --2- 172.21.15.86:0/3742048691 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff7580a1110 0x7ff7580a35d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:03.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:03.187+0000 7ff778c00640 1 --2- 172.21.15.86:0/3742048691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff774103b50 0x7ff77419f640 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:03.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:03.187+0000 7ff778c00640 1 --2- 172.21.15.86:0/3742048691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff774103190 0x7ff7741985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:03.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:03.187+0000 7ff778c00640 1 --2- 172.21.15.86:0/3742048691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff774101fa0 0x7ff774198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:03.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:03.187+0000 7ff778c00640 1 -- 172.21.15.86:0/3742048691 >> 172.21.15.86:0/3742048691 conn(0x7ff7740fd700 msgr2=0x7ff774106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:03.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:03.188+0000 7ff778c00640 1 -- 172.21.15.86:0/3742048691 shutdown_connections 2024-09-13T16:08:03.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:03.188+0000 7ff778c00640 1 -- 172.21.15.86:0/3742048691 wait complete. 2024-09-13T16:08:03.452 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:08:03 smithi139 systemd[1]: Starting Ceph mds.b for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:08:03.747 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:03 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3742048691' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:08:03.748 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:08:03 smithi139 podman[64614]: 2024-09-13 16:08:03.353581715 +0000 UTC m=+0.016022244 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:08:03.748 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:08:03 smithi139 podman[64614]: 2024-09-13 16:08:03.530444826 +0000 UTC m=+0.192885390 container create b2ac5437779927c1815eccfd6f070400db73b0eac3eeb17821668c6bb53b784c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-b, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-13T16:08:04.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:03 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3742048691' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:08:04.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:03 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3742048691' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:08:04.248 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:08:03 smithi139 podman[64614]: 2024-09-13 16:08:03.89014401 +0000 UTC m=+0.552584528 container init b2ac5437779927c1815eccfd6f070400db73b0eac3eeb17821668c6bb53b784c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-13T16:08:04.248 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:08:03 smithi139 podman[64614]: 2024-09-13 16:08:03.893033016 +0000 UTC m=+0.555473550 container start b2ac5437779927c1815eccfd6f070400db73b0eac3eeb17821668c6bb53b784c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-b, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-09-13T16:08:04.249 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:08:03 smithi139 ceph-mds[64633]: -- 172.21.15.139:0/2666058459 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e78ab58d00 con 0x55e78ab2d000 2024-09-13T16:08:04.249 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:08:03 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-b[64629]: starting mds.b at 2024-09-13T16:08:04.249 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:08:03 smithi139 bash[64614]: b2ac5437779927c1815eccfd6f070400db73b0eac3eeb17821668c6bb53b784c 2024-09-13T16:08:04.249 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:08:04 smithi139 systemd[1]: Started Ceph mds.b for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:08:04.901 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:04 smithi139 ceph-mon[35320]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:08:04.901 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:04 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:04.901 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:04 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:04.901 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:04 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:04.901 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:04 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:04.901 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:04 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:04.901 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:04 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:08:04.901 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:04 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:04.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:04 smithi194 ceph-mon[35694]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:08:04.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:04 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:04.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:04 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:04.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:04 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:04.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:04 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:04.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:04 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:04.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:04 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:08:04.968 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:04 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:05.012 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:04 smithi086 ceph-mon[30379]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:08:05.012 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:04 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:05.012 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:04 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:05.012 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:04 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:05.012 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:04 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:05.012 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:04 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:05.012 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:04 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:08:05.012 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:04 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:05.205 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:08:05.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.362+0000 7f59d6e00640 1 -- 172.21.15.86:0/279526701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59d0103970 msgr2=0x7f59d010a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:05.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.362+0000 7f59d6e00640 1 --2- 172.21.15.86:0/279526701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59d0103970 0x7f59d010a200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009ca0 tx=0x7f59c802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:08:05.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.362+0000 7f59d6e00640 1 -- 172.21.15.86:0/279526701 shutdown_connections 2024-09-13T16:08:05.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.362+0000 7f59d6e00640 1 --2- 172.21.15.86:0/279526701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59d0103970 0x7f59d010a200 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:05.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.362+0000 7f59d6e00640 1 --2- 172.21.15.86:0/279526701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59d0102fb0 0x7f59d0103430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:05.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.362+0000 7f59d6e00640 1 --2- 172.21.15.86:0/279526701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59d0101dc0 0x7f59d01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:05.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.362+0000 7f59d6e00640 1 -- 172.21.15.86:0/279526701 >> 172.21.15.86:0/279526701 conn(0x7f59d00fd540 msgr2=0x7f59d00ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:05.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.362+0000 7f59d6e00640 1 -- 172.21.15.86:0/279526701 shutdown_connections 2024-09-13T16:08:05.365 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.362+0000 7f59d6e00640 1 -- 172.21.15.86:0/279526701 wait complete. 2024-09-13T16:08:05.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.363+0000 7f59d6e00640 1 Processor -- start 2024-09-13T16:08:05.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.364+0000 7f59d6e00640 1 -- start start 2024-09-13T16:08:05.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.364+0000 7f59d6e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59d0101dc0 0x7f59d0197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:05.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.364+0000 7f59d6e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59d0102fb0 0x7f59d01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:05.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.364+0000 7f59d6e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59d0103970 0x7f59d019f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:05.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.364+0000 7f59d6e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d019f950 con 0x7f59d0103970 2024-09-13T16:08:05.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.364+0000 7f59d6e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d019fac0 con 0x7f59d0101dc0 2024-09-13T16:08:05.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.364+0000 7f59d6e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d019fc80 con 0x7f59d0102fb0 2024-09-13T16:08:05.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.364+0000 7f59d5000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59d0102fb0 0x7f59d01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:05.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.364+0000 7f59d6400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59d0103970 0x7f59d019f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:05.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.364+0000 7f59d5a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59d0101dc0 0x7f59d0197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:05.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.364+0000 7f59d5000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59d0102fb0 0x7f59d01983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:52732/0 (socket says 172.21.15.86:52732) 2024-09-13T16:08:05.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.364+0000 7f59d5000640 1 -- 172.21.15.86:0/2610512045 learned_addr learned my addr 172.21.15.86:0/2610512045 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:05.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.365+0000 7f59d5000640 1 -- 172.21.15.86:0/2610512045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59d0101dc0 msgr2=0x7f59d0197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:05.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.365+0000 7f59d5000640 1 --2- 172.21.15.86:0/2610512045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59d0101dc0 0x7f59d0197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:05.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.365+0000 7f59d5000640 1 -- 172.21.15.86:0/2610512045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59d0103970 msgr2=0x7f59d019f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:05.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.365+0000 7f59d5000640 1 --2- 172.21.15.86:0/2610512045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59d0103970 0x7f59d019f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:05.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.365+0000 7f59d5000640 1 -- 172.21.15.86:0/2610512045 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c8009900 con 0x7f59d0102fb0 2024-09-13T16:08:05.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.365+0000 7f59d6400640 1 --2- 172.21.15.86:0/2610512045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59d0103970 0x7f59d019f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:05.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.365+0000 7f59d5000640 1 --2- 172.21.15.86:0/2610512045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59d0102fb0 0x7f59d01983f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00e9f0 tx=0x7f59bc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:05.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.365+0000 7f59ce000640 1 -- 172.21.15.86:0/2610512045 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc009720 con 0x7f59d0102fb0 2024-09-13T16:08:05.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.365+0000 7f59ce000640 1 -- 172.21.15.86:0/2610512045 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f59bc00cd80 con 0x7f59d0102fb0 2024-09-13T16:08:05.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.365+0000 7f59d6e00640 1 -- 172.21.15.86:0/2610512045 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d019ff60 con 0x7f59d0102fb0 2024-09-13T16:08:05.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.365+0000 7f59ce000640 1 -- 172.21.15.86:0/2610512045 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc010690 con 0x7f59d0102fb0 2024-09-13T16:08:05.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.365+0000 7f59d6e00640 1 -- 172.21.15.86:0/2610512045 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d01a0390 con 0x7f59d0102fb0 2024-09-13T16:08:05.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.366+0000 7f59d6e00640 1 -- 172.21.15.86:0/2610512045 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d01091b0 con 0x7f59d0102fb0 2024-09-13T16:08:05.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.368+0000 7f59ce000640 1 -- 172.21.15.86:0/2610512045 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f59bc0046c0 con 0x7f59d0102fb0 2024-09-13T16:08:05.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.369+0000 7f59ce000640 1 --2- 172.21.15.86:0/2610512045 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f59b80a1110 0x7f59b80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:05.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.369+0000 7f59ce000640 1 -- 172.21.15.86:0/2610512045 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f59bc014070 con 0x7f59d0102fb0 2024-09-13T16:08:05.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.370+0000 7f59d5a00640 1 --2- 172.21.15.86:0/2610512045 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f59b80a1110 0x7f59b80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:05.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.370+0000 7f59d5a00640 1 --2- 172.21.15.86:0/2610512045 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f59b80a1110 0x7f59b80a35d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f59d0102e10 tx=0x7f59c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:05.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.372+0000 7f59ce000640 1 -- 172.21.15.86:0/2610512045 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f59bc096b40 con 0x7f59d0102fb0 2024-09-13T16:08:05.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.627+0000 7f59d6e00640 1 -- 172.21.15.86:0/2610512045 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59d010d850 con 0x7f59d0102fb0 2024-09-13T16:08:05.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.628+0000 7f59ce000640 1 -- 172.21.15.86:0/2610512045 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9607 (secure 0 0 0) 0x7f59bc09a160 con 0x7f59d0102fb0 2024-09-13T16:08:05.630 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:05.630 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14508,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1509120923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1509120923},{"type":"v1","addr":"172.21.15.86:6839","nonce":1509120923}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6841/1971775519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":1971775519},{"type":"v1","addr":"172.21.15.86:6841","nonce":1971775519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1370900762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1370900762},{"type":"v1","addr":"172.21.15.194:6835","nonce":1370900762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2460451799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":2460451799},{"type":"v1","addr":"172.21.15.194:6837","nonce":2460451799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24530,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2399531832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2399531832},{"type":"v1","addr":"172.21.15.139:6837","nonce":2399531832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24544,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/3799859182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3799859182},{"type":"v1","addr":"172.21.15.194:6839","nonce":3799859182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/3370280063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3370280063},{"type":"v1","addr":"172.21.15.139:6839","nonce":3370280063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2024-09-13T16:08:05.630 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 13 2024-09-13T16:08:05.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.630+0000 7f59d6e00640 1 -- 172.21.15.86:0/2610512045 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f59b80a1110 msgr2=0x7f59b80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:05.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.630+0000 7f59d6e00640 1 --2- 172.21.15.86:0/2610512045 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f59b80a1110 0x7f59b80a35d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f59d0102e10 tx=0x7f59c4005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:05.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.630+0000 7f59d6e00640 1 -- 172.21.15.86:0/2610512045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59d0102fb0 msgr2=0x7f59d01983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.630+0000 7f59d6e00640 1 --2- 172.21.15.86:0/2610512045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59d0102fb0 0x7f59d01983f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00e9f0 tx=0x7f59bc00edf0 comp rx=0 tx=0).stop 2024-09-13T16:08:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.631+0000 7f59d6e00640 1 -- 172.21.15.86:0/2610512045 shutdown_connections 2024-09-13T16:08:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.631+0000 7f59d6e00640 1 --2- 172.21.15.86:0/2610512045 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f59b80a1110 0x7f59b80a35d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.631+0000 7f59d6e00640 1 --2- 172.21.15.86:0/2610512045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59d0103970 0x7f59d019f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.631+0000 7f59d6e00640 1 --2- 172.21.15.86:0/2610512045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59d0102fb0 0x7f59d01983f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.631+0000 7f59d6e00640 1 --2- 172.21.15.86:0/2610512045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59d0101dc0 0x7f59d0197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.631+0000 7f59d6e00640 1 -- 172.21.15.86:0/2610512045 >> 172.21.15.86:0/2610512045 conn(0x7f59d00fd540 msgr2=0x7f59d0106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.631+0000 7f59d6e00640 1 -- 172.21.15.86:0/2610512045 shutdown_connections 2024-09-13T16:08:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.631+0000 7f59d6e00640 1 -- 172.21.15.86:0/2610512045 wait complete. 2024-09-13T16:08:05.654 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:08:05.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.829+0000 7f80b3c00640 1 -- 172.21.15.86:0/1176128798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80ac101fb0 msgr2=0x7f80ac1023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:05.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.829+0000 7f80b3c00640 1 --2- 172.21.15.86:0/1176128798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80ac101fb0 0x7f80ac1023b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009900 tx=0x7f80a002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:08:05.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.829+0000 7f80b3c00640 1 -- 172.21.15.86:0/1176128798 shutdown_connections 2024-09-13T16:08:05.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.829+0000 7f80b3c00640 1 --2- 172.21.15.86:0/1176128798 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80ac103b60 0x7f80ac10a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:05.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.829+0000 7f80b3c00640 1 --2- 172.21.15.86:0/1176128798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80ac1031a0 0x7f80ac103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:05.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.829+0000 7f80b3c00640 1 --2- 172.21.15.86:0/1176128798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80ac101fb0 0x7f80ac1023b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:05.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.829+0000 7f80b3c00640 1 -- 172.21.15.86:0/1176128798 >> 172.21.15.86:0/1176128798 conn(0x7f80ac0fd730 msgr2=0x7f80ac0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:05.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.829+0000 7f80b3c00640 1 -- 172.21.15.86:0/1176128798 shutdown_connections 2024-09-13T16:08:05.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.829+0000 7f80b3c00640 1 -- 172.21.15.86:0/1176128798 wait complete. 2024-09-13T16:08:05.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.830+0000 7f80b3c00640 1 Processor -- start 2024-09-13T16:08:05.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.830+0000 7f80b3c00640 1 -- start start 2024-09-13T16:08:05.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.830+0000 7f80b3c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80ac101fb0 0x7f80ac198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:05.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.831+0000 7f80b3c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80ac1031a0 0x7f80ac198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:05.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.831+0000 7f80b3c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80ac103b60 0x7f80ac19f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:05.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.831+0000 7f80b3c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac19fb10 con 0x7f80ac101fb0 2024-09-13T16:08:05.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.831+0000 7f80b3c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac19fc80 con 0x7f80ac1031a0 2024-09-13T16:08:05.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.831+0000 7f80b3c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac19fe40 con 0x7f80ac103b60 2024-09-13T16:08:05.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.831+0000 7f80b1200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80ac101fb0 0x7f80ac198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:05.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.831+0000 7f80b1200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80ac101fb0 0x7f80ac198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39508/0 (socket says 172.21.15.86:39508) 2024-09-13T16:08:05.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.831+0000 7f80b1200640 1 -- 172.21.15.86:0/190763530 learned_addr learned my addr 172.21.15.86:0/190763530 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:05.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.831+0000 7f80abe00640 1 --2- 172.21.15.86:0/190763530 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80ac1031a0 0x7f80ac198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:05.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.831+0000 7f80b1c00640 1 --2- 172.21.15.86:0/190763530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80ac103b60 0x7f80ac19f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:05.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.831+0000 7f80b1200640 1 -- 172.21.15.86:0/190763530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80ac103b60 msgr2=0x7f80ac19f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:05.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.831+0000 7f80b1200640 1 --2- 172.21.15.86:0/190763530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80ac103b60 0x7f80ac19f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:05.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.831+0000 7f80b1200640 1 -- 172.21.15.86:0/190763530 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80ac1031a0 msgr2=0x7f80ac198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:05.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.831+0000 7f80b1200640 1 --2- 172.21.15.86:0/190763530 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80ac1031a0 0x7f80ac198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:05.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.831+0000 7f80b1200640 1 -- 172.21.15.86:0/190763530 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a0009560 con 0x7f80ac101fb0 2024-09-13T16:08:05.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.831+0000 7f80abe00640 1 --2- 172.21.15.86:0/190763530 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80ac1031a0 0x7f80ac198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:05.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.831+0000 7f80b1c00640 1 --2- 172.21.15.86:0/190763530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80ac103b60 0x7f80ac19f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:05.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.832+0000 7f80b1200640 1 --2- 172.21.15.86:0/190763530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80ac101fb0 0x7f80ac198020 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f80a0031510 tx=0x7f80a00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:05.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.832+0000 7f80a9600640 1 -- 172.21.15.86:0/190763530 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0004b50 con 0x7f80ac101fb0 2024-09-13T16:08:05.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.832+0000 7f80a9600640 1 -- 172.21.15.86:0/190763530 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f80a0004cb0 con 0x7f80ac101fb0 2024-09-13T16:08:05.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.832+0000 7f80a9600640 1 -- 172.21.15.86:0/190763530 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0031ba0 con 0x7f80ac101fb0 2024-09-13T16:08:05.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.832+0000 7f80b3c00640 1 -- 172.21.15.86:0/190763530 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ac1a00c0 con 0x7f80ac101fb0 2024-09-13T16:08:05.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.832+0000 7f80b3c00640 1 -- 172.21.15.86:0/190763530 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ac1a0520 con 0x7f80ac101fb0 2024-09-13T16:08:05.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.833+0000 7f80b3c00640 1 -- 172.21.15.86:0/190763530 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ac109440 con 0x7f80ac101fb0 2024-09-13T16:08:05.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.835+0000 7f80a9600640 1 -- 172.21.15.86:0/190763530 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f80a0031d00 con 0x7f80ac101fb0 2024-09-13T16:08:05.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.837+0000 7f80a9600640 1 --2- 172.21.15.86:0/190763530 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f80940a1110 0x7f80940a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:05.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.837+0000 7f80a9600640 1 -- 172.21.15.86:0/190763530 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f80a00ed310 con 0x7f80ac101fb0 2024-09-13T16:08:05.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.837+0000 7f80abe00640 1 --2- 172.21.15.86:0/190763530 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f80940a1110 0x7f80940a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:05.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.838+0000 7f80abe00640 1 --2- 172.21.15.86:0/190763530 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f80940a1110 0x7f80940a35d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f80ac199530 tx=0x7f8098005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:05.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:05.841+0000 7f80a9600640 1 -- 172.21.15.86:0/190763530 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f80a00b6f50 con 0x7f80ac101fb0 2024-09-13T16:08:05.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:05 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] up:boot 2024-09-13T16:08:05.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:05 smithi139 ceph-mon[35320]: fsmap 12 up:standby 2024-09-13T16:08:05.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T16:08:05.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:05 smithi139 ceph-mon[35320]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:08:05.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:05.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:05 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:05.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:05 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2610512045' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:08:06.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:05 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] up:boot 2024-09-13T16:08:06.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:05 smithi194 ceph-mon[35694]: fsmap 12 up:standby 2024-09-13T16:08:06.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T16:08:06.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:05 smithi194 ceph-mon[35694]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:08:06.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:05 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:05 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2610512045' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:08:06.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.059+0000 7f80b3c00640 1 -- 172.21.15.86:0/190763530 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80ac10da00 con 0x7f80ac101fb0 2024-09-13T16:08:06.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.060+0000 7f80a9600640 1 -- 172.21.15.86:0/190763530 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18411 (secure 0 0 0) 0x7f80a00ba570 con 0x7f80ac101fb0 2024-09-13T16:08:06.062 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:06.063 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":82,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:07:17.532611+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:08:06.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.063+0000 7f80b3c00640 1 -- 172.21.15.86:0/190763530 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f80940a1110 msgr2=0x7f80940a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:06.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.063+0000 7f80b3c00640 1 --2- 172.21.15.86:0/190763530 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f80940a1110 0x7f80940a35d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f80ac199530 tx=0x7f8098005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:06.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.063+0000 7f80b3c00640 1 -- 172.21.15.86:0/190763530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80ac101fb0 msgr2=0x7f80ac198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:06.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.063+0000 7f80b3c00640 1 --2- 172.21.15.86:0/190763530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80ac101fb0 0x7f80ac198020 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f80a0031510 tx=0x7f80a00055a0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.063+0000 7f80b3c00640 1 -- 172.21.15.86:0/190763530 shutdown_connections 2024-09-13T16:08:06.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.063+0000 7f80b3c00640 1 --2- 172.21.15.86:0/190763530 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f80940a1110 0x7f80940a35d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.063+0000 7f80b3c00640 1 --2- 172.21.15.86:0/190763530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80ac103b60 0x7f80ac19f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.063+0000 7f80b3c00640 1 --2- 172.21.15.86:0/190763530 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80ac1031a0 0x7f80ac198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.063+0000 7f80b3c00640 1 --2- 172.21.15.86:0/190763530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80ac101fb0 0x7f80ac198020 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.063+0000 7f80b3c00640 1 -- 172.21.15.86:0/190763530 >> 172.21.15.86:0/190763530 conn(0x7f80ac0fd730 msgr2=0x7f80ac106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:06.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.063+0000 7f80b3c00640 1 -- 172.21.15.86:0/190763530 shutdown_connections 2024-09-13T16:08:06.066 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.063+0000 7f80b3c00640 1 -- 172.21.15.86:0/190763530 wait complete. 2024-09-13T16:08:06.078 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:05 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] up:boot 2024-09-13T16:08:06.078 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:05 smithi086 ceph-mon[30379]: fsmap 12 up:standby 2024-09-13T16:08:06.078 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T16:08:06.078 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:05 smithi086 ceph-mon[30379]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:08:06.078 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.079 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:05 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.079 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:05 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2610512045' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:08:06.081 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:03:27.830423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:08:06.082 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:08:06.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.252+0000 7f2215c00640 1 -- 172.21.15.86:0/1581861933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22100fe660 msgr2=0x7f22100fea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:06.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.252+0000 7f2215c00640 1 --2- 172.21.15.86:0/1581861933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22100fe660 0x7f22100fea60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2200009900 tx=0x7f220002a410 comp rx=0 tx=0).stop 2024-09-13T16:08:06.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.252+0000 7f2215c00640 1 -- 172.21.15.86:0/1581861933 shutdown_connections 2024-09-13T16:08:06.254 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.252+0000 7f2215c00640 1 --2- 172.21.15.86:0/1581861933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22100ff940 0x7f22100ffdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.252+0000 7f2215c00640 1 --2- 172.21.15.86:0/1581861933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22100fefa0 0x7f22100ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.252+0000 7f2215c00640 1 --2- 172.21.15.86:0/1581861933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22100fe660 0x7f22100fea60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.252+0000 7f2215c00640 1 -- 172.21.15.86:0/1581861933 >> 172.21.15.86:0/1581861933 conn(0x7f22100fa3d0 msgr2=0x7f22100fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:06.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.252+0000 7f2215c00640 1 -- 172.21.15.86:0/1581861933 shutdown_connections 2024-09-13T16:08:06.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.252+0000 7f2215c00640 1 -- 172.21.15.86:0/1581861933 wait complete. 2024-09-13T16:08:06.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.253+0000 7f2215c00640 1 Processor -- start 2024-09-13T16:08:06.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.253+0000 7f2215c00640 1 -- start start 2024-09-13T16:08:06.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.254+0000 7f2215c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22100fe660 0x7f2210198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:06.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.254+0000 7f2215c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22100fefa0 0x7f22101985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:06.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.254+0000 7f2215c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22100ff940 0x7f221019f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:06.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.254+0000 7f2215c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221019fb60 con 0x7f22100ff940 2024-09-13T16:08:06.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.254+0000 7f2215c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221019fcd0 con 0x7f22100fe660 2024-09-13T16:08:06.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.254+0000 7f2215c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221019fe90 con 0x7f22100fefa0 2024-09-13T16:08:06.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.254+0000 7f220f400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22100ff940 0x7f221019f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:06.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.254+0000 7f220e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22100fefa0 0x7f22101985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:06.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.254+0000 7f220f400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22100ff940 0x7f221019f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39534/0 (socket says 172.21.15.86:39534) 2024-09-13T16:08:06.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.254+0000 7f220f400640 1 -- 172.21.15.86:0/88717750 learned_addr learned my addr 172.21.15.86:0/88717750 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:06.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.254+0000 7f220ea00640 1 --2- 172.21.15.86:0/88717750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22100fe660 0x7f2210198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:06.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.254+0000 7f220f400640 1 -- 172.21.15.86:0/88717750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22100fefa0 msgr2=0x7f22101985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:06.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.254+0000 7f220f400640 1 --2- 172.21.15.86:0/88717750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22100fefa0 0x7f22101985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.255+0000 7f220f400640 1 -- 172.21.15.86:0/88717750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22100fe660 msgr2=0x7f2210198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:06.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.255+0000 7f220f400640 1 --2- 172.21.15.86:0/88717750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22100fe660 0x7f2210198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.255+0000 7f220f400640 1 -- 172.21.15.86:0/88717750 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc009490 con 0x7f22100ff940 2024-09-13T16:08:06.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.255+0000 7f220e000640 1 --2- 172.21.15.86:0/88717750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22100fefa0 0x7f22101985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:06.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.255+0000 7f220f400640 1 --2- 172.21.15.86:0/88717750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22100ff940 0x7f221019f620 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f220800eb10 tx=0x7f220800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:06.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.255+0000 7f2207400640 1 -- 172.21.15.86:0/88717750 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208004b20 con 0x7f22100ff940 2024-09-13T16:08:06.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.255+0000 7f2207400640 1 -- 172.21.15.86:0/88717750 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2208004c80 con 0x7f22100ff940 2024-09-13T16:08:06.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.255+0000 7f2215c00640 1 -- 172.21.15.86:0/88717750 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2200009560 con 0x7f22100ff940 2024-09-13T16:08:06.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.255+0000 7f2207400640 1 -- 172.21.15.86:0/88717750 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208010650 con 0x7f22100ff940 2024-09-13T16:08:06.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.255+0000 7f2215c00640 1 -- 172.21.15.86:0/88717750 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22101a0540 con 0x7f22100ff940 2024-09-13T16:08:06.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.256+0000 7f2215c00640 1 -- 172.21.15.86:0/88717750 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2210109540 con 0x7f22100ff940 2024-09-13T16:08:06.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.259+0000 7f2207400640 1 -- 172.21.15.86:0/88717750 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2208005020 con 0x7f22100ff940 2024-09-13T16:08:06.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.260+0000 7f2207400640 1 --2- 172.21.15.86:0/88717750 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f21f40a1110 0x7f21f40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:06.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.261+0000 7f2207400640 1 -- 172.21.15.86:0/88717750 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2208014070 con 0x7f22100ff940 2024-09-13T16:08:06.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.261+0000 7f220ea00640 1 --2- 172.21.15.86:0/88717750 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f21f40a1110 0x7f21f40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:06.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.261+0000 7f220ea00640 1 --2- 172.21.15.86:0/88717750 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f21f40a1110 0x7f21f40a35d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2200005ab0 tx=0x7f2200005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:06.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.264+0000 7f2207400640 1 -- 172.21.15.86:0/88717750 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2208096560 con 0x7f22100ff940 2024-09-13T16:08:06.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.444+0000 7f2215c00640 1 -- 172.21.15.86:0/88717750 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f221002c3e0 con 0x7f22100ff940 2024-09-13T16:08:06.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.444+0000 7f2207400640 1 -- 172.21.15.86:0/88717750 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2208099b80 con 0x7f22100ff940 2024-09-13T16:08:06.446 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-09-13T16:08:06.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.446+0000 7f2215c00640 1 -- 172.21.15.86:0/88717750 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f21f40a1110 msgr2=0x7f21f40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:06.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.446+0000 7f2215c00640 1 --2- 172.21.15.86:0/88717750 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f21f40a1110 0x7f21f40a35d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2200005ab0 tx=0x7f2200005a20 comp rx=0 tx=0).stop 2024-09-13T16:08:06.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.447+0000 7f2215c00640 1 -- 172.21.15.86:0/88717750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22100ff940 msgr2=0x7f221019f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:06.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.447+0000 7f2215c00640 1 --2- 172.21.15.86:0/88717750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22100ff940 0x7f221019f620 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f220800eb10 tx=0x7f220800c2d0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.447+0000 7f2215c00640 1 -- 172.21.15.86:0/88717750 shutdown_connections 2024-09-13T16:08:06.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.447+0000 7f2215c00640 1 --2- 172.21.15.86:0/88717750 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f21f40a1110 0x7f21f40a35d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.447+0000 7f2215c00640 1 --2- 172.21.15.86:0/88717750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22100ff940 0x7f221019f620 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.447+0000 7f2215c00640 1 --2- 172.21.15.86:0/88717750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22100fefa0 0x7f22101985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.447+0000 7f2215c00640 1 --2- 172.21.15.86:0/88717750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22100fe660 0x7f2210198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.447+0000 7f2215c00640 1 -- 172.21.15.86:0/88717750 >> 172.21.15.86:0/88717750 conn(0x7f22100fa3d0 msgr2=0x7f22100fbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:06.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.447+0000 7f2215c00640 1 -- 172.21.15.86:0/88717750 shutdown_connections 2024-09-13T16:08:06.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.447+0000 7f2215c00640 1 -- 172.21.15.86:0/88717750 wait complete. 2024-09-13T16:08:06.467 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T16:08:06.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.623+0000 7ff5acc00640 1 -- 172.21.15.86:0/527760810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a8101720 msgr2=0x7ff5a8107fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:06.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.623+0000 7ff5acc00640 1 --2- 172.21.15.86:0/527760810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a8101720 0x7ff5a8107fb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009ca0 tx=0x7ff5a002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.623+0000 7ff5acc00640 1 -- 172.21.15.86:0/527760810 shutdown_connections 2024-09-13T16:08:06.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.623+0000 7ff5acc00640 1 --2- 172.21.15.86:0/527760810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a8101720 0x7ff5a8107fb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.623+0000 7ff5acc00640 1 --2- 172.21.15.86:0/527760810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5a8100d60 0x7ff5a81011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.623+0000 7ff5acc00640 1 --2- 172.21.15.86:0/527760810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5a80ffb70 0x7ff5a80fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.623+0000 7ff5acc00640 1 -- 172.21.15.86:0/527760810 >> 172.21.15.86:0/527760810 conn(0x7ff5a80fb2f0 msgr2=0x7ff5a80fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:06.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.623+0000 7ff5acc00640 1 -- 172.21.15.86:0/527760810 shutdown_connections 2024-09-13T16:08:06.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.623+0000 7ff5acc00640 1 -- 172.21.15.86:0/527760810 wait complete. 2024-09-13T16:08:06.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.624+0000 7ff5acc00640 1 Processor -- start 2024-09-13T16:08:06.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.624+0000 7ff5acc00640 1 -- start start 2024-09-13T16:08:06.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.625+0000 7ff5acc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5a80ffb70 0x7ff5a8197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:06.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.625+0000 7ff5acc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a8100d60 0x7ff5a8198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:06.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.625+0000 7ff5acc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5a8101720 0x7ff5a819f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:06.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.625+0000 7ff5acc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a819f910 con 0x7ff5a80ffb70 2024-09-13T16:08:06.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.625+0000 7ff5acc00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a819fa80 con 0x7ff5a8100d60 2024-09-13T16:08:06.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.625+0000 7ff5acc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a819fc40 con 0x7ff5a8101720 2024-09-13T16:08:06.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.625+0000 7ff5a7400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5a80ffb70 0x7ff5a8197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:06.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.625+0000 7ff59fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a8100d60 0x7ff5a8198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:06.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.625+0000 7ff5a7400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5a80ffb70 0x7ff5a8197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39558/0 (socket says 172.21.15.86:39558) 2024-09-13T16:08:06.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.625+0000 7ff5a7400640 1 -- 172.21.15.86:0/2274383886 learned_addr learned my addr 172.21.15.86:0/2274383886 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:06.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.625+0000 7ff5a7e00640 1 --2- 172.21.15.86:0/2274383886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5a8101720 0x7ff5a819f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:06.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.625+0000 7ff59fe00640 1 -- 172.21.15.86:0/2274383886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5a8101720 msgr2=0x7ff5a819f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:06.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.625+0000 7ff59fe00640 1 --2- 172.21.15.86:0/2274383886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5a8101720 0x7ff5a819f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.625+0000 7ff59fe00640 1 -- 172.21.15.86:0/2274383886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5a80ffb70 msgr2=0x7ff5a8197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:06.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.625+0000 7ff59fe00640 1 --2- 172.21.15.86:0/2274383886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5a80ffb70 0x7ff5a8197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.625+0000 7ff59fe00640 1 -- 172.21.15.86:0/2274383886 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff598009490 con 0x7ff5a8100d60 2024-09-13T16:08:06.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.626+0000 7ff5a7400640 1 --2- 172.21.15.86:0/2274383886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5a80ffb70 0x7ff5a8197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:06.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.626+0000 7ff59fe00640 1 --2- 172.21.15.86:0/2274383886 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a8100d60 0x7ff5a8198360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff59000e9f0 tx=0x7ff59000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:06.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.626+0000 7ff5a4c00640 1 -- 172.21.15.86:0/2274383886 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59000ccc0 con 0x7ff5a8100d60 2024-09-13T16:08:06.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.626+0000 7ff5a4c00640 1 -- 172.21.15.86:0/2274383886 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff59000ce20 con 0x7ff5a8100d60 2024-09-13T16:08:06.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.626+0000 7ff5acc00640 1 -- 172.21.15.86:0/2274383886 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a0009900 con 0x7ff5a8100d60 2024-09-13T16:08:06.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.626+0000 7ff5a4c00640 1 -- 172.21.15.86:0/2274383886 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590018920 con 0x7ff5a8100d60 2024-09-13T16:08:06.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.626+0000 7ff5acc00640 1 -- 172.21.15.86:0/2274383886 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a81a0240 con 0x7ff5a8100d60 2024-09-13T16:08:06.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.627+0000 7ff5acc00640 1 -- 172.21.15.86:0/2274383886 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a810b600 con 0x7ff5a8100d60 2024-09-13T16:08:06.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.630+0000 7ff5a4c00640 1 -- 172.21.15.86:0/2274383886 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff590018a80 con 0x7ff5a8100d60 2024-09-13T16:08:06.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.631+0000 7ff5a4c00640 1 --2- 172.21.15.86:0/2274383886 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff58c0a1090 0x7ff58c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:06.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.631+0000 7ff5a4c00640 1 -- 172.21.15.86:0/2274383886 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff590014070 con 0x7ff5a8100d60 2024-09-13T16:08:06.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.631+0000 7ff5a7400640 1 --2- 172.21.15.86:0/2274383886 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff58c0a1090 0x7ff58c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:06.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.632+0000 7ff5a7400640 1 --2- 172.21.15.86:0/2274383886 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff58c0a1090 0x7ff58c0a3550 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff5980058c0 tx=0x7ff598005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:06.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.635+0000 7ff5a4c00640 1 -- 172.21.15.86:0/2274383886 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff590052e20 con 0x7ff5a8100d60 2024-09-13T16:08:06.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.834+0000 7ff5acc00640 1 -- 172.21.15.86:0/2274383886 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff5a810b840 con 0x7ff5a8100d60 2024-09-13T16:08:06.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.835+0000 7ff5a4c00640 1 -- 172.21.15.86:0/2274383886 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff590099e70 con 0x7ff5a8100d60 2024-09-13T16:08:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:06.837 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2024-09-13T16:08:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:08:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "poolnum": 1, 2024-09-13T16:08:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "poolname": ".mgr" 2024-09-13T16:08:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:08:06.837 INFO:teuthology.orchestra.run.smithi086.stdout:] 2024-09-13T16:08:06.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.838+0000 7ff5acc00640 1 -- 172.21.15.86:0/2274383886 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff58c0a1090 msgr2=0x7ff58c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:06.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.838+0000 7ff5acc00640 1 --2- 172.21.15.86:0/2274383886 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff58c0a1090 0x7ff58c0a3550 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff5980058c0 tx=0x7ff598005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:06.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.838+0000 7ff5acc00640 1 -- 172.21.15.86:0/2274383886 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a8100d60 msgr2=0x7ff5a8198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:06.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.838+0000 7ff5acc00640 1 --2- 172.21.15.86:0/2274383886 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a8100d60 0x7ff5a8198360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff59000e9f0 tx=0x7ff59000eeb0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.838+0000 7ff5acc00640 1 -- 172.21.15.86:0/2274383886 shutdown_connections 2024-09-13T16:08:06.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.838+0000 7ff5acc00640 1 --2- 172.21.15.86:0/2274383886 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff58c0a1090 0x7ff58c0a3550 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.838+0000 7ff5acc00640 1 --2- 172.21.15.86:0/2274383886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5a8101720 0x7ff5a819f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.838+0000 7ff5acc00640 1 --2- 172.21.15.86:0/2274383886 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a8100d60 0x7ff5a8198360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.839+0000 7ff5acc00640 1 --2- 172.21.15.86:0/2274383886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5a80ffb70 0x7ff5a8197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:06.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.839+0000 7ff5acc00640 1 -- 172.21.15.86:0/2274383886 >> 172.21.15.86:0/2274383886 conn(0x7ff5a80fb2f0 msgr2=0x7ff5a80726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:06.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.839+0000 7ff5acc00640 1 -- 172.21.15.86:0/2274383886 shutdown_connections 2024-09-13T16:08:06.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:06.839+0000 7ff5acc00640 1 -- 172.21.15.86:0/2274383886 wait complete. 2024-09-13T16:08:06.856 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:06 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.856 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:06 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.857 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:06 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/190763530' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:06.857 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:06 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.857 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:06 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.857 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:06 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:08:06.857 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:06 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:08:06.857 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:06 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.857 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:06 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:08:06.857 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:06 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/88717750' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:08:06.859 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T16:08:06.859 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T16:08:06.964 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:06 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.964 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:06 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.964 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:06 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/190763530' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:06.964 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:06 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.964 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:06 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.964 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:06 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:08:06.964 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:06 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:08:06.965 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:06 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.965 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:06 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:08:06.965 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:06 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/88717750' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:08:06.965 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:06 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.965 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:06 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.965 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:06 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/190763530' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:06.965 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:06 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:06 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:06 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:08:06.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:06 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:08:06.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:06 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:06.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:06 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:08:06.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:06 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/88717750' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:08:07.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.028+0000 7f2716e00640 1 -- 172.21.15.86:0/3363983691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2710101ea0 msgr2=0x7f27101022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:07.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.028+0000 7f2716e00640 1 --2- 172.21.15.86:0/3363983691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2710101ea0 0x7f27101022a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2704009900 tx=0x7f270402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:08:07.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.028+0000 7f2716e00640 1 -- 172.21.15.86:0/3363983691 shutdown_connections 2024-09-13T16:08:07.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.028+0000 7f2716e00640 1 --2- 172.21.15.86:0/3363983691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2710103a40 0x7f271010a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:07.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.028+0000 7f2716e00640 1 --2- 172.21.15.86:0/3363983691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2710103080 0x7f2710103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:07.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.028+0000 7f2716e00640 1 --2- 172.21.15.86:0/3363983691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2710101ea0 0x7f27101022a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:07.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.028+0000 7f2716e00640 1 -- 172.21.15.86:0/3363983691 >> 172.21.15.86:0/3363983691 conn(0x7f27100fd650 msgr2=0x7f27100ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:07.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.028+0000 7f2716e00640 1 -- 172.21.15.86:0/3363983691 shutdown_connections 2024-09-13T16:08:07.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.028+0000 7f2716e00640 1 -- 172.21.15.86:0/3363983691 wait complete. 2024-09-13T16:08:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.029+0000 7f2716e00640 1 Processor -- start 2024-09-13T16:08:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.029+0000 7f2716e00640 1 -- start start 2024-09-13T16:08:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.030+0000 7f2716e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2710101ea0 0x7f2710197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.030+0000 7f2716e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2710103080 0x7f27101984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.030+0000 7f2716e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2710103a40 0x7f271019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.030+0000 7f2716e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271019fa70 con 0x7f2710101ea0 2024-09-13T16:08:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.030+0000 7f2716e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271019fbe0 con 0x7f2710103a40 2024-09-13T16:08:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.030+0000 7f2716e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271019fda0 con 0x7f2710103080 2024-09-13T16:08:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.030+0000 7f2715a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2710101ea0 0x7f2710197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.030+0000 7f2715000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2710103080 0x7f27101984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.030+0000 7f2715a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2710101ea0 0x7f2710197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39578/0 (socket says 172.21.15.86:39578) 2024-09-13T16:08:07.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.030+0000 7f2715a00640 1 -- 172.21.15.86:0/2546231538 learned_addr learned my addr 172.21.15.86:0/2546231538 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:07.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.030+0000 7f2716400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2710103a40 0x7f271019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:07.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.030+0000 7f2715000640 1 -- 172.21.15.86:0/2546231538 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2710103a40 msgr2=0x7f271019f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:07.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.030+0000 7f2715000640 1 --2- 172.21.15.86:0/2546231538 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2710103a40 0x7f271019f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:07.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.030+0000 7f2715000640 1 -- 172.21.15.86:0/2546231538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2710101ea0 msgr2=0x7f2710197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:07.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.030+0000 7f2715000640 1 --2- 172.21.15.86:0/2546231538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2710101ea0 0x7f2710197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:07.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.030+0000 7f2715000640 1 -- 172.21.15.86:0/2546231538 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc009490 con 0x7f2710103080 2024-09-13T16:08:07.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.031+0000 7f2715000640 1 --2- 172.21.15.86:0/2546231538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2710103080 0x7f27101984c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00e9f0 tx=0x7f26fc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:07.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.031+0000 7f270e000640 1 -- 172.21.15.86:0/2546231538 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc00cd80 con 0x7f2710103080 2024-09-13T16:08:07.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.031+0000 7f270e000640 1 -- 172.21.15.86:0/2546231538 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f26fc0035f0 con 0x7f2710103080 2024-09-13T16:08:07.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.031+0000 7f2716e00640 1 -- 172.21.15.86:0/2546231538 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2704009560 con 0x7f2710103080 2024-09-13T16:08:07.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.031+0000 7f270e000640 1 -- 172.21.15.86:0/2546231538 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc010690 con 0x7f2710103080 2024-09-13T16:08:07.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.031+0000 7f2716e00640 1 -- 172.21.15.86:0/2546231538 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27101a0400 con 0x7f2710103080 2024-09-13T16:08:07.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.032+0000 7f2716e00640 1 -- 172.21.15.86:0/2546231538 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27101093b0 con 0x7f2710103080 2024-09-13T16:08:07.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.034+0000 7f270e000640 1 -- 172.21.15.86:0/2546231538 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f26fc003af0 con 0x7f2710103080 2024-09-13T16:08:07.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.036+0000 7f270e000640 1 --2- 172.21.15.86:0/2546231538 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f26f80a1090 0x7f26f80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:07.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.036+0000 7f270e000640 1 -- 172.21.15.86:0/2546231538 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f26fc014070 con 0x7f2710103080 2024-09-13T16:08:07.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.036+0000 7f2715a00640 1 --2- 172.21.15.86:0/2546231538 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f26f80a1090 0x7f26f80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:07.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.036+0000 7f2715a00640 1 --2- 172.21.15.86:0/2546231538 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f26f80a1090 0x7f26f80a3550 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2704000c00 tx=0x7f27040058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:07.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.038+0000 7f270e000640 1 -- 172.21.15.86:0/2546231538 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f26fc0966c0 con 0x7f2710103080 2024-09-13T16:08:07.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.210+0000 7f2716e00640 1 -- 172.21.15.86:0/2546231538 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f271010d910 con 0x7f2710103080 2024-09-13T16:08:07.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.790+0000 7f270e000640 1 -- 172.21.15.86:0/2546231538 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) v1 ==== 138+0+0 (secure 0 0 0) 0x7f26fc099ce0 con 0x7f2710103080 2024-09-13T16:08:07.794 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' created 2024-09-13T16:08:07.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.796+0000 7f2716e00640 1 -- 172.21.15.86:0/2546231538 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f26f80a1090 msgr2=0x7f26f80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:07.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.796+0000 7f2716e00640 1 --2- 172.21.15.86:0/2546231538 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f26f80a1090 0x7f26f80a3550 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2704000c00 tx=0x7f27040058d0 comp rx=0 tx=0).stop 2024-09-13T16:08:07.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.796+0000 7f2716e00640 1 -- 172.21.15.86:0/2546231538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2710103080 msgr2=0x7f27101984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:07.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.796+0000 7f2716e00640 1 --2- 172.21.15.86:0/2546231538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2710103080 0x7f27101984c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00e9f0 tx=0x7f26fc00eeb0 comp rx=0 tx=0).stop 2024-09-13T16:08:07.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.796+0000 7f2716e00640 1 -- 172.21.15.86:0/2546231538 shutdown_connections 2024-09-13T16:08:07.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.796+0000 7f2716e00640 1 --2- 172.21.15.86:0/2546231538 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f26f80a1090 0x7f26f80a3550 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:07.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.796+0000 7f2716e00640 1 --2- 172.21.15.86:0/2546231538 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2710103a40 0x7f271019f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:07.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.796+0000 7f2716e00640 1 --2- 172.21.15.86:0/2546231538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2710103080 0x7f27101984c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:07.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.796+0000 7f2716e00640 1 --2- 172.21.15.86:0/2546231538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2710101ea0 0x7f2710197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:07.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.796+0000 7f2716e00640 1 -- 172.21.15.86:0/2546231538 >> 172.21.15.86:0/2546231538 conn(0x7f27100fd650 msgr2=0x7f2710106580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:07.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.796+0000 7f2716e00640 1 -- 172.21.15.86:0/2546231538 shutdown_connections 2024-09-13T16:08:07.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.797+0000 7f2716e00640 1 -- 172.21.15.86:0/2546231538 wait complete. 2024-09-13T16:08:07.815 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-13T16:08:07.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.986+0000 7fc347200640 1 -- 172.21.15.86:0/183761169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc340103a50 msgr2=0x7fc34010a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:07.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.986+0000 7fc347200640 1 --2- 172.21.15.86:0/183761169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc340103a50 0x7fc34010a370 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009be0 tx=0x7fc33c02a6c0 comp rx=0 tx=0).stop 2024-09-13T16:08:07.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.986+0000 7fc347200640 1 -- 172.21.15.86:0/183761169 shutdown_connections 2024-09-13T16:08:07.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.986+0000 7fc347200640 1 --2- 172.21.15.86:0/183761169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc340103a50 0x7fc34010a370 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:07.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.986+0000 7fc347200640 1 --2- 172.21.15.86:0/183761169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc340103090 0x7fc340103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:07.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.986+0000 7fc347200640 1 --2- 172.21.15.86:0/183761169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc340101eb0 0x7fc3401022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:07.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.986+0000 7fc347200640 1 -- 172.21.15.86:0/183761169 >> 172.21.15.86:0/183761169 conn(0x7fc3400fd660 msgr2=0x7fc3400ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:07.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.987+0000 7fc347200640 1 -- 172.21.15.86:0/183761169 shutdown_connections 2024-09-13T16:08:07.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.987+0000 7fc347200640 1 -- 172.21.15.86:0/183761169 wait complete. 2024-09-13T16:08:07.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.987+0000 7fc347200640 1 Processor -- start 2024-09-13T16:08:07.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.988+0000 7fc347200640 1 -- start start 2024-09-13T16:08:07.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.988+0000 7fc347200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc340101eb0 0x7fc340197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:07.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.988+0000 7fc347200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc340103090 0x7fc340198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:07.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.988+0000 7fc347200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc340103a50 0x7fc34019f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:07.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.988+0000 7fc347200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34019fa20 con 0x7fc340103090 2024-09-13T16:08:07.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.988+0000 7fc347200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34019fb90 con 0x7fc340101eb0 2024-09-13T16:08:07.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.988+0000 7fc347200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34019fd50 con 0x7fc340103a50 2024-09-13T16:08:07.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.988+0000 7fc345400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc340103090 0x7fc340198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:07.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.988+0000 7fc345e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc340101eb0 0x7fc340197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:07.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.988+0000 7fc346800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc340103a50 0x7fc34019f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:07.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.988+0000 7fc345400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc340103090 0x7fc340198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39600/0 (socket says 172.21.15.86:39600) 2024-09-13T16:08:07.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.988+0000 7fc345e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc340101eb0 0x7fc340197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:37922/0 (socket says 172.21.15.86:37922) 2024-09-13T16:08:07.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.988+0000 7fc345400640 1 -- 172.21.15.86:0/3812962497 learned_addr learned my addr 172.21.15.86:0/3812962497 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:07.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.989+0000 7fc345e00640 1 -- 172.21.15.86:0/3812962497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc340103a50 msgr2=0x7fc34019f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:07.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.989+0000 7fc345e00640 1 --2- 172.21.15.86:0/3812962497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc340103a50 0x7fc34019f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:07.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.989+0000 7fc345e00640 1 -- 172.21.15.86:0/3812962497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc340103090 msgr2=0x7fc340198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:07.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.989+0000 7fc345e00640 1 --2- 172.21.15.86:0/3812962497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc340103090 0x7fc340198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:07.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.989+0000 7fc345e00640 1 -- 172.21.15.86:0/3812962497 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc334009490 con 0x7fc340101eb0 2024-09-13T16:08:07.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.989+0000 7fc345e00640 1 --2- 172.21.15.86:0/3812962497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc340101eb0 0x7fc340197f30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc33400e9c0 tx=0x7fc33400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:07.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.989+0000 7fc33aa00640 1 -- 172.21.15.86:0/3812962497 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33400cd80 con 0x7fc340101eb0 2024-09-13T16:08:07.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.989+0000 7fc347200640 1 -- 172.21.15.86:0/3812962497 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33c009840 con 0x7fc340101eb0 2024-09-13T16:08:07.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.989+0000 7fc33aa00640 1 -- 172.21.15.86:0/3812962497 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc334010910 con 0x7fc340101eb0 2024-09-13T16:08:07.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.989+0000 7fc33aa00640 1 -- 172.21.15.86:0/3812962497 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc334018850 con 0x7fc340101eb0 2024-09-13T16:08:07.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.989+0000 7fc347200640 1 -- 172.21.15.86:0/3812962497 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3401a02c0 con 0x7fc340101eb0 2024-09-13T16:08:07.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.990+0000 7fc347200640 1 -- 172.21.15.86:0/3812962497 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc340109370 con 0x7fc340101eb0 2024-09-13T16:08:07.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.992+0000 7fc33aa00640 1 -- 172.21.15.86:0/3812962497 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc334010a80 con 0x7fc340101eb0 2024-09-13T16:08:07.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.993+0000 7fc33aa00640 1 --2- 172.21.15.86:0/3812962497 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc3280a1090 0x7fc3280a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:07.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.993+0000 7fc33aa00640 1 -- 172.21.15.86:0/3812962497 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7497+0+0 (secure 0 0 0) 0x7fc334014070 con 0x7fc340101eb0 2024-09-13T16:08:07.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.993+0000 7fc345400640 1 --2- 172.21.15.86:0/3812962497 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc3280a1090 0x7fc3280a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:07.998 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.994+0000 7fc345400640 1 --2- 172.21.15.86:0/3812962497 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc3280a1090 0x7fc3280a3550 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc340199440 tx=0x7fc330009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:07.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:07 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2274383886' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-13T16:08:07.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:07.997+0000 7fc33aa00640 1 -- 172.21.15.86:0/3812962497 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc3340964d0 con 0x7fc340101eb0 2024-09-13T16:08:08.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:07 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2274383886' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-13T16:08:08.073 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:07 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2274383886' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-13T16:08:08.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.187+0000 7fc347200640 1 -- 172.21.15.86:0/3812962497 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fc340108de0 con 0x7fc340101eb0 2024-09-13T16:08:08.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.792+0000 7fc33aa00640 1 -- 172.21.15.86:0/3812962497 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v84) v1 ==== 171+0+0 (secure 0 0 0) 0x7fc334099af0 con 0x7fc340101eb0 2024-09-13T16:08:08.794 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' created 2024-09-13T16:08:08.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.799+0000 7fc347200640 1 -- 172.21.15.86:0/3812962497 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc3280a1090 msgr2=0x7fc3280a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:08.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.799+0000 7fc347200640 1 --2- 172.21.15.86:0/3812962497 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc3280a1090 0x7fc3280a3550 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc340199440 tx=0x7fc330009260 comp rx=0 tx=0).stop 2024-09-13T16:08:08.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.799+0000 7fc347200640 1 -- 172.21.15.86:0/3812962497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc340101eb0 msgr2=0x7fc340197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:08.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.799+0000 7fc347200640 1 --2- 172.21.15.86:0/3812962497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc340101eb0 0x7fc340197f30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc33400e9c0 tx=0x7fc33400ee80 comp rx=0 tx=0).stop 2024-09-13T16:08:08.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.799+0000 7fc347200640 1 -- 172.21.15.86:0/3812962497 shutdown_connections 2024-09-13T16:08:08.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.799+0000 7fc347200640 1 --2- 172.21.15.86:0/3812962497 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc3280a1090 0x7fc3280a3550 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc340199440 tx=0x7fc330009260 comp rx=0 tx=0).stop 2024-09-13T16:08:08.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.799+0000 7fc347200640 1 --2- 172.21.15.86:0/3812962497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc340103a50 0x7fc34019f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.799+0000 7fc347200640 1 --2- 172.21.15.86:0/3812962497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc340103090 0x7fc340198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.799+0000 7fc347200640 1 --2- 172.21.15.86:0/3812962497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc340101eb0 0x7fc340197f30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.799+0000 7fc347200640 1 -- 172.21.15.86:0/3812962497 >> 172.21.15.86:0/3812962497 conn(0x7fc3400fd660 msgr2=0x7fc340106540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:08.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.800+0000 7fc347200640 1 -- 172.21.15.86:0/3812962497 shutdown_connections 2024-09-13T16:08:08.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.800+0000 7fc347200640 1 -- 172.21.15.86:0/3812962497 wait complete. 2024-09-13T16:08:08.829 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T16:08:08.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.985+0000 7fd035c00640 1 -- 172.21.15.86:0/708854553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0300ffcf0 msgr2=0x7fd0301000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:08.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.985+0000 7fd035c00640 1 --2- 172.21.15.86:0/708854553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0300ffcf0 0x7fd0301000f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd020009900 tx=0x7fd02002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.985+0000 7fd035c00640 1 -- 172.21.15.86:0/708854553 shutdown_connections 2024-09-13T16:08:08.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.985+0000 7fd035c00640 1 --2- 172.21.15.86:0/708854553 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0301018a0 0x7fd030108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.985+0000 7fd035c00640 1 --2- 172.21.15.86:0/708854553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd030100ee0 0x7fd030101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.985+0000 7fd035c00640 1 --2- 172.21.15.86:0/708854553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0300ffcf0 0x7fd0301000f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.985+0000 7fd035c00640 1 -- 172.21.15.86:0/708854553 >> 172.21.15.86:0/708854553 conn(0x7fd0300fb450 msgr2=0x7fd0300fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:08.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.986+0000 7fd035c00640 1 -- 172.21.15.86:0/708854553 shutdown_connections 2024-09-13T16:08:08.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.986+0000 7fd035c00640 1 -- 172.21.15.86:0/708854553 wait complete. 2024-09-13T16:08:08.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.986+0000 7fd035c00640 1 Processor -- start 2024-09-13T16:08:08.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.987+0000 7fd035c00640 1 -- start start 2024-09-13T16:08:08.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.987+0000 7fd035c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0300ffcf0 0x7fd030198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.987+0000 7fd035c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd030100ee0 0x7fd030198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.987+0000 7fd035c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0301018a0 0x7fd03019f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.987+0000 7fd035c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03019faf0 con 0x7fd0301018a0 2024-09-13T16:08:08.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.987+0000 7fd035c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03019fc60 con 0x7fd030100ee0 2024-09-13T16:08:08.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.987+0000 7fd035c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03019fe20 con 0x7fd0300ffcf0 2024-09-13T16:08:08.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.987+0000 7fd035200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0301018a0 0x7fd03019f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.987+0000 7fd035200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0301018a0 0x7fd03019f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39608/0 (socket says 172.21.15.86:39608) 2024-09-13T16:08:08.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.987+0000 7fd035200640 1 -- 172.21.15.86:0/2857241490 learned_addr learned my addr 172.21.15.86:0/2857241490 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:08.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.987+0000 7fd02fe00640 1 --2- 172.21.15.86:0/2857241490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0300ffcf0 0x7fd030198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.987+0000 7fd02f400640 1 --2- 172.21.15.86:0/2857241490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd030100ee0 0x7fd030198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.987+0000 7fd035200640 1 -- 172.21.15.86:0/2857241490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0300ffcf0 msgr2=0x7fd030198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:08.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.987+0000 7fd035200640 1 --2- 172.21.15.86:0/2857241490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0300ffcf0 0x7fd030198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.987+0000 7fd035200640 1 -- 172.21.15.86:0/2857241490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd030100ee0 msgr2=0x7fd030198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:08.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.987+0000 7fd035200640 1 --2- 172.21.15.86:0/2857241490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd030100ee0 0x7fd030198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.987+0000 7fd035200640 1 -- 172.21.15.86:0/2857241490 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd020009560 con 0x7fd0301018a0 2024-09-13T16:08:08.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.988+0000 7fd035200640 1 --2- 172.21.15.86:0/2857241490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0301018a0 0x7fd03019f5b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd02800eaa0 tx=0x7fd02800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:08.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.988+0000 7fd02cc00640 1 -- 172.21.15.86:0/2857241490 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02800cdb0 con 0x7fd0301018a0 2024-09-13T16:08:08.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.988+0000 7fd02cc00640 1 -- 172.21.15.86:0/2857241490 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd028005020 con 0x7fd0301018a0 2024-09-13T16:08:08.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.988+0000 7fd02cc00640 1 -- 172.21.15.86:0/2857241490 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0280116b0 con 0x7fd0301018a0 2024-09-13T16:08:08.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.988+0000 7fd035c00640 1 -- 172.21.15.86:0/2857241490 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0301a0100 con 0x7fd0301018a0 2024-09-13T16:08:08.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.988+0000 7fd035c00640 1 -- 172.21.15.86:0/2857241490 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0301a05c0 con 0x7fd0301018a0 2024-09-13T16:08:08.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.989+0000 7fd035c00640 1 -- 172.21.15.86:0/2857241490 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd03010b780 con 0x7fd0301018a0 2024-09-13T16:08:08.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.991+0000 7fd02cc00640 1 -- 172.21.15.86:0/2857241490 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd028005520 con 0x7fd0301018a0 2024-09-13T16:08:08.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.993+0000 7fd02cc00640 1 --2- 172.21.15.86:0/2857241490 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd0140a1110 0x7fd0140a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.993+0000 7fd02cc00640 1 -- 172.21.15.86:0/2857241490 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7879+0+0 (secure 0 0 0) 0x7fd0280ccce0 con 0x7fd0301018a0 2024-09-13T16:08:08.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.993+0000 7fd02fe00640 1 --2- 172.21.15.86:0/2857241490 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd0140a1110 0x7fd0140a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.994+0000 7fd02fe00640 1 --2- 172.21.15.86:0/2857241490 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd0140a1110 0x7fd0140a35d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd020009230 tx=0x7fd020005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:08.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:08.995+0000 7fd02cc00640 1 -- 172.21.15.86:0/2857241490 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd0280966b0 con 0x7fd0301018a0 2024-09-13T16:08:09.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:08 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2546231538' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T16:08:09.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:08 smithi194 ceph-mon[35694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T16:08:09.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:08 smithi194 ceph-mon[35694]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:08:09.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:08 smithi194 ceph-mon[35694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-13T16:08:09.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:08 smithi194 ceph-mon[35694]: osdmap e83: 12 total, 12 up, 12 in 2024-09-13T16:08:09.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:08 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:09.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:08 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:09.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:08 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:09.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:08 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:09.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:08 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3812962497' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T16:08:09.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:08 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2546231538' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T16:08:09.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:08 smithi086 ceph-mon[30379]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T16:08:09.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:08 smithi086 ceph-mon[30379]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:08:09.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:08 smithi086 ceph-mon[30379]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-13T16:08:09.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:08 smithi086 ceph-mon[30379]: osdmap e83: 12 total, 12 up, 12 in 2024-09-13T16:08:09.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:08 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:09.117 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:08 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:09.118 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:08 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:09.118 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:08 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:09.118 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:08 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3812962497' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T16:08:09.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.200+0000 7fd035c00640 1 -- 172.21.15.86:0/2857241490 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd03010b960 con 0x7fd0301018a0 2024-09-13T16:08:09.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.208+0000 7fd02cc00640 1 -- 172.21.15.86:0/2857241490 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd02801f020 con 0x7fd0301018a0 2024-09-13T16:08:09.210 INFO:teuthology.orchestra.run.smithi086.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T16:08:09.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.212+0000 7fd035c00640 1 -- 172.21.15.86:0/2857241490 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd0140a1110 msgr2=0x7fd0140a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:09.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.213+0000 7fd035c00640 1 --2- 172.21.15.86:0/2857241490 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd0140a1110 0x7fd0140a35d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd020009230 tx=0x7fd020005a20 comp rx=0 tx=0).stop 2024-09-13T16:08:09.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.213+0000 7fd035c00640 1 -- 172.21.15.86:0/2857241490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0301018a0 msgr2=0x7fd03019f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:09.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.213+0000 7fd035c00640 1 --2- 172.21.15.86:0/2857241490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0301018a0 0x7fd03019f5b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd02800eaa0 tx=0x7fd02800ef60 comp rx=0 tx=0).stop 2024-09-13T16:08:09.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.213+0000 7fd035c00640 1 -- 172.21.15.86:0/2857241490 shutdown_connections 2024-09-13T16:08:09.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.213+0000 7fd035c00640 1 --2- 172.21.15.86:0/2857241490 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd0140a1110 0x7fd0140a35d0 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd020009230 tx=0x7fd020005a20 comp rx=0 tx=0).stop 2024-09-13T16:08:09.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.213+0000 7fd035c00640 1 --2- 172.21.15.86:0/2857241490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0301018a0 0x7fd03019f5b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:09.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.213+0000 7fd035c00640 1 --2- 172.21.15.86:0/2857241490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd030100ee0 0x7fd030198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:09.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.213+0000 7fd035c00640 1 --2- 172.21.15.86:0/2857241490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0300ffcf0 0x7fd030198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:09.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.213+0000 7fd035c00640 1 -- 172.21.15.86:0/2857241490 >> 172.21.15.86:0/2857241490 conn(0x7fd0300fb450 msgr2=0x7fd030106720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:09.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.214+0000 7fd035c00640 1 -- 172.21.15.86:0/2857241490 shutdown_connections 2024-09-13T16:08:09.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.215+0000 7fd035c00640 1 -- 172.21.15.86:0/2857241490 wait complete. 2024-09-13T16:08:09.245 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-13T16:08:09.245 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-13T16:08:09.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:08 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2546231538' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T16:08:09.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:08 smithi139 ceph-mon[35320]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T16:08:09.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:08 smithi139 ceph-mon[35320]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:08:09.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:08 smithi139 ceph-mon[35320]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-13T16:08:09.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:08 smithi139 ceph-mon[35320]: osdmap e83: 12 total, 12 up, 12 in 2024-09-13T16:08:09.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:08 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:09.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:08 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:09.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:08 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:09.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:08 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:09.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:08 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3812962497' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T16:08:09.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.403+0000 7f9cc0e00640 1 -- 172.21.15.86:0/1564199032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cbc101fa0 msgr2=0x7f9cbc1023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:09.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.403+0000 7f9cc0e00640 1 --2- 172.21.15.86:0/1564199032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cbc101fa0 0x7f9cbc1023a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009900 tx=0x7f9cac02a3f0 comp rx=0 tx=0).stop 2024-09-13T16:08:09.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.404+0000 7f9cc0e00640 1 -- 172.21.15.86:0/1564199032 shutdown_connections 2024-09-13T16:08:09.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.404+0000 7f9cc0e00640 1 --2- 172.21.15.86:0/1564199032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cbc103b50 0x7f9cbc10a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:09.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.404+0000 7f9cc0e00640 1 --2- 172.21.15.86:0/1564199032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cbc103190 0x7f9cbc103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:09.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.404+0000 7f9cc0e00640 1 --2- 172.21.15.86:0/1564199032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cbc101fa0 0x7f9cbc1023a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:09.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.404+0000 7f9cc0e00640 1 -- 172.21.15.86:0/1564199032 >> 172.21.15.86:0/1564199032 conn(0x7f9cbc0fd700 msgr2=0x7f9cbc0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:09.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.404+0000 7f9cc0e00640 1 -- 172.21.15.86:0/1564199032 shutdown_connections 2024-09-13T16:08:09.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.404+0000 7f9cc0e00640 1 -- 172.21.15.86:0/1564199032 wait complete. 2024-09-13T16:08:09.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.404+0000 7f9cc0e00640 1 Processor -- start 2024-09-13T16:08:09.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.405+0000 7f9cc0e00640 1 -- start start 2024-09-13T16:08:09.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.405+0000 7f9cc0e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cbc101fa0 0x7f9cbc198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:09.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.405+0000 7f9cc0e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cbc103190 0x7f9cbc1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:09.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.405+0000 7f9cc0e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cbc103b50 0x7f9cbc19f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:09.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.405+0000 7f9cc0e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc19fb80 con 0x7f9cbc101fa0 2024-09-13T16:08:09.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.405+0000 7f9cc0e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc19fcf0 con 0x7f9cbc103b50 2024-09-13T16:08:09.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.405+0000 7f9cc0e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc19feb0 con 0x7f9cbc103190 2024-09-13T16:08:09.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.405+0000 7f9cb9e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cbc101fa0 0x7f9cbc198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:09.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.405+0000 7f9cb9e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cbc101fa0 0x7f9cbc198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39628/0 (socket says 172.21.15.86:39628) 2024-09-13T16:08:09.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.405+0000 7f9cb9e00640 1 -- 172.21.15.86:0/4098016472 learned_addr learned my addr 172.21.15.86:0/4098016472 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:09.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.405+0000 7f9cb1400640 1 --2- 172.21.15.86:0/4098016472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cbc103190 0x7f9cbc1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:09.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.405+0000 7f9cba800640 1 --2- 172.21.15.86:0/4098016472 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cbc103b50 0x7f9cbc19f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:09.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.406+0000 7f9cb9e00640 1 -- 172.21.15.86:0/4098016472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cbc103190 msgr2=0x7f9cbc1985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:09.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.406+0000 7f9cb9e00640 1 --2- 172.21.15.86:0/4098016472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cbc103190 0x7f9cbc1985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:09.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.406+0000 7f9cb9e00640 1 -- 172.21.15.86:0/4098016472 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cbc103b50 msgr2=0x7f9cbc19f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:09.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.406+0000 7f9cb9e00640 1 --2- 172.21.15.86:0/4098016472 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cbc103b50 0x7f9cbc19f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:09.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.406+0000 7f9cb9e00640 1 -- 172.21.15.86:0/4098016472 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca4009490 con 0x7f9cbc101fa0 2024-09-13T16:08:09.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.406+0000 7f9cb1400640 1 --2- 172.21.15.86:0/4098016472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cbc103190 0x7f9cbc1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:09.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.406+0000 7f9cb9e00640 1 --2- 172.21.15.86:0/4098016472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cbc101fa0 0x7f9cbc198090 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9cac02f620 tx=0x7f9cac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:09.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.406+0000 7f9cb3400640 1 -- 172.21.15.86:0/4098016472 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac005410 con 0x7f9cbc101fa0 2024-09-13T16:08:09.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.406+0000 7f9cb3400640 1 -- 172.21.15.86:0/4098016472 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9cac0044e0 con 0x7f9cbc101fa0 2024-09-13T16:08:09.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.406+0000 7f9cc0e00640 1 -- 172.21.15.86:0/4098016472 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb4009840 con 0x7f9cbc101fa0 2024-09-13T16:08:09.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.406+0000 7f9cb3400640 1 -- 172.21.15.86:0/4098016472 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac003c50 con 0x7f9cbc101fa0 2024-09-13T16:08:09.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.406+0000 7f9cc0e00640 1 -- 172.21.15.86:0/4098016472 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cac009560 con 0x7f9cbc101fa0 2024-09-13T16:08:09.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.407+0000 7f9cc0e00640 1 -- 172.21.15.86:0/4098016472 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cbc109330 con 0x7f9cbc101fa0 2024-09-13T16:08:09.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.409+0000 7f9cb3400640 1 -- 172.21.15.86:0/4098016472 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9cac004ca0 con 0x7f9cbc101fa0 2024-09-13T16:08:09.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.410+0000 7f9cb3400640 1 --2- 172.21.15.86:0/4098016472 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9ca00a1110 0x7f9ca00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:09.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.410+0000 7f9cb3400640 1 -- 172.21.15.86:0/4098016472 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9cac0ed8a0 con 0x7f9cbc101fa0 2024-09-13T16:08:09.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.410+0000 7f9cb1400640 1 --2- 172.21.15.86:0/4098016472 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9ca00a1110 0x7f9ca00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:09.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.411+0000 7f9cb1400640 1 --2- 172.21.15.86:0/4098016472 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9ca00a1110 0x7f9ca00a35d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc1995a0 tx=0x7f9ca4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:09.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.414+0000 7f9cb3400640 1 -- 172.21.15.86:0/4098016472 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9cac0b70e0 con 0x7f9cbc101fa0 2024-09-13T16:08:09.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:09.594+0000 7f9cc0e00640 1 -- 172.21.15.86:0/4098016472 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f9cbc10d980 con 0x7f9cbc101fa0 2024-09-13T16:08:10.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:09 smithi194 ceph-mon[35694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T16:08:10.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:09 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:10.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:09 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:10.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:09 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:08:10.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:09 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:08:10.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:09 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:10.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:09 smithi194 ceph-mon[35694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-13T16:08:10.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:09 smithi194 ceph-mon[35694]: osdmap e84: 12 total, 12 up, 12 in 2024-09-13T16:08:10.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:09 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2857241490' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T16:08:10.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:09 smithi194 ceph-mon[35694]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-13T16:08:10.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:09 smithi194 ceph-mon[35694]: osdmap e85: 12 total, 12 up, 12 in 2024-09-13T16:08:10.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:09 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2857241490' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-13T16:08:10.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:09 smithi194 ceph-mon[35694]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-13T16:08:10.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:09 smithi194 ceph-mon[35694]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-13T16:08:10.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:09 smithi194 ceph-mon[35694]: pgmap v290: 97 pgs: 14 creating+peering, 1 active+clean, 82 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:08:10.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:09 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/4098016472' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-13T16:08:10.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:09 smithi086 ceph-mon[30379]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T16:08:10.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:09 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:10.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:09 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:10.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:09 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:08:10.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:09 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:08:10.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:09 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:10.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:09 smithi086 ceph-mon[30379]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-13T16:08:10.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:09 smithi086 ceph-mon[30379]: osdmap e84: 12 total, 12 up, 12 in 2024-09-13T16:08:10.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:09 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2857241490' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T16:08:10.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:09 smithi086 ceph-mon[30379]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-13T16:08:10.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:09 smithi086 ceph-mon[30379]: osdmap e85: 12 total, 12 up, 12 in 2024-09-13T16:08:10.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:09 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2857241490' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-13T16:08:10.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:09 smithi086 ceph-mon[30379]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-13T16:08:10.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:09 smithi086 ceph-mon[30379]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-13T16:08:10.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:09 smithi086 ceph-mon[30379]: pgmap v290: 97 pgs: 14 creating+peering, 1 active+clean, 82 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:08:10.116 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:09 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/4098016472' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-13T16:08:10.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.212+0000 7f9cb3400640 1 -- 172.21.15.86:0/4098016472 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v86) v1 ==== 157+0+0 (secure 0 0 0) 0x7f9cac0400e0 con 0x7f9cbc101fa0 2024-09-13T16:08:10.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.215+0000 7f9cc0e00640 1 -- 172.21.15.86:0/4098016472 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9ca00a1110 msgr2=0x7f9ca00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:10.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.215+0000 7f9cc0e00640 1 --2- 172.21.15.86:0/4098016472 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9ca00a1110 0x7f9ca00a35d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc1995a0 tx=0x7f9ca4005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:10.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.215+0000 7f9cc0e00640 1 -- 172.21.15.86:0/4098016472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cbc101fa0 msgr2=0x7f9cbc198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:10.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.215+0000 7f9cc0e00640 1 --2- 172.21.15.86:0/4098016472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cbc101fa0 0x7f9cbc198090 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9cac02f620 tx=0x7f9cac0042f0 comp rx=0 tx=0).stop 2024-09-13T16:08:10.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.215+0000 7f9cc0e00640 1 -- 172.21.15.86:0/4098016472 shutdown_connections 2024-09-13T16:08:10.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.215+0000 7f9cc0e00640 1 --2- 172.21.15.86:0/4098016472 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9ca00a1110 0x7f9ca00a35d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:10.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.215+0000 7f9cc0e00640 1 --2- 172.21.15.86:0/4098016472 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cbc103b50 0x7f9cbc19f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:10.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.215+0000 7f9cc0e00640 1 --2- 172.21.15.86:0/4098016472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cbc103190 0x7f9cbc1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:10.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.215+0000 7f9cc0e00640 1 --2- 172.21.15.86:0/4098016472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cbc101fa0 0x7f9cbc198090 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:10.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.215+0000 7f9cc0e00640 1 -- 172.21.15.86:0/4098016472 >> 172.21.15.86:0/4098016472 conn(0x7f9cbc0fd700 msgr2=0x7f9cbc106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:10.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.215+0000 7f9cc0e00640 1 -- 172.21.15.86:0/4098016472 shutdown_connections 2024-09-13T16:08:10.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.215+0000 7f9cc0e00640 1 -- 172.21.15.86:0/4098016472 wait complete. 2024-09-13T16:08:10.233 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T16:08:10.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:09 smithi139 ceph-mon[35320]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T16:08:10.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:09 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:10.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:09 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:10.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:09 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:08:10.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:09 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:08:10.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:09 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:08:10.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:09 smithi139 ceph-mon[35320]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-13T16:08:10.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:09 smithi139 ceph-mon[35320]: osdmap e84: 12 total, 12 up, 12 in 2024-09-13T16:08:10.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:09 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2857241490' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T16:08:10.250 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:09 smithi139 ceph-mon[35320]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-13T16:08:10.251 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:09 smithi139 ceph-mon[35320]: osdmap e85: 12 total, 12 up, 12 in 2024-09-13T16:08:10.251 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:09 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2857241490' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-13T16:08:10.251 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:09 smithi139 ceph-mon[35320]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-13T16:08:10.251 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:09 smithi139 ceph-mon[35320]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-13T16:08:10.251 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:09 smithi139 ceph-mon[35320]: pgmap v290: 97 pgs: 14 creating+peering, 1 active+clean, 82 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:08:10.251 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:09 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/4098016472' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-13T16:08:10.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.393+0000 7f12ff200640 1 -- 172.21.15.86:0/3908114784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1300100da0 msgr2=0x7f1300101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:10.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.393+0000 7f12ff200640 1 --2- 172.21.15.86:0/3908114784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1300100da0 0x7f1300101220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009900 tx=0x7f12ec02a410 comp rx=0 tx=0).stop 2024-09-13T16:08:10.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.393+0000 7f12ff200640 1 -- 172.21.15.86:0/3908114784 shutdown_connections 2024-09-13T16:08:10.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.393+0000 7f12ff200640 1 --2- 172.21.15.86:0/3908114784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1300101760 0x7f1300107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:10.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.393+0000 7f12ff200640 1 --2- 172.21.15.86:0/3908114784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1300100da0 0x7f1300101220 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:10.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.393+0000 7f12ff200640 1 --2- 172.21.15.86:0/3908114784 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13000ffbb0 0x7f13000fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:10.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.393+0000 7f12ff200640 1 -- 172.21.15.86:0/3908114784 >> 172.21.15.86:0/3908114784 conn(0x7f13000fb330 msgr2=0x7f13000fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:10.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.393+0000 7f12ff200640 1 -- 172.21.15.86:0/3908114784 shutdown_connections 2024-09-13T16:08:10.395 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.393+0000 7f12ff200640 1 -- 172.21.15.86:0/3908114784 wait complete. 2024-09-13T16:08:10.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.394+0000 7f12ff200640 1 Processor -- start 2024-09-13T16:08:10.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.394+0000 7f12ff200640 1 -- start start 2024-09-13T16:08:10.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.394+0000 7f12ff200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13000ffbb0 0x7f1300074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:10.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.394+0000 7f12ff200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1300100da0 0x7f13000728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:10.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.394+0000 7f12ff200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1300101760 0x7f1300072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:10.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.394+0000 7f12ff200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1300073540 con 0x7f13000ffbb0 2024-09-13T16:08:10.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.394+0000 7f12ff200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000736b0 con 0x7f1300100da0 2024-09-13T16:08:10.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.394+0000 7f12ff200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130019fca0 con 0x7f1300101760 2024-09-13T16:08:10.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.395+0000 7f12fde00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13000ffbb0 0x7f1300074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:10.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.395+0000 7f12fde00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13000ffbb0 0x7f1300074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39636/0 (socket says 172.21.15.86:39636) 2024-09-13T16:08:10.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.395+0000 7f12fde00640 1 -- 172.21.15.86:0/2684903104 learned_addr learned my addr 172.21.15.86:0/2684903104 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:10.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.395+0000 7f12fe800640 1 --2- 172.21.15.86:0/2684903104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1300101760 0x7f1300072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:10.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.395+0000 7f12fd400640 1 --2- 172.21.15.86:0/2684903104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1300100da0 0x7f13000728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:10.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.395+0000 7f12fde00640 1 -- 172.21.15.86:0/2684903104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1300101760 msgr2=0x7f1300072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:10.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.395+0000 7f12fde00640 1 --2- 172.21.15.86:0/2684903104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1300101760 0x7f1300072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:10.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.395+0000 7f12fde00640 1 -- 172.21.15.86:0/2684903104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1300100da0 msgr2=0x7f13000728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:10.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.395+0000 7f12fde00640 1 --2- 172.21.15.86:0/2684903104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1300100da0 0x7f13000728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:10.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.395+0000 7f12fde00640 1 -- 172.21.15.86:0/2684903104 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec009560 con 0x7f13000ffbb0 2024-09-13T16:08:10.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.395+0000 7f12fd400640 1 --2- 172.21.15.86:0/2684903104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1300100da0 0x7f13000728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:08:10.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.395+0000 7f12fde00640 1 --2- 172.21.15.86:0/2684903104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13000ffbb0 0x7f1300074260 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f12f000e9f0 tx=0x7f12f000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:10.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.395+0000 7f12f6a00640 1 -- 172.21.15.86:0/2684903104 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f00096e0 con 0x7f13000ffbb0 2024-09-13T16:08:10.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.396+0000 7f12f6a00640 1 -- 172.21.15.86:0/2684903104 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f12f000cd80 con 0x7f13000ffbb0 2024-09-13T16:08:10.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.396+0000 7f12ff200640 1 -- 172.21.15.86:0/2684903104 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130019ff50 con 0x7f13000ffbb0 2024-09-13T16:08:10.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.396+0000 7f12f6a00640 1 -- 172.21.15.86:0/2684903104 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0010430 con 0x7f13000ffbb0 2024-09-13T16:08:10.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.396+0000 7f12ff200640 1 -- 172.21.15.86:0/2684903104 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13001a0320 con 0x7f13000ffbb0 2024-09-13T16:08:10.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.397+0000 7f12ff200640 1 -- 172.21.15.86:0/2684903104 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1300107040 con 0x7f13000ffbb0 2024-09-13T16:08:10.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.398+0000 7f12f6a00640 1 -- 172.21.15.86:0/2684903104 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f12f0003680 con 0x7f13000ffbb0 2024-09-13T16:08:10.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.400+0000 7f12f6a00640 1 --2- 172.21.15.86:0/2684903104 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f12e40a1090 0x7f12e40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:10.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.400+0000 7f12f6a00640 1 -- 172.21.15.86:0/2684903104 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8205+0+0 (secure 0 0 0) 0x7f12f0014070 con 0x7f13000ffbb0 2024-09-13T16:08:10.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.400+0000 7f12fd400640 1 --2- 172.21.15.86:0/2684903104 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f12e40a1090 0x7f12e40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:10.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.401+0000 7f12fd400640 1 --2- 172.21.15.86:0/2684903104 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f12e40a1090 0x7f12e40a3550 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f12ec006010 tx=0x7f12ec005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:10.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.403+0000 7f12f6a00640 1 -- 172.21.15.86:0/2684903104 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f12f0096460 con 0x7f13000ffbb0 2024-09-13T16:08:10.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:10.574+0000 7f12ff200640 1 -- 172.21.15.86:0/2684903104 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f130010b5f0 con 0x7f13000ffbb0 2024-09-13T16:08:11.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:11 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] up:active 2024-09-13T16:08:11.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:11 smithi139 ceph-mon[35320]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:08:11.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:11 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/4098016472' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-13T16:08:11.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:11 smithi139 ceph-mon[35320]: osdmap e86: 12 total, 12 up, 12 in 2024-09-13T16:08:11.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:11 smithi139 ceph-mon[35320]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:08:11.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:11 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2684903104' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T16:08:11.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:11 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] up:active 2024-09-13T16:08:11.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:11 smithi194 ceph-mon[35694]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:08:11.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:11 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/4098016472' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-13T16:08:11.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:11 smithi194 ceph-mon[35694]: osdmap e86: 12 total, 12 up, 12 in 2024-09-13T16:08:11.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:11 smithi194 ceph-mon[35694]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:08:11.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:11 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2684903104' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T16:08:11.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:11 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] up:active 2024-09-13T16:08:11.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:11 smithi086 ceph-mon[30379]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:08:11.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:11 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/4098016472' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-13T16:08:11.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:11 smithi086 ceph-mon[30379]: osdmap e86: 12 total, 12 up, 12 in 2024-09-13T16:08:11.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:11 smithi086 ceph-mon[30379]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:08:11.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:11 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2684903104' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T16:08:12.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.226+0000 7f12f6a00640 1 -- 172.21.15.86:0/2684903104 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v88) v1 ==== 228+0+0 (secure 0 0 0) 0x7f12f0099a80 con 0x7f13000ffbb0 2024-09-13T16:08:12.228 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data_ec' created 2024-09-13T16:08:12.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.231+0000 7f12ff200640 1 -- 172.21.15.86:0/2684903104 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f12e40a1090 msgr2=0x7f12e40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:12.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.231+0000 7f12ff200640 1 --2- 172.21.15.86:0/2684903104 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f12e40a1090 0x7f12e40a3550 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f12ec006010 tx=0x7f12ec005a20 comp rx=0 tx=0).stop 2024-09-13T16:08:12.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.231+0000 7f12ff200640 1 -- 172.21.15.86:0/2684903104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13000ffbb0 msgr2=0x7f1300074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:12.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.231+0000 7f12ff200640 1 --2- 172.21.15.86:0/2684903104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13000ffbb0 0x7f1300074260 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f12f000e9f0 tx=0x7f12f000eeb0 comp rx=0 tx=0).stop 2024-09-13T16:08:12.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.231+0000 7f12ff200640 1 -- 172.21.15.86:0/2684903104 shutdown_connections 2024-09-13T16:08:12.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.231+0000 7f12ff200640 1 --2- 172.21.15.86:0/2684903104 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f12e40a1090 0x7f12e40a3550 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:12.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.231+0000 7f12ff200640 1 --2- 172.21.15.86:0/2684903104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1300101760 0x7f1300072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:12.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.231+0000 7f12ff200640 1 --2- 172.21.15.86:0/2684903104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1300100da0 0x7f13000728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:12.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.231+0000 7f12ff200640 1 --2- 172.21.15.86:0/2684903104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13000ffbb0 0x7f1300074260 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:12.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.231+0000 7f12ff200640 1 -- 172.21.15.86:0/2684903104 >> 172.21.15.86:0/2684903104 conn(0x7f13000fb330 msgr2=0x7f1300104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:12.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.231+0000 7f12ff200640 1 -- 172.21.15.86:0/2684903104 shutdown_connections 2024-09-13T16:08:12.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.231+0000 7f12ff200640 1 -- 172.21.15.86:0/2684903104 wait complete. 2024-09-13T16:08:12.256 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-13T16:08:12.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.412+0000 7f3cb1800640 1 -- 172.21.15.86:0/3629504552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cac103a40 msgr2=0x7f3cac10a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:12.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.412+0000 7f3cb1800640 1 --2- 172.21.15.86:0/3629504552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cac103a40 0x7f3cac10a360 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4009ca0 tx=0x7f3ca402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:08:12.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.412+0000 7f3cb1800640 1 -- 172.21.15.86:0/3629504552 shutdown_connections 2024-09-13T16:08:12.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.412+0000 7f3cb1800640 1 --2- 172.21.15.86:0/3629504552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cac103a40 0x7f3cac10a360 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:12.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.412+0000 7f3cb1800640 1 --2- 172.21.15.86:0/3629504552 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cac103080 0x7f3cac103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:12.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.412+0000 7f3cb1800640 1 --2- 172.21.15.86:0/3629504552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3cac101ea0 0x7f3cac1022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:12.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.412+0000 7f3cb1800640 1 -- 172.21.15.86:0/3629504552 >> 172.21.15.86:0/3629504552 conn(0x7f3cac0fd670 msgr2=0x7f3cac0ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:12.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.412+0000 7f3cb1800640 1 -- 172.21.15.86:0/3629504552 shutdown_connections 2024-09-13T16:08:12.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.412+0000 7f3cb1800640 1 -- 172.21.15.86:0/3629504552 wait complete. 2024-09-13T16:08:12.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.413+0000 7f3cb1800640 1 Processor -- start 2024-09-13T16:08:12.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.413+0000 7f3cb1800640 1 -- start start 2024-09-13T16:08:12.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.413+0000 7f3cb1800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3cac101ea0 0x7f3cac197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:12.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.413+0000 7f3cb1800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cac103080 0x7f3cac198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:12.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.413+0000 7f3cb1800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cac103a40 0x7f3cac19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:12.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.413+0000 7f3cb1800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac19fa10 con 0x7f3cac103080 2024-09-13T16:08:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.413+0000 7f3cb1800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac19fb80 con 0x7f3cac103a40 2024-09-13T16:08:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.413+0000 7f3cb1800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac19fd40 con 0x7f3cac101ea0 2024-09-13T16:08:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.413+0000 7f3ca3e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cac103080 0x7f3cac198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.413+0000 7f3ca3e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cac103080 0x7f3cac198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39644/0 (socket says 172.21.15.86:39644) 2024-09-13T16:08:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.413+0000 7f3ca3e00640 1 -- 172.21.15.86:0/333898846 learned_addr learned my addr 172.21.15.86:0/333898846 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.413+0000 7f3cb0e00640 1 --2- 172.21.15.86:0/333898846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cac103a40 0x7f3cac19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.413+0000 7f3cabe00640 1 --2- 172.21.15.86:0/333898846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3cac101ea0 0x7f3cac197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.414+0000 7f3ca3e00640 1 -- 172.21.15.86:0/333898846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3cac101ea0 msgr2=0x7f3cac197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.414+0000 7f3ca3e00640 1 --2- 172.21.15.86:0/333898846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3cac101ea0 0x7f3cac197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.414+0000 7f3ca3e00640 1 -- 172.21.15.86:0/333898846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cac103a40 msgr2=0x7f3cac19f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.414+0000 7f3ca3e00640 1 --2- 172.21.15.86:0/333898846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cac103a40 0x7f3cac19f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.414+0000 7f3ca3e00640 1 -- 172.21.15.86:0/333898846 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca4009900 con 0x7f3cac103080 2024-09-13T16:08:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.414+0000 7f3ca3e00640 1 --2- 172.21.15.86:0/333898846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cac103080 0x7f3cac198460 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400d950 tx=0x7f3c9400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:12.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.414+0000 7f3ca9600640 1 -- 172.21.15.86:0/333898846 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94009c30 con 0x7f3cac103080 2024-09-13T16:08:12.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.414+0000 7f3ca9600640 1 -- 172.21.15.86:0/333898846 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3c94009d90 con 0x7f3cac103080 2024-09-13T16:08:12.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.414+0000 7f3ca9600640 1 -- 172.21.15.86:0/333898846 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9400f7e0 con 0x7f3cac103080 2024-09-13T16:08:12.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.414+0000 7f3cb1800640 1 -- 172.21.15.86:0/333898846 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cac19ffc0 con 0x7f3cac103080 2024-09-13T16:08:12.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.414+0000 7f3cb1800640 1 -- 172.21.15.86:0/333898846 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cac1a0450 con 0x7f3cac103080 2024-09-13T16:08:12.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.415+0000 7f3cb1800640 1 -- 172.21.15.86:0/333898846 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cac109310 con 0x7f3cac103080 2024-09-13T16:08:12.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.417+0000 7f3ca9600640 1 -- 172.21.15.86:0/333898846 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3c94010ad0 con 0x7f3cac103080 2024-09-13T16:08:12.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.419+0000 7f3ca9600640 1 --2- 172.21.15.86:0/333898846 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f3c900a1090 0x7f3c900a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:12.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.419+0000 7f3ca9600640 1 -- 172.21.15.86:0/333898846 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8698+0+0 (secure 0 0 0) 0x7f3c940cc670 con 0x7f3cac103080 2024-09-13T16:08:12.420 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.419+0000 7f3cabe00640 1 --2- 172.21.15.86:0/333898846 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f3c900a1090 0x7f3c900a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:12.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.420+0000 7f3cabe00640 1 --2- 172.21.15.86:0/333898846 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f3c900a1090 0x7f3c900a3550 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3cac102bf0 tx=0x7f3c9c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:12.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.421+0000 7f3ca9600640 1 -- 172.21.15.86:0/333898846 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3c94095c80 con 0x7f3cac103080 2024-09-13T16:08:12.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:12 smithi139 ceph-mon[35320]: pgmap v293: 97 pgs: 14 creating+peering, 41 active+clean, 42 unknown; 578 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s wr, 4 op/s 2024-09-13T16:08:12.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:12 smithi139 ceph-mon[35320]: osdmap e87: 12 total, 12 up, 12 in 2024-09-13T16:08:12.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:12 smithi194 ceph-mon[35694]: pgmap v293: 97 pgs: 14 creating+peering, 41 active+clean, 42 unknown; 578 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s wr, 4 op/s 2024-09-13T16:08:12.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:12 smithi194 ceph-mon[35694]: osdmap e87: 12 total, 12 up, 12 in 2024-09-13T16:08:12.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:12.591+0000 7f3cb1800640 1 -- 172.21.15.86:0/333898846 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f3cac10d8f0 con 0x7f3cac103080 2024-09-13T16:08:12.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:12 smithi086 ceph-mon[30379]: pgmap v293: 97 pgs: 14 creating+peering, 41 active+clean, 42 unknown; 578 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s wr, 4 op/s 2024-09-13T16:08:12.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:12 smithi086 ceph-mon[30379]: osdmap e87: 12 total, 12 up, 12 in 2024-09-13T16:08:13.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.230+0000 7f3ca9600640 1 -- 172.21.15.86:0/333898846 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v89) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3c940992a0 con 0x7f3cac103080 2024-09-13T16:08:13.232 INFO:teuthology.orchestra.run.smithi086.stderr:set pool 4 allow_ec_overwrites to true 2024-09-13T16:08:13.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.236+0000 7f3cb1800640 1 -- 172.21.15.86:0/333898846 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f3c900a1090 msgr2=0x7f3c900a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:13.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.236+0000 7f3cb1800640 1 --2- 172.21.15.86:0/333898846 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f3c900a1090 0x7f3c900a3550 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3cac102bf0 tx=0x7f3c9c00b390 comp rx=0 tx=0).stop 2024-09-13T16:08:13.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.236+0000 7f3cb1800640 1 -- 172.21.15.86:0/333898846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cac103080 msgr2=0x7f3cac198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:13.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.236+0000 7f3cb1800640 1 --2- 172.21.15.86:0/333898846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cac103080 0x7f3cac198460 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400d950 tx=0x7f3c9400de10 comp rx=0 tx=0).stop 2024-09-13T16:08:13.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.237+0000 7f3cb1800640 1 -- 172.21.15.86:0/333898846 shutdown_connections 2024-09-13T16:08:13.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.237+0000 7f3cb1800640 1 --2- 172.21.15.86:0/333898846 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f3c900a1090 0x7f3c900a3550 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.237+0000 7f3cb1800640 1 --2- 172.21.15.86:0/333898846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cac103a40 0x7f3cac19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.237+0000 7f3cb1800640 1 --2- 172.21.15.86:0/333898846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cac103080 0x7f3cac198460 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.237+0000 7f3cb1800640 1 --2- 172.21.15.86:0/333898846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3cac101ea0 0x7f3cac197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.237+0000 7f3cb1800640 1 -- 172.21.15.86:0/333898846 >> 172.21.15.86:0/333898846 conn(0x7f3cac0fd670 msgr2=0x7f3cac1064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:13.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.237+0000 7f3cb1800640 1 -- 172.21.15.86:0/333898846 shutdown_connections 2024-09-13T16:08:13.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.238+0000 7f3cb1800640 1 -- 172.21.15.86:0/333898846 wait complete. 2024-09-13T16:08:13.271 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-13T16:08:13.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.429+0000 7efd4fc00640 1 -- 172.21.15.86:0/1049906560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd48074e70 msgr2=0x7efd48075270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:13.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.429+0000 7efd4fc00640 1 --2- 172.21.15.86:0/1049906560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd48074e70 0x7efd48075270 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efd38009900 tx=0x7efd3802a410 comp rx=0 tx=0).stop 2024-09-13T16:08:13.431 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.429+0000 7efd4fc00640 1 -- 172.21.15.86:0/1049906560 shutdown_connections 2024-09-13T16:08:13.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.429+0000 7efd4fc00640 1 --2- 172.21.15.86:0/1049906560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd48076a50 0x7efd480772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.429+0000 7efd4fc00640 1 --2- 172.21.15.86:0/1049906560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd480760b0 0x7efd48076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.429+0000 7efd4fc00640 1 --2- 172.21.15.86:0/1049906560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd48074e70 0x7efd48075270 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.429+0000 7efd4fc00640 1 -- 172.21.15.86:0/1049906560 >> 172.21.15.86:0/1049906560 conn(0x7efd480fd6f0 msgr2=0x7efd480ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:13.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.429+0000 7efd4fc00640 1 -- 172.21.15.86:0/1049906560 shutdown_connections 2024-09-13T16:08:13.432 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.430+0000 7efd4fc00640 1 -- 172.21.15.86:0/1049906560 wait complete. 2024-09-13T16:08:13.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.430+0000 7efd4fc00640 1 Processor -- start 2024-09-13T16:08:13.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.430+0000 7efd4fc00640 1 -- start start 2024-09-13T16:08:13.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.431+0000 7efd4fc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd48074e70 0x7efd4819c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:13.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.431+0000 7efd4fc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd480760b0 0x7efd4819ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:13.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.431+0000 7efd4fc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd48076a50 0x7efd481a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:13.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.431+0000 7efd4fc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd481a3fc0 con 0x7efd480760b0 2024-09-13T16:08:13.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.431+0000 7efd4fc00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd481a4130 con 0x7efd48076a50 2024-09-13T16:08:13.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.431+0000 7efd4fc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd481a42f0 con 0x7efd48074e70 2024-09-13T16:08:13.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.431+0000 7efd3fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd480760b0 0x7efd4819ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:13.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.431+0000 7efd3fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd480760b0 0x7efd4819ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41294/0 (socket says 172.21.15.86:41294) 2024-09-13T16:08:13.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.431+0000 7efd4d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd48074e70 0x7efd4819c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:13.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.431+0000 7efd3fe00640 1 -- 172.21.15.86:0/449681260 learned_addr learned my addr 172.21.15.86:0/449681260 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:13.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.431+0000 7efd4dc00640 1 --2- 172.21.15.86:0/449681260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd48076a50 0x7efd481a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:13.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.431+0000 7efd3fe00640 1 -- 172.21.15.86:0/449681260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd48074e70 msgr2=0x7efd4819c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:13.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.431+0000 7efd3fe00640 1 --2- 172.21.15.86:0/449681260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd48074e70 0x7efd4819c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.431+0000 7efd3fe00640 1 -- 172.21.15.86:0/449681260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd48076a50 msgr2=0x7efd481a3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:13.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.431+0000 7efd3fe00640 1 --2- 172.21.15.86:0/449681260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd48076a50 0x7efd481a3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.431+0000 7efd3fe00640 1 -- 172.21.15.86:0/449681260 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd38009560 con 0x7efd480760b0 2024-09-13T16:08:13.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.431+0000 7efd4d200640 1 --2- 172.21.15.86:0/449681260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd48074e70 0x7efd4819c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:13.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.432+0000 7efd3fe00640 1 --2- 172.21.15.86:0/449681260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd480760b0 0x7efd4819ca10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efd3000d950 tx=0x7efd3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:13.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.432+0000 7efd46000640 1 -- 172.21.15.86:0/449681260 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd30009a30 con 0x7efd480760b0 2024-09-13T16:08:13.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.432+0000 7efd46000640 1 -- 172.21.15.86:0/449681260 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efd30009b90 con 0x7efd480760b0 2024-09-13T16:08:13.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.432+0000 7efd4fc00640 1 -- 172.21.15.86:0/449681260 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd481a45d0 con 0x7efd480760b0 2024-09-13T16:08:13.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.432+0000 7efd46000640 1 -- 172.21.15.86:0/449681260 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd30004a00 con 0x7efd480760b0 2024-09-13T16:08:13.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.432+0000 7efd4fc00640 1 -- 172.21.15.86:0/449681260 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd481a4ae0 con 0x7efd480760b0 2024-09-13T16:08:13.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.433+0000 7efd4fc00640 1 -- 172.21.15.86:0/449681260 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd4810e8e0 con 0x7efd480760b0 2024-09-13T16:08:13.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.435+0000 7efd46000640 1 -- 172.21.15.86:0/449681260 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7efd30009d00 con 0x7efd480760b0 2024-09-13T16:08:13.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.436+0000 7efd46000640 1 --2- 172.21.15.86:0/449681260 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efd2c0a1090 0x7efd2c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:13.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.437+0000 7efd46000640 1 -- 172.21.15.86:0/449681260 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8698+0+0 (secure 0 0 0) 0x7efd300cc4e0 con 0x7efd480760b0 2024-09-13T16:08:13.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.437+0000 7efd4d200640 1 --2- 172.21.15.86:0/449681260 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efd2c0a1090 0x7efd2c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:13.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.437+0000 7efd4d200640 1 --2- 172.21.15.86:0/449681260 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efd2c0a1090 0x7efd2c0a3550 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efd38005ab0 tx=0x7efd38005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:13.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.440+0000 7efd46000640 1 -- 172.21.15.86:0/449681260 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efd30095a40 con 0x7efd480760b0 2024-09-13T16:08:13.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:13 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2684903104' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-13T16:08:13.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:13 smithi139 ceph-mon[35320]: osdmap e88: 12 total, 12 up, 12 in 2024-09-13T16:08:13.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:13 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/333898846' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-13T16:08:13.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:13 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2684903104' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-13T16:08:13.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:13 smithi194 ceph-mon[35694]: osdmap e88: 12 total, 12 up, 12 in 2024-09-13T16:08:13.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:13 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/333898846' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-13T16:08:13.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:13 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2684903104' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-13T16:08:13.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:13 smithi086 ceph-mon[30379]: osdmap e88: 12 total, 12 up, 12 in 2024-09-13T16:08:13.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:13 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/333898846' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-13T16:08:13.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.654+0000 7efd4fc00640 1 -- 172.21.15.86:0/449681260 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7efd48111db0 con 0x7efd480760b0 2024-09-13T16:08:13.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.662+0000 7efd46000640 1 -- 172.21.15.86:0/449681260 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) v1 ==== 137+0+0 (secure 0 0 0) 0x7efd30099060 con 0x7efd480760b0 2024-09-13T16:08:13.663 INFO:teuthology.orchestra.run.smithi086.stderr:added data pool 4 to fsmap 2024-09-13T16:08:13.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.664+0000 7efd4fc00640 1 -- 172.21.15.86:0/449681260 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efd2c0a1090 msgr2=0x7efd2c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:13.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.664+0000 7efd4fc00640 1 --2- 172.21.15.86:0/449681260 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efd2c0a1090 0x7efd2c0a3550 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efd38005ab0 tx=0x7efd38005a20 comp rx=0 tx=0).stop 2024-09-13T16:08:13.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.664+0000 7efd4fc00640 1 -- 172.21.15.86:0/449681260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd480760b0 msgr2=0x7efd4819ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:13.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.664+0000 7efd4fc00640 1 --2- 172.21.15.86:0/449681260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd480760b0 0x7efd4819ca10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efd3000d950 tx=0x7efd3000de10 comp rx=0 tx=0).stop 2024-09-13T16:08:13.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.664+0000 7efd4fc00640 1 -- 172.21.15.86:0/449681260 shutdown_connections 2024-09-13T16:08:13.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.664+0000 7efd4fc00640 1 --2- 172.21.15.86:0/449681260 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efd2c0a1090 0x7efd2c0a3550 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.664+0000 7efd4fc00640 1 --2- 172.21.15.86:0/449681260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd48076a50 0x7efd481a3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.664+0000 7efd4fc00640 1 --2- 172.21.15.86:0/449681260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd480760b0 0x7efd4819ca10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.664+0000 7efd4fc00640 1 --2- 172.21.15.86:0/449681260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd48074e70 0x7efd4819c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.664+0000 7efd4fc00640 1 -- 172.21.15.86:0/449681260 >> 172.21.15.86:0/449681260 conn(0x7efd480fd6f0 msgr2=0x7efd480ff1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:13.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.664+0000 7efd4fc00640 1 -- 172.21.15.86:0/449681260 shutdown_connections 2024-09-13T16:08:13.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.664+0000 7efd4fc00640 1 -- 172.21.15.86:0/449681260 wait complete. 2024-09-13T16:08:13.682 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:08:13.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.832+0000 7f059f200640 1 -- 172.21.15.86:0/2638478966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a0100630 msgr2=0x7f05a0102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:13.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.832+0000 7f059f200640 1 --2- 172.21.15.86:0/2638478966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a0100630 0x7f05a0102a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0590009900 tx=0x7f059002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.832+0000 7f059f200640 1 -- 172.21.15.86:0/2638478966 shutdown_connections 2024-09-13T16:08:13.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.832+0000 7f059f200640 1 --2- 172.21.15.86:0/2638478966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05a0105890 0x7f05a0107d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.832+0000 7f059f200640 1 --2- 172.21.15.86:0/2638478966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05a0102f60 0x7f05a0105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.832+0000 7f059f200640 1 --2- 172.21.15.86:0/2638478966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a0100630 0x7f05a0102a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.832+0000 7f059f200640 1 -- 172.21.15.86:0/2638478966 >> 172.21.15.86:0/2638478966 conn(0x7f05a00fa210 msgr2=0x7f05a00fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:13.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.833+0000 7f059f200640 1 -- 172.21.15.86:0/2638478966 shutdown_connections 2024-09-13T16:08:13.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.833+0000 7f059f200640 1 -- 172.21.15.86:0/2638478966 wait complete. 2024-09-13T16:08:13.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.833+0000 7f059f200640 1 Processor -- start 2024-09-13T16:08:13.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.834+0000 7f059f200640 1 -- start start 2024-09-13T16:08:13.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.834+0000 7f059f200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05a0100630 0x7f05a0197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:13.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.834+0000 7f059f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05a0102f60 0x7f05a0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:13.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.834+0000 7f059f200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a0105890 0x7f05a019f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:13.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.834+0000 7f059f200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a019f9f0 con 0x7f05a0105890 2024-09-13T16:08:13.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.834+0000 7f059f200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a019fb60 con 0x7f05a0100630 2024-09-13T16:08:13.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.834+0000 7f059f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a019fd20 con 0x7f05a0102f60 2024-09-13T16:08:13.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.834+0000 7f059e800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a0105890 0x7f05a019f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:13.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.834+0000 7f059e800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a0105890 0x7f05a019f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41322/0 (socket says 172.21.15.86:41322) 2024-09-13T16:08:13.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.834+0000 7f059e800640 1 -- 172.21.15.86:0/4123191949 learned_addr learned my addr 172.21.15.86:0/4123191949 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:13.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.834+0000 7f059de00640 1 --2- 172.21.15.86:0/4123191949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05a0100630 0x7f05a0197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:13.838 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.834+0000 7f0597e00640 1 --2- 172.21.15.86:0/4123191949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05a0102f60 0x7f05a0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:13.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.835+0000 7f059e800640 1 -- 172.21.15.86:0/4123191949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05a0102f60 msgr2=0x7f05a0198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:13.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.835+0000 7f059e800640 1 --2- 172.21.15.86:0/4123191949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05a0102f60 0x7f05a0198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.835+0000 7f059e800640 1 -- 172.21.15.86:0/4123191949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05a0100630 msgr2=0x7f05a0197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:13.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.835+0000 7f059e800640 1 --2- 172.21.15.86:0/4123191949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05a0100630 0x7f05a0197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:13.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.835+0000 7f059e800640 1 -- 172.21.15.86:0/4123191949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0590009560 con 0x7f05a0105890 2024-09-13T16:08:13.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.835+0000 7f059e800640 1 --2- 172.21.15.86:0/4123191949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a0105890 0x7f05a019f4b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f059800ccb0 tx=0x7f059800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:13.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.835+0000 7f0596a00640 1 -- 172.21.15.86:0/4123191949 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059800f450 con 0x7f05a0105890 2024-09-13T16:08:13.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.835+0000 7f0596a00640 1 -- 172.21.15.86:0/4123191949 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f059800fa90 con 0x7f05a0105890 2024-09-13T16:08:13.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.835+0000 7f059f200640 1 -- 172.21.15.86:0/4123191949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a019ffa0 con 0x7f05a0105890 2024-09-13T16:08:13.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.835+0000 7f0596a00640 1 -- 172.21.15.86:0/4123191949 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0598018b50 con 0x7f05a0105890 2024-09-13T16:08:13.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.835+0000 7f059f200640 1 -- 172.21.15.86:0/4123191949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a01a0430 con 0x7f05a0105890 2024-09-13T16:08:13.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.837+0000 7f059f200640 1 -- 172.21.15.86:0/4123191949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a0107400 con 0x7f05a0105890 2024-09-13T16:08:13.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.838+0000 7f0596a00640 1 -- 172.21.15.86:0/4123191949 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f059800fc00 con 0x7f05a0105890 2024-09-13T16:08:13.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.839+0000 7f0596a00640 1 --2- 172.21.15.86:0/4123191949 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f05840a1090 0x7f05840a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:13.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.840+0000 7f0596a00640 1 -- 172.21.15.86:0/4123191949 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f05980cd8a0 con 0x7f05a0105890 2024-09-13T16:08:13.841 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.840+0000 7f059de00640 1 --2- 172.21.15.86:0/4123191949 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f05840a1090 0x7f05840a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:13.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.840+0000 7f059de00640 1 --2- 172.21.15.86:0/4123191949 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f05840a1090 0x7f05840a3550 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0590005940 tx=0x7f05900058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:13.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:13.842+0000 7f0596a00640 1 -- 172.21.15.86:0/4123191949 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0598096de0 con 0x7f05a0105890 2024-09-13T16:08:14.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.050+0000 7f059f200640 1 -- 172.21.15.86:0/4123191949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05a010b5e0 con 0x7f05a0105890 2024-09-13T16:08:14.052 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.051+0000 7f0596a00640 1 -- 172.21.15.86:0/4123191949 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10816 (secure 0 0 0) 0x7f059809a400 con 0x7f05a0105890 2024-09-13T16:08:14.052 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:14.053 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14508,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1509120923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1509120923},{"type":"v1","addr":"172.21.15.86:6839","nonce":1509120923}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6841/1971775519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":1971775519},{"type":"v1","addr":"172.21.15.86:6841","nonce":1971775519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1370900762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1370900762},{"type":"v1","addr":"172.21.15.194:6835","nonce":1370900762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2460451799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":2460451799},{"type":"v1","addr":"172.21.15.194:6837","nonce":2460451799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24530,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2399531832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2399531832},{"type":"v1","addr":"172.21.15.139:6837","nonce":2399531832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24544,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/3799859182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3799859182},{"type":"v1","addr":"172.21.15.194:6839","nonce":3799859182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:08:09.202262+0000","modified":"2024-09-13T16:08:13.655980+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.139:6839/3370280063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3370280063},{"type":"v1","addr":"172.21.15.139:6839","nonce":3370280063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T16:08:14.053 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 17 2024-09-13T16:08:14.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.053+0000 7f059f200640 1 -- 172.21.15.86:0/4123191949 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f05840a1090 msgr2=0x7f05840a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:14.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.053+0000 7f059f200640 1 --2- 172.21.15.86:0/4123191949 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f05840a1090 0x7f05840a3550 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0590005940 tx=0x7f05900058d0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.053+0000 7f059f200640 1 -- 172.21.15.86:0/4123191949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a0105890 msgr2=0x7f05a019f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:14.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.053+0000 7f059f200640 1 --2- 172.21.15.86:0/4123191949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a0105890 0x7f05a019f4b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f059800ccb0 tx=0x7f059800a620 comp rx=0 tx=0).stop 2024-09-13T16:08:14.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.053+0000 7f059f200640 1 -- 172.21.15.86:0/4123191949 shutdown_connections 2024-09-13T16:08:14.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.053+0000 7f059f200640 1 --2- 172.21.15.86:0/4123191949 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f05840a1090 0x7f05840a3550 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.053+0000 7f059f200640 1 --2- 172.21.15.86:0/4123191949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05a0105890 0x7f05a019f4b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.053+0000 7f059f200640 1 --2- 172.21.15.86:0/4123191949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05a0102f60 0x7f05a0198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.053+0000 7f059f200640 1 --2- 172.21.15.86:0/4123191949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05a0100630 0x7f05a0197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.053+0000 7f059f200640 1 -- 172.21.15.86:0/4123191949 >> 172.21.15.86:0/4123191949 conn(0x7f05a00fa210 msgr2=0x7f05a00ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:14.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.053+0000 7f059f200640 1 -- 172.21.15.86:0/4123191949 shutdown_connections 2024-09-13T16:08:14.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.053+0000 7f059f200640 1 -- 172.21.15.86:0/4123191949 wait complete. 2024-09-13T16:08:14.071 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:08:14.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.226+0000 7fb78ea00640 1 -- 172.21.15.86:0/1560993549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7880ffbb0 msgr2=0x7fb7880fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:14.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.226+0000 7fb78ea00640 1 --2- 172.21.15.86:0/1560993549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7880ffbb0 0x7fb7880fffb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009900 tx=0x7fb77c02a3f0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.227+0000 7fb78ea00640 1 -- 172.21.15.86:0/1560993549 shutdown_connections 2024-09-13T16:08:14.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.227+0000 7fb78ea00640 1 --2- 172.21.15.86:0/1560993549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb788101760 0x7fb788107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.227+0000 7fb78ea00640 1 --2- 172.21.15.86:0/1560993549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb788100da0 0x7fb788101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.227+0000 7fb78ea00640 1 --2- 172.21.15.86:0/1560993549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7880ffbb0 0x7fb7880fffb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.227+0000 7fb78ea00640 1 -- 172.21.15.86:0/1560993549 >> 172.21.15.86:0/1560993549 conn(0x7fb7880fb330 msgr2=0x7fb7880fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:14.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.227+0000 7fb78ea00640 1 -- 172.21.15.86:0/1560993549 shutdown_connections 2024-09-13T16:08:14.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.227+0000 7fb78ea00640 1 -- 172.21.15.86:0/1560993549 wait complete. 2024-09-13T16:08:14.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.228+0000 7fb78ea00640 1 Processor -- start 2024-09-13T16:08:14.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.228+0000 7fb78ea00640 1 -- start start 2024-09-13T16:08:14.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.228+0000 7fb78ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7880ffbb0 0x7fb788197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:14.232 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.228+0000 7fb78ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb788100da0 0x7fb788198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:14.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.228+0000 7fb78ea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb788101760 0x7fb78819f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:14.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.228+0000 7fb78ea00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78819f9e0 con 0x7fb7880ffbb0 2024-09-13T16:08:14.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.228+0000 7fb78ea00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78819fb50 con 0x7fb788100da0 2024-09-13T16:08:14.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.228+0000 7fb78ea00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78819fd10 con 0x7fb788101760 2024-09-13T16:08:14.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.228+0000 7fb78d600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7880ffbb0 0x7fb788197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:14.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.228+0000 7fb78d600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7880ffbb0 0x7fb788197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41340/0 (socket says 172.21.15.86:41340) 2024-09-13T16:08:14.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.228+0000 7fb78d600640 1 -- 172.21.15.86:0/579170803 learned_addr learned my addr 172.21.15.86:0/579170803 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:14.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.228+0000 7fb78cc00640 1 --2- 172.21.15.86:0/579170803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb788100da0 0x7fb788198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:14.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.228+0000 7fb78e000640 1 --2- 172.21.15.86:0/579170803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb788101760 0x7fb78819f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:14.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.229+0000 7fb78d600640 1 -- 172.21.15.86:0/579170803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb788101760 msgr2=0x7fb78819f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:14.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.229+0000 7fb78d600640 1 --2- 172.21.15.86:0/579170803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb788101760 0x7fb78819f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.229+0000 7fb78d600640 1 -- 172.21.15.86:0/579170803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb788100da0 msgr2=0x7fb788198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:14.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.229+0000 7fb78d600640 1 --2- 172.21.15.86:0/579170803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb788100da0 0x7fb788198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.229+0000 7fb78d600640 1 -- 172.21.15.86:0/579170803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c009560 con 0x7fb7880ffbb0 2024-09-13T16:08:14.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.229+0000 7fb78d600640 1 --2- 172.21.15.86:0/579170803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7880ffbb0 0x7fb788197f40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb77c031510 tx=0x7fb77c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:14.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.229+0000 7fb786000640 1 -- 172.21.15.86:0/579170803 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c004b50 con 0x7fb7880ffbb0 2024-09-13T16:08:14.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.229+0000 7fb786000640 1 -- 172.21.15.86:0/579170803 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb77c004cb0 con 0x7fb7880ffbb0 2024-09-13T16:08:14.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.229+0000 7fb786000640 1 -- 172.21.15.86:0/579170803 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c031ba0 con 0x7fb7880ffbb0 2024-09-13T16:08:14.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.229+0000 7fb78ea00640 1 -- 172.21.15.86:0/579170803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78819ff90 con 0x7fb7880ffbb0 2024-09-13T16:08:14.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.229+0000 7fb78ea00640 1 -- 172.21.15.86:0/579170803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7881a0350 con 0x7fb7880ffbb0 2024-09-13T16:08:14.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.230+0000 7fb78ea00640 1 -- 172.21.15.86:0/579170803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78810b640 con 0x7fb7880ffbb0 2024-09-13T16:08:14.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.232+0000 7fb786000640 1 -- 172.21.15.86:0/579170803 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb77c031d00 con 0x7fb7880ffbb0 2024-09-13T16:08:14.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.233+0000 7fb786000640 1 --2- 172.21.15.86:0/579170803 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb7700a1090 0x7fb7700a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:14.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.234+0000 7fb786000640 1 -- 172.21.15.86:0/579170803 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb77c0edf20 con 0x7fb7880ffbb0 2024-09-13T16:08:14.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.234+0000 7fb78cc00640 1 --2- 172.21.15.86:0/579170803 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb7700a1090 0x7fb7700a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:14.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.234+0000 7fb78cc00640 1 --2- 172.21.15.86:0/579170803 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb7700a1090 0x7fb7700a3550 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb788199400 tx=0x7fb774005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:14.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.236+0000 7fb786000640 1 -- 172.21.15.86:0/579170803 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb77c0b7570 con 0x7fb7880ffbb0 2024-09-13T16:08:14.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:14 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/333898846' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-13T16:08:14.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:14 smithi086 ceph-mon[30379]: osdmap e89: 12 total, 12 up, 12 in 2024-09-13T16:08:14.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:14 smithi086 ceph-mon[30379]: pgmap v296: 129 pgs: 9 creating+peering, 71 active+clean, 49 unknown; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2024-09-13T16:08:14.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:14 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/449681260' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-13T16:08:14.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:14 smithi086 ceph-mon[30379]: osdmap e90: 12 total, 12 up, 12 in 2024-09-13T16:08:14.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:14 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/449681260' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-13T16:08:14.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:14 smithi086 ceph-mon[30379]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:08:14.366 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:14 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/4123191949' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:08:14.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.413+0000 7fb78ea00640 1 -- 172.21.15.86:0/579170803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7881a08a0 con 0x7fb7880ffbb0 2024-09-13T16:08:14.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.414+0000 7fb786000640 1 -- 172.21.15.86:0/579170803 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23949 (secure 0 0 0) 0x7fb77c0bab90 con 0x7fb7880ffbb0 2024-09-13T16:08:14.416 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:14.416 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":90,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:08:13.655740+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:08:14.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.417+0000 7fb78ea00640 1 -- 172.21.15.86:0/579170803 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb7700a1090 msgr2=0x7fb7700a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:14.418 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.417+0000 7fb78ea00640 1 --2- 172.21.15.86:0/579170803 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb7700a1090 0x7fb7700a3550 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb788199400 tx=0x7fb774005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:14.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.417+0000 7fb78ea00640 1 -- 172.21.15.86:0/579170803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7880ffbb0 msgr2=0x7fb788197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:14.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.417+0000 7fb78ea00640 1 --2- 172.21.15.86:0/579170803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7880ffbb0 0x7fb788197f40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb77c031510 tx=0x7fb77c0055a0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.417+0000 7fb78ea00640 1 -- 172.21.15.86:0/579170803 shutdown_connections 2024-09-13T16:08:14.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.417+0000 7fb78ea00640 1 --2- 172.21.15.86:0/579170803 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb7700a1090 0x7fb7700a3550 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.417+0000 7fb78ea00640 1 --2- 172.21.15.86:0/579170803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb788101760 0x7fb78819f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.417+0000 7fb78ea00640 1 --2- 172.21.15.86:0/579170803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb788100da0 0x7fb788198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.417+0000 7fb78ea00640 1 --2- 172.21.15.86:0/579170803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7880ffbb0 0x7fb788197f40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.417+0000 7fb78ea00640 1 -- 172.21.15.86:0/579170803 >> 172.21.15.86:0/579170803 conn(0x7fb7880fb330 msgr2=0x7fb7881065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:14.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.417+0000 7fb78ea00640 1 -- 172.21.15.86:0/579170803 shutdown_connections 2024-09-13T16:08:14.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.417+0000 7fb78ea00640 1 -- 172.21.15.86:0/579170803 wait complete. 2024-09-13T16:08:14.436 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:08:14.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:14 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/333898846' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-13T16:08:14.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:14 smithi139 ceph-mon[35320]: osdmap e89: 12 total, 12 up, 12 in 2024-09-13T16:08:14.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:14 smithi139 ceph-mon[35320]: pgmap v296: 129 pgs: 9 creating+peering, 71 active+clean, 49 unknown; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2024-09-13T16:08:14.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:14 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/449681260' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-13T16:08:14.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:14 smithi139 ceph-mon[35320]: osdmap e90: 12 total, 12 up, 12 in 2024-09-13T16:08:14.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:14 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/449681260' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-13T16:08:14.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:14 smithi139 ceph-mon[35320]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:08:14.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:14 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/4123191949' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:08:14.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:14 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/333898846' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-13T16:08:14.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:14 smithi194 ceph-mon[35694]: osdmap e89: 12 total, 12 up, 12 in 2024-09-13T16:08:14.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:14 smithi194 ceph-mon[35694]: pgmap v296: 129 pgs: 9 creating+peering, 71 active+clean, 49 unknown; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2024-09-13T16:08:14.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:14 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/449681260' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-13T16:08:14.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:14 smithi194 ceph-mon[35694]: osdmap e90: 12 total, 12 up, 12 in 2024-09-13T16:08:14.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:14 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/449681260' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-13T16:08:14.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:14 smithi194 ceph-mon[35694]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:08:14.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:14 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/4123191949' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:08:14.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.595+0000 7fc6f2000640 1 -- 172.21.15.86:0/1322191334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6ec100610 msgr2=0x7fc6ec102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:14.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.595+0000 7fc6f2000640 1 --2- 172.21.15.86:0/1322191334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6ec100610 0x7fc6ec102a00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009900 tx=0x7fc6e002a410 comp rx=0 tx=0).stop 2024-09-13T16:08:14.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.595+0000 7fc6f2000640 1 -- 172.21.15.86:0/1322191334 shutdown_connections 2024-09-13T16:08:14.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.595+0000 7fc6f2000640 1 --2- 172.21.15.86:0/1322191334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6ec105870 0x7fc6ec107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.595+0000 7fc6f2000640 1 --2- 172.21.15.86:0/1322191334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ec102f40 0x7fc6ec105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.595+0000 7fc6f2000640 1 --2- 172.21.15.86:0/1322191334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6ec100610 0x7fc6ec102a00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.595+0000 7fc6f2000640 1 -- 172.21.15.86:0/1322191334 >> 172.21.15.86:0/1322191334 conn(0x7fc6ec0fa1f0 msgr2=0x7fc6ec0fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:14.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.596+0000 7fc6f2000640 1 -- 172.21.15.86:0/1322191334 shutdown_connections 2024-09-13T16:08:14.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.596+0000 7fc6f2000640 1 -- 172.21.15.86:0/1322191334 wait complete. 2024-09-13T16:08:14.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.596+0000 7fc6f2000640 1 Processor -- start 2024-09-13T16:08:14.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.597+0000 7fc6f2000640 1 -- start start 2024-09-13T16:08:14.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.597+0000 7fc6f2000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6ec100610 0x7fc6ec197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:14.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.597+0000 7fc6f2000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ec102f40 0x7fc6ec198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:14.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.597+0000 7fc6f2000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6ec105870 0x7fc6ec19f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:14.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.597+0000 7fc6f2000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec19f9b0 con 0x7fc6ec100610 2024-09-13T16:08:14.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.597+0000 7fc6f2000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec19fb20 con 0x7fc6ec105870 2024-09-13T16:08:14.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.597+0000 7fc6f2000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec19fce0 con 0x7fc6ec102f40 2024-09-13T16:08:14.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.597+0000 7fc6f0c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6ec100610 0x7fc6ec197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:14.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.597+0000 7fc6f0c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6ec100610 0x7fc6ec197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41364/0 (socket says 172.21.15.86:41364) 2024-09-13T16:08:14.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.597+0000 7fc6f0c00640 1 -- 172.21.15.86:0/3476544629 learned_addr learned my addr 172.21.15.86:0/3476544629 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:14.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.597+0000 7fc6f1600640 1 --2- 172.21.15.86:0/3476544629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6ec105870 0x7fc6ec19f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:14.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.597+0000 7fc6ebe00640 1 --2- 172.21.15.86:0/3476544629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ec102f40 0x7fc6ec198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:14.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.597+0000 7fc6f0c00640 1 -- 172.21.15.86:0/3476544629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ec102f40 msgr2=0x7fc6ec198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:14.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.597+0000 7fc6f0c00640 1 --2- 172.21.15.86:0/3476544629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ec102f40 0x7fc6ec198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.597+0000 7fc6f0c00640 1 -- 172.21.15.86:0/3476544629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6ec105870 msgr2=0x7fc6ec19f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:14.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.597+0000 7fc6f0c00640 1 --2- 172.21.15.86:0/3476544629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6ec105870 0x7fc6ec19f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.597+0000 7fc6f0c00640 1 -- 172.21.15.86:0/3476544629 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e4009840 con 0x7fc6ec100610 2024-09-13T16:08:14.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.598+0000 7fc6f0c00640 1 --2- 172.21.15.86:0/3476544629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6ec100610 0x7fc6ec197ec0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0031510 tx=0x7fc6e0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:14.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.598+0000 7fc6e9600640 1 -- 172.21.15.86:0/3476544629 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0005000 con 0x7fc6ec100610 2024-09-13T16:08:14.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.598+0000 7fc6e9600640 1 -- 172.21.15.86:0/3476544629 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc6e00046c0 con 0x7fc6ec100610 2024-09-13T16:08:14.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.598+0000 7fc6f2000640 1 -- 172.21.15.86:0/3476544629 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e0009560 con 0x7fc6ec100610 2024-09-13T16:08:14.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.598+0000 7fc6e9600640 1 -- 172.21.15.86:0/3476544629 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0003950 con 0x7fc6ec100610 2024-09-13T16:08:14.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.598+0000 7fc6f2000640 1 -- 172.21.15.86:0/3476544629 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ec1a01d0 con 0x7fc6ec100610 2024-09-13T16:08:14.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.599+0000 7fc6f2000640 1 -- 172.21.15.86:0/3476544629 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ec1073c0 con 0x7fc6ec100610 2024-09-13T16:08:14.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.601+0000 7fc6e9600640 1 -- 172.21.15.86:0/3476544629 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc6e0003cc0 con 0x7fc6ec100610 2024-09-13T16:08:14.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.602+0000 7fc6e9600640 1 --2- 172.21.15.86:0/3476544629 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc6d40a1090 0x7fc6d40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:14.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.602+0000 7fc6e9600640 1 -- 172.21.15.86:0/3476544629 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc6e00eda60 con 0x7fc6ec100610 2024-09-13T16:08:14.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.603+0000 7fc6ebe00640 1 --2- 172.21.15.86:0/3476544629 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc6d40a1090 0x7fc6d40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:14.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.603+0000 7fc6ebe00640 1 --2- 172.21.15.86:0/3476544629 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc6d40a1090 0x7fc6d40a3550 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec1993d0 tx=0x7fc6d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:14.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.605+0000 7fc6e9600640 1 -- 172.21.15.86:0/3476544629 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc6e00b70c0 con 0x7fc6ec100610 2024-09-13T16:08:14.787 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.786+0000 7fc6f2000640 1 -- 172.21.15.86:0/3476544629 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6ec10b5e0 con 0x7fc6ec100610 2024-09-13T16:08:14.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.787+0000 7fc6e9600640 1 -- 172.21.15.86:0/3476544629 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23949 (secure 0 0 0) 0x7fc6e0040090 con 0x7fc6ec100610 2024-09-13T16:08:14.789 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:14.789 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":90,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:08:13.655740+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:08:14.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.791+0000 7fc6f2000640 1 -- 172.21.15.86:0/3476544629 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc6d40a1090 msgr2=0x7fc6d40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:14.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.791+0000 7fc6f2000640 1 --2- 172.21.15.86:0/3476544629 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc6d40a1090 0x7fc6d40a3550 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec1993d0 tx=0x7fc6d8005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:14.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.791+0000 7fc6f2000640 1 -- 172.21.15.86:0/3476544629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6ec100610 msgr2=0x7fc6ec197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:14.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.791+0000 7fc6f2000640 1 --2- 172.21.15.86:0/3476544629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6ec100610 0x7fc6ec197ec0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0031510 tx=0x7fc6e0004270 comp rx=0 tx=0).stop 2024-09-13T16:08:14.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.791+0000 7fc6f2000640 1 -- 172.21.15.86:0/3476544629 shutdown_connections 2024-09-13T16:08:14.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.791+0000 7fc6f2000640 1 --2- 172.21.15.86:0/3476544629 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc6d40a1090 0x7fc6d40a3550 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.791+0000 7fc6f2000640 1 --2- 172.21.15.86:0/3476544629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6ec105870 0x7fc6ec19f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.791+0000 7fc6f2000640 1 --2- 172.21.15.86:0/3476544629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ec102f40 0x7fc6ec198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.791+0000 7fc6f2000640 1 --2- 172.21.15.86:0/3476544629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6ec100610 0x7fc6ec197ec0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.791+0000 7fc6f2000640 1 -- 172.21.15.86:0/3476544629 >> 172.21.15.86:0/3476544629 conn(0x7fc6ec0fa1f0 msgr2=0x7fc6ec0ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:14.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.791+0000 7fc6f2000640 1 -- 172.21.15.86:0/3476544629 shutdown_connections 2024-09-13T16:08:14.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.791+0000 7fc6f2000640 1 -- 172.21.15.86:0/3476544629 wait complete. 2024-09-13T16:08:14.837 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:08:14.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.994+0000 7f47b2000640 1 -- 172.21.15.86:0/228288161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47ac100da0 msgr2=0x7f47ac101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:14.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.994+0000 7f47b2000640 1 --2- 172.21.15.86:0/228288161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47ac100da0 0x7f47ac101220 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4798009900 tx=0x7f479802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.994+0000 7f47b2000640 1 -- 172.21.15.86:0/228288161 shutdown_connections 2024-09-13T16:08:14.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.994+0000 7f47b2000640 1 --2- 172.21.15.86:0/228288161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47ac101760 0x7f47ac107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.994+0000 7f47b2000640 1 --2- 172.21.15.86:0/228288161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47ac100da0 0x7f47ac101220 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.994+0000 7f47b2000640 1 --2- 172.21.15.86:0/228288161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47ac0ffbb0 0x7f47ac0fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:14.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.994+0000 7f47b2000640 1 -- 172.21.15.86:0/228288161 >> 172.21.15.86:0/228288161 conn(0x7f47ac0fb330 msgr2=0x7f47ac0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:14.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.994+0000 7f47b2000640 1 -- 172.21.15.86:0/228288161 shutdown_connections 2024-09-13T16:08:14.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.994+0000 7f47b2000640 1 -- 172.21.15.86:0/228288161 wait complete. 2024-09-13T16:08:14.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.995+0000 7f47b2000640 1 Processor -- start 2024-09-13T16:08:14.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.995+0000 7f47b2000640 1 -- start start 2024-09-13T16:08:14.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.995+0000 7f47b2000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47ac0ffbb0 0x7f47ac074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:14.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.995+0000 7f47b2000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47ac100da0 0x7f47ac0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:14.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.995+0000 7f47b2000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47ac101760 0x7f47ac072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:14.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.995+0000 7f47b2000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac073540 con 0x7f47ac0ffbb0 2024-09-13T16:08:14.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.995+0000 7f47b2000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac0736b0 con 0x7f47ac100da0 2024-09-13T16:08:14.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.995+0000 7f47b2000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac19fd20 con 0x7f47ac101760 2024-09-13T16:08:15.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.995+0000 7f47b0c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47ac0ffbb0 0x7f47ac074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.996+0000 7f47abe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47ac100da0 0x7f47ac0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.996+0000 7f47abe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47ac100da0 0x7f47ac0728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:34598/0 (socket says 172.21.15.86:34598) 2024-09-13T16:08:15.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.996+0000 7f47abe00640 1 -- 172.21.15.86:0/583198149 learned_addr learned my addr 172.21.15.86:0/583198149 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:15.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.996+0000 7f47b1600640 1 --2- 172.21.15.86:0/583198149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47ac101760 0x7f47ac072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.996+0000 7f47abe00640 1 -- 172.21.15.86:0/583198149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47ac101760 msgr2=0x7f47ac072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:15.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.996+0000 7f47abe00640 1 --2- 172.21.15.86:0/583198149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47ac101760 0x7f47ac072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.996+0000 7f47abe00640 1 -- 172.21.15.86:0/583198149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47ac0ffbb0 msgr2=0x7f47ac074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:15.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.996+0000 7f47abe00640 1 --2- 172.21.15.86:0/583198149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47ac0ffbb0 0x7f47ac074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.996+0000 7f47abe00640 1 -- 172.21.15.86:0/583198149 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a0009490 con 0x7f47ac100da0 2024-09-13T16:08:15.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.996+0000 7f47abe00640 1 --2- 172.21.15.86:0/583198149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47ac100da0 0x7f47ac0728a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4798005ab0 tx=0x7f47980055a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:15.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.996+0000 7f47a9600640 1 -- 172.21.15.86:0/583198149 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798004b50 con 0x7f47ac100da0 2024-09-13T16:08:15.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.996+0000 7f47a9600640 1 -- 172.21.15.86:0/583198149 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4798004cb0 con 0x7f47ac100da0 2024-09-13T16:08:15.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.996+0000 7f47b2000640 1 -- 172.21.15.86:0/583198149 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4798009560 con 0x7f47ac100da0 2024-09-13T16:08:15.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.996+0000 7f47a9600640 1 -- 172.21.15.86:0/583198149 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798003be0 con 0x7f47ac100da0 2024-09-13T16:08:15.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.997+0000 7f47b2000640 1 -- 172.21.15.86:0/583198149 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ac1a0230 con 0x7f47ac100da0 2024-09-13T16:08:15.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.998+0000 7f47b2000640 1 -- 172.21.15.86:0/583198149 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ac107010 con 0x7f47ac100da0 2024-09-13T16:08:15.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:14.999+0000 7f47a9600640 1 -- 172.21.15.86:0/583198149 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4798003d40 con 0x7f47ac100da0 2024-09-13T16:08:15.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.001+0000 7f47a9600640 1 --2- 172.21.15.86:0/583198149 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f47940a1090 0x7f47940a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.001+0000 7f47a9600640 1 -- 172.21.15.86:0/583198149 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f47980edd90 con 0x7f47ac100da0 2024-09-13T16:08:15.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.001+0000 7f47b0c00640 1 --2- 172.21.15.86:0/583198149 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f47940a1090 0x7f47940a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.002+0000 7f47b0c00640 1 --2- 172.21.15.86:0/583198149 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f47940a1090 0x7f47940a3550 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f47ac100c00 tx=0x7f47a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:15.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.003+0000 7f47a9600640 1 -- 172.21.15.86:0/583198149 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f47980b7380 con 0x7f47ac100da0 2024-09-13T16:08:15.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.214+0000 7f47b2000640 1 -- 172.21.15.86:0/583198149 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47ac10b640 con 0x7f47ac100da0 2024-09-13T16:08:15.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.215+0000 7f47a9600640 1 -- 172.21.15.86:0/583198149 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10816 (secure 0 0 0) 0x7f47980cee60 con 0x7f47ac100da0 2024-09-13T16:08:15.216 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:15.217 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14508,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1509120923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1509120923},{"type":"v1","addr":"172.21.15.86:6839","nonce":1509120923}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6841/1971775519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":1971775519},{"type":"v1","addr":"172.21.15.86:6841","nonce":1971775519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1370900762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1370900762},{"type":"v1","addr":"172.21.15.194:6835","nonce":1370900762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2460451799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":2460451799},{"type":"v1","addr":"172.21.15.194:6837","nonce":2460451799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24530,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2399531832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2399531832},{"type":"v1","addr":"172.21.15.139:6837","nonce":2399531832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24544,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/3799859182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3799859182},{"type":"v1","addr":"172.21.15.194:6839","nonce":3799859182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:08:09.202262+0000","modified":"2024-09-13T16:08:13.655980+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.139:6839/3370280063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3370280063},{"type":"v1","addr":"172.21.15.139:6839","nonce":3370280063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T16:08:15.217 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 17 2024-09-13T16:08:15.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.217+0000 7f47b2000640 1 -- 172.21.15.86:0/583198149 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f47940a1090 msgr2=0x7f47940a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:15.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.217+0000 7f47b2000640 1 --2- 172.21.15.86:0/583198149 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f47940a1090 0x7f47940a3550 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f47ac100c00 tx=0x7f47a0005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:15.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.217+0000 7f47b2000640 1 -- 172.21.15.86:0/583198149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47ac100da0 msgr2=0x7f47ac0728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:15.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.217+0000 7f47b2000640 1 --2- 172.21.15.86:0/583198149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47ac100da0 0x7f47ac0728a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4798005ab0 tx=0x7f47980055a0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.217+0000 7f47b2000640 1 -- 172.21.15.86:0/583198149 shutdown_connections 2024-09-13T16:08:15.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.217+0000 7f47b2000640 1 --2- 172.21.15.86:0/583198149 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f47940a1090 0x7f47940a3550 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.217+0000 7f47b2000640 1 --2- 172.21.15.86:0/583198149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47ac101760 0x7f47ac072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.217+0000 7f47b2000640 1 --2- 172.21.15.86:0/583198149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47ac100da0 0x7f47ac0728a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.217+0000 7f47b2000640 1 --2- 172.21.15.86:0/583198149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47ac0ffbb0 0x7f47ac074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.217+0000 7f47b2000640 1 -- 172.21.15.86:0/583198149 >> 172.21.15.86:0/583198149 conn(0x7f47ac0fb330 msgr2=0x7f47ac1041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:15.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.217+0000 7f47b2000640 1 -- 172.21.15.86:0/583198149 shutdown_connections 2024-09-13T16:08:15.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.217+0000 7f47b2000640 1 -- 172.21.15.86:0/583198149 wait complete. 2024-09-13T16:08:15.235 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:08:15.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.391+0000 7fa1c7e00640 1 -- 172.21.15.86:0/3330204804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1c8101760 msgr2=0x7fa1c8107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:15.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.391+0000 7fa1c7e00640 1 --2- 172.21.15.86:0/3330204804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1c8101760 0x7fa1c8107ff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009be0 tx=0x7fa1c002a6c0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.391+0000 7fa1c7e00640 1 -- 172.21.15.86:0/3330204804 shutdown_connections 2024-09-13T16:08:15.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.391+0000 7fa1c7e00640 1 --2- 172.21.15.86:0/3330204804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1c8101760 0x7fa1c8107ff0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.391+0000 7fa1c7e00640 1 --2- 172.21.15.86:0/3330204804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c8100da0 0x7fa1c8101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.391+0000 7fa1c7e00640 1 --2- 172.21.15.86:0/3330204804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1c80ffbb0 0x7fa1c80fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.391+0000 7fa1c7e00640 1 -- 172.21.15.86:0/3330204804 >> 172.21.15.86:0/3330204804 conn(0x7fa1c80fb330 msgr2=0x7fa1c80fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:15.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.391+0000 7fa1c7e00640 1 -- 172.21.15.86:0/3330204804 shutdown_connections 2024-09-13T16:08:15.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.391+0000 7fa1c7e00640 1 -- 172.21.15.86:0/3330204804 wait complete. 2024-09-13T16:08:15.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.392+0000 7fa1c7e00640 1 Processor -- start 2024-09-13T16:08:15.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.392+0000 7fa1c7e00640 1 -- start start 2024-09-13T16:08:15.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.393+0000 7fa1c7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c80ffbb0 0x7fa1c8074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.393+0000 7fa1c7e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1c8100da0 0x7fa1c80728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.393+0000 7fa1c7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1c8101760 0x7fa1c8072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.393+0000 7fa1c7e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c8073540 con 0x7fa1c8100da0 2024-09-13T16:08:15.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.393+0000 7fa1c7e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c80736b0 con 0x7fa1c8101760 2024-09-13T16:08:15.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.393+0000 7fa1c7e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c819fce0 con 0x7fa1c80ffbb0 2024-09-13T16:08:15.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.393+0000 7fa1c6a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c80ffbb0 0x7fa1c8074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.393+0000 7fa1c6a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c80ffbb0 0x7fa1c8074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:58370/0 (socket says 172.21.15.86:58370) 2024-09-13T16:08:15.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.393+0000 7fa1c6a00640 1 -- 172.21.15.86:0/249413250 learned_addr learned my addr 172.21.15.86:0/249413250 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:15.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.393+0000 7fa1c6000640 1 --2- 172.21.15.86:0/249413250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1c8100da0 0x7fa1c80728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.393+0000 7fa1c7400640 1 --2- 172.21.15.86:0/249413250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1c8101760 0x7fa1c8072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.393+0000 7fa1c6a00640 1 -- 172.21.15.86:0/249413250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1c8101760 msgr2=0x7fa1c8072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:15.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.393+0000 7fa1c6a00640 1 --2- 172.21.15.86:0/249413250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1c8101760 0x7fa1c8072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.393+0000 7fa1c6a00640 1 -- 172.21.15.86:0/249413250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1c8100da0 msgr2=0x7fa1c80728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:15.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.393+0000 7fa1c6a00640 1 --2- 172.21.15.86:0/249413250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1c8100da0 0x7fa1c80728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.393+0000 7fa1c6a00640 1 -- 172.21.15.86:0/249413250 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b8009560 con 0x7fa1c80ffbb0 2024-09-13T16:08:15.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.393+0000 7fa1c7400640 1 --2- 172.21.15.86:0/249413250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1c8101760 0x7fa1c8072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:15.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.394+0000 7fa1c6a00640 1 --2- 172.21.15.86:0/249413250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c80ffbb0 0x7fa1c8074260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800e9a0 tx=0x7fa1b800ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:15.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.394+0000 7fa1bf400640 1 -- 172.21.15.86:0/249413250 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b800cd80 con 0x7fa1c80ffbb0 2024-09-13T16:08:15.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.394+0000 7fa1bf400640 1 -- 172.21.15.86:0/249413250 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa1b8010910 con 0x7fa1c80ffbb0 2024-09-13T16:08:15.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.394+0000 7fa1c7e00640 1 -- 172.21.15.86:0/249413250 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c0009840 con 0x7fa1c80ffbb0 2024-09-13T16:08:15.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.394+0000 7fa1bf400640 1 -- 172.21.15.86:0/249413250 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8018980 con 0x7fa1c80ffbb0 2024-09-13T16:08:15.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.394+0000 7fa1c7e00640 1 -- 172.21.15.86:0/249413250 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c81a0280 con 0x7fa1c80ffbb0 2024-09-13T16:08:15.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.395+0000 7fa1c7e00640 1 -- 172.21.15.86:0/249413250 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c8107040 con 0x7fa1c80ffbb0 2024-09-13T16:08:15.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.397+0000 7fa1bf400640 1 -- 172.21.15.86:0/249413250 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa1b8010a80 con 0x7fa1c80ffbb0 2024-09-13T16:08:15.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.398+0000 7fa1bf400640 1 --2- 172.21.15.86:0/249413250 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa1ac0a1110 0x7fa1ac0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.398+0000 7fa1bf400640 1 -- 172.21.15.86:0/249413250 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa1b8014070 con 0x7fa1c80ffbb0 2024-09-13T16:08:15.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.398+0000 7fa1c6000640 1 --2- 172.21.15.86:0/249413250 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa1ac0a1110 0x7fa1ac0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.399+0000 7fa1c6000640 1 --2- 172.21.15.86:0/249413250 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa1ac0a1110 0x7fa1ac0a35d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8073fd0 tx=0x7fa1b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:15.403 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.402+0000 7fa1bf400640 1 -- 172.21.15.86:0/249413250 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa1b80964d0 con 0x7fa1c80ffbb0 2024-09-13T16:08:15.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:15 smithi139 ceph-mon[35320]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T16:08:15.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:15 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/579170803' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:15.498 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:15 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3476544629' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:15.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:15 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/583198149' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:08:15.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:15 smithi194 ceph-mon[35694]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T16:08:15.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:15 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/579170803' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:15.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:15 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3476544629' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:15.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:15 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/583198149' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:08:15.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.579+0000 7fa1c7e00640 1 -- 172.21.15.86:0/249413250 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1c810b5f0 con 0x7fa1c80ffbb0 2024-09-13T16:08:15.582 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.581+0000 7fa1bf400640 1 -- 172.21.15.86:0/249413250 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23949 (secure 0 0 0) 0x7fa1b8099af0 con 0x7fa1c80ffbb0 2024-09-13T16:08:15.583 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:15.583 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":90,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:08:13.655740+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:08:15.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.583+0000 7fa1c7e00640 1 -- 172.21.15.86:0/249413250 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa1ac0a1110 msgr2=0x7fa1ac0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:15.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.583+0000 7fa1c7e00640 1 --2- 172.21.15.86:0/249413250 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa1ac0a1110 0x7fa1ac0a35d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8073fd0 tx=0x7fa1b4005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:15.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.583+0000 7fa1c7e00640 1 -- 172.21.15.86:0/249413250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c80ffbb0 msgr2=0x7fa1c8074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:15.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.583+0000 7fa1c7e00640 1 --2- 172.21.15.86:0/249413250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c80ffbb0 0x7fa1c8074260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800e9a0 tx=0x7fa1b800ee60 comp rx=0 tx=0).stop 2024-09-13T16:08:15.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.583+0000 7fa1c7e00640 1 -- 172.21.15.86:0/249413250 shutdown_connections 2024-09-13T16:08:15.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.583+0000 7fa1c7e00640 1 --2- 172.21.15.86:0/249413250 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa1ac0a1110 0x7fa1ac0a35d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.583+0000 7fa1c7e00640 1 --2- 172.21.15.86:0/249413250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1c8101760 0x7fa1c8072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.583+0000 7fa1c7e00640 1 --2- 172.21.15.86:0/249413250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1c8100da0 0x7fa1c80728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.583+0000 7fa1c7e00640 1 --2- 172.21.15.86:0/249413250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c80ffbb0 0x7fa1c8074260 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.583+0000 7fa1c7e00640 1 -- 172.21.15.86:0/249413250 >> 172.21.15.86:0/249413250 conn(0x7fa1c80fb330 msgr2=0x7fa1c8104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:15.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.583+0000 7fa1c7e00640 1 -- 172.21.15.86:0/249413250 shutdown_connections 2024-09-13T16:08:15.586 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.584+0000 7fa1c7e00640 1 -- 172.21.15.86:0/249413250 wait complete. 2024-09-13T16:08:15.600 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:15 smithi086 ceph-mon[30379]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T16:08:15.600 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:15 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/579170803' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:15.600 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:15 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3476544629' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:15.600 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:15 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/583198149' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:08:15.603 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T16:08:09.202262+0000', 'modified': '2024-09-13T16:08:13.655980+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24581}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24581': {'gid': 24581, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.139:6839/3370280063', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6838', 'nonce': 3370280063}, {'type': 'v1', 'addr': '172.21.15.139:6839', 'nonce': 3370280063}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-09-13T16:08:15.603 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T16:08:15.603 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T16:08:15.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.757+0000 7f99abe00640 1 -- 172.21.15.86:0/668000108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99ac074e70 msgr2=0x7f99ac075270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:15.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.757+0000 7f99abe00640 1 --2- 172.21.15.86:0/668000108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99ac074e70 0x7f99ac075270 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f999c009900 tx=0x7f999c02a410 comp rx=0 tx=0).stop 2024-09-13T16:08:15.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.757+0000 7f99abe00640 1 -- 172.21.15.86:0/668000108 shutdown_connections 2024-09-13T16:08:15.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.757+0000 7f99abe00640 1 --2- 172.21.15.86:0/668000108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99ac076a50 0x7f99ac0772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.757+0000 7f99abe00640 1 --2- 172.21.15.86:0/668000108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99ac0760b0 0x7f99ac076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.757+0000 7f99abe00640 1 --2- 172.21.15.86:0/668000108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99ac074e70 0x7f99ac075270 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.757+0000 7f99abe00640 1 -- 172.21.15.86:0/668000108 >> 172.21.15.86:0/668000108 conn(0x7f99ac0fd500 msgr2=0x7f99ac0ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:15.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.757+0000 7f99abe00640 1 -- 172.21.15.86:0/668000108 shutdown_connections 2024-09-13T16:08:15.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.757+0000 7f99abe00640 1 -- 172.21.15.86:0/668000108 wait complete. 2024-09-13T16:08:15.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.758+0000 7f99abe00640 1 Processor -- start 2024-09-13T16:08:15.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.758+0000 7f99abe00640 1 -- start start 2024-09-13T16:08:15.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.758+0000 7f99abe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99ac074e70 0x7f99ac19c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.759+0000 7f99abe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99ac0760b0 0x7f99ac19c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.759+0000 7f99abe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99ac076a50 0x7f99ac1a3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.759+0000 7f99abe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac1a3da0 con 0x7f99ac074e70 2024-09-13T16:08:15.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.759+0000 7f99abe00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac1a3f10 con 0x7f99ac0760b0 2024-09-13T16:08:15.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.759+0000 7f99abe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac1a40d0 con 0x7f99ac076a50 2024-09-13T16:08:15.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.759+0000 7f99aaa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99ac074e70 0x7f99ac19c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.759+0000 7f99aaa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99ac074e70 0x7f99ac19c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41430/0 (socket says 172.21.15.86:41430) 2024-09-13T16:08:15.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.759+0000 7f99aaa00640 1 -- 172.21.15.86:0/3312321167 learned_addr learned my addr 172.21.15.86:0/3312321167 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:15.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.759+0000 7f99ab400640 1 --2- 172.21.15.86:0/3312321167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99ac076a50 0x7f99ac1a3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.759+0000 7f99aa000640 1 --2- 172.21.15.86:0/3312321167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99ac0760b0 0x7f99ac19c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.759+0000 7f99aaa00640 1 -- 172.21.15.86:0/3312321167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99ac076a50 msgr2=0x7f99ac1a3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:15.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.759+0000 7f99aaa00640 1 --2- 172.21.15.86:0/3312321167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99ac076a50 0x7f99ac1a3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.759+0000 7f99aaa00640 1 -- 172.21.15.86:0/3312321167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99ac0760b0 msgr2=0x7f99ac19c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:15.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.759+0000 7f99aaa00640 1 --2- 172.21.15.86:0/3312321167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99ac0760b0 0x7f99ac19c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.759+0000 7f99aaa00640 1 -- 172.21.15.86:0/3312321167 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c009560 con 0x7f99ac074e70 2024-09-13T16:08:15.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.759+0000 7f99aa000640 1 --2- 172.21.15.86:0/3312321167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99ac0760b0 0x7f99ac19c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:08:15.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.759+0000 7f99aaa00640 1 --2- 172.21.15.86:0/3312321167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99ac074e70 0x7f99ac19c2b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f999c031510 tx=0x7f999c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:15.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.760+0000 7f99b0a00640 1 -- 172.21.15.86:0/3312321167 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c004cc0 con 0x7f99ac074e70 2024-09-13T16:08:15.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.760+0000 7f99b0a00640 1 -- 172.21.15.86:0/3312321167 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f999c003ad0 con 0x7f99ac074e70 2024-09-13T16:08:15.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.760+0000 7f99abe00640 1 -- 172.21.15.86:0/3312321167 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ac1a4350 con 0x7f99ac074e70 2024-09-13T16:08:15.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.760+0000 7f99b0a00640 1 -- 172.21.15.86:0/3312321167 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c031d60 con 0x7f99ac074e70 2024-09-13T16:08:15.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.760+0000 7f99abe00640 1 -- 172.21.15.86:0/3312321167 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ac1a4800 con 0x7f99ac074e70 2024-09-13T16:08:15.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.763+0000 7f99b4bc4740 1 Processor -- start 2024-09-13T16:08:15.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.763+0000 7f99b0a00640 1 -- 172.21.15.86:0/3312321167 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f999c003c40 con 0x7f99ac074e70 2024-09-13T16:08:15.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.763+0000 7f99b4bc4740 1 -- start start 2024-09-13T16:08:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.763+0000 7f99b4bc4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 0x5637f6f8d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.763+0000 7f99b4bc4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f8d5e0 0x5637f6f920a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.763+0000 7f99b4bc4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f92670 0x5637f6f94b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.763+0000 7f99b4bc4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f6ef6ab0 con 0x5637f6f8d5e0 2024-09-13T16:08:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.763+0000 7f99b4bc4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f6ef4240 con 0x5637f6f92670 2024-09-13T16:08:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.763+0000 7f99b4bc4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f6eefb30 con 0x5637f6f8cca0 2024-09-13T16:08:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.763+0000 7f99aaa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f8d5e0 0x5637f6f920a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.763+0000 7f99ab400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 0x5637f6f8d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.763+0000 7f99ab400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 0x5637f6f8d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:58400/0 (socket says 172.21.15.86:58400) 2024-09-13T16:08:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.763+0000 7f99ab400640 1 -- 172.21.15.86:0/3787191549 learned_addr learned my addr 172.21.15.86:0/3787191549 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.764+0000 7f99aa000640 1 --2- 172.21.15.86:0/3787191549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f92670 0x5637f6f94b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.764+0000 7f99ab400640 1 -- 172.21.15.86:0/3787191549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f92670 msgr2=0x5637f6f94b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:15.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.764+0000 7f99ab400640 1 --2- 172.21.15.86:0/3787191549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f92670 0x5637f6f94b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.764+0000 7f99ab400640 1 -- 172.21.15.86:0/3787191549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f8d5e0 msgr2=0x5637f6f920a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:15.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.764+0000 7f99ab400640 1 --2- 172.21.15.86:0/3787191549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f8d5e0 0x5637f6f920a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.764+0000 7f99ab400640 1 -- 172.21.15.86:0/3787191549 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637f6ebabd0 con 0x5637f6f8cca0 2024-09-13T16:08:15.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.764+0000 7f99ab400640 1 --2- 172.21.15.86:0/3787191549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 0x5637f6f8d0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f99a4010370 tx=0x7f99a4010830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29bb34d1dc2568cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:15.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.764+0000 7f99b0a00640 1 --2- 172.21.15.86:0/3312321167 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f99900a1090 0x7f99900a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.764+0000 7f99a0c00640 1 -- 172.21.15.86:0/3787191549 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4004d20 con 0x5637f6f8cca0 2024-09-13T16:08:15.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.764+0000 7f99a0c00640 1 -- 172.21.15.86:0/3787191549 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f99a4004e80 con 0x5637f6f8cca0 2024-09-13T16:08:15.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.764+0000 7f99b0a00640 1 -- 172.21.15.86:0/3312321167 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f999c0edc50 con 0x7f99ac074e70 2024-09-13T16:08:15.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.764+0000 7f99a0c00640 1 -- 172.21.15.86:0/3787191549 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a40054d0 con 0x5637f6f8cca0 2024-09-13T16:08:15.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.764+0000 7f99aaa00640 1 --2- 172.21.15.86:0/3312321167 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f99900a1090 0x7f99900a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.765+0000 7f99b4bc4740 1 -- 172.21.15.86:0/3787191549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 msgr2=0x5637f6f8d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:15.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.765+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/3787191549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 0x5637f6f8d0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f99a4010370 tx=0x7f99a4010830 comp rx=0 tx=0).stop 2024-09-13T16:08:15.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.765+0000 7f99aaa00640 1 --2- 172.21.15.86:0/3312321167 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f99900a1090 0x7f99900a3550 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f999c003aa0 tx=0x7f999c0f1650 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:15.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.765+0000 7f99b4bc4740 1 -- 172.21.15.86:0/3787191549 shutdown_connections 2024-09-13T16:08:15.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.765+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/3787191549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f92670 0x5637f6f94b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.765+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/3787191549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f8d5e0 0x5637f6f920a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.765+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/3787191549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 0x5637f6f8d0a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.765+0000 7f99b4bc4740 1 -- 172.21.15.86:0/3787191549 >> 172.21.15.86:0/3787191549 conn(0x5637f6f88310 msgr2=0x5637f6f88710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:15.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.765+0000 7f99b4bc4740 1 -- 172.21.15.86:0/3787191549 shutdown_connections 2024-09-13T16:08:15.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.765+0000 7f99b4bc4740 1 -- 172.21.15.86:0/3787191549 wait complete. 2024-09-13T16:08:15.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.766+0000 7f99b4bc4740 1 -- start start 2024-09-13T16:08:15.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.766+0000 7f99b4bc4740 1 Processor -- start 2024-09-13T16:08:15.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.766+0000 7f99b4bc4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 0x5637f6f96920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.766+0000 7f99b4bc4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f8d5e0 0x5637f6f96e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.766+0000 7f99b4bc4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f92670 0x5637f6f9dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.766+0000 7f99b4bc4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f6e91260 con 0x5637f6f92670 2024-09-13T16:08:15.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.766+0000 7f99b4bc4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f6e90f00 con 0x5637f6f8d5e0 2024-09-13T16:08:15.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.766+0000 7f99b4bc4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f6c56f20 con 0x5637f6f8cca0 2024-09-13T16:08:15.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.766+0000 7f99b4bc4740 10 client.0 _ll_register_callbacks cb 0x5637f6ee91a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:08:15.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.767+0000 7f99aa000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f8d5e0 0x5637f6f96e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.767+0000 7f99ab400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f92670 0x5637f6f9dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.767+0000 7f99aa000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f8d5e0 0x5637f6f96e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:34664/0 (socket says 172.21.15.86:34664) 2024-09-13T16:08:15.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.767+0000 7f99aa000640 1 -- 172.21.15.86:0/2710923518 learned_addr learned my addr 172.21.15.86:0/2710923518 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:15.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.767+0000 7f99ab400640 1 --2- 172.21.15.86:0/2710923518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 0x5637f6f96920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.767+0000 7f99aa000640 1 -- 172.21.15.86:0/2710923518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 msgr2=0x5637f6f96920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:15.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.767+0000 7f99aa000640 1 --2- 172.21.15.86:0/2710923518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 0x5637f6f96920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.767+0000 7f99aa000640 1 -- 172.21.15.86:0/2710923518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f92670 msgr2=0x5637f6f9dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:15.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.767+0000 7f99aa000640 1 --2- 172.21.15.86:0/2710923518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f92670 0x5637f6f9dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.767+0000 7f99aa000640 1 -- 172.21.15.86:0/2710923518 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a4009c50 con 0x5637f6f8d5e0 2024-09-13T16:08:15.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.767+0000 7f99aa000640 1 --2- 172.21.15.86:0/2710923518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f8d5e0 0x5637f6f96e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f999800bf80 tx=0x7f99980128e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccebca5964b7ad0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:15.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.767+0000 7f9995600640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-13T16:08:15.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.768+0000 7f9995600640 1 -- 172.21.15.86:0/2710923518 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998005220 con 0x5637f6f8d5e0 2024-09-13T16:08:15.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.768+0000 7f99b4bc4740 1 -- 172.21.15.86:0/2710923518 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5637f6be33c0 con 0x5637f6f8d5e0 2024-09-13T16:08:15.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.768+0000 7f9995600640 1 -- 172.21.15.86:0/2710923518 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f9998005380 con 0x5637f6f8d5e0 2024-09-13T16:08:15.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.768+0000 7f9995600640 1 -- 172.21.15.86:0/2710923518 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9998005540 con 0x5637f6f8d5e0 2024-09-13T16:08:15.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.768+0000 7f99b4bc4740 10 client.24689 fetch_fsmap learned FSMap version 17 2024-09-13T16:08:15.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.768+0000 7f99b4bc4740 1 -- 172.21.15.86:0/2710923518 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x5637f6eee1b0 con 0x5637f6f8d5e0 2024-09-13T16:08:15.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.768+0000 7f9995600640 1 -- 172.21.15.86:0/2710923518 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5637f6be33c0 con 0x5637f6f8d5e0 2024-09-13T16:08:15.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.768+0000 7f9995600640 1 -- 172.21.15.86:0/2710923518 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 17) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f9998010b90 con 0x5637f6f8d5e0 2024-09-13T16:08:15.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.768+0000 7f99b4bc4740 10 client.24689 fetch_fsmap finished waiting for FSMap version 17 2024-09-13T16:08:15.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.768+0000 7f99b4bc4740 10 client.24689 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T16:08:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.768+0000 7f99b4bc4740 20 client.24689 populate_metadata read hostname 'smithi086' 2024-09-13T16:08:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.768+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/2710923518 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5637f6fa2da0 0x5637f6fa6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.768+0000 7f99b4bc4740 4 client.24689 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:08:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.768+0000 7f99b4bc4740 1 -- 172.21.15.86:0/2710923518 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5637f6bf46c0 con 0x5637f6fa2da0 2024-09-13T16:08:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.769+0000 7f99ab400640 1 --2- 172.21.15.86:0/2710923518 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5637f6fa2da0 0x5637f6fa6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.769+0000 7f99ab400640 1 --2- 172.21.15.86:0/2710923518 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5637f6fa2da0 0x5637f6fa6f00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ba7ad6a6c3756f5 server_cookie=c52a6d93b45981de in_seq=0 out_seq=0 2024-09-13T16:08:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.769+0000 7f9995600640 10 client.24689 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:08:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.770+0000 7f9995600640 1 -- 172.21.15.86:0/2710923518 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5637f6bf46c0 con 0x5637f6fa2da0 2024-09-13T16:08:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.770+0000 7f9995600640 10 client.24689 handle_command_reply: tid=0 2024-09-13T16:08:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.770+0000 7f99b4bc4740 1 client.24689 shutdown 2024-09-13T16:08:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.770+0000 7f99b4bc4740 1 -- 172.21.15.86:0/2710923518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f8d5e0 msgr2=0x5637f6f96e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.770+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/2710923518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f8d5e0 0x5637f6f96e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f999800bf80 tx=0x7f99980128e0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.770+0000 7f99b4bc4740 1 -- 172.21.15.86:0/2710923518 shutdown_connections 2024-09-13T16:08:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.770+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/2710923518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f92670 0x5637f6f9dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.770+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/2710923518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f8d5e0 0x5637f6f96e60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.770+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/2710923518 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5637f6fa2da0 0x5637f6fa6f00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.770+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/2710923518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 0x5637f6f96920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.770+0000 7f9995600640 0 client.24689 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:08:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.770+0000 7f99b4bc4740 1 -- 172.21.15.86:0/2710923518 >> 172.21.15.86:0/2710923518 conn(0x5637f6f88310 msgr2=0x5637f6f87650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.770+0000 7f99b4bc4740 1 -- 172.21.15.86:0/2710923518 shutdown_connections 2024-09-13T16:08:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.770+0000 7f99b4bc4740 1 -- 172.21.15.86:0/2710923518 wait complete. 2024-09-13T16:08:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.770+0000 7f99b4bc4740 20 client.24689 trim_cache size 0 max 16384 2024-09-13T16:08:15.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.785+0000 7f99b4bc4740 1 Processor -- start 2024-09-13T16:08:15.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.785+0000 7f99b4bc4740 1 -- start start 2024-09-13T16:08:15.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.785+0000 7f99b4bc4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f8cca0 0x5637f6f8d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.785+0000 7f99b4bc4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8d5e0 0x5637f6f9de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.785+0000 7f99b4bc4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f92670 0x5637f6f96920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.785+0000 7f99b4bc4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f6be33c0 con 0x5637f6f92670 2024-09-13T16:08:15.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.785+0000 7f99b4bc4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f6f84140 con 0x5637f6f8cca0 2024-09-13T16:08:15.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.785+0000 7f99b4bc4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f6f8dea0 con 0x5637f6f8d5e0 2024-09-13T16:08:15.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.786+0000 7f99ab400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f92670 0x5637f6f96920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.786+0000 7f99ab400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f92670 0x5637f6f96920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41458/0 (socket says 172.21.15.86:41458) 2024-09-13T16:08:15.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.786+0000 7f99aa000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8d5e0 0x5637f6f9de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.786+0000 7f99ab400640 1 -- 172.21.15.86:0/3765123630 learned_addr learned my addr 172.21.15.86:0/3765123630 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:15.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.786+0000 7f99ab400640 1 --2- 172.21.15.86:0/3765123630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f8cca0 0x5637f6f8d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.786+0000 7f99aa000640 1 -- 172.21.15.86:0/3765123630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f8cca0 msgr2=0x5637f6f8d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:15.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.786+0000 7f99aa000640 1 --2- 172.21.15.86:0/3765123630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f8cca0 0x5637f6f8d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.786+0000 7f99aa000640 1 -- 172.21.15.86:0/3765123630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f92670 msgr2=0x5637f6f96920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:15.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.786+0000 7f99aa000640 1 --2- 172.21.15.86:0/3765123630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f92670 0x5637f6f96920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.786+0000 7f99aa000640 1 -- 172.21.15.86:0/3765123630 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637f6e90470 con 0x5637f6f8d5e0 2024-09-13T16:08:15.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.786+0000 7f99ab400640 1 --2- 172.21.15.86:0/3765123630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f92670 0x5637f6f96920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:15.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.786+0000 7f99aa000640 1 --2- 172.21.15.86:0/3765123630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8d5e0 0x5637f6f9de60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9998010f90 tx=0x7f999800b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3a020633cdebaa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:15.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.787+0000 7f99a1600640 1 -- 172.21.15.86:0/3765123630 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998021860 con 0x5637f6f8d5e0 2024-09-13T16:08:15.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.787+0000 7f99a1600640 1 -- 172.21.15.86:0/3765123630 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f99980219c0 con 0x5637f6f8d5e0 2024-09-13T16:08:15.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.787+0000 7f99a1600640 1 -- 172.21.15.86:0/3765123630 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998004680 con 0x5637f6f8d5e0 2024-09-13T16:08:15.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.787+0000 7f99b4bc4740 1 -- 172.21.15.86:0/3765123630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8d5e0 msgr2=0x5637f6f9de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:15.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.787+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/3765123630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8d5e0 0x5637f6f9de60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9998010f90 tx=0x7f999800b840 comp rx=0 tx=0).stop 2024-09-13T16:08:15.795 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.787+0000 7f99b4bc4740 1 -- 172.21.15.86:0/3765123630 shutdown_connections 2024-09-13T16:08:15.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.787+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/3765123630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f92670 0x5637f6f96920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.787+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/3765123630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8d5e0 0x5637f6f9de60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.787+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/3765123630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f8cca0 0x5637f6f8d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.787+0000 7f99b4bc4740 1 -- 172.21.15.86:0/3765123630 >> 172.21.15.86:0/3765123630 conn(0x5637f6f88310 msgr2=0x5637f6f95e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:15.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.787+0000 7f99b4bc4740 1 -- 172.21.15.86:0/3765123630 shutdown_connections 2024-09-13T16:08:15.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.787+0000 7f99b4bc4740 1 -- 172.21.15.86:0/3765123630 wait complete. 2024-09-13T16:08:15.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.788+0000 7f99b4bc4740 1 -- start start 2024-09-13T16:08:15.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.788+0000 7f99b4bc4740 1 Processor -- start 2024-09-13T16:08:15.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.788+0000 7f99b4bc4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 0x5637f6f988b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.788+0000 7f99b4bc4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f8d5e0 0x5637f6f9de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.788+0000 7f99b4bc4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f92670 0x5637f6f98f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.788+0000 7f99b4bc4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f6ff8bc0 con 0x5637f6f8d5e0 2024-09-13T16:08:15.797 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.788+0000 7f99b4bc4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f6ff8d00 con 0x5637f6f92670 2024-09-13T16:08:15.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.788+0000 7f99b4bc4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f6ff8e70 con 0x5637f6f8cca0 2024-09-13T16:08:15.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.789+0000 7f99b4bc4740 10 client.0 _ll_register_callbacks cb 0x7f999800bb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:08:15.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.789+0000 7f99ab400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 0x5637f6f988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.789+0000 7f99ab400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 0x5637f6f988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:58430/0 (socket says 172.21.15.86:58430) 2024-09-13T16:08:15.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.789+0000 7f99ab400640 1 -- 172.21.15.86:0/560591625 learned_addr learned my addr 172.21.15.86:0/560591625 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:15.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.789+0000 7f99aa000640 1 --2- 172.21.15.86:0/560591625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f8d5e0 0x5637f6f9de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.798 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.789+0000 7f99ab400640 1 --2- 172.21.15.86:0/560591625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f92670 0x5637f6f98f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.789+0000 7f99ab400640 1 -- 172.21.15.86:0/560591625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f92670 msgr2=0x5637f6f98f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:15.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.789+0000 7f99ab400640 1 --2- 172.21.15.86:0/560591625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f92670 0x5637f6f98f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.789+0000 7f99ab400640 1 -- 172.21.15.86:0/560591625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f8d5e0 msgr2=0x5637f6f9de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:15.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.789+0000 7f99ab400640 1 --2- 172.21.15.86:0/560591625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f8d5e0 0x5637f6f9de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.789+0000 7f99ab400640 1 -- 172.21.15.86:0/560591625 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a4023040 con 0x5637f6f8cca0 2024-09-13T16:08:15.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.789+0000 7f99ab400640 1 --2- 172.21.15.86:0/560591625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 0x5637f6f988b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f99a4010d30 tx=0x7f99a401c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25b682e34bbca899 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:15.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.789+0000 7f9995600640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-13T16:08:15.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.789+0000 7f9995600640 1 -- 172.21.15.86:0/560591625 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4034020 con 0x5637f6f8cca0 2024-09-13T16:08:15.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.789+0000 7f99b4bc4740 1 -- 172.21.15.86:0/560591625 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5637f6f19cd0 con 0x5637f6f8cca0 2024-09-13T16:08:15.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.789+0000 7f9995600640 1 -- 172.21.15.86:0/560591625 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f99a40058f0 con 0x5637f6f8cca0 2024-09-13T16:08:15.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.790+0000 7f9995600640 1 -- 172.21.15.86:0/560591625 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99a402d450 con 0x5637f6f8cca0 2024-09-13T16:08:15.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.790+0000 7f99b4bc4740 10 client.24697 fetch_fsmap learned FSMap version 17 2024-09-13T16:08:15.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.790+0000 7f99b4bc4740 1 -- 172.21.15.86:0/560591625 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x5637f6eee1b0 con 0x5637f6f8cca0 2024-09-13T16:08:15.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.790+0000 7f9995600640 1 -- 172.21.15.86:0/560591625 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5637f6f19cd0 con 0x5637f6f8cca0 2024-09-13T16:08:15.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.790+0000 7f9995600640 1 -- 172.21.15.86:0/560591625 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 17) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f99a4012c20 con 0x5637f6f8cca0 2024-09-13T16:08:15.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.790+0000 7f99b4bc4740 10 client.24697 fetch_fsmap finished waiting for FSMap version 17 2024-09-13T16:08:15.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.790+0000 7f99b4bc4740 10 client.24697 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T16:08:15.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.790+0000 7f99b4bc4740 20 client.24697 populate_metadata read hostname 'smithi086' 2024-09-13T16:08:15.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.790+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/560591625 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5637f6ffdcb0 0x5637f6ffa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:15.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.790+0000 7f99b4bc4740 4 client.24697 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T16:08:15.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.790+0000 7f99b4bc4740 1 -- 172.21.15.86:0/560591625 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5637f6c47d10 con 0x5637f6ffdcb0 2024-09-13T16:08:15.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.791+0000 7f99aa000640 1 --2- 172.21.15.86:0/560591625 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5637f6ffdcb0 0x5637f6ffa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:15.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.791+0000 7f9995600640 10 client.24697 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:08:15.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.791+0000 7f99aa000640 1 --2- 172.21.15.86:0/560591625 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5637f6ffdcb0 0x5637f6ffa5f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3397e3c3a375993b server_cookie=64d81c7c3d0d5f87 in_seq=0 out_seq=0 2024-09-13T16:08:15.802 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.791+0000 7f9995600640 1 -- 172.21.15.86:0/560591625 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x5637f6c47d10 con 0x5637f6ffdcb0 2024-09-13T16:08:15.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.791+0000 7f9995600640 10 client.24697 handle_command_reply: tid=0 2024-09-13T16:08:15.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.791+0000 7f99b4bc4740 1 client.24697 shutdown 2024-09-13T16:08:15.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.791+0000 7f99b4bc4740 1 -- 172.21.15.86:0/560591625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 msgr2=0x5637f6f988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:15.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.791+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/560591625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 0x5637f6f988b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f99a4010d30 tx=0x7f99a401c040 comp rx=0 tx=0).stop 2024-09-13T16:08:15.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99b4bc4740 1 -- 172.21.15.86:0/560591625 shutdown_connections 2024-09-13T16:08:15.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/560591625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637f6f92670 0x5637f6f98f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/560591625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5637f6f8d5e0 0x5637f6f9de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/560591625 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5637f6ffdcb0 0x5637f6ffa5f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99b4bc4740 1 --2- 172.21.15.86:0/560591625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5637f6f8cca0 0x5637f6f988b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99b4bc4740 1 -- 172.21.15.86:0/560591625 >> 172.21.15.86:0/560591625 conn(0x5637f6f88310 msgr2=0x5637f6f968c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:15.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f9995600640 0 client.24697 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:08:15.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99b4bc4740 1 -- 172.21.15.86:0/560591625 shutdown_connections 2024-09-13T16:08:15.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99b4bc4740 1 -- 172.21.15.86:0/560591625 wait complete. 2024-09-13T16:08:15.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99b4bc4740 20 client.24697 trim_cache size 0 max 16384 2024-09-13T16:08:15.804 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T16:08:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "1ecdfbda-71e9-11ef-bceb-c7b262605968", 2024-09-13T16:08:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2024-09-13T16:08:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24581, 2024-09-13T16:08:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-09-13T16:08:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-09-13T16:08:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-09-13T16:08:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 6.5868313250000003, 2024-09-13T16:08:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 17, 2024-09-13T16:08:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 90, 2024-09-13T16:08:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 89, 2024-09-13T16:08:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 11.874584831 2024-09-13T16:08:15.805 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T16:08:15.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99abe00640 1 -- 172.21.15.86:0/3312321167 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f99900a1090 msgr2=0x7f99900a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:15.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99abe00640 1 --2- 172.21.15.86:0/3312321167 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f99900a1090 0x7f99900a3550 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f999c003aa0 tx=0x7f999c0f1650 comp rx=0 tx=0).stop 2024-09-13T16:08:15.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99abe00640 1 -- 172.21.15.86:0/3312321167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99ac074e70 msgr2=0x7f99ac19c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:15.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99abe00640 1 --2- 172.21.15.86:0/3312321167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99ac074e70 0x7f99ac19c2b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f999c031510 tx=0x7f999c0046c0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99abe00640 1 -- 172.21.15.86:0/3312321167 shutdown_connections 2024-09-13T16:08:15.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99abe00640 1 --2- 172.21.15.86:0/3312321167 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f99900a1090 0x7f99900a3550 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.806 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99abe00640 1 --2- 172.21.15.86:0/3312321167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99ac076a50 0x7f99ac1a3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99abe00640 1 --2- 172.21.15.86:0/3312321167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99ac0760b0 0x7f99ac19c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99abe00640 1 --2- 172.21.15.86:0/3312321167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99ac074e70 0x7f99ac19c2b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:15.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.792+0000 7f99abe00640 1 -- 172.21.15.86:0/3312321167 >> 172.21.15.86:0/3312321167 conn(0x7f99ac0fd500 msgr2=0x7f99ac0fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:15.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.793+0000 7f99abe00640 1 -- 172.21.15.86:0/3312321167 shutdown_connections 2024-09-13T16:08:15.807 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:15.793+0000 7f99abe00640 1 -- 172.21.15.86:0/3312321167 wait complete. 2024-09-13T16:08:15.809 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T16:08:15.809 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T16:08:15.810 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T16:08:16.122 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:08:16.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:16 smithi194 ceph-mon[35694]: pgmap v298: 129 pgs: 1 creating+peering, 111 active+clean, 17 unknown; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 8 op/s 2024-09-13T16:08:16.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:16 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/249413250' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:16.535 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:16 smithi086 ceph-mon[30379]: pgmap v298: 129 pgs: 1 creating+peering, 111 active+clean, 17 unknown; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 8 op/s 2024-09-13T16:08:16.535 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:16 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/249413250' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:16.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:16 smithi139 ceph-mon[35320]: pgmap v298: 129 pgs: 1 creating+peering, 111 active+clean, 17 unknown; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 8 op/s 2024-09-13T16:08:16.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:16 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/249413250' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:17.295 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:17 smithi086 ceph-mon[30379]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T16:08:17.295 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:17 smithi086 ceph-mon[30379]: Cluster is now healthy 2024-09-13T16:08:17.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:17 smithi194 ceph-mon[35694]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T16:08:17.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:17 smithi194 ceph-mon[35694]: Cluster is now healthy 2024-09-13T16:08:17.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:17 smithi139 ceph-mon[35320]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T16:08:17.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:17 smithi139 ceph-mon[35320]: Cluster is now healthy 2024-09-13T16:08:17.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.959+0000 7fa958800640 1 -- 172.21.15.86:0/2380072761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9500749e0 msgr2=0x7fa950074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:17.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.959+0000 7fa958800640 1 --2- 172.21.15.86:0/2380072761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9500749e0 0x7fa950074dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa944009900 tx=0x7fa94402a410 comp rx=0 tx=0).stop 2024-09-13T16:08:17.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.959+0000 7fa958800640 1 -- 172.21.15.86:0/2380072761 shutdown_connections 2024-09-13T16:08:17.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.959+0000 7fa958800640 1 --2- 172.21.15.86:0/2380072761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa950110c40 0x7fa950113030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:17.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.959+0000 7fa958800640 1 --2- 172.21.15.86:0/2380072761 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa950075300 0x7fa950110700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:17.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.959+0000 7fa958800640 1 --2- 172.21.15.86:0/2380072761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9500749e0 0x7fa950074dc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:17.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.959+0000 7fa958800640 1 -- 172.21.15.86:0/2380072761 >> 172.21.15.86:0/2380072761 conn(0x7fa9500fdc60 msgr2=0x7fa950100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:17.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.959+0000 7fa958800640 1 -- 172.21.15.86:0/2380072761 shutdown_connections 2024-09-13T16:08:17.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.959+0000 7fa958800640 1 -- 172.21.15.86:0/2380072761 wait complete. 2024-09-13T16:08:17.968 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.960+0000 7fa958800640 1 Processor -- start 2024-09-13T16:08:17.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.960+0000 7fa958800640 1 -- start start 2024-09-13T16:08:17.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.961+0000 7fa958800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9500749e0 0x7fa95019c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:17.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.961+0000 7fa958800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa950075300 0x7fa95019cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:17.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.961+0000 7fa958800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa950110c40 0x7fa9501a1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:17.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.961+0000 7fa958800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9501a1950 con 0x7fa9500749e0 2024-09-13T16:08:17.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.961+0000 7fa958800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9501a1ac0 con 0x7fa950075300 2024-09-13T16:08:17.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.961+0000 7fa958800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9501a1c80 con 0x7fa950110c40 2024-09-13T16:08:17.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.961+0000 7fa955e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9500749e0 0x7fa95019c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:17.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.961+0000 7fa955e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9500749e0 0x7fa95019c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41490/0 (socket says 172.21.15.86:41490) 2024-09-13T16:08:17.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.961+0000 7fa955e00640 1 -- 172.21.15.86:0/287311975 learned_addr learned my addr 172.21.15.86:0/287311975 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:17.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.961+0000 7fa955400640 1 --2- 172.21.15.86:0/287311975 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa950075300 0x7fa95019cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:17.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.961+0000 7fa956800640 1 --2- 172.21.15.86:0/287311975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa950110c40 0x7fa9501a1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:17.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.961+0000 7fa955e00640 1 -- 172.21.15.86:0/287311975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa950110c40 msgr2=0x7fa9501a1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:17.969 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.961+0000 7fa955e00640 1 --2- 172.21.15.86:0/287311975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa950110c40 0x7fa9501a1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:17.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.961+0000 7fa955e00640 1 -- 172.21.15.86:0/287311975 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa950075300 msgr2=0x7fa95019cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:17.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.961+0000 7fa955e00640 1 --2- 172.21.15.86:0/287311975 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa950075300 0x7fa95019cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:17.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.961+0000 7fa955e00640 1 -- 172.21.15.86:0/287311975 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa944009560 con 0x7fa9500749e0 2024-09-13T16:08:17.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.962+0000 7fa955e00640 1 --2- 172.21.15.86:0/287311975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9500749e0 0x7fa95019c9e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa944005ab0 tx=0x7fa944005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:17.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.962+0000 7fa94aa00640 1 -- 172.21.15.86:0/287311975 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944004bd0 con 0x7fa9500749e0 2024-09-13T16:08:17.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.962+0000 7fa958800640 1 -- 172.21.15.86:0/287311975 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9501a1f00 con 0x7fa9500749e0 2024-09-13T16:08:17.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.962+0000 7fa94aa00640 1 -- 172.21.15.86:0/287311975 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa944004d30 con 0x7fa9500749e0 2024-09-13T16:08:17.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.962+0000 7fa94aa00640 1 -- 172.21.15.86:0/287311975 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944031a00 con 0x7fa9500749e0 2024-09-13T16:08:17.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.962+0000 7fa958800640 1 -- 172.21.15.86:0/287311975 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9501a21d0 con 0x7fa9500749e0 2024-09-13T16:08:17.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.963+0000 7fa958800640 1 -- 172.21.15.86:0/287311975 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa950076120 con 0x7fa9500749e0 2024-09-13T16:08:17.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.965+0000 7fa94aa00640 1 -- 172.21.15.86:0/287311975 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa944031b60 con 0x7fa9500749e0 2024-09-13T16:08:17.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.966+0000 7fa94aa00640 1 --2- 172.21.15.86:0/287311975 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa9380a1080 0x7fa9380a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:17.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.967+0000 7fa94aa00640 1 -- 172.21.15.86:0/287311975 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa9440edaa0 con 0x7fa9500749e0 2024-09-13T16:08:17.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.967+0000 7fa955400640 1 --2- 172.21.15.86:0/287311975 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa9380a1080 0x7fa9380a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:17.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.968+0000 7fa955400640 1 --2- 172.21.15.86:0/287311975 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa9380a1080 0x7fa9380a3540 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa940005fd0 tx=0x7fa940005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:17.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:17.970+0000 7fa94aa00640 1 -- 172.21.15.86:0/287311975 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa9440b6fe0 con 0x7fa9500749e0 2024-09-13T16:08:18.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:18.179+0000 7fa958800640 1 -- 172.21.15.86:0/287311975 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa95019dd40 con 0x7fa9500749e0 2024-09-13T16:08:18.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:18.180+0000 7fa94aa00640 1 -- 172.21.15.86:0/287311975 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa944040070 con 0x7fa9500749e0 2024-09-13T16:08:18.182 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T16:08:18.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:18.182+0000 7fa958800640 1 -- 172.21.15.86:0/287311975 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa9380a1080 msgr2=0x7fa9380a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:18.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:18.182+0000 7fa958800640 1 --2- 172.21.15.86:0/287311975 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa9380a1080 0x7fa9380a3540 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa940005fd0 tx=0x7fa940005850 comp rx=0 tx=0).stop 2024-09-13T16:08:18.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:18.182+0000 7fa958800640 1 -- 172.21.15.86:0/287311975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9500749e0 msgr2=0x7fa95019c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:18.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:18.182+0000 7fa958800640 1 --2- 172.21.15.86:0/287311975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9500749e0 0x7fa95019c9e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa944005ab0 tx=0x7fa944005690 comp rx=0 tx=0).stop 2024-09-13T16:08:18.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:18.182+0000 7fa958800640 1 -- 172.21.15.86:0/287311975 shutdown_connections 2024-09-13T16:08:18.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:18.182+0000 7fa958800640 1 --2- 172.21.15.86:0/287311975 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa9380a1080 0x7fa9380a3540 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:18.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:18.182+0000 7fa958800640 1 --2- 172.21.15.86:0/287311975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa950110c40 0x7fa9501a1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:18.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:18.182+0000 7fa958800640 1 --2- 172.21.15.86:0/287311975 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa950075300 0x7fa95019cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:18.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:18.182+0000 7fa958800640 1 --2- 172.21.15.86:0/287311975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9500749e0 0x7fa95019c9e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:18.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:18.182+0000 7fa958800640 1 -- 172.21.15.86:0/287311975 >> 172.21.15.86:0/287311975 conn(0x7fa9500fdc60 msgr2=0x7fa950100050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:18.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:18.183+0000 7fa958800640 1 -- 172.21.15.86:0/287311975 shutdown_connections 2024-09-13T16:08:18.185 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:18.183+0000 7fa958800640 1 -- 172.21.15.86:0/287311975 wait complete. 2024-09-13T16:08:18.513 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:18 smithi086 ceph-mon[30379]: pgmap v299: 129 pgs: 1 creating+peering, 128 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 4 op/s 2024-09-13T16:08:18.513 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:18 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/287311975' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T16:08:18.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:18 smithi139 ceph-mon[35320]: pgmap v299: 129 pgs: 1 creating+peering, 128 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 4 op/s 2024-09-13T16:08:18.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:18 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/287311975' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T16:08:18.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:18 smithi194 ceph-mon[35694]: pgmap v299: 129 pgs: 1 creating+peering, 128 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 4 op/s 2024-09-13T16:08:18.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:18 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/287311975' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T16:08:18.903 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T16:08:18.903 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T16:08:18.903 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2024-09-13T16:08:18.903 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-13T16:08:18.903 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T16:08:18.903 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T16:08:18.904 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T16:08:18.904 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T16:08:18.904 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T16:08:18.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:18.904 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2024-09-13T16:08:18.941 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T16:08:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T16:08:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T16:08:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:08:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2024-09-13T16:08:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:08:18.942 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:08:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:08:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2024-09-13T16:08:18.943 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:08:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:08:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2024-09-13T16:08:18.943 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:08:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:08:18.943 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T16:08:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:08:18.944 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T16:08:18.944 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42262sec preferred_lft 42262sec 2024-09-13T16:08:18.944 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link noprefixroute 2024-09-13T16:08:18.944 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:08:18.945 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T16:08:18.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:18.945 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2024-09-13T16:08:18.946 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-13T16:08:18.946 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add name ceph-brx type bridge 2024-09-13T16:08:18.946 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr flush dev ceph-brx 2024-09-13T16:08:18.946 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set ceph-brx up 2024-09-13T16:08:18.946 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T16:08:18.946 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-13T16:08:19.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:19.317 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T16:08:19.373 INFO:teuthology.orchestra.run.smithi086.stdout:1 2024-09-13T16:08:19.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:19.377 DEBUG:teuthology.orchestra.run.smithi086:> route 2024-09-13T16:08:19.430 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2024-09-13T16:08:19.430 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T16:08:19.430 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T16:08:19.431 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T16:08:19.431 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T16:08:19.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:19.432 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2024-09-13T16:08:19.432 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-13T16:08:19.432 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T16:08:19.432 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T16:08:19.432 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T16:08:19.432 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-13T16:08:19.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:19.969 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-09-13T16:08:20.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:20.005 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list-id 2024-09-13T16:08:20.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:20.081 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2024-09-13T16:08:20.081 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-13T16:08:20.081 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T16:08:20.081 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-13T16:08:20.081 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-13T16:08:20.209 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-13T16:08:20.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:20.209 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2024-09-13T16:08:20.209 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-13T16:08:20.210 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-13T16:08:20.210 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T16:08:20.210 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-13T16:08:20.210 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-13T16:08:20.210 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-13T16:08:20.210 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-13T16:08:20.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:20.395 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2024-09-13T16:08:20.395 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-13T16:08:20.395 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2024-09-13T16:08:20.395 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T16:08:20.395 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-13T16:08:20.511 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-13T16:08:20.511 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T16:08:20.512 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-13T16:08:20.547 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T16:08:20.547 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T16:08:20.548 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-13T16:08:20.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:20 smithi086 ceph-mon[30379]: pgmap v300: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 144 B/s wr, 3 op/s 2024-09-13T16:08:20.623 DEBUG:teuthology.orchestra.run.smithi086:> sudo modprobe fuse 2024-09-13T16:08:20.721 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T16:08:20.721 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T16:08:20.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:20 smithi139 ceph-mon[35320]: pgmap v300: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 144 B/s wr, 3 op/s 2024-09-13T16:08:20.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:20 smithi194 ceph-mon[35694]: pgmap v300: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 144 B/s wr, 3 op/s 2024-09-13T16:08:20.775 INFO:teuthology.orchestra.run.smithi086.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T16:08:20.778 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T16:08:20.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:20.778 DEBUG:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2024-09-13T16:08:20.813 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T16:08:20.813 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-13T16:08:20.857 DEBUG:teuthology.orchestra.run.smithi086:> sudo modprobe fuse 2024-09-13T16:08:20.914 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T16:08:20.914 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T16:08:20.968 INFO:teuthology.orchestra.run.smithi086.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T16:08:20.971 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T16:08:20.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:20.971 DEBUG:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2024-09-13T16:08:21.043 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi086.stderr:2024-09-13T16:08:21.043+0000 7f81cc31b480 -1 init, newargv = 0x55777e69c980 newargc=15 2024-09-13T16:08:21.044 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi086.stderr:ceph-fuse[73077]: starting ceph client 2024-09-13T16:08:21.052 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi086.stderr:ceph-fuse[73077]: starting fuse 2024-09-13T16:08:22.107 DEBUG:teuthology.orchestra.run.smithi086:> sudo modprobe fuse 2024-09-13T16:08:22.168 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T16:08:22.168 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T16:08:22.222 INFO:teuthology.orchestra.run.smithi086.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T16:08:22.224 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T16:08:22.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:22.225 DEBUG:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2024-09-13T16:08:22.260 INFO:teuthology.orchestra.run.smithi086.stdout:120 2024-09-13T16:08:22.260 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-13T16:08:22.260 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T16:08:22.260 DEBUG:teuthology.orchestra.run.smithi086:> import glob 2024-09-13T16:08:22.260 DEBUG:teuthology.orchestra.run.smithi086:> import re 2024-09-13T16:08:22.260 DEBUG:teuthology.orchestra.run.smithi086:> import os 2024-09-13T16:08:22.261 DEBUG:teuthology.orchestra.run.smithi086:> import subprocess 2024-09-13T16:08:22.261 DEBUG:teuthology.orchestra.run.smithi086:> 2024-09-13T16:08:22.261 DEBUG:teuthology.orchestra.run.smithi086:> def _find_admin_socket(client_name): 2024-09-13T16:08:22.261 DEBUG:teuthology.orchestra.run.smithi086:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-13T16:08:22.261 DEBUG:teuthology.orchestra.run.smithi086:> files = glob.glob(asok_path) 2024-09-13T16:08:22.261 DEBUG:teuthology.orchestra.run.smithi086:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-13T16:08:22.261 DEBUG:teuthology.orchestra.run.smithi086:> 2024-09-13T16:08:22.261 DEBUG:teuthology.orchestra.run.smithi086:> # Given a non-glob path, it better be there 2024-09-13T16:08:22.261 DEBUG:teuthology.orchestra.run.smithi086:> if "*" not in asok_path: 2024-09-13T16:08:22.261 DEBUG:teuthology.orchestra.run.smithi086:> assert(len(files) == 1) 2024-09-13T16:08:22.261 DEBUG:teuthology.orchestra.run.smithi086:> return files[0] 2024-09-13T16:08:22.261 DEBUG:teuthology.orchestra.run.smithi086:> 2024-09-13T16:08:22.261 DEBUG:teuthology.orchestra.run.smithi086:> for f in files: 2024-09-13T16:08:22.261 DEBUG:teuthology.orchestra.run.smithi086:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T16:08:22.261 DEBUG:teuthology.orchestra.run.smithi086:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T16:08:22.262 DEBUG:teuthology.orchestra.run.smithi086:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T16:08:22.262 DEBUG:teuthology.orchestra.run.smithi086:> contents = proc_f.read() 2024-09-13T16:08:22.262 DEBUG:teuthology.orchestra.run.smithi086:> if mountpoint in contents: 2024-09-13T16:08:22.262 DEBUG:teuthology.orchestra.run.smithi086:> return f 2024-09-13T16:08:22.262 DEBUG:teuthology.orchestra.run.smithi086:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T16:08:22.262 DEBUG:teuthology.orchestra.run.smithi086:> 2024-09-13T16:08:22.262 DEBUG:teuthology.orchestra.run.smithi086:> print(_find_admin_socket("client.admin")) 2024-09-13T16:08:22.262 DEBUG:teuthology.orchestra.run.smithi086:> ' 2024-09-13T16:08:22.422 INFO:teuthology.orchestra.run.smithi086.stdout:/var/run/ceph/ceph-client.admin.73077.asok 2024-09-13T16:08:22.603 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:22 smithi086 ceph-mon[30379]: pgmap v301: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 126 B/s wr, 0 op/s 2024-09-13T16:08:22.605 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.73077.asok 2024-09-13T16:08:22.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:22.605 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.73077.asok status 2024-09-13T16:08:22.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:22 smithi139 ceph-mon[35320]: pgmap v301: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 126 B/s wr, 0 op/s 2024-09-13T16:08:22.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:22 smithi194 ceph-mon[35694]: pgmap v301: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 126 B/s wr, 0 op/s 2024-09-13T16:08:22.788 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T16:08:22.788 INFO:teuthology.orchestra.run.smithi086.stdout: "metadata": { 2024-09-13T16:08:22.788 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_sha1": "50bbe7f395997dcd871813949c49addbbf630361", 2024-09-13T16:08:22.788 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_version": "ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable)", 2024-09-13T16:08:22.788 INFO:teuthology.orchestra.run.smithi086.stdout: "entity_id": "admin", 2024-09-13T16:08:22.788 INFO:teuthology.orchestra.run.smithi086.stdout: "hostname": "smithi086", 2024-09-13T16:08:22.788 INFO:teuthology.orchestra.run.smithi086.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-13T16:08:22.789 INFO:teuthology.orchestra.run.smithi086.stdout: "pid": "73077", 2024-09-13T16:08:22.789 INFO:teuthology.orchestra.run.smithi086.stdout: "root": "/" 2024-09-13T16:08:22.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:08:22.789 INFO:teuthology.orchestra.run.smithi086.stdout: "dentry_count": 0, 2024-09-13T16:08:22.789 INFO:teuthology.orchestra.run.smithi086.stdout: "dentry_pinned_count": 0, 2024-09-13T16:08:22.789 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 14661, 2024-09-13T16:08:22.789 INFO:teuthology.orchestra.run.smithi086.stdout: "inst": { 2024-09-13T16:08:22.789 INFO:teuthology.orchestra.run.smithi086.stdout: "name": { 2024-09-13T16:08:22.789 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "client", 2024-09-13T16:08:22.789 INFO:teuthology.orchestra.run.smithi086.stdout: "num": 14661 2024-09-13T16:08:22.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:08:22.789 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2024-09-13T16:08:22.789 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v1", 2024-09-13T16:08:22.790 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "192.168.0.1:0", 2024-09-13T16:08:22.790 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 3747345897 2024-09-13T16:08:22.790 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:08:22.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:08:22.790 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2024-09-13T16:08:22.790 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v1", 2024-09-13T16:08:22.790 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "192.168.0.1:0", 2024-09-13T16:08:22.790 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 3747345897 2024-09-13T16:08:22.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:08:22.790 INFO:teuthology.orchestra.run.smithi086.stdout: "inst_str": "client.14661 192.168.0.1:0/3747345897", 2024-09-13T16:08:22.790 INFO:teuthology.orchestra.run.smithi086.stdout: "addr_str": "192.168.0.1:0/3747345897", 2024-09-13T16:08:22.790 INFO:teuthology.orchestra.run.smithi086.stdout: "inode_count": 1, 2024-09-13T16:08:22.790 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_epoch": 17, 2024-09-13T16:08:22.791 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_epoch": 90, 2024-09-13T16:08:22.791 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_epoch_barrier": 0, 2024-09-13T16:08:22.791 INFO:teuthology.orchestra.run.smithi086.stdout: "blocklisted": false, 2024-09-13T16:08:22.791 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs" 2024-09-13T16:08:22.791 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T16:08:22.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:22.800 DEBUG:teuthology.orchestra.run.smithi086:> stat --file-system '--printf=%T 2024-09-13T16:08:22.800 DEBUG:teuthology.orchestra.run.smithi086:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-13T16:08:22.836 INFO:teuthology.orchestra.run.smithi086.stdout:fuseblk 2024-09-13T16:08:22.836 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-13T16:08:22.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:22.836 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-13T16:08:22.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:22.934 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-13T16:08:23.000 INFO:teuthology.orchestra.run.smithi086.stdout:# file: . 2024-09-13T16:08:23.000 INFO:teuthology.orchestra.run.smithi086.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-13T16:08:23.000 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:23.001 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T16:08:23.001 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:08:23.037 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:08:23.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.229+0000 7f7c5ee00640 1 -- 172.21.15.86:0/4198426128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c58100820 msgr2=0x7f7c58102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:23.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.229+0000 7f7c5ee00640 1 --2- 172.21.15.86:0/4198426128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c58100820 0x7f7c58102c10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009900 tx=0x7f7c4802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.229+0000 7f7c5ee00640 1 -- 172.21.15.86:0/4198426128 shutdown_connections 2024-09-13T16:08:23.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.229+0000 7f7c5ee00640 1 --2- 172.21.15.86:0/4198426128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c58105a80 0x7f7c58107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.229+0000 7f7c5ee00640 1 --2- 172.21.15.86:0/4198426128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c58103150 0x7f7c58105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.229+0000 7f7c5ee00640 1 --2- 172.21.15.86:0/4198426128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c58100820 0x7f7c58102c10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.229+0000 7f7c5ee00640 1 -- 172.21.15.86:0/4198426128 >> 172.21.15.86:0/4198426128 conn(0x7f7c580fa400 msgr2=0x7f7c580fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:23.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.229+0000 7f7c5ee00640 1 -- 172.21.15.86:0/4198426128 shutdown_connections 2024-09-13T16:08:23.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.229+0000 7f7c5ee00640 1 -- 172.21.15.86:0/4198426128 wait complete. 2024-09-13T16:08:23.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.230+0000 7f7c5ee00640 1 Processor -- start 2024-09-13T16:08:23.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.230+0000 7f7c5ee00640 1 -- start start 2024-09-13T16:08:23.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.231+0000 7f7c5ee00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c58100820 0x7f7c58198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:23.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.231+0000 7f7c5ee00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c58103150 0x7f7c581986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:23.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.231+0000 7f7c5ee00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c58105a80 0x7f7c5819f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:23.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.231+0000 7f7c5ee00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5819fc80 con 0x7f7c58103150 2024-09-13T16:08:23.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.231+0000 7f7c5ee00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5819fdf0 con 0x7f7c58105a80 2024-09-13T16:08:23.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.231+0000 7f7c5ee00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5819ffb0 con 0x7f7c58100820 2024-09-13T16:08:23.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.231+0000 7f7c4fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c58103150 0x7f7c581986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:23.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.231+0000 7f7c4fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c58103150 0x7f7c581986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44640/0 (socket says 172.21.15.86:44640) 2024-09-13T16:08:23.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.231+0000 7f7c4fe00640 1 -- 172.21.15.86:0/2345528776 learned_addr learned my addr 172.21.15.86:0/2345528776 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:23.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.231+0000 7f7c57e00640 1 --2- 172.21.15.86:0/2345528776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c58100820 0x7f7c58198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:23.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.231+0000 7f7c5ce00640 1 --2- 172.21.15.86:0/2345528776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c58105a80 0x7f7c5819f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:23.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.231+0000 7f7c4fe00640 1 -- 172.21.15.86:0/2345528776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c58100820 msgr2=0x7f7c58198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:23.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.231+0000 7f7c4fe00640 1 --2- 172.21.15.86:0/2345528776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c58100820 0x7f7c58198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.234 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.232+0000 7f7c4fe00640 1 -- 172.21.15.86:0/2345528776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c58105a80 msgr2=0x7f7c5819f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:23.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.232+0000 7f7c4fe00640 1 --2- 172.21.15.86:0/2345528776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c58105a80 0x7f7c5819f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.232+0000 7f7c4fe00640 1 -- 172.21.15.86:0/2345528776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c48009560 con 0x7f7c58103150 2024-09-13T16:08:23.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.232+0000 7f7c4fe00640 1 --2- 172.21.15.86:0/2345528776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c58103150 0x7f7c581986d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000d770 tx=0x7f7c4000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:23.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.232+0000 7f7c55600640 1 -- 172.21.15.86:0/2345528776 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40009c30 con 0x7f7c58103150 2024-09-13T16:08:23.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.232+0000 7f7c5ee00640 1 -- 172.21.15.86:0/2345528776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c581a0290 con 0x7f7c58103150 2024-09-13T16:08:23.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.232+0000 7f7c55600640 1 -- 172.21.15.86:0/2345528776 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7c4000de80 con 0x7f7c58103150 2024-09-13T16:08:23.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.232+0000 7f7c55600640 1 -- 172.21.15.86:0/2345528776 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4000f6b0 con 0x7f7c58103150 2024-09-13T16:08:23.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.232+0000 7f7c5ee00640 1 -- 172.21.15.86:0/2345528776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c581a07a0 con 0x7f7c58103150 2024-09-13T16:08:23.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.233+0000 7f7c5ee00640 1 -- 172.21.15.86:0/2345528776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c581075f0 con 0x7f7c58103150 2024-09-13T16:08:23.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.235+0000 7f7c55600640 1 -- 172.21.15.86:0/2345528776 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7c40005030 con 0x7f7c58103150 2024-09-13T16:08:23.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.236+0000 7f7c55600640 1 --2- 172.21.15.86:0/2345528776 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7c3c0a1090 0x7f7c3c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:23.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.236+0000 7f7c55600640 1 -- 172.21.15.86:0/2345528776 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f7c400cc7f0 con 0x7f7c58103150 2024-09-13T16:08:23.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.236+0000 7f7c57e00640 1 --2- 172.21.15.86:0/2345528776 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7c3c0a1090 0x7f7c3c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:23.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.237+0000 7f7c57e00640 1 --2- 172.21.15.86:0/2345528776 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7c3c0a1090 0x7f7c3c0a3550 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7c48005940 tx=0x7f7c480058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:23.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.239+0000 7f7c55600640 1 -- 172.21.15.86:0/2345528776 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7c40095de0 con 0x7f7c58103150 2024-09-13T16:08:23.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.411+0000 7f7c5ee00640 1 -- 172.21.15.86:0/2345528776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c5810b7d0 con 0x7f7c58103150 2024-09-13T16:08:23.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.412+0000 7f7c55600640 1 -- 172.21.15.86:0/2345528776 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23949 (secure 0 0 0) 0x7f7c40021090 con 0x7f7c58103150 2024-09-13T16:08:23.413 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:23.413 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":90,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:08:13.655740+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:08:23.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.414+0000 7f7c5ee00640 1 -- 172.21.15.86:0/2345528776 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7c3c0a1090 msgr2=0x7f7c3c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:23.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.414+0000 7f7c5ee00640 1 --2- 172.21.15.86:0/2345528776 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7c3c0a1090 0x7f7c3c0a3550 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7c48005940 tx=0x7f7c480058d0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.414+0000 7f7c5ee00640 1 -- 172.21.15.86:0/2345528776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c58103150 msgr2=0x7f7c581986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:23.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.414+0000 7f7c5ee00640 1 --2- 172.21.15.86:0/2345528776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c58103150 0x7f7c581986d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000d770 tx=0x7f7c4000dc30 comp rx=0 tx=0).stop 2024-09-13T16:08:23.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.415+0000 7f7c5ee00640 1 -- 172.21.15.86:0/2345528776 shutdown_connections 2024-09-13T16:08:23.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.415+0000 7f7c5ee00640 1 --2- 172.21.15.86:0/2345528776 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7c3c0a1090 0x7f7c3c0a3550 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.415+0000 7f7c5ee00640 1 --2- 172.21.15.86:0/2345528776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c58105a80 0x7f7c5819f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.415+0000 7f7c5ee00640 1 --2- 172.21.15.86:0/2345528776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c58103150 0x7f7c581986d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.415+0000 7f7c5ee00640 1 --2- 172.21.15.86:0/2345528776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c58100820 0x7f7c58198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.415+0000 7f7c5ee00640 1 -- 172.21.15.86:0/2345528776 >> 172.21.15.86:0/2345528776 conn(0x7f7c580fa400 msgr2=0x7f7c580fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:23.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.415+0000 7f7c5ee00640 1 -- 172.21.15.86:0/2345528776 shutdown_connections 2024-09-13T16:08:23.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.415+0000 7f7c5ee00640 1 -- 172.21.15.86:0/2345528776 wait complete. 2024-09-13T16:08:23.430 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:03:27.830423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:08:07.732536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:08:08.742145+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T16:08:11.721740+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T16:08:23.431 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:08:23.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.586+0000 7f606d600640 1 -- 172.21.15.86:0/2592293592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6068103190 msgr2=0x7f6068103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:23.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.586+0000 7f606d600640 1 --2- 172.21.15.86:0/2592293592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6068103190 0x7f6068103610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6050009860 tx=0x7f605002a340 comp rx=0 tx=0).stop 2024-09-13T16:08:23.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.586+0000 7f606d600640 1 -- 172.21.15.86:0/2592293592 shutdown_connections 2024-09-13T16:08:23.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.586+0000 7f606d600640 1 --2- 172.21.15.86:0/2592293592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6068103b50 0x7f606810a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.586+0000 7f606d600640 1 --2- 172.21.15.86:0/2592293592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6068103190 0x7f6068103610 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.586+0000 7f606d600640 1 --2- 172.21.15.86:0/2592293592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6068101fa0 0x7f60681023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.586+0000 7f606d600640 1 -- 172.21.15.86:0/2592293592 >> 172.21.15.86:0/2592293592 conn(0x7f60680fd700 msgr2=0x7f60680ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:23.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.586+0000 7f606d600640 1 -- 172.21.15.86:0/2592293592 shutdown_connections 2024-09-13T16:08:23.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.586+0000 7f606d600640 1 -- 172.21.15.86:0/2592293592 wait complete. 2024-09-13T16:08:23.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.587+0000 7f606d600640 1 Processor -- start 2024-09-13T16:08:23.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.587+0000 7f606d600640 1 -- start start 2024-09-13T16:08:23.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.587+0000 7f606d600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6068101fa0 0x7f60681980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:23.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.587+0000 7f606d600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6068103190 0x7f60681985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:23.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.587+0000 7f606d600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6068103b50 0x7f606819f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:23.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.587+0000 7f606d600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606819fb90 con 0x7f6068103190 2024-09-13T16:08:23.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.587+0000 7f606d600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606819fd00 con 0x7f6068101fa0 2024-09-13T16:08:23.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.587+0000 7f606d600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606819fec0 con 0x7f6068103b50 2024-09-13T16:08:23.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.588+0000 7f605fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6068103190 0x7f60681985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:23.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.588+0000 7f605fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6068103190 0x7f60681985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44644/0 (socket says 172.21.15.86:44644) 2024-09-13T16:08:23.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.588+0000 7f605fe00640 1 -- 172.21.15.86:0/587654770 learned_addr learned my addr 172.21.15.86:0/587654770 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:23.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.588+0000 7f6067400640 1 --2- 172.21.15.86:0/587654770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6068103b50 0x7f606819f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:23.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.588+0000 7f6066a00640 1 --2- 172.21.15.86:0/587654770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6068101fa0 0x7f60681980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:23.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.588+0000 7f605fe00640 1 -- 172.21.15.86:0/587654770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6068103b50 msgr2=0x7f606819f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:23.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.588+0000 7f605fe00640 1 --2- 172.21.15.86:0/587654770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6068103b50 0x7f606819f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.588+0000 7f605fe00640 1 -- 172.21.15.86:0/587654770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6068101fa0 msgr2=0x7f60681980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:23.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.588+0000 7f605fe00640 1 --2- 172.21.15.86:0/587654770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6068101fa0 0x7f60681980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.588+0000 7f605fe00640 1 -- 172.21.15.86:0/587654770 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6060009900 con 0x7f6068103190 2024-09-13T16:08:23.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.588+0000 7f6066a00640 1 --2- 172.21.15.86:0/587654770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6068101fa0 0x7f60681980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:08:23.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.588+0000 7f605fe00640 1 --2- 172.21.15.86:0/587654770 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6068103190 0x7f60681985e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6050005940 tx=0x7f60500326f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:23.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.589+0000 7f605f400640 1 -- 172.21.15.86:0/587654770 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050032ea0 con 0x7f6068103190 2024-09-13T16:08:23.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.589+0000 7f605f400640 1 -- 172.21.15.86:0/587654770 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f60500035f0 con 0x7f6068103190 2024-09-13T16:08:23.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.589+0000 7f606d600640 1 -- 172.21.15.86:0/587654770 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6050009490 con 0x7f6068103190 2024-09-13T16:08:23.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.589+0000 7f605f400640 1 -- 172.21.15.86:0/587654770 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050004520 con 0x7f6068103190 2024-09-13T16:08:23.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.589+0000 7f606d600640 1 -- 172.21.15.86:0/587654770 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60681a0460 con 0x7f6068103190 2024-09-13T16:08:23.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.590+0000 7f606d600640 1 -- 172.21.15.86:0/587654770 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6068109430 con 0x7f6068103190 2024-09-13T16:08:23.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.592+0000 7f605f400640 1 -- 172.21.15.86:0/587654770 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6050039040 con 0x7f6068103190 2024-09-13T16:08:23.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.593+0000 7f605f400640 1 --2- 172.21.15.86:0/587654770 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f604c0a1090 0x7f604c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:23.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.593+0000 7f605f400640 1 -- 172.21.15.86:0/587654770 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f60500ed410 con 0x7f6068103190 2024-09-13T16:08:23.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.593+0000 7f6066a00640 1 --2- 172.21.15.86:0/587654770 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f604c0a1090 0x7f604c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:23.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.594+0000 7f6066a00640 1 --2- 172.21.15.86:0/587654770 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f604c0a1090 0x7f604c0a3550 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6068102ff0 tx=0x7f6058005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:23.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.596+0000 7f605f400640 1 -- 172.21.15.86:0/587654770 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f60500b69b0 con 0x7f6068103190 2024-09-13T16:08:23.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.767+0000 7f606d600640 1 -- 172.21.15.86:0/587654770 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f60681a0080 con 0x7f6068103190 2024-09-13T16:08:23.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.768+0000 7f605f400640 1 -- 172.21.15.86:0/587654770 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f60500b9fd0 con 0x7f6068103190 2024-09-13T16:08:23.769 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-09-13T16:08:23.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.770+0000 7f606d600640 1 -- 172.21.15.86:0/587654770 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f604c0a1090 msgr2=0x7f604c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:23.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.770+0000 7f606d600640 1 --2- 172.21.15.86:0/587654770 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f604c0a1090 0x7f604c0a3550 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6068102ff0 tx=0x7f6058005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:23.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.770+0000 7f606d600640 1 -- 172.21.15.86:0/587654770 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6068103190 msgr2=0x7f60681985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:23.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.770+0000 7f606d600640 1 --2- 172.21.15.86:0/587654770 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6068103190 0x7f60681985e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6050005940 tx=0x7f60500326f0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.770+0000 7f606d600640 1 -- 172.21.15.86:0/587654770 shutdown_connections 2024-09-13T16:08:23.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.770+0000 7f606d600640 1 --2- 172.21.15.86:0/587654770 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f604c0a1090 0x7f604c0a3550 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.770+0000 7f606d600640 1 --2- 172.21.15.86:0/587654770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6068103b50 0x7f606819f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.770+0000 7f606d600640 1 --2- 172.21.15.86:0/587654770 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6068103190 0x7f60681985e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.770+0000 7f606d600640 1 --2- 172.21.15.86:0/587654770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6068101fa0 0x7f60681980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.770+0000 7f606d600640 1 -- 172.21.15.86:0/587654770 >> 172.21.15.86:0/587654770 conn(0x7f60680fd700 msgr2=0x7f6068106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:23.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.771+0000 7f606d600640 1 -- 172.21.15.86:0/587654770 shutdown_connections 2024-09-13T16:08:23.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.771+0000 7f606d600640 1 -- 172.21.15.86:0/587654770 wait complete. 2024-09-13T16:08:23.787 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:08:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.944+0000 7f3b65400640 1 -- 172.21.15.86:0/3543051911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b60101fa0 msgr2=0x7f3b601023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.944+0000 7f3b65400640 1 --2- 172.21.15.86:0/3543051911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b60101fa0 0x7f3b601023a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009900 tx=0x7f3b5002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.944+0000 7f3b65400640 1 -- 172.21.15.86:0/3543051911 shutdown_connections 2024-09-13T16:08:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.944+0000 7f3b65400640 1 --2- 172.21.15.86:0/3543051911 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b60103b50 0x7f3b6010a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.944+0000 7f3b65400640 1 --2- 172.21.15.86:0/3543051911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b60103190 0x7f3b60103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.944+0000 7f3b65400640 1 --2- 172.21.15.86:0/3543051911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b60101fa0 0x7f3b601023a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.944+0000 7f3b65400640 1 -- 172.21.15.86:0/3543051911 >> 172.21.15.86:0/3543051911 conn(0x7f3b600fd700 msgr2=0x7f3b600ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.944+0000 7f3b65400640 1 -- 172.21.15.86:0/3543051911 shutdown_connections 2024-09-13T16:08:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.944+0000 7f3b65400640 1 -- 172.21.15.86:0/3543051911 wait complete. 2024-09-13T16:08:23.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.945+0000 7f3b65400640 1 Processor -- start 2024-09-13T16:08:23.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.945+0000 7f3b65400640 1 -- start start 2024-09-13T16:08:23.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.945+0000 7f3b65400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b60101fa0 0x7f3b60198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:23.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.945+0000 7f3b65400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b60103190 0x7f3b601985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:23.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.945+0000 7f3b65400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b60103b50 0x7f3b6019f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:23.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.945+0000 7f3b65400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6019fb50 con 0x7f3b60101fa0 2024-09-13T16:08:23.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.945+0000 7f3b65400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6019fcc0 con 0x7f3b60103b50 2024-09-13T16:08:23.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.945+0000 7f3b65400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6019fe80 con 0x7f3b60103190 2024-09-13T16:08:23.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.945+0000 7f3b5e800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b60101fa0 0x7f3b60198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:23.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.945+0000 7f3b5e800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b60101fa0 0x7f3b60198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44664/0 (socket says 172.21.15.86:44664) 2024-09-13T16:08:23.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.945+0000 7f3b5e800640 1 -- 172.21.15.86:0/3521590340 learned_addr learned my addr 172.21.15.86:0/3521590340 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:23.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.946+0000 7f3b5de00640 1 --2- 172.21.15.86:0/3521590340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b60103190 0x7f3b601985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:23.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.946+0000 7f3b5f200640 1 --2- 172.21.15.86:0/3521590340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b60103b50 0x7f3b6019f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:23.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.946+0000 7f3b5e800640 1 -- 172.21.15.86:0/3521590340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b60103190 msgr2=0x7f3b601985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:23.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.946+0000 7f3b5e800640 1 --2- 172.21.15.86:0/3521590340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b60103190 0x7f3b601985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.946+0000 7f3b5e800640 1 -- 172.21.15.86:0/3521590340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b60103b50 msgr2=0x7f3b6019f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:23.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.946+0000 7f3b5e800640 1 --2- 172.21.15.86:0/3521590340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b60103b50 0x7f3b6019f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:23.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.946+0000 7f3b5e800640 1 -- 172.21.15.86:0/3521590340 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b50009560 con 0x7f3b60101fa0 2024-09-13T16:08:23.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.946+0000 7f3b5e800640 1 --2- 172.21.15.86:0/3521590340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b60101fa0 0x7f3b60198060 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b50031510 tx=0x7f3b50004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:23.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.946+0000 7f3b57400640 1 -- 172.21.15.86:0/3521590340 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b50005000 con 0x7f3b60101fa0 2024-09-13T16:08:23.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.946+0000 7f3b57400640 1 -- 172.21.15.86:0/3521590340 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3b500046c0 con 0x7f3b60101fa0 2024-09-13T16:08:23.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.946+0000 7f3b57400640 1 -- 172.21.15.86:0/3521590340 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b50003a10 con 0x7f3b60101fa0 2024-09-13T16:08:23.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.947+0000 7f3b65400640 1 -- 172.21.15.86:0/3521590340 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b601a0100 con 0x7f3b60101fa0 2024-09-13T16:08:23.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.947+0000 7f3b65400640 1 -- 172.21.15.86:0/3521590340 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b601a0560 con 0x7f3b60101fa0 2024-09-13T16:08:23.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.948+0000 7f3b65400640 1 -- 172.21.15.86:0/3521590340 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b601093d0 con 0x7f3b60101fa0 2024-09-13T16:08:23.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.949+0000 7f3b57400640 1 -- 172.21.15.86:0/3521590340 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3b50004bc0 con 0x7f3b60101fa0 2024-09-13T16:08:23.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.951+0000 7f3b57400640 1 --2- 172.21.15.86:0/3521590340 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f3b440a1090 0x7f3b440a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:23.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.951+0000 7f3b57400640 1 -- 172.21.15.86:0/3521590340 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f3b500ed8d0 con 0x7f3b60101fa0 2024-09-13T16:08:23.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.951+0000 7f3b5de00640 1 --2- 172.21.15.86:0/3521590340 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f3b440a1090 0x7f3b440a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:23.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.951+0000 7f3b5de00640 1 --2- 172.21.15.86:0/3521590340 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f3b440a1090 0x7f3b440a3550 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3b60199570 tx=0x7f3b4c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:23.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:23.954+0000 7f3b57400640 1 -- 172.21.15.86:0/3521590340 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3b500b6f20 con 0x7f3b60101fa0 2024-09-13T16:08:24.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.125+0000 7f3b65400640 1 -- 172.21.15.86:0/3521590340 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b6002c3e0 con 0x7f3b60101fa0 2024-09-13T16:08:24.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.125+0000 7f3b57400640 1 -- 172.21.15.86:0/3521590340 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b5004a020 con 0x7f3b60101fa0 2024-09-13T16:08:24.126 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-09-13T16:08:24.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.127+0000 7f3b65400640 1 -- 172.21.15.86:0/3521590340 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f3b440a1090 msgr2=0x7f3b440a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:24.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.127+0000 7f3b65400640 1 --2- 172.21.15.86:0/3521590340 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f3b440a1090 0x7f3b440a3550 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3b60199570 tx=0x7f3b4c005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:24.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.127+0000 7f3b65400640 1 -- 172.21.15.86:0/3521590340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b60101fa0 msgr2=0x7f3b60198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:24.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.127+0000 7f3b65400640 1 --2- 172.21.15.86:0/3521590340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b60101fa0 0x7f3b60198060 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b50031510 tx=0x7f3b50004270 comp rx=0 tx=0).stop 2024-09-13T16:08:24.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.127+0000 7f3b65400640 1 -- 172.21.15.86:0/3521590340 shutdown_connections 2024-09-13T16:08:24.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.127+0000 7f3b65400640 1 --2- 172.21.15.86:0/3521590340 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f3b440a1090 0x7f3b440a3550 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.127+0000 7f3b65400640 1 --2- 172.21.15.86:0/3521590340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b60103b50 0x7f3b6019f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.127+0000 7f3b65400640 1 --2- 172.21.15.86:0/3521590340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b60103190 0x7f3b601985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.127+0000 7f3b65400640 1 --2- 172.21.15.86:0/3521590340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b60101fa0 0x7f3b60198060 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.127+0000 7f3b65400640 1 -- 172.21.15.86:0/3521590340 >> 172.21.15.86:0/3521590340 conn(0x7f3b600fd700 msgr2=0x7f3b601065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:24.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.128+0000 7f3b65400640 1 -- 172.21.15.86:0/3521590340 shutdown_connections 2024-09-13T16:08:24.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.128+0000 7f3b65400640 1 -- 172.21.15.86:0/3521590340 wait complete. 2024-09-13T16:08:24.143 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:08:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.299+0000 7fa8ad400640 1 -- 172.21.15.86:0/4042651892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a80ffd70 msgr2=0x7fa8a8100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.299+0000 7fa8ad400640 1 --2- 172.21.15.86:0/4042651892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a80ffd70 0x7fa8a8100170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa898009900 tx=0x7fa89802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.299+0000 7fa8ad400640 1 -- 172.21.15.86:0/4042651892 shutdown_connections 2024-09-13T16:08:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.299+0000 7fa8ad400640 1 --2- 172.21.15.86:0/4042651892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a8101920 0x7fa8a81081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.299+0000 7fa8ad400640 1 --2- 172.21.15.86:0/4042651892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8a8100f60 0x7fa8a81013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.299+0000 7fa8ad400640 1 --2- 172.21.15.86:0/4042651892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a80ffd70 0x7fa8a8100170 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.299+0000 7fa8ad400640 1 -- 172.21.15.86:0/4042651892 >> 172.21.15.86:0/4042651892 conn(0x7fa8a80fb4d0 msgr2=0x7fa8a80fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:24.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.299+0000 7fa8ad400640 1 -- 172.21.15.86:0/4042651892 shutdown_connections 2024-09-13T16:08:24.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.299+0000 7fa8ad400640 1 -- 172.21.15.86:0/4042651892 wait complete. 2024-09-13T16:08:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.300+0000 7fa8ad400640 1 Processor -- start 2024-09-13T16:08:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.300+0000 7fa8ad400640 1 -- start start 2024-09-13T16:08:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.300+0000 7fa8ad400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a80ffd70 0x7fa8a8198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.300+0000 7fa8ad400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a8100f60 0x7fa8a81985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.300+0000 7fa8ad400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8a8101920 0x7fa8a819f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.300+0000 7fa8ad400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a819fb80 con 0x7fa8a8100f60 2024-09-13T16:08:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.300+0000 7fa8ad400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a819fcf0 con 0x7fa8a80ffd70 2024-09-13T16:08:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.300+0000 7fa8ad400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a819feb0 con 0x7fa8a8101920 2024-09-13T16:08:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.300+0000 7fa8a5e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a8100f60 0x7fa8a81985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.300+0000 7fa8a6800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a80ffd70 0x7fa8a8198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.301+0000 7fa8a6800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a80ffd70 0x7fa8a8198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:42410/0 (socket says 172.21.15.86:42410) 2024-09-13T16:08:24.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.301+0000 7fa8a6800640 1 -- 172.21.15.86:0/761496384 learned_addr learned my addr 172.21.15.86:0/761496384 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:24.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.301+0000 7fa8a5e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a8100f60 0x7fa8a81985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44682/0 (socket says 172.21.15.86:44682) 2024-09-13T16:08:24.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.301+0000 7fa8a7200640 1 --2- 172.21.15.86:0/761496384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8a8101920 0x7fa8a819f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:24.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.301+0000 7fa8a6800640 1 -- 172.21.15.86:0/761496384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8a8101920 msgr2=0x7fa8a819f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:24.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.301+0000 7fa8a6800640 1 --2- 172.21.15.86:0/761496384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8a8101920 0x7fa8a819f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.301+0000 7fa8a6800640 1 -- 172.21.15.86:0/761496384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a8100f60 msgr2=0x7fa8a81985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:24.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.301+0000 7fa8a6800640 1 --2- 172.21.15.86:0/761496384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a8100f60 0x7fa8a81985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.301+0000 7fa8a6800640 1 -- 172.21.15.86:0/761496384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa894009490 con 0x7fa8a80ffd70 2024-09-13T16:08:24.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.301+0000 7fa8a5e00640 1 --2- 172.21.15.86:0/761496384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a8100f60 0x7fa8a81985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:24.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.301+0000 7fa8a6800640 1 --2- 172.21.15.86:0/761496384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a80ffd70 0x7fa8a8198090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa898031510 tx=0x7fa898004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:24.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.301+0000 7fa89f400640 1 -- 172.21.15.86:0/761496384 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898005000 con 0x7fa8a80ffd70 2024-09-13T16:08:24.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.301+0000 7fa89f400640 1 -- 172.21.15.86:0/761496384 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa8980046c0 con 0x7fa8a80ffd70 2024-09-13T16:08:24.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.301+0000 7fa8ad400640 1 -- 172.21.15.86:0/761496384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa898009560 con 0x7fa8a80ffd70 2024-09-13T16:08:24.305 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.302+0000 7fa89f400640 1 -- 172.21.15.86:0/761496384 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898003a10 con 0x7fa8a80ffd70 2024-09-13T16:08:24.305 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.302+0000 7fa8ad400640 1 -- 172.21.15.86:0/761496384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a81a04a0 con 0x7fa8a80ffd70 2024-09-13T16:08:24.305 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.303+0000 7fa8ad400640 1 -- 172.21.15.86:0/761496384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a810b7b0 con 0x7fa8a80ffd70 2024-09-13T16:08:24.305 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.305+0000 7fa89f400640 1 -- 172.21.15.86:0/761496384 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa898004bc0 con 0x7fa8a80ffd70 2024-09-13T16:08:24.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.306+0000 7fa89f400640 1 --2- 172.21.15.86:0/761496384 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa88c0a1110 0x7fa88c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:24.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.306+0000 7fa89f400640 1 -- 172.21.15.86:0/761496384 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa8980edcd0 con 0x7fa8a80ffd70 2024-09-13T16:08:24.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.306+0000 7fa8a5e00640 1 --2- 172.21.15.86:0/761496384 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa88c0a1110 0x7fa88c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:24.307 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.307+0000 7fa8a5e00640 1 --2- 172.21.15.86:0/761496384 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa88c0a1110 0x7fa88c0a35d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa8a81995a0 tx=0x7fa894005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:24.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.308+0000 7fa89f400640 1 -- 172.21.15.86:0/761496384 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa8980b72c0 con 0x7fa8a80ffd70 2024-09-13T16:08:24.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.479+0000 7fa8ad400640 1 -- 172.21.15.86:0/761496384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa8a81a08e0 con 0x7fa8a80ffd70 2024-09-13T16:08:24.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.480+0000 7fa89f400640 1 -- 172.21.15.86:0/761496384 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa898035020 con 0x7fa8a80ffd70 2024-09-13T16:08:24.481 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2024-09-13T16:08:24.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.482+0000 7fa8ad400640 1 -- 172.21.15.86:0/761496384 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa88c0a1110 msgr2=0x7fa88c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:24.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.482+0000 7fa8ad400640 1 --2- 172.21.15.86:0/761496384 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa88c0a1110 0x7fa88c0a35d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa8a81995a0 tx=0x7fa894005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:24.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.482+0000 7fa8ad400640 1 -- 172.21.15.86:0/761496384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a80ffd70 msgr2=0x7fa8a8198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:24.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.482+0000 7fa8ad400640 1 --2- 172.21.15.86:0/761496384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a80ffd70 0x7fa8a8198090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa898031510 tx=0x7fa898004270 comp rx=0 tx=0).stop 2024-09-13T16:08:24.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.482+0000 7fa8ad400640 1 -- 172.21.15.86:0/761496384 shutdown_connections 2024-09-13T16:08:24.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.482+0000 7fa8ad400640 1 --2- 172.21.15.86:0/761496384 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa88c0a1110 0x7fa88c0a35d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.482+0000 7fa8ad400640 1 --2- 172.21.15.86:0/761496384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8a8101920 0x7fa8a819f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.482+0000 7fa8ad400640 1 --2- 172.21.15.86:0/761496384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a8100f60 0x7fa8a81985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.482+0000 7fa8ad400640 1 --2- 172.21.15.86:0/761496384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a80ffd70 0x7fa8a8198090 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.482+0000 7fa8ad400640 1 -- 172.21.15.86:0/761496384 >> 172.21.15.86:0/761496384 conn(0x7fa8a80fb4d0 msgr2=0x7fa8a8106720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:24.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.482+0000 7fa8ad400640 1 -- 172.21.15.86:0/761496384 shutdown_connections 2024-09-13T16:08:24.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.482+0000 7fa8ad400640 1 -- 172.21.15.86:0/761496384 wait complete. 2024-09-13T16:08:24.498 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T16:08:24.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.653+0000 7ff62f800640 1 -- 172.21.15.86:0/3712929289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff628074e70 msgr2=0x7ff628075270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:24.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.653+0000 7ff62f800640 1 --2- 172.21.15.86:0/3712929289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff628074e70 0x7ff628075270 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff618009900 tx=0x7ff61802a410 comp rx=0 tx=0).stop 2024-09-13T16:08:24.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.653+0000 7ff62f800640 1 -- 172.21.15.86:0/3712929289 shutdown_connections 2024-09-13T16:08:24.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.653+0000 7ff62f800640 1 --2- 172.21.15.86:0/3712929289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff628076a50 0x7ff6280772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.653+0000 7ff62f800640 1 --2- 172.21.15.86:0/3712929289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6280760b0 0x7ff628076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.653+0000 7ff62f800640 1 --2- 172.21.15.86:0/3712929289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff628074e70 0x7ff628075270 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.653+0000 7ff62f800640 1 -- 172.21.15.86:0/3712929289 >> 172.21.15.86:0/3712929289 conn(0x7ff6280fd700 msgr2=0x7ff6280ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:24.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.653+0000 7ff62f800640 1 -- 172.21.15.86:0/3712929289 shutdown_connections 2024-09-13T16:08:24.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.653+0000 7ff62f800640 1 -- 172.21.15.86:0/3712929289 wait complete. 2024-09-13T16:08:24.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.654+0000 7ff62f800640 1 Processor -- start 2024-09-13T16:08:24.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.654+0000 7ff62f800640 1 -- start start 2024-09-13T16:08:24.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.655+0000 7ff62f800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff628074e70 0x7ff62819c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:24.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.655+0000 7ff62f800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6280760b0 0x7ff62819c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:24.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.655+0000 7ff62f800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff628076a50 0x7ff6281a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:24.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.655+0000 7ff62f800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6281a3f10 con 0x7ff6280760b0 2024-09-13T16:08:24.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.655+0000 7ff62f800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6281a4080 con 0x7ff628074e70 2024-09-13T16:08:24.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.655+0000 7ff62f800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6281a4240 con 0x7ff628076a50 2024-09-13T16:08:24.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.655+0000 7ff61fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6280760b0 0x7ff62819c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:24.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.655+0000 7ff61fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6280760b0 0x7ff62819c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44708/0 (socket says 172.21.15.86:44708) 2024-09-13T16:08:24.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.655+0000 7ff61fe00640 1 -- 172.21.15.86:0/3082508074 learned_addr learned my addr 172.21.15.86:0/3082508074 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:24.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.655+0000 7ff62ce00640 1 --2- 172.21.15.86:0/3082508074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff628074e70 0x7ff62819c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:24.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.655+0000 7ff62d800640 1 --2- 172.21.15.86:0/3082508074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff628076a50 0x7ff6281a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:24.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.655+0000 7ff61fe00640 1 -- 172.21.15.86:0/3082508074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff628076a50 msgr2=0x7ff6281a39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:24.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.655+0000 7ff61fe00640 1 --2- 172.21.15.86:0/3082508074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff628076a50 0x7ff6281a39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.655+0000 7ff61fe00640 1 -- 172.21.15.86:0/3082508074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff628074e70 msgr2=0x7ff62819c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:24.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.655+0000 7ff61fe00640 1 --2- 172.21.15.86:0/3082508074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff628074e70 0x7ff62819c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.655+0000 7ff61fe00640 1 -- 172.21.15.86:0/3082508074 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff618009560 con 0x7ff6280760b0 2024-09-13T16:08:24.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.655+0000 7ff62ce00640 1 --2- 172.21.15.86:0/3082508074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff628074e70 0x7ff62819c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:08:24.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.656+0000 7ff61fe00640 1 --2- 172.21.15.86:0/3082508074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6280760b0 0x7ff62819c960 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff61000e9f0 tx=0x7ff61000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:24.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.656+0000 7ff626000640 1 -- 172.21.15.86:0/3082508074 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610009700 con 0x7ff6280760b0 2024-09-13T16:08:24.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.656+0000 7ff62f800640 1 -- 172.21.15.86:0/3082508074 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6281a4520 con 0x7ff6280760b0 2024-09-13T16:08:24.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.656+0000 7ff626000640 1 -- 172.21.15.86:0/3082508074 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff61000cd80 con 0x7ff6280760b0 2024-09-13T16:08:24.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.656+0000 7ff626000640 1 -- 172.21.15.86:0/3082508074 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610018920 con 0x7ff6280760b0 2024-09-13T16:08:24.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.656+0000 7ff62f800640 1 -- 172.21.15.86:0/3082508074 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6281a4a30 con 0x7ff6280760b0 2024-09-13T16:08:24.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.657+0000 7ff62f800640 1 -- 172.21.15.86:0/3082508074 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62810e8f0 con 0x7ff6280760b0 2024-09-13T16:08:24.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.659+0000 7ff626000640 1 -- 172.21.15.86:0/3082508074 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff610018a80 con 0x7ff6280760b0 2024-09-13T16:08:24.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.660+0000 7ff626000640 1 --2- 172.21.15.86:0/3082508074 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff60c0a1090 0x7ff60c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:24.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.661+0000 7ff626000640 1 -- 172.21.15.86:0/3082508074 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff610014070 con 0x7ff6280760b0 2024-09-13T16:08:24.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.661+0000 7ff62ce00640 1 --2- 172.21.15.86:0/3082508074 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff60c0a1090 0x7ff60c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:24.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.661+0000 7ff62ce00640 1 --2- 172.21.15.86:0/3082508074 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff60c0a1090 0x7ff60c0a3550 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff618006010 tx=0x7ff618005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:24.663 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.663+0000 7ff626000640 1 -- 172.21.15.86:0/3082508074 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff610096980 con 0x7ff6280760b0 2024-09-13T16:08:24.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:24 smithi139 ceph-mon[35320]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 102 B/s wr, 0 op/s 2024-09-13T16:08:24.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:24 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2345528776' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:24.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:24 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/587654770' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:08:24.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:24 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3521590340' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:08:24.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:24 smithi194 ceph-mon[35694]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 102 B/s wr, 0 op/s 2024-09-13T16:08:24.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:24 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2345528776' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:24.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:24 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/587654770' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:08:24.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:24 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3521590340' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:08:24.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.836+0000 7ff62f800640 1 -- 172.21.15.86:0/3082508074 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff62810e360 con 0x7ff6280760b0 2024-09-13T16:08:24.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.836+0000 7ff626000640 1 -- 172.21.15.86:0/3082508074 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff610099fa0 con 0x7ff6280760b0 2024-09-13T16:08:24.837 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-09-13T16:08:24.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.838+0000 7ff62f800640 1 -- 172.21.15.86:0/3082508074 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff60c0a1090 msgr2=0x7ff60c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:24.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.838+0000 7ff62f800640 1 --2- 172.21.15.86:0/3082508074 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff60c0a1090 0x7ff60c0a3550 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff618006010 tx=0x7ff618005a20 comp rx=0 tx=0).stop 2024-09-13T16:08:24.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.838+0000 7ff62f800640 1 -- 172.21.15.86:0/3082508074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6280760b0 msgr2=0x7ff62819c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:24.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.838+0000 7ff62f800640 1 --2- 172.21.15.86:0/3082508074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6280760b0 0x7ff62819c960 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff61000e9f0 tx=0x7ff61000eeb0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.838+0000 7ff62f800640 1 -- 172.21.15.86:0/3082508074 shutdown_connections 2024-09-13T16:08:24.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.838+0000 7ff62f800640 1 --2- 172.21.15.86:0/3082508074 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff60c0a1090 0x7ff60c0a3550 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.838+0000 7ff62f800640 1 --2- 172.21.15.86:0/3082508074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff628076a50 0x7ff6281a39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.838+0000 7ff62f800640 1 --2- 172.21.15.86:0/3082508074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6280760b0 0x7ff62819c960 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.838+0000 7ff62f800640 1 --2- 172.21.15.86:0/3082508074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff628074e70 0x7ff62819c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:24.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.838+0000 7ff62f800640 1 -- 172.21.15.86:0/3082508074 >> 172.21.15.86:0/3082508074 conn(0x7ff6280fd700 msgr2=0x7ff6280ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:24.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.838+0000 7ff62f800640 1 -- 172.21.15.86:0/3082508074 shutdown_connections 2024-09-13T16:08:24.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:24.838+0000 7ff62f800640 1 -- 172.21.15.86:0/3082508074 wait complete. 2024-09-13T16:08:24.853 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:24 smithi086 ceph-mon[30379]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 102 B/s wr, 0 op/s 2024-09-13T16:08:24.853 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:24 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2345528776' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:24.853 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:24 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/587654770' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:08:24.853 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:24 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3521590340' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:08:24.855 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T16:08:25.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.012+0000 7f1ad2000640 1 -- 172.21.15.86:0/3535919061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1acc0760b0 msgr2=0x7f1acc076510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:25.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.012+0000 7f1ad2000640 1 --2- 172.21.15.86:0/3535919061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1acc0760b0 0x7f1acc076510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009900 tx=0x7f1ab402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.013 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.012+0000 7f1ad2000640 1 -- 172.21.15.86:0/3535919061 shutdown_connections 2024-09-13T16:08:25.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.012+0000 7f1ad2000640 1 --2- 172.21.15.86:0/3535919061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1acc076a50 0x7f1acc0772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.012+0000 7f1ad2000640 1 --2- 172.21.15.86:0/3535919061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1acc0760b0 0x7f1acc076510 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.012+0000 7f1ad2000640 1 --2- 172.21.15.86:0/3535919061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1acc074e70 0x7f1acc075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.012+0000 7f1ad2000640 1 -- 172.21.15.86:0/3535919061 >> 172.21.15.86:0/3535919061 conn(0x7f1acc0fd500 msgr2=0x7f1acc0ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:25.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.012+0000 7f1ad2000640 1 -- 172.21.15.86:0/3535919061 shutdown_connections 2024-09-13T16:08:25.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.012+0000 7f1ad2000640 1 -- 172.21.15.86:0/3535919061 wait complete. 2024-09-13T16:08:25.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.013+0000 7f1ad2000640 1 Processor -- start 2024-09-13T16:08:25.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.013+0000 7f1ad2000640 1 -- start start 2024-09-13T16:08:25.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.014+0000 7f1ad2000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1acc074e70 0x7f1acc19c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:25.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.014+0000 7f1ad2000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1acc0760b0 0x7f1acc19c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:25.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.014+0000 7f1ad2000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1acc076a50 0x7f1acc1a3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:25.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.014+0000 7f1ad2000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc1a3d90 con 0x7f1acc074e70 2024-09-13T16:08:25.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.014+0000 7f1ad2000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc1a3f00 con 0x7f1acc0760b0 2024-09-13T16:08:25.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.014+0000 7f1ad2000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc1a40c0 con 0x7f1acc076a50 2024-09-13T16:08:25.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.014+0000 7f1ad0c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1acc074e70 0x7f1acc19c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:25.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.014+0000 7f1ad0c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1acc074e70 0x7f1acc19c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44716/0 (socket says 172.21.15.86:44716) 2024-09-13T16:08:25.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.014+0000 7f1ad0c00640 1 -- 172.21.15.86:0/2690322839 learned_addr learned my addr 172.21.15.86:0/2690322839 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:25.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.014+0000 7f1ac3e00640 1 --2- 172.21.15.86:0/2690322839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1acc0760b0 0x7f1acc19c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:25.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.014+0000 7f1ad1600640 1 --2- 172.21.15.86:0/2690322839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1acc076a50 0x7f1acc1a3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:25.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.014+0000 7f1ad0c00640 1 -- 172.21.15.86:0/2690322839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1acc076a50 msgr2=0x7f1acc1a3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:25.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.014+0000 7f1ad0c00640 1 --2- 172.21.15.86:0/2690322839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1acc076a50 0x7f1acc1a3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.014+0000 7f1ad0c00640 1 -- 172.21.15.86:0/2690322839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1acc0760b0 msgr2=0x7f1acc19c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:25.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.014+0000 7f1ad0c00640 1 --2- 172.21.15.86:0/2690322839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1acc0760b0 0x7f1acc19c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.014+0000 7f1ad0c00640 1 -- 172.21.15.86:0/2690322839 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab4009560 con 0x7f1acc074e70 2024-09-13T16:08:25.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.014+0000 7f1ad1600640 1 --2- 172.21.15.86:0/2690322839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1acc076a50 0x7f1acc1a3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:08:25.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.015+0000 7f1ad0c00640 1 --2- 172.21.15.86:0/2690322839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1acc074e70 0x7f1acc19c2a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1abc00e9f0 tx=0x7f1abc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:25.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.015+0000 7f1aca000640 1 -- 172.21.15.86:0/2690322839 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc009720 con 0x7f1acc074e70 2024-09-13T16:08:25.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.015+0000 7f1aca000640 1 -- 172.21.15.86:0/2690322839 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1abc00cd80 con 0x7f1acc074e70 2024-09-13T16:08:25.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.015+0000 7f1ad2000640 1 -- 172.21.15.86:0/2690322839 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1acc1a43a0 con 0x7f1acc074e70 2024-09-13T16:08:25.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.015+0000 7f1aca000640 1 -- 172.21.15.86:0/2690322839 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc010690 con 0x7f1acc074e70 2024-09-13T16:08:25.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.015+0000 7f1ad2000640 1 -- 172.21.15.86:0/2690322839 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1acc1a4830 con 0x7f1acc074e70 2024-09-13T16:08:25.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.016+0000 7f1ad2000640 1 -- 172.21.15.86:0/2690322839 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1acc10e6f0 con 0x7f1acc074e70 2024-09-13T16:08:25.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.018+0000 7f1aca000640 1 -- 172.21.15.86:0/2690322839 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1abc0046c0 con 0x7f1acc074e70 2024-09-13T16:08:25.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.019+0000 7f1aca000640 1 --2- 172.21.15.86:0/2690322839 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1ab00a1090 0x7f1ab00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:25.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.019+0000 7f1aca000640 1 -- 172.21.15.86:0/2690322839 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f1abc014070 con 0x7f1acc074e70 2024-09-13T16:08:25.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.019+0000 7f1ac3e00640 1 --2- 172.21.15.86:0/2690322839 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1ab00a1090 0x7f1ab00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:25.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.020+0000 7f1ac3e00640 1 --2- 172.21.15.86:0/2690322839 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1ab00a1090 0x7f1ab00a3550 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4005ab0 tx=0x7f1ab4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:25.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.023+0000 7f1aca000640 1 -- 172.21.15.86:0/2690322839 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1abc0d0030 con 0x7f1acc074e70 2024-09-13T16:08:25.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.210+0000 7f1ad2000640 1 -- 172.21.15.86:0/2690322839 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1acc111c00 con 0x7f1acc074e70 2024-09-13T16:08:25.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.210+0000 7f1aca000640 1 -- 172.21.15.86:0/2690322839 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) v1 ==== 81+0+591 (secure 0 0 0) 0x7f1abc0964b0 con 0x7f1acc074e70 2024-09-13T16:08:25.211 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6801/3020585994 2024-09-14T16:00:59.245481+0000 2024-09-13T16:08:25.211 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6800/3020585994 2024-09-14T16:00:59.245481+0000 2024-09-13T16:08:25.211 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/3295688385 2024-09-14T16:00:32.423780+0000 2024-09-13T16:08:25.211 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/3012247455 2024-09-14T16:00:59.245481+0000 2024-09-13T16:08:25.211 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/4048858537 2024-09-14T16:00:32.423780+0000 2024-09-13T16:08:25.211 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/538861985 2024-09-14T16:00:59.245481+0000 2024-09-13T16:08:25.212 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/1103077747 2024-09-14T16:00:32.423780+0000 2024-09-13T16:08:25.212 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6801/2495317297 2024-09-14T16:00:32.423780+0000 2024-09-13T16:08:25.212 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/3038340163 2024-09-14T16:00:59.245481+0000 2024-09-13T16:08:25.212 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6800/2495317297 2024-09-14T16:00:32.423780+0000 2024-09-13T16:08:25.212 INFO:teuthology.orchestra.run.smithi086.stderr:listed 10 entries 2024-09-13T16:08:25.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.212+0000 7f1ad2000640 1 -- 172.21.15.86:0/2690322839 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1ab00a1090 msgr2=0x7f1ab00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:25.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.212+0000 7f1ad2000640 1 --2- 172.21.15.86:0/2690322839 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1ab00a1090 0x7f1ab00a3550 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4005ab0 tx=0x7f1ab4005a20 comp rx=0 tx=0).stop 2024-09-13T16:08:25.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.212+0000 7f1ad2000640 1 -- 172.21.15.86:0/2690322839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1acc074e70 msgr2=0x7f1acc19c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:25.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.212+0000 7f1ad2000640 1 --2- 172.21.15.86:0/2690322839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1acc074e70 0x7f1acc19c2a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1abc00e9f0 tx=0x7f1abc00edf0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.212+0000 7f1ad2000640 1 -- 172.21.15.86:0/2690322839 shutdown_connections 2024-09-13T16:08:25.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.212+0000 7f1ad2000640 1 --2- 172.21.15.86:0/2690322839 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1ab00a1090 0x7f1ab00a3550 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.212+0000 7f1ad2000640 1 --2- 172.21.15.86:0/2690322839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1acc076a50 0x7f1acc1a3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.212+0000 7f1ad2000640 1 --2- 172.21.15.86:0/2690322839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1acc0760b0 0x7f1acc19c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.212+0000 7f1ad2000640 1 --2- 172.21.15.86:0/2690322839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1acc074e70 0x7f1acc19c2a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.212+0000 7f1ad2000640 1 -- 172.21.15.86:0/2690322839 >> 172.21.15.86:0/2690322839 conn(0x7f1acc0fd500 msgr2=0x7f1acc0fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:25.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.212+0000 7f1ad2000640 1 -- 172.21.15.86:0/2690322839 shutdown_connections 2024-09-13T16:08:25.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.212+0000 7f1ad2000640 1 -- 172.21.15.86:0/2690322839 wait complete. 2024-09-13T16:08:25.231 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T16:08:25.231 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:08:25.267 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:08:25.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.462+0000 7fb856e00640 1 -- 172.21.15.86:0/3530251908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb850103b60 msgr2=0x7fb85010a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:25.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.462+0000 7fb856e00640 1 --2- 172.21.15.86:0/3530251908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb850103b60 0x7fb85010a3f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb848009be0 tx=0x7fb84802a6c0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.462+0000 7fb856e00640 1 -- 172.21.15.86:0/3530251908 shutdown_connections 2024-09-13T16:08:25.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.462+0000 7fb856e00640 1 --2- 172.21.15.86:0/3530251908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb850103b60 0x7fb85010a3f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.462+0000 7fb856e00640 1 --2- 172.21.15.86:0/3530251908 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8501031a0 0x7fb850103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.462+0000 7fb856e00640 1 --2- 172.21.15.86:0/3530251908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb850101fb0 0x7fb8501023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.462+0000 7fb856e00640 1 -- 172.21.15.86:0/3530251908 >> 172.21.15.86:0/3530251908 conn(0x7fb8500fd730 msgr2=0x7fb8500ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:25.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.462+0000 7fb856e00640 1 -- 172.21.15.86:0/3530251908 shutdown_connections 2024-09-13T16:08:25.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.462+0000 7fb856e00640 1 -- 172.21.15.86:0/3530251908 wait complete. 2024-09-13T16:08:25.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.463+0000 7fb856e00640 1 Processor -- start 2024-09-13T16:08:25.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.463+0000 7fb856e00640 1 -- start start 2024-09-13T16:08:25.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.463+0000 7fb856e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb850101fb0 0x7fb850198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:25.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.463+0000 7fb856e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8501031a0 0x7fb850198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:25.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.463+0000 7fb856e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb850103b60 0x7fb85019f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:25.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.463+0000 7fb856e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85019fad0 con 0x7fb8501031a0 2024-09-13T16:08:25.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.463+0000 7fb856e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85019fc40 con 0x7fb850103b60 2024-09-13T16:08:25.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.463+0000 7fb856e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85019fe00 con 0x7fb850101fb0 2024-09-13T16:08:25.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.464+0000 7fb84f400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8501031a0 0x7fb850198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:25.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.464+0000 7fb84f400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8501031a0 0x7fb850198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44732/0 (socket says 172.21.15.86:44732) 2024-09-13T16:08:25.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.464+0000 7fb84f400640 1 -- 172.21.15.86:0/565068295 learned_addr learned my addr 172.21.15.86:0/565068295 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:25.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.464+0000 7fb84fe00640 1 --2- 172.21.15.86:0/565068295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb850101fb0 0x7fb850198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:25.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.464+0000 7fb854e00640 1 --2- 172.21.15.86:0/565068295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb850103b60 0x7fb85019f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:25.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.464+0000 7fb84f400640 1 -- 172.21.15.86:0/565068295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb850101fb0 msgr2=0x7fb850198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:25.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.464+0000 7fb84f400640 1 --2- 172.21.15.86:0/565068295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb850101fb0 0x7fb850198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.464+0000 7fb84f400640 1 -- 172.21.15.86:0/565068295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb850103b60 msgr2=0x7fb85019f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:25.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.464+0000 7fb84f400640 1 --2- 172.21.15.86:0/565068295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb850103b60 0x7fb85019f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.464+0000 7fb84f400640 1 -- 172.21.15.86:0/565068295 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb840009560 con 0x7fb8501031a0 2024-09-13T16:08:25.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.464+0000 7fb84f400640 1 --2- 172.21.15.86:0/565068295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8501031a0 0x7fb850198570 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00e9f0 tx=0x7fb83c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:25.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.465+0000 7fb84cc00640 1 -- 172.21.15.86:0/565068295 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c009700 con 0x7fb8501031a0 2024-09-13T16:08:25.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.465+0000 7fb856e00640 1 -- 172.21.15.86:0/565068295 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb848009840 con 0x7fb8501031a0 2024-09-13T16:08:25.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.465+0000 7fb84cc00640 1 -- 172.21.15.86:0/565068295 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb83c00cd80 con 0x7fb8501031a0 2024-09-13T16:08:25.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.465+0000 7fb84cc00640 1 -- 172.21.15.86:0/565068295 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c018920 con 0x7fb8501031a0 2024-09-13T16:08:25.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.465+0000 7fb856e00640 1 -- 172.21.15.86:0/565068295 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8501a04b0 con 0x7fb8501031a0 2024-09-13T16:08:25.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.466+0000 7fb856e00640 1 -- 172.21.15.86:0/565068295 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8501093f0 con 0x7fb8501031a0 2024-09-13T16:08:25.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.468+0000 7fb84cc00640 1 -- 172.21.15.86:0/565068295 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb83c018a80 con 0x7fb8501031a0 2024-09-13T16:08:25.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.470+0000 7fb84cc00640 1 --2- 172.21.15.86:0/565068295 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb8340a1090 0x7fb8340a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:25.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.470+0000 7fb84cc00640 1 -- 172.21.15.86:0/565068295 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb83c014070 con 0x7fb8501031a0 2024-09-13T16:08:25.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.470+0000 7fb84fe00640 1 --2- 172.21.15.86:0/565068295 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb8340a1090 0x7fb8340a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:25.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.470+0000 7fb84fe00640 1 --2- 172.21.15.86:0/565068295 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb8340a1090 0x7fb8340a3550 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb840009530 tx=0x7fb840009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:25.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.473+0000 7fb84cc00640 1 -- 172.21.15.86:0/565068295 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb83c052e20 con 0x7fb8501031a0 2024-09-13T16:08:25.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:25 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/761496384' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:08:25.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:25 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3082508074' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:08:25.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:25 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2690322839' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T16:08:25.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.648+0000 7fb856e00640 1 -- 172.21.15.86:0/565068295 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb850108e60 con 0x7fb8501031a0 2024-09-13T16:08:25.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.649+0000 7fb84cc00640 1 -- 172.21.15.86:0/565068295 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23949 (secure 0 0 0) 0x7fb83c0964e0 con 0x7fb8501031a0 2024-09-13T16:08:25.650 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:25.651 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":90,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:08:13.655740+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:08:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.652+0000 7fb856e00640 1 -- 172.21.15.86:0/565068295 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb8340a1090 msgr2=0x7fb8340a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.652+0000 7fb856e00640 1 --2- 172.21.15.86:0/565068295 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb8340a1090 0x7fb8340a3550 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb840009530 tx=0x7fb840009260 comp rx=0 tx=0).stop 2024-09-13T16:08:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.652+0000 7fb856e00640 1 -- 172.21.15.86:0/565068295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8501031a0 msgr2=0x7fb850198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.652+0000 7fb856e00640 1 --2- 172.21.15.86:0/565068295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8501031a0 0x7fb850198570 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00e9f0 tx=0x7fb83c00eeb0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.652+0000 7fb856e00640 1 -- 172.21.15.86:0/565068295 shutdown_connections 2024-09-13T16:08:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.652+0000 7fb856e00640 1 --2- 172.21.15.86:0/565068295 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb8340a1090 0x7fb8340a3550 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.652+0000 7fb856e00640 1 --2- 172.21.15.86:0/565068295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb850103b60 0x7fb85019f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.652+0000 7fb856e00640 1 --2- 172.21.15.86:0/565068295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8501031a0 0x7fb850198570 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.652+0000 7fb856e00640 1 --2- 172.21.15.86:0/565068295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb850101fb0 0x7fb850198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.652+0000 7fb856e00640 1 -- 172.21.15.86:0/565068295 >> 172.21.15.86:0/565068295 conn(0x7fb8500fd730 msgr2=0x7fb8501065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.652+0000 7fb856e00640 1 -- 172.21.15.86:0/565068295 shutdown_connections 2024-09-13T16:08:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.652+0000 7fb856e00640 1 -- 172.21.15.86:0/565068295 wait complete. 2024-09-13T16:08:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:03:27.830423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:08:07.732536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:08:08.742145+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T16:08:11.721740+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T16:08:25.670 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:08:25.697 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:25 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/761496384' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:08:25.697 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:25 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3082508074' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:08:25.697 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:25 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2690322839' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T16:08:25.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:25 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/761496384' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:08:25.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:25 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3082508074' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:08:25.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:25 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2690322839' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T16:08:25.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.828+0000 7f75db200640 1 -- 172.21.15.86:0/3960226004 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75dc103940 msgr2=0x7f75dc10a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:25.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.828+0000 7f75db200640 1 --2- 172.21.15.86:0/3960226004 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75dc103940 0x7f75dc10a260 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009ca0 tx=0x7f75d402a8b0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.828+0000 7f75db200640 1 -- 172.21.15.86:0/3960226004 shutdown_connections 2024-09-13T16:08:25.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.828+0000 7f75db200640 1 --2- 172.21.15.86:0/3960226004 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75dc103940 0x7f75dc10a260 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.828+0000 7f75db200640 1 --2- 172.21.15.86:0/3960226004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75dc102f80 0x7f75dc103400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.828+0000 7f75db200640 1 --2- 172.21.15.86:0/3960226004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75dc101e30 0x7f75dc102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.828+0000 7f75db200640 1 -- 172.21.15.86:0/3960226004 >> 172.21.15.86:0/3960226004 conn(0x7f75dc0fd5b0 msgr2=0x7f75dc0ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:25.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.829+0000 7f75db200640 1 -- 172.21.15.86:0/3960226004 shutdown_connections 2024-09-13T16:08:25.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.829+0000 7f75db200640 1 -- 172.21.15.86:0/3960226004 wait complete. 2024-09-13T16:08:25.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.829+0000 7f75db200640 1 Processor -- start 2024-09-13T16:08:25.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.830+0000 7f75db200640 1 -- start start 2024-09-13T16:08:25.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.830+0000 7f75db200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75dc101e30 0x7f75dc197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:25.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.830+0000 7f75db200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75dc102f80 0x7f75dc198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:25.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.830+0000 7f75db200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75dc103940 0x7f75dc19f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:25.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.830+0000 7f75db200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc19f8f0 con 0x7f75dc102f80 2024-09-13T16:08:25.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.830+0000 7f75db200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc19fa60 con 0x7f75dc101e30 2024-09-13T16:08:25.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.830+0000 7f75db200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc19fc20 con 0x7f75dc103940 2024-09-13T16:08:25.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.830+0000 7f75d9400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75dc102f80 0x7f75dc198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:25.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.830+0000 7f75d9400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75dc102f80 0x7f75dc198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44752/0 (socket says 172.21.15.86:44752) 2024-09-13T16:08:25.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.830+0000 7f75d9400640 1 -- 172.21.15.86:0/919835315 learned_addr learned my addr 172.21.15.86:0/919835315 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:25.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.830+0000 7f75d9e00640 1 --2- 172.21.15.86:0/919835315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75dc101e30 0x7f75dc197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:25.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.830+0000 7f75da800640 1 --2- 172.21.15.86:0/919835315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75dc103940 0x7f75dc19f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:25.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.831+0000 7f75d9400640 1 -- 172.21.15.86:0/919835315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75dc103940 msgr2=0x7f75dc19f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:25.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.831+0000 7f75d9400640 1 --2- 172.21.15.86:0/919835315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75dc103940 0x7f75dc19f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.831+0000 7f75d9400640 1 -- 172.21.15.86:0/919835315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75dc101e30 msgr2=0x7f75dc197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:25.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.831+0000 7f75d9400640 1 --2- 172.21.15.86:0/919835315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75dc101e30 0x7f75dc197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:25.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.831+0000 7f75d9400640 1 -- 172.21.15.86:0/919835315 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d4009900 con 0x7f75dc102f80 2024-09-13T16:08:25.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.831+0000 7f75d9400640 1 --2- 172.21.15.86:0/919835315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75dc102f80 0x7f75dc198340 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f75c800d770 tx=0x7f75c800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:25.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.831+0000 7f75d2a00640 1 -- 172.21.15.86:0/919835315 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8009c30 con 0x7f75dc102f80 2024-09-13T16:08:25.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.831+0000 7f75d2a00640 1 -- 172.21.15.86:0/919835315 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f75c800de80 con 0x7f75dc102f80 2024-09-13T16:08:25.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.831+0000 7f75d2a00640 1 -- 172.21.15.86:0/919835315 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8010460 con 0x7f75dc102f80 2024-09-13T16:08:25.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.831+0000 7f75db200640 1 -- 172.21.15.86:0/919835315 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75dc19ff00 con 0x7f75dc102f80 2024-09-13T16:08:25.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.831+0000 7f75db200640 1 -- 172.21.15.86:0/919835315 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75dc1a0330 con 0x7f75dc102f80 2024-09-13T16:08:25.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.832+0000 7f75db200640 1 -- 172.21.15.86:0/919835315 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75dc1091c0 con 0x7f75dc102f80 2024-09-13T16:08:25.835 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.834+0000 7f75d2a00640 1 -- 172.21.15.86:0/919835315 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f75c8003f60 con 0x7f75dc102f80 2024-09-13T16:08:25.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.835+0000 7f75d2a00640 1 --2- 172.21.15.86:0/919835315 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f75c00a1090 0x7f75c00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:25.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.835+0000 7f75d2a00640 1 -- 172.21.15.86:0/919835315 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f75c80cc760 con 0x7f75dc102f80 2024-09-13T16:08:25.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.836+0000 7f75d9e00640 1 --2- 172.21.15.86:0/919835315 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f75c00a1090 0x7f75c00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:25.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.836+0000 7f75d9e00640 1 --2- 172.21.15.86:0/919835315 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f75c00a1090 0x7f75c00a3550 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00bbe0 tx=0x7f75cc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:25.839 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:25.839+0000 7f75d2a00640 1 -- 172.21.15.86:0/919835315 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f75c8095d50 con 0x7f75dc102f80 2024-09-13T16:08:26.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.006+0000 7f75db200640 1 -- 172.21.15.86:0/919835315 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f75dc02c410 con 0x7f75dc102f80 2024-09-13T16:08:26.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.007+0000 7f75d2a00640 1 -- 172.21.15.86:0/919835315 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f75c8099370 con 0x7f75dc102f80 2024-09-13T16:08:26.008 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-09-13T16:08:26.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.009+0000 7f75db200640 1 -- 172.21.15.86:0/919835315 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f75c00a1090 msgr2=0x7f75c00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:26.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.009+0000 7f75db200640 1 --2- 172.21.15.86:0/919835315 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f75c00a1090 0x7f75c00a3550 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00bbe0 tx=0x7f75cc00b390 comp rx=0 tx=0).stop 2024-09-13T16:08:26.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.009+0000 7f75db200640 1 -- 172.21.15.86:0/919835315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75dc102f80 msgr2=0x7f75dc198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:26.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.009+0000 7f75db200640 1 --2- 172.21.15.86:0/919835315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75dc102f80 0x7f75dc198340 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f75c800d770 tx=0x7f75c800dc30 comp rx=0 tx=0).stop 2024-09-13T16:08:26.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.009+0000 7f75db200640 1 -- 172.21.15.86:0/919835315 shutdown_connections 2024-09-13T16:08:26.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.009+0000 7f75db200640 1 --2- 172.21.15.86:0/919835315 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f75c00a1090 0x7f75c00a3550 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.009+0000 7f75db200640 1 --2- 172.21.15.86:0/919835315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75dc103940 0x7f75dc19f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.009+0000 7f75db200640 1 --2- 172.21.15.86:0/919835315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75dc102f80 0x7f75dc198340 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.009+0000 7f75db200640 1 --2- 172.21.15.86:0/919835315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75dc101e30 0x7f75dc197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.009+0000 7f75db200640 1 -- 172.21.15.86:0/919835315 >> 172.21.15.86:0/919835315 conn(0x7f75dc0fd5b0 msgr2=0x7f75dc106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:26.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.009+0000 7f75db200640 1 -- 172.21.15.86:0/919835315 shutdown_connections 2024-09-13T16:08:26.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.009+0000 7f75db200640 1 -- 172.21.15.86:0/919835315 wait complete. 2024-09-13T16:08:26.027 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:08:26.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.182+0000 7efcac400640 1 -- 172.21.15.86:0/3455930411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efca4103190 msgr2=0x7efca4103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:26.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.182+0000 7efcac400640 1 --2- 172.21.15.86:0/3455930411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efca4103190 0x7efca4103610 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efc90009900 tx=0x7efc9002a410 comp rx=0 tx=0).stop 2024-09-13T16:08:26.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.182+0000 7efcac400640 1 -- 172.21.15.86:0/3455930411 shutdown_connections 2024-09-13T16:08:26.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.182+0000 7efcac400640 1 --2- 172.21.15.86:0/3455930411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efca4103b50 0x7efca410a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.182+0000 7efcac400640 1 --2- 172.21.15.86:0/3455930411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efca4103190 0x7efca4103610 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.182+0000 7efcac400640 1 --2- 172.21.15.86:0/3455930411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efca4101fa0 0x7efca41023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.182+0000 7efcac400640 1 -- 172.21.15.86:0/3455930411 >> 172.21.15.86:0/3455930411 conn(0x7efca40fd700 msgr2=0x7efca40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:26.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.182+0000 7efcac400640 1 -- 172.21.15.86:0/3455930411 shutdown_connections 2024-09-13T16:08:26.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.182+0000 7efcac400640 1 -- 172.21.15.86:0/3455930411 wait complete. 2024-09-13T16:08:26.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.183+0000 7efcac400640 1 Processor -- start 2024-09-13T16:08:26.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.183+0000 7efcac400640 1 -- start start 2024-09-13T16:08:26.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.184+0000 7efcac400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efca4101fa0 0x7efca41980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:26.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.184+0000 7efcac400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efca4103190 0x7efca41985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:26.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.184+0000 7efcac400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efca4103b50 0x7efca419f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:26.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.184+0000 7efcac400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca419fb90 con 0x7efca4103b50 2024-09-13T16:08:26.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.184+0000 7efcac400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca419fd00 con 0x7efca4103190 2024-09-13T16:08:26.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.184+0000 7efcac400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca419fec0 con 0x7efca4101fa0 2024-09-13T16:08:26.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.184+0000 7efcaa400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efca4103b50 0x7efca419f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:26.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.184+0000 7efcaa400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efca4103b50 0x7efca419f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44772/0 (socket says 172.21.15.86:44772) 2024-09-13T16:08:26.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.184+0000 7efcaa400640 1 -- 172.21.15.86:0/3050398823 learned_addr learned my addr 172.21.15.86:0/3050398823 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:26.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.184+0000 7efca9a00640 1 --2- 172.21.15.86:0/3050398823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efca4101fa0 0x7efca41980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:26.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.184+0000 7efca9000640 1 --2- 172.21.15.86:0/3050398823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efca4103190 0x7efca41985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:26.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.184+0000 7efcaa400640 1 -- 172.21.15.86:0/3050398823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efca4101fa0 msgr2=0x7efca41980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:26.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.184+0000 7efcaa400640 1 --2- 172.21.15.86:0/3050398823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efca4101fa0 0x7efca41980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.184+0000 7efcaa400640 1 -- 172.21.15.86:0/3050398823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efca4103190 msgr2=0x7efca41985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:26.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.184+0000 7efcaa400640 1 --2- 172.21.15.86:0/3050398823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efca4103190 0x7efca41985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.184+0000 7efcaa400640 1 -- 172.21.15.86:0/3050398823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc90009560 con 0x7efca4103b50 2024-09-13T16:08:26.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.184+0000 7efca9000640 1 --2- 172.21.15.86:0/3050398823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efca4103190 0x7efca41985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:08:26.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.185+0000 7efcaa400640 1 --2- 172.21.15.86:0/3050398823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efca4103b50 0x7efca419f650 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00e970 tx=0x7efc9c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:26.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.185+0000 7efca2000640 1 -- 172.21.15.86:0/3050398823 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c009720 con 0x7efca4103b50 2024-09-13T16:08:26.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.185+0000 7efca2000640 1 -- 172.21.15.86:0/3050398823 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efc9c005500 con 0x7efca4103b50 2024-09-13T16:08:26.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.185+0000 7efcac400640 1 -- 172.21.15.86:0/3050398823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca41a01a0 con 0x7efca4103b50 2024-09-13T16:08:26.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.185+0000 7efca2000640 1 -- 172.21.15.86:0/3050398823 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c010430 con 0x7efca4103b50 2024-09-13T16:08:26.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.185+0000 7efcac400640 1 -- 172.21.15.86:0/3050398823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca41a0680 con 0x7efca4103b50 2024-09-13T16:08:26.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.186+0000 7efcac400640 1 -- 172.21.15.86:0/3050398823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca4109450 con 0x7efca4103b50 2024-09-13T16:08:26.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.188+0000 7efca2000640 1 -- 172.21.15.86:0/3050398823 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7efc9c005020 con 0x7efca4103b50 2024-09-13T16:08:26.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.189+0000 7efca2000640 1 --2- 172.21.15.86:0/3050398823 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efc8c0a1110 0x7efc8c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:26.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.189+0000 7efca2000640 1 -- 172.21.15.86:0/3050398823 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7efc9c014070 con 0x7efca4103b50 2024-09-13T16:08:26.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.189+0000 7efca9a00640 1 --2- 172.21.15.86:0/3050398823 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efc8c0a1110 0x7efc8c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:26.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.190+0000 7efca9a00640 1 --2- 172.21.15.86:0/3050398823 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efc8c0a1110 0x7efc8c0a35d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efca4102ff0 tx=0x7efc98009720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:26.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.193+0000 7efca2000640 1 -- 172.21.15.86:0/3050398823 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efc9c0963b0 con 0x7efca4103b50 2024-09-13T16:08:26.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.363+0000 7efcac400640 1 -- 172.21.15.86:0/3050398823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efca4108ec0 con 0x7efca4103b50 2024-09-13T16:08:26.364 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.364+0000 7efca2000640 1 -- 172.21.15.86:0/3050398823 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7efc9c0999d0 con 0x7efca4103b50 2024-09-13T16:08:26.365 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-09-13T16:08:26.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.366+0000 7efcac400640 1 -- 172.21.15.86:0/3050398823 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efc8c0a1110 msgr2=0x7efc8c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:26.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.366+0000 7efcac400640 1 --2- 172.21.15.86:0/3050398823 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efc8c0a1110 0x7efc8c0a35d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efca4102ff0 tx=0x7efc98009720 comp rx=0 tx=0).stop 2024-09-13T16:08:26.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.366+0000 7efcac400640 1 -- 172.21.15.86:0/3050398823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efca4103b50 msgr2=0x7efca419f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:26.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.366+0000 7efcac400640 1 --2- 172.21.15.86:0/3050398823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efca4103b50 0x7efca419f650 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00e970 tx=0x7efc9c00ed70 comp rx=0 tx=0).stop 2024-09-13T16:08:26.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.366+0000 7efcac400640 1 -- 172.21.15.86:0/3050398823 shutdown_connections 2024-09-13T16:08:26.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.366+0000 7efcac400640 1 --2- 172.21.15.86:0/3050398823 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efc8c0a1110 0x7efc8c0a35d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.366+0000 7efcac400640 1 --2- 172.21.15.86:0/3050398823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efca4103b50 0x7efca419f650 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.366+0000 7efcac400640 1 --2- 172.21.15.86:0/3050398823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efca4103190 0x7efca41985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.366+0000 7efcac400640 1 --2- 172.21.15.86:0/3050398823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efca4101fa0 0x7efca41980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.366+0000 7efcac400640 1 -- 172.21.15.86:0/3050398823 >> 172.21.15.86:0/3050398823 conn(0x7efca40fd700 msgr2=0x7efca4106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:26.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.366+0000 7efcac400640 1 -- 172.21.15.86:0/3050398823 shutdown_connections 2024-09-13T16:08:26.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.366+0000 7efcac400640 1 -- 172.21.15.86:0/3050398823 wait complete. 2024-09-13T16:08:26.384 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:08:26.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.541+0000 7f112da00640 1 -- 172.21.15.86:0/2425485145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1128100ed0 msgr2=0x7f1128101350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:26.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.541+0000 7f112da00640 1 --2- 172.21.15.86:0/2425485145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1128100ed0 0x7f1128101350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1114009860 tx=0x7f111402a340 comp rx=0 tx=0).stop 2024-09-13T16:08:26.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.541+0000 7f112da00640 1 -- 172.21.15.86:0/2425485145 shutdown_connections 2024-09-13T16:08:26.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.541+0000 7f112da00640 1 --2- 172.21.15.86:0/2425485145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1128101890 0x7f1128108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.541+0000 7f112da00640 1 --2- 172.21.15.86:0/2425485145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1128100ed0 0x7f1128101350 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.541+0000 7f112da00640 1 --2- 172.21.15.86:0/2425485145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11280ffce0 0x7f11281000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.541+0000 7f112da00640 1 -- 172.21.15.86:0/2425485145 >> 172.21.15.86:0/2425485145 conn(0x7f11280fb440 msgr2=0x7f11280fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:26.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.542+0000 7f112da00640 1 -- 172.21.15.86:0/2425485145 shutdown_connections 2024-09-13T16:08:26.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.542+0000 7f112da00640 1 -- 172.21.15.86:0/2425485145 wait complete. 2024-09-13T16:08:26.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.542+0000 7f112da00640 1 Processor -- start 2024-09-13T16:08:26.548 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.543+0000 7f112da00640 1 -- start start 2024-09-13T16:08:26.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.543+0000 7f112da00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11280ffce0 0x7f1128197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:26.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.543+0000 7f112da00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1128100ed0 0x7f1128198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:26.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.543+0000 7f112da00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1128101890 0x7f112819f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:26.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.543+0000 7f112da00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112819fab0 con 0x7f1128100ed0 2024-09-13T16:08:26.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.543+0000 7f112da00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112819fc20 con 0x7f11280ffce0 2024-09-13T16:08:26.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.543+0000 7f112da00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112819fde0 con 0x7f1128101890 2024-09-13T16:08:26.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.543+0000 7f1127400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1128100ed0 0x7f1128198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:26.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.543+0000 7f1127400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1128100ed0 0x7f1128198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44800/0 (socket says 172.21.15.86:44800) 2024-09-13T16:08:26.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.543+0000 7f1127400640 1 -- 172.21.15.86:0/2432910113 learned_addr learned my addr 172.21.15.86:0/2432910113 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:26.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.543+0000 7f1127e00640 1 --2- 172.21.15.86:0/2432910113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11280ffce0 0x7f1128197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:26.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.543+0000 7f112d000640 1 --2- 172.21.15.86:0/2432910113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1128101890 0x7f112819f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:26.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.544+0000 7f1127400640 1 -- 172.21.15.86:0/2432910113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1128101890 msgr2=0x7f112819f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:26.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.544+0000 7f1127400640 1 --2- 172.21.15.86:0/2432910113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1128101890 0x7f112819f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.544+0000 7f1127400640 1 -- 172.21.15.86:0/2432910113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11280ffce0 msgr2=0x7f1128197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:26.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.544+0000 7f1127400640 1 --2- 172.21.15.86:0/2432910113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11280ffce0 0x7f1128197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.544+0000 7f1127400640 1 -- 172.21.15.86:0/2432910113 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1114009490 con 0x7f1128100ed0 2024-09-13T16:08:26.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.544+0000 7f1127400640 1 --2- 172.21.15.86:0/2432910113 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1128100ed0 0x7f1128198500 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1114005940 tx=0x7f11140326f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:26.551 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.544+0000 7f1124c00640 1 -- 172.21.15.86:0/2432910113 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1114032ea0 con 0x7f1128100ed0 2024-09-13T16:08:26.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.544+0000 7f1124c00640 1 -- 172.21.15.86:0/2432910113 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f11140303b0 con 0x7f1128100ed0 2024-09-13T16:08:26.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.544+0000 7f112da00640 1 -- 172.21.15.86:0/2432910113 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11281a0060 con 0x7f1128100ed0 2024-09-13T16:08:26.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.544+0000 7f1124c00640 1 -- 172.21.15.86:0/2432910113 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111403b430 con 0x7f1128100ed0 2024-09-13T16:08:26.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.544+0000 7f112da00640 1 -- 172.21.15.86:0/2432910113 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11281a0510 con 0x7f1128100ed0 2024-09-13T16:08:26.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.545+0000 7f112da00640 1 -- 172.21.15.86:0/2432910113 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f112810b720 con 0x7f1128100ed0 2024-09-13T16:08:26.554 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.547+0000 7f1124c00640 1 -- 172.21.15.86:0/2432910113 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1114039040 con 0x7f1128100ed0 2024-09-13T16:08:26.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.548+0000 7f1124c00640 1 --2- 172.21.15.86:0/2432910113 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f110c0a1090 0x7f110c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:26.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.548+0000 7f1124c00640 1 -- 172.21.15.86:0/2432910113 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f11140ed390 con 0x7f1128100ed0 2024-09-13T16:08:26.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.549+0000 7f1127e00640 1 --2- 172.21.15.86:0/2432910113 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f110c0a1090 0x7f110c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:26.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.549+0000 7f1127e00640 1 --2- 172.21.15.86:0/2432910113 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f110c0a1090 0x7f110c0a3550 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1128100d30 tx=0x7f1118009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:26.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.552+0000 7f1124c00640 1 -- 172.21.15.86:0/2432910113 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f11140b68d0 con 0x7f1128100ed0 2024-09-13T16:08:26.722 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.721+0000 7f112da00640 1 -- 172.21.15.86:0/2432910113 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11281a0730 con 0x7f1128100ed0 2024-09-13T16:08:26.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.721+0000 7f1124c00640 1 -- 172.21.15.86:0/2432910113 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7f11140b9ef0 con 0x7f1128100ed0 2024-09-13T16:08:26.723 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2024-09-13T16:08:26.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.723+0000 7f112da00640 1 -- 172.21.15.86:0/2432910113 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f110c0a1090 msgr2=0x7f110c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:26.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.723+0000 7f112da00640 1 --2- 172.21.15.86:0/2432910113 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f110c0a1090 0x7f110c0a3550 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1128100d30 tx=0x7f1118009260 comp rx=0 tx=0).stop 2024-09-13T16:08:26.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.723+0000 7f112da00640 1 -- 172.21.15.86:0/2432910113 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1128100ed0 msgr2=0x7f1128198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:26.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.723+0000 7f112da00640 1 --2- 172.21.15.86:0/2432910113 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1128100ed0 0x7f1128198500 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1114005940 tx=0x7f11140326f0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.724+0000 7f112da00640 1 -- 172.21.15.86:0/2432910113 shutdown_connections 2024-09-13T16:08:26.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.724+0000 7f112da00640 1 --2- 172.21.15.86:0/2432910113 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f110c0a1090 0x7f110c0a3550 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.724+0000 7f112da00640 1 --2- 172.21.15.86:0/2432910113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1128101890 0x7f112819f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.724+0000 7f112da00640 1 --2- 172.21.15.86:0/2432910113 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1128100ed0 0x7f1128198500 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.724+0000 7f112da00640 1 --2- 172.21.15.86:0/2432910113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11280ffce0 0x7f1128197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.724+0000 7f112da00640 1 -- 172.21.15.86:0/2432910113 >> 172.21.15.86:0/2432910113 conn(0x7f11280fb440 msgr2=0x7f11281066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:26.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.724+0000 7f112da00640 1 -- 172.21.15.86:0/2432910113 shutdown_connections 2024-09-13T16:08:26.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.724+0000 7f112da00640 1 -- 172.21.15.86:0/2432910113 wait complete. 2024-09-13T16:08:26.740 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:26 smithi086 ceph-mon[30379]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 87 B/s wr, 0 op/s 2024-09-13T16:08:26.740 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:26 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/565068295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:26.740 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:26 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/919835315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:08:26.740 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:26 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3050398823' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:08:26.741 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T16:08:26.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:26 smithi139 ceph-mon[35320]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 87 B/s wr, 0 op/s 2024-09-13T16:08:26.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:26 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/565068295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:26.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:26 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/919835315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:08:26.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:26 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3050398823' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:08:26.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:26 smithi194 ceph-mon[35694]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 87 B/s wr, 0 op/s 2024-09-13T16:08:26.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:26 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/565068295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:26.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:26 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/919835315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:08:26.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:26 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3050398823' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:08:26.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.896+0000 7fac3e800640 1 -- 172.21.15.86:0/1844219197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac38103b50 msgr2=0x7fac3810a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:26.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.896+0000 7fac3e800640 1 --2- 172.21.15.86:0/1844219197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac38103b50 0x7fac3810a3e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fac30009ca0 tx=0x7fac3002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.897+0000 7fac3e800640 1 -- 172.21.15.86:0/1844219197 shutdown_connections 2024-09-13T16:08:26.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.897+0000 7fac3e800640 1 --2- 172.21.15.86:0/1844219197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac38103b50 0x7fac3810a3e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.897+0000 7fac3e800640 1 --2- 172.21.15.86:0/1844219197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac38103190 0x7fac38103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.897+0000 7fac3e800640 1 --2- 172.21.15.86:0/1844219197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac38101fa0 0x7fac381023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.897+0000 7fac3e800640 1 -- 172.21.15.86:0/1844219197 >> 172.21.15.86:0/1844219197 conn(0x7fac380fd700 msgr2=0x7fac380ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:26.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.897+0000 7fac3e800640 1 -- 172.21.15.86:0/1844219197 shutdown_connections 2024-09-13T16:08:26.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.897+0000 7fac3e800640 1 -- 172.21.15.86:0/1844219197 wait complete. 2024-09-13T16:08:26.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.898+0000 7fac3e800640 1 Processor -- start 2024-09-13T16:08:26.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.898+0000 7fac3e800640 1 -- start start 2024-09-13T16:08:26.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.898+0000 7fac3e800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac38101fa0 0x7fac38198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:26.901 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.898+0000 7fac3e800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac38103190 0x7fac38198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:26.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.898+0000 7fac3e800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac38103b50 0x7fac3819f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:26.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.898+0000 7fac3e800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3819fb10 con 0x7fac38101fa0 2024-09-13T16:08:26.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.898+0000 7fac3e800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3819fc80 con 0x7fac38103190 2024-09-13T16:08:26.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.898+0000 7fac3e800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3819fe40 con 0x7fac38103b50 2024-09-13T16:08:26.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.898+0000 7fac37400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac38101fa0 0x7fac38198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:26.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.898+0000 7fac37400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac38101fa0 0x7fac38198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44810/0 (socket says 172.21.15.86:44810) 2024-09-13T16:08:26.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.898+0000 7fac37400640 1 -- 172.21.15.86:0/2225308060 learned_addr learned my addr 172.21.15.86:0/2225308060 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:26.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.898+0000 7fac36a00640 1 --2- 172.21.15.86:0/2225308060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac38103190 0x7fac38198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:26.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.898+0000 7fac37e00640 1 --2- 172.21.15.86:0/2225308060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac38103b50 0x7fac3819f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:26.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.899+0000 7fac37400640 1 -- 172.21.15.86:0/2225308060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac38103b50 msgr2=0x7fac3819f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:26.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.899+0000 7fac37400640 1 --2- 172.21.15.86:0/2225308060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac38103b50 0x7fac3819f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.899+0000 7fac37400640 1 -- 172.21.15.86:0/2225308060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac38103190 msgr2=0x7fac38198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:26.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.899+0000 7fac37400640 1 --2- 172.21.15.86:0/2225308060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac38103190 0x7fac38198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:26.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.899+0000 7fac37400640 1 -- 172.21.15.86:0/2225308060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac30009900 con 0x7fac38101fa0 2024-09-13T16:08:26.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.899+0000 7fac37400640 1 --2- 172.21.15.86:0/2225308060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac38101fa0 0x7fac38198020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fac2800eb00 tx=0x7fac2800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:26.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.899+0000 7fac2fe00640 1 -- 172.21.15.86:0/2225308060 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac28009700 con 0x7fac38101fa0 2024-09-13T16:08:26.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.899+0000 7fac2fe00640 1 -- 172.21.15.86:0/2225308060 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fac280035f0 con 0x7fac38101fa0 2024-09-13T16:08:26.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.899+0000 7fac3e800640 1 -- 172.21.15.86:0/2225308060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac381a0120 con 0x7fac38101fa0 2024-09-13T16:08:26.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.899+0000 7fac2fe00640 1 -- 172.21.15.86:0/2225308060 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac28010690 con 0x7fac38101fa0 2024-09-13T16:08:26.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.899+0000 7fac3e800640 1 -- 172.21.15.86:0/2225308060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac381a0630 con 0x7fac38101fa0 2024-09-13T16:08:26.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.900+0000 7fac3e800640 1 -- 172.21.15.86:0/2225308060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac38109340 con 0x7fac38101fa0 2024-09-13T16:08:26.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.902+0000 7fac2fe00640 1 -- 172.21.15.86:0/2225308060 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fac28003af0 con 0x7fac38101fa0 2024-09-13T16:08:26.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.903+0000 7fac2fe00640 1 --2- 172.21.15.86:0/2225308060 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fac1c0a1090 0x7fac1c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:26.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.904+0000 7fac2fe00640 1 -- 172.21.15.86:0/2225308060 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fac28014070 con 0x7fac38101fa0 2024-09-13T16:08:26.905 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.904+0000 7fac36a00640 1 --2- 172.21.15.86:0/2225308060 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fac1c0a1090 0x7fac1c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:26.906 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.904+0000 7fac36a00640 1 --2- 172.21.15.86:0/2225308060 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fac1c0a1090 0x7fac1c0a3550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fac38199530 tx=0x7fac24005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:26.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:26.907+0000 7fac2fe00640 1 -- 172.21.15.86:0/2225308060 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fac28096640 con 0x7fac38101fa0 2024-09-13T16:08:27.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.077+0000 7fac3e800640 1 -- 172.21.15.86:0/2225308060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fac3802c3e0 con 0x7fac38101fa0 2024-09-13T16:08:27.079 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.078+0000 7fac2fe00640 1 -- 172.21.15.86:0/2225308060 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7fac28099c60 con 0x7fac38101fa0 2024-09-13T16:08:27.079 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-09-13T16:08:27.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.080+0000 7fac3e800640 1 -- 172.21.15.86:0/2225308060 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fac1c0a1090 msgr2=0x7fac1c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:27.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.080+0000 7fac3e800640 1 --2- 172.21.15.86:0/2225308060 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fac1c0a1090 0x7fac1c0a3550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fac38199530 tx=0x7fac24005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:27.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.080+0000 7fac3e800640 1 -- 172.21.15.86:0/2225308060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac38101fa0 msgr2=0x7fac38198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:27.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.080+0000 7fac3e800640 1 --2- 172.21.15.86:0/2225308060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac38101fa0 0x7fac38198020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fac2800eb00 tx=0x7fac2800c2d0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.080+0000 7fac3e800640 1 -- 172.21.15.86:0/2225308060 shutdown_connections 2024-09-13T16:08:27.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.080+0000 7fac3e800640 1 --2- 172.21.15.86:0/2225308060 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fac1c0a1090 0x7fac1c0a3550 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.080+0000 7fac3e800640 1 --2- 172.21.15.86:0/2225308060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac38103b50 0x7fac3819f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.080+0000 7fac3e800640 1 --2- 172.21.15.86:0/2225308060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac38103190 0x7fac38198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.080+0000 7fac3e800640 1 --2- 172.21.15.86:0/2225308060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac38101fa0 0x7fac38198020 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.080+0000 7fac3e800640 1 -- 172.21.15.86:0/2225308060 >> 172.21.15.86:0/2225308060 conn(0x7fac380fd700 msgr2=0x7fac38106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:27.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.080+0000 7fac3e800640 1 -- 172.21.15.86:0/2225308060 shutdown_connections 2024-09-13T16:08:27.082 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.080+0000 7fac3e800640 1 -- 172.21.15.86:0/2225308060 wait complete. 2024-09-13T16:08:27.097 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T16:08:27.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.250+0000 7fd303000640 1 -- 172.21.15.86:0/3572019060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2fc101f90 msgr2=0x7fd2fc102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:27.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.250+0000 7fd303000640 1 --2- 172.21.15.86:0/3572019060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2fc101f90 0x7fd2fc102390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009900 tx=0x7fd2ec02a410 comp rx=0 tx=0).stop 2024-09-13T16:08:27.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.250+0000 7fd303000640 1 -- 172.21.15.86:0/3572019060 shutdown_connections 2024-09-13T16:08:27.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.250+0000 7fd303000640 1 --2- 172.21.15.86:0/3572019060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc103b40 0x7fd2fc10a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.250+0000 7fd303000640 1 --2- 172.21.15.86:0/3572019060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2fc103180 0x7fd2fc103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.250+0000 7fd303000640 1 --2- 172.21.15.86:0/3572019060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2fc101f90 0x7fd2fc102390 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.250+0000 7fd303000640 1 -- 172.21.15.86:0/3572019060 >> 172.21.15.86:0/3572019060 conn(0x7fd2fc0fd6d0 msgr2=0x7fd2fc0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:27.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.250+0000 7fd303000640 1 -- 172.21.15.86:0/3572019060 shutdown_connections 2024-09-13T16:08:27.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.250+0000 7fd303000640 1 -- 172.21.15.86:0/3572019060 wait complete. 2024-09-13T16:08:27.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.251+0000 7fd303000640 1 Processor -- start 2024-09-13T16:08:27.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.251+0000 7fd303000640 1 -- start start 2024-09-13T16:08:27.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.251+0000 7fd303000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2fc101f90 0x7fd2fc198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:27.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.251+0000 7fd303000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2fc103180 0x7fd2fc198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:27.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.251+0000 7fd303000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc103b40 0x7fd2fc19f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:27.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.251+0000 7fd303000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc19fb00 con 0x7fd2fc103180 2024-09-13T16:08:27.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.251+0000 7fd303000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc19fc70 con 0x7fd2fc101f90 2024-09-13T16:08:27.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.251+0000 7fd303000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc19fe30 con 0x7fd2fc103b40 2024-09-13T16:08:27.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.252+0000 7fd2fbe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2fc101f90 0x7fd2fc198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:27.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.252+0000 7fd301000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc103b40 0x7fd2fc19f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:27.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.252+0000 7fd2f3e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2fc103180 0x7fd2fc198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:27.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.252+0000 7fd301000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc103b40 0x7fd2fc19f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:43290/0 (socket says 172.21.15.86:43290) 2024-09-13T16:08:27.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.252+0000 7fd2fbe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2fc101f90 0x7fd2fc198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:42590/0 (socket says 172.21.15.86:42590) 2024-09-13T16:08:27.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.252+0000 7fd301000640 1 -- 172.21.15.86:0/3020309448 learned_addr learned my addr 172.21.15.86:0/3020309448 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:27.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.252+0000 7fd2f3e00640 1 -- 172.21.15.86:0/3020309448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc103b40 msgr2=0x7fd2fc19f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:27.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.252+0000 7fd2f3e00640 1 --2- 172.21.15.86:0/3020309448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc103b40 0x7fd2fc19f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.252+0000 7fd2f3e00640 1 -- 172.21.15.86:0/3020309448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2fc101f90 msgr2=0x7fd2fc198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:27.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.252+0000 7fd2f3e00640 1 --2- 172.21.15.86:0/3020309448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2fc101f90 0x7fd2fc198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.256 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.252+0000 7fd2f3e00640 1 -- 172.21.15.86:0/3020309448 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec009560 con 0x7fd2fc103180 2024-09-13T16:08:27.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.252+0000 7fd301000640 1 --2- 172.21.15.86:0/3020309448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc103b40 0x7fd2fc19f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:27.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.252+0000 7fd2f3e00640 1 --2- 172.21.15.86:0/3020309448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2fc103180 0x7fd2fc198550 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400e9f0 tx=0x7fd2e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:27.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.253+0000 7fd2f9600640 1 -- 172.21.15.86:0/3020309448 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e400ccc0 con 0x7fd2fc103180 2024-09-13T16:08:27.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.253+0000 7fd2f9600640 1 -- 172.21.15.86:0/3020309448 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd2e400ce20 con 0x7fd2fc103180 2024-09-13T16:08:27.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.253+0000 7fd303000640 1 -- 172.21.15.86:0/3020309448 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc1a0110 con 0x7fd2fc103180 2024-09-13T16:08:27.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.253+0000 7fd2f9600640 1 -- 172.21.15.86:0/3020309448 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4018920 con 0x7fd2fc103180 2024-09-13T16:08:27.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.253+0000 7fd303000640 1 -- 172.21.15.86:0/3020309448 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc1a0620 con 0x7fd2fc103180 2024-09-13T16:08:27.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.254+0000 7fd303000640 1 -- 172.21.15.86:0/3020309448 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2fc1093a0 con 0x7fd2fc103180 2024-09-13T16:08:27.257 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.255+0000 7fd2f9600640 1 -- 172.21.15.86:0/3020309448 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd2e4018a80 con 0x7fd2fc103180 2024-09-13T16:08:27.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.257+0000 7fd2f9600640 1 --2- 172.21.15.86:0/3020309448 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd2e00a1090 0x7fd2e00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:27.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.257+0000 7fd2f9600640 1 -- 172.21.15.86:0/3020309448 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd2e4014070 con 0x7fd2fc103180 2024-09-13T16:08:27.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.257+0000 7fd2fbe00640 1 --2- 172.21.15.86:0/3020309448 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd2e00a1090 0x7fd2e00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:27.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.258+0000 7fd2fbe00640 1 --2- 172.21.15.86:0/3020309448 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd2e00a1090 0x7fd2e00a3550 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec02aa00 tx=0x7fd2ec0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:27.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.260+0000 7fd2f9600640 1 -- 172.21.15.86:0/3020309448 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd2e4052e20 con 0x7fd2fc103180 2024-09-13T16:08:27.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.445+0000 7fd303000640 1 -- 172.21.15.86:0/3020309448 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd2fc10d9a0 con 0x7fd2fc103180 2024-09-13T16:08:27.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.446+0000 7fd2f9600640 1 -- 172.21.15.86:0/3020309448 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) v1 ==== 81+0+591 (secure 0 0 0) 0x7fd2e4099e80 con 0x7fd2fc103180 2024-09-13T16:08:27.448 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6801/3020585994 2024-09-14T16:00:59.245481+0000 2024-09-13T16:08:27.448 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6800/3020585994 2024-09-14T16:00:59.245481+0000 2024-09-13T16:08:27.448 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/3295688385 2024-09-14T16:00:32.423780+0000 2024-09-13T16:08:27.448 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/3012247455 2024-09-14T16:00:59.245481+0000 2024-09-13T16:08:27.448 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/4048858537 2024-09-14T16:00:32.423780+0000 2024-09-13T16:08:27.448 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/538861985 2024-09-14T16:00:59.245481+0000 2024-09-13T16:08:27.448 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/1103077747 2024-09-14T16:00:32.423780+0000 2024-09-13T16:08:27.448 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6801/2495317297 2024-09-14T16:00:32.423780+0000 2024-09-13T16:08:27.448 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/3038340163 2024-09-14T16:00:59.245481+0000 2024-09-13T16:08:27.448 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6800/2495317297 2024-09-14T16:00:32.423780+0000 2024-09-13T16:08:27.449 INFO:teuthology.orchestra.run.smithi086.stderr:listed 10 entries 2024-09-13T16:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.448+0000 7fd303000640 1 -- 172.21.15.86:0/3020309448 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd2e00a1090 msgr2=0x7fd2e00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.448+0000 7fd303000640 1 --2- 172.21.15.86:0/3020309448 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd2e00a1090 0x7fd2e00a3550 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec02aa00 tx=0x7fd2ec0058d0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.448+0000 7fd303000640 1 -- 172.21.15.86:0/3020309448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2fc103180 msgr2=0x7fd2fc198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.448+0000 7fd303000640 1 --2- 172.21.15.86:0/3020309448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2fc103180 0x7fd2fc198550 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400e9f0 tx=0x7fd2e400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.448+0000 7fd303000640 1 -- 172.21.15.86:0/3020309448 shutdown_connections 2024-09-13T16:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.448+0000 7fd303000640 1 --2- 172.21.15.86:0/3020309448 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd2e00a1090 0x7fd2e00a3550 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.448+0000 7fd303000640 1 --2- 172.21.15.86:0/3020309448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc103b40 0x7fd2fc19f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.448+0000 7fd303000640 1 --2- 172.21.15.86:0/3020309448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2fc103180 0x7fd2fc198550 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.448+0000 7fd303000640 1 --2- 172.21.15.86:0/3020309448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2fc101f90 0x7fd2fc198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.448+0000 7fd303000640 1 -- 172.21.15.86:0/3020309448 >> 172.21.15.86:0/3020309448 conn(0x7fd2fc0fd6d0 msgr2=0x7fd2fc106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.448+0000 7fd303000640 1 -- 172.21.15.86:0/3020309448 shutdown_connections 2024-09-13T16:08:27.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.448+0000 7fd303000640 1 -- 172.21.15.86:0/3020309448 wait complete. 2024-09-13T16:08:27.466 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi086.front.sepia.ceph.com... 2024-09-13T16:08:27.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:27.466 DEBUG:teuthology.orchestra.run.smithi086:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-13T16:08:27.520 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi086.stderr:ceph-fuse[73077]: fuse finished with error 0 and tester_r 0 2024-09-13T16:08:27.523 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:08:27.622 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T16:08:27.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:08:27.622 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-13T16:08:27.670 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:08:27.717 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:27 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2432910113' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:08:27.717 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:27 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2225308060' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:08:27.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:27 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2432910113' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:08:27.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:27 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2225308060' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:08:27.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:27 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2432910113' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:08:27.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:27 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2225308060' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:08:27.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.823+0000 7f94f1000640 1 -- 172.21.15.86:0/2397531847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ec103180 msgr2=0x7f94ec103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:27.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.823+0000 7f94f1000640 1 --2- 172.21.15.86:0/2397531847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ec103180 0x7f94ec103600 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009860 tx=0x7f94d802a340 comp rx=0 tx=0).stop 2024-09-13T16:08:27.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.823+0000 7f94f1000640 1 -- 172.21.15.86:0/2397531847 shutdown_connections 2024-09-13T16:08:27.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.823+0000 7f94f1000640 1 --2- 172.21.15.86:0/2397531847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94ec103b40 0x7f94ec10a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.823+0000 7f94f1000640 1 --2- 172.21.15.86:0/2397531847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ec103180 0x7f94ec103600 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.823+0000 7f94f1000640 1 --2- 172.21.15.86:0/2397531847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94ec101f90 0x7f94ec102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.823+0000 7f94f1000640 1 -- 172.21.15.86:0/2397531847 >> 172.21.15.86:0/2397531847 conn(0x7f94ec0fd730 msgr2=0x7f94ec0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:27.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.823+0000 7f94f1000640 1 -- 172.21.15.86:0/2397531847 shutdown_connections 2024-09-13T16:08:27.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.823+0000 7f94f1000640 1 -- 172.21.15.86:0/2397531847 wait complete. 2024-09-13T16:08:27.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.824+0000 7f94f1000640 1 Processor -- start 2024-09-13T16:08:27.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.824+0000 7f94f1000640 1 -- start start 2024-09-13T16:08:27.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.825+0000 7f94f1000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ec101f90 0x7f94ec1980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:27.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.825+0000 7f94f1000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94ec103180 0x7f94ec198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:27.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.825+0000 7f94f1000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94ec103b40 0x7f94ec19f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:27.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.825+0000 7f94f1000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec19fbc0 con 0x7f94ec103b40 2024-09-13T16:08:27.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.825+0000 7f94f1000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec19fd30 con 0x7f94ec103180 2024-09-13T16:08:27.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.825+0000 7f94f1000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec19fef0 con 0x7f94ec101f90 2024-09-13T16:08:27.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.825+0000 7f94ea800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94ec103b40 0x7f94ec19f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:27.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.825+0000 7f94e9e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ec101f90 0x7f94ec1980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:27.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.825+0000 7f94e9e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ec101f90 0x7f94ec1980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:43318/0 (socket says 172.21.15.86:43318) 2024-09-13T16:08:27.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.825+0000 7f94e9e00640 1 -- 172.21.15.86:0/840113378 learned_addr learned my addr 172.21.15.86:0/840113378 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:27.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.825+0000 7f94e9400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94ec103180 0x7f94ec198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:27.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.825+0000 7f94e9e00640 1 -- 172.21.15.86:0/840113378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94ec103180 msgr2=0x7f94ec198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:27.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.825+0000 7f94e9e00640 1 --2- 172.21.15.86:0/840113378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94ec103180 0x7f94ec198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.825+0000 7f94e9e00640 1 -- 172.21.15.86:0/840113378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94ec103b40 msgr2=0x7f94ec19f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:27.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.825+0000 7f94e9e00640 1 --2- 172.21.15.86:0/840113378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94ec103b40 0x7f94ec19f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:27.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.825+0000 7f94e9e00640 1 -- 172.21.15.86:0/840113378 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e4009900 con 0x7f94ec101f90 2024-09-13T16:08:27.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.825+0000 7f94ea800640 1 --2- 172.21.15.86:0/840113378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94ec103b40 0x7f94ec19f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:27.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.826+0000 7f94e9e00640 1 --2- 172.21.15.86:0/840113378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ec101f90 0x7f94ec1980d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00e9c0 tx=0x7f94dc00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:27.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.826+0000 7f94e2a00640 1 -- 172.21.15.86:0/840113378 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc0096e0 con 0x7f94ec101f90 2024-09-13T16:08:27.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.826+0000 7f94e2a00640 1 -- 172.21.15.86:0/840113378 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f94dc00cd80 con 0x7f94ec101f90 2024-09-13T16:08:27.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.826+0000 7f94f1000640 1 -- 172.21.15.86:0/840113378 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d8009490 con 0x7f94ec101f90 2024-09-13T16:08:27.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.826+0000 7f94e2a00640 1 -- 172.21.15.86:0/840113378 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc010430 con 0x7f94ec101f90 2024-09-13T16:08:27.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.826+0000 7f94f1000640 1 -- 172.21.15.86:0/840113378 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ec1a04d0 con 0x7f94ec101f90 2024-09-13T16:08:27.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.827+0000 7f94f1000640 1 -- 172.21.15.86:0/840113378 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ec109410 con 0x7f94ec101f90 2024-09-13T16:08:27.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.829+0000 7f94e2a00640 1 -- 172.21.15.86:0/840113378 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f94dc003680 con 0x7f94ec101f90 2024-09-13T16:08:27.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.830+0000 7f94e2a00640 1 --2- 172.21.15.86:0/840113378 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f94d00a1090 0x7f94d00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:27.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.830+0000 7f94e2a00640 1 -- 172.21.15.86:0/840113378 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f94dc014070 con 0x7f94ec101f90 2024-09-13T16:08:27.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.830+0000 7f94e9400640 1 --2- 172.21.15.86:0/840113378 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f94d00a1090 0x7f94d00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:27.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.831+0000 7f94e9400640 1 --2- 172.21.15.86:0/840113378 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f94d00a1090 0x7f94d00a3550 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f94d802a930 tx=0x7f94d8030680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:27.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:27.832+0000 7f94e2a00640 1 -- 172.21.15.86:0/840113378 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f94dc0967a0 con 0x7f94ec101f90 2024-09-13T16:08:28.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.002+0000 7f94f1000640 1 -- 172.21.15.86:0/840113378 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94ec10d9a0 con 0x7f94ec101f90 2024-09-13T16:08:28.006 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.004+0000 7f94e2a00640 1 -- 172.21.15.86:0/840113378 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23949 (secure 0 0 0) 0x7f94dc099dc0 con 0x7f94ec101f90 2024-09-13T16:08:28.006 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:28.006 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":90,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:08:13.655740+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:08:28.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.006+0000 7f94f1000640 1 -- 172.21.15.86:0/840113378 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f94d00a1090 msgr2=0x7f94d00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:28.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.006+0000 7f94f1000640 1 --2- 172.21.15.86:0/840113378 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f94d00a1090 0x7f94d00a3550 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f94d802a930 tx=0x7f94d8030680 comp rx=0 tx=0).stop 2024-09-13T16:08:28.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.006+0000 7f94f1000640 1 -- 172.21.15.86:0/840113378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ec101f90 msgr2=0x7f94ec1980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:28.008 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.006+0000 7f94f1000640 1 --2- 172.21.15.86:0/840113378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ec101f90 0x7f94ec1980d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00e9c0 tx=0x7f94dc00ee80 comp rx=0 tx=0).stop 2024-09-13T16:08:28.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.006+0000 7f94f1000640 1 -- 172.21.15.86:0/840113378 shutdown_connections 2024-09-13T16:08:28.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.007+0000 7f94f1000640 1 --2- 172.21.15.86:0/840113378 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f94d00a1090 0x7f94d00a3550 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.007+0000 7f94f1000640 1 --2- 172.21.15.86:0/840113378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94ec103b40 0x7f94ec19f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.007+0000 7f94f1000640 1 --2- 172.21.15.86:0/840113378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94ec103180 0x7f94ec198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.007+0000 7f94f1000640 1 --2- 172.21.15.86:0/840113378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ec101f90 0x7f94ec1980d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.007+0000 7f94f1000640 1 -- 172.21.15.86:0/840113378 >> 172.21.15.86:0/840113378 conn(0x7f94ec0fd730 msgr2=0x7f94ec1065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:28.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.007+0000 7f94f1000640 1 -- 172.21.15.86:0/840113378 shutdown_connections 2024-09-13T16:08:28.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.007+0000 7f94f1000640 1 -- 172.21.15.86:0/840113378 wait complete. 2024-09-13T16:08:28.025 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:08:28.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.177+0000 7f7be8200640 1 -- 172.21.15.86:0/2960738267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be0106710 msgr2=0x7f7be0106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:28.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.177+0000 7f7be8200640 1 --2- 172.21.15.86:0/2960738267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be0106710 0x7f7be0106b10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009930 tx=0x7f7bd402a420 comp rx=0 tx=0).stop 2024-09-13T16:08:28.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.177+0000 7f7be8200640 1 -- 172.21.15.86:0/2960738267 shutdown_connections 2024-09-13T16:08:28.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.177+0000 7f7be8200640 1 --2- 172.21.15.86:0/2960738267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be0107fb0 0x7f7be010e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.177+0000 7f7be8200640 1 --2- 172.21.15.86:0/2960738267 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be01075f0 0x7f7be0107a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.177+0000 7f7be8200640 1 --2- 172.21.15.86:0/2960738267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be0106710 0x7f7be0106b10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.177+0000 7f7be8200640 1 -- 172.21.15.86:0/2960738267 >> 172.21.15.86:0/2960738267 conn(0x7f7be0075570 msgr2=0x7f7be00779b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:28.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.177+0000 7f7be8200640 1 -- 172.21.15.86:0/2960738267 shutdown_connections 2024-09-13T16:08:28.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.177+0000 7f7be8200640 1 -- 172.21.15.86:0/2960738267 wait complete. 2024-09-13T16:08:28.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.178+0000 7f7be8200640 1 Processor -- start 2024-09-13T16:08:28.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.178+0000 7f7be8200640 1 -- start start 2024-09-13T16:08:28.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.179+0000 7f7be8200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be0106710 0x7f7be019c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:28.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.179+0000 7f7be8200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be01075f0 0x7f7be019c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:28.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.179+0000 7f7be8200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be0107fb0 0x7f7be01a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:28.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.179+0000 7f7be8200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be01a3f90 con 0x7f7be0107fb0 2024-09-13T16:08:28.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.179+0000 7f7be8200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be01a4100 con 0x7f7be01075f0 2024-09-13T16:08:28.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.179+0000 7f7be8200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be01a42c0 con 0x7f7be0106710 2024-09-13T16:08:28.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.179+0000 7f7be6200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be0107fb0 0x7f7be01a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:28.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.179+0000 7f7be6200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be0107fb0 0x7f7be01a3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44876/0 (socket says 172.21.15.86:44876) 2024-09-13T16:08:28.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.179+0000 7f7be6200640 1 -- 172.21.15.86:0/3994407150 learned_addr learned my addr 172.21.15.86:0/3994407150 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:28.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.179+0000 7f7be4e00640 1 --2- 172.21.15.86:0/3994407150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be01075f0 0x7f7be019c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:28.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.179+0000 7f7be5800640 1 --2- 172.21.15.86:0/3994407150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be0106710 0x7f7be019c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:28.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.179+0000 7f7be4e00640 1 -- 172.21.15.86:0/3994407150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be0106710 msgr2=0x7f7be019c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:28.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.179+0000 7f7be4e00640 1 --2- 172.21.15.86:0/3994407150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be0106710 0x7f7be019c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.179+0000 7f7be4e00640 1 -- 172.21.15.86:0/3994407150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be0107fb0 msgr2=0x7f7be01a3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:28.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.179+0000 7f7be4e00640 1 --2- 172.21.15.86:0/3994407150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be0107fb0 0x7f7be01a3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.179+0000 7f7be4e00640 1 -- 172.21.15.86:0/3994407150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd4009560 con 0x7f7be01075f0 2024-09-13T16:08:28.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.179+0000 7f7be6200640 1 --2- 172.21.15.86:0/3994407150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be0107fb0 0x7f7be01a3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:28.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.180+0000 7f7be4e00640 1 --2- 172.21.15.86:0/3994407150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be01075f0 0x7f7be019c9e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00e9f0 tx=0x7f7bcc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:28.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.180+0000 7f7bde000640 1 -- 172.21.15.86:0/3994407150 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc00ccc0 con 0x7f7be01075f0 2024-09-13T16:08:28.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.180+0000 7f7be8200640 1 -- 172.21.15.86:0/3994407150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be01a45a0 con 0x7f7be01075f0 2024-09-13T16:08:28.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.180+0000 7f7bde000640 1 -- 172.21.15.86:0/3994407150 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7bcc00ce20 con 0x7f7be01075f0 2024-09-13T16:08:28.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.180+0000 7f7bde000640 1 -- 172.21.15.86:0/3994407150 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc018920 con 0x7f7be01075f0 2024-09-13T16:08:28.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.180+0000 7f7be8200640 1 -- 172.21.15.86:0/3994407150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be01a4b00 con 0x7f7be01075f0 2024-09-13T16:08:28.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.181+0000 7f7be8200640 1 -- 172.21.15.86:0/3994407150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be010d840 con 0x7f7be01075f0 2024-09-13T16:08:28.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.183+0000 7f7bde000640 1 -- 172.21.15.86:0/3994407150 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7bcc018a80 con 0x7f7be01075f0 2024-09-13T16:08:28.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.185+0000 7f7bde000640 1 --2- 172.21.15.86:0/3994407150 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7bc80a1090 0x7f7bc80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:28.186 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.185+0000 7f7bde000640 1 -- 172.21.15.86:0/3994407150 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f7bcc014070 con 0x7f7be01075f0 2024-09-13T16:08:28.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.185+0000 7f7be5800640 1 --2- 172.21.15.86:0/3994407150 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7bc80a1090 0x7f7bc80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:28.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.186+0000 7f7be5800640 1 --2- 172.21.15.86:0/3994407150 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7bc80a1090 0x7f7bc80a3550 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7bd402aa10 tx=0x7f7bd40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:28.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.186+0000 7f7bde000640 1 -- 172.21.15.86:0/3994407150 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7bcc0965f0 con 0x7f7be01075f0 2024-09-13T16:08:28.357 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.355+0000 7f7be8200640 1 -- 172.21.15.86:0/3994407150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7be010d2b0 con 0x7f7be01075f0 2024-09-13T16:08:28.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.357+0000 7f7bde000640 1 -- 172.21.15.86:0/3994407150 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23949 (secure 0 0 0) 0x7f7bcc099c10 con 0x7f7be01075f0 2024-09-13T16:08:28.359 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:28.359 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":90,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:08:13.655740+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:08:28.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.359+0000 7f7be8200640 1 -- 172.21.15.86:0/3994407150 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7bc80a1090 msgr2=0x7f7bc80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:28.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.359+0000 7f7be8200640 1 --2- 172.21.15.86:0/3994407150 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7bc80a1090 0x7f7bc80a3550 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7bd402aa10 tx=0x7f7bd40058d0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.359+0000 7f7be8200640 1 -- 172.21.15.86:0/3994407150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be01075f0 msgr2=0x7f7be019c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:28.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.359+0000 7f7be8200640 1 --2- 172.21.15.86:0/3994407150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be01075f0 0x7f7be019c9e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00e9f0 tx=0x7f7bcc00eeb0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.359+0000 7f7be8200640 1 -- 172.21.15.86:0/3994407150 shutdown_connections 2024-09-13T16:08:28.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.359+0000 7f7be8200640 1 --2- 172.21.15.86:0/3994407150 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7bc80a1090 0x7f7bc80a3550 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.359+0000 7f7be8200640 1 --2- 172.21.15.86:0/3994407150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be0107fb0 0x7f7be01a3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.359+0000 7f7be8200640 1 --2- 172.21.15.86:0/3994407150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7be01075f0 0x7f7be019c9e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.359+0000 7f7be8200640 1 --2- 172.21.15.86:0/3994407150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be0106710 0x7f7be019c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.359+0000 7f7be8200640 1 -- 172.21.15.86:0/3994407150 >> 172.21.15.86:0/3994407150 conn(0x7f7be0075570 msgr2=0x7f7be010aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:28.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.359+0000 7f7be8200640 1 -- 172.21.15.86:0/3994407150 shutdown_connections 2024-09-13T16:08:28.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.359+0000 7f7be8200640 1 -- 172.21.15.86:0/3994407150 wait complete. 2024-09-13T16:08:28.377 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T16:08:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.533+0000 7fa821600640 1 -- 172.21.15.86:0/2986431253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c072f10 msgr2=0x7fa81c073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.533+0000 7fa821600640 1 --2- 172.21.15.86:0/2986431253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c072f10 0x7fa81c073370 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa804009900 tx=0x7fa80402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.533+0000 7fa821600640 1 -- 172.21.15.86:0/2986431253 shutdown_connections 2024-09-13T16:08:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.533+0000 7fa821600640 1 --2- 172.21.15.86:0/2986431253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa81c10c340 0x7fa81c10e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.533+0000 7fa821600640 1 --2- 172.21.15.86:0/2986431253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c072f10 0x7fa81c073370 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.533+0000 7fa821600640 1 --2- 172.21.15.86:0/2986431253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa81c0744f0 0x7fa81c072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.533+0000 7fa821600640 1 -- 172.21.15.86:0/2986431253 >> 172.21.15.86:0/2986431253 conn(0x7fa81c0fb4d0 msgr2=0x7fa81c0fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.533+0000 7fa821600640 1 -- 172.21.15.86:0/2986431253 shutdown_connections 2024-09-13T16:08:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.533+0000 7fa821600640 1 -- 172.21.15.86:0/2986431253 wait complete. 2024-09-13T16:08:28.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.534+0000 7fa821600640 1 Processor -- start 2024-09-13T16:08:28.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.534+0000 7fa821600640 1 -- start start 2024-09-13T16:08:28.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.534+0000 7fa821600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa81c072f10 0x7fa81c19c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:28.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.534+0000 7fa821600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c0744f0 0x7fa81c19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:28.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.534+0000 7fa821600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa81c10c340 0x7fa81c1a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:28.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.534+0000 7fa821600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c1a3f60 con 0x7fa81c0744f0 2024-09-13T16:08:28.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.534+0000 7fa821600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c1a40d0 con 0x7fa81c10c340 2024-09-13T16:08:28.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.534+0000 7fa821600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c1a4290 con 0x7fa81c072f10 2024-09-13T16:08:28.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.535+0000 7fa813e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c0744f0 0x7fa81c19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:28.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.535+0000 7fa813e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c0744f0 0x7fa81c19c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44890/0 (socket says 172.21.15.86:44890) 2024-09-13T16:08:28.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.535+0000 7fa813e00640 1 -- 172.21.15.86:0/1722930345 learned_addr learned my addr 172.21.15.86:0/1722930345 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:28.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.535+0000 7fa81aa00640 1 --2- 172.21.15.86:0/1722930345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa81c072f10 0x7fa81c19c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:28.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.535+0000 7fa81b400640 1 --2- 172.21.15.86:0/1722930345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa81c10c340 0x7fa81c1a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:28.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.535+0000 7fa813e00640 1 -- 172.21.15.86:0/1722930345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa81c072f10 msgr2=0x7fa81c19c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:28.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.535+0000 7fa813e00640 1 --2- 172.21.15.86:0/1722930345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa81c072f10 0x7fa81c19c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.535+0000 7fa813e00640 1 -- 172.21.15.86:0/1722930345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa81c10c340 msgr2=0x7fa81c1a3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:28.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.535+0000 7fa813e00640 1 --2- 172.21.15.86:0/1722930345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa81c10c340 0x7fa81c1a3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:28.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.535+0000 7fa813e00640 1 -- 172.21.15.86:0/1722930345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa804009560 con 0x7fa81c0744f0 2024-09-13T16:08:28.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.535+0000 7fa81aa00640 1 --2- 172.21.15.86:0/1722930345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa81c072f10 0x7fa81c19c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:28.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.535+0000 7fa81b400640 1 --2- 172.21.15.86:0/1722930345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa81c10c340 0x7fa81c1a3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:28.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.535+0000 7fa813e00640 1 --2- 172.21.15.86:0/1722930345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c0744f0 0x7fa81c19c9b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa804031510 tx=0x7fa8040055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:28.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.536+0000 7fa813400640 1 -- 172.21.15.86:0/1722930345 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804004b50 con 0x7fa81c0744f0 2024-09-13T16:08:28.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.536+0000 7fa813400640 1 -- 172.21.15.86:0/1722930345 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa804004cb0 con 0x7fa81c0744f0 2024-09-13T16:08:28.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.536+0000 7fa813400640 1 -- 172.21.15.86:0/1722930345 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804031ba0 con 0x7fa81c0744f0 2024-09-13T16:08:28.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.536+0000 7fa821600640 1 -- 172.21.15.86:0/1722930345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81c1a4510 con 0x7fa81c0744f0 2024-09-13T16:08:28.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.536+0000 7fa821600640 1 -- 172.21.15.86:0/1722930345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c1a4970 con 0x7fa81c0744f0 2024-09-13T16:08:28.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.537+0000 7fa821600640 1 -- 172.21.15.86:0/1722930345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81c101ce0 con 0x7fa81c0744f0 2024-09-13T16:08:28.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.538+0000 7fa813400640 1 -- 172.21.15.86:0/1722930345 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa804031d00 con 0x7fa81c0744f0 2024-09-13T16:08:28.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.540+0000 7fa813400640 1 --2- 172.21.15.86:0/1722930345 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa8000a1090 0x7fa8000a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:28.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.540+0000 7fa813400640 1 -- 172.21.15.86:0/1722930345 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa8040eda00 con 0x7fa81c0744f0 2024-09-13T16:08:28.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.540+0000 7fa81aa00640 1 --2- 172.21.15.86:0/1722930345 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa8000a1090 0x7fa8000a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:28.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.541+0000 7fa81aa00640 1 --2- 172.21.15.86:0/1722930345 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa8000a1090 0x7fa8000a3550 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009fc0 tx=0x7fa80c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:28.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.543+0000 7fa813400640 1 -- 172.21.15.86:0/1722930345 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa8040b6ff0 con 0x7fa81c0744f0 2024-09-13T16:08:28.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:28 smithi139 ceph-mon[35320]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T16:08:28.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:28 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3020309448' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T16:08:28.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:28 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/840113378' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:28.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:28 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3994407150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:28.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:28.748+0000 7fa821600640 1 -- 172.21.15.86:0/1722930345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa81c111dd0 con 0x7fa81c0744f0 2024-09-13T16:08:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:28 smithi194 ceph-mon[35694]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T16:08:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:28 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3020309448' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T16:08:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:28 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/840113378' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:28 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3994407150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:28.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:28 smithi086 ceph-mon[30379]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T16:08:28.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:28 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3020309448' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T16:08:28.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:28 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/840113378' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:28.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:28 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3994407150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:29.419 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.418+0000 7fa813400640 1 -- 172.21.15.86:0/1722930345 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa8040ba610 con 0x7fa81c0744f0 2024-09-13T16:08:29.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.420+0000 7fa821600640 1 -- 172.21.15.86:0/1722930345 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa8000a1090 msgr2=0x7fa8000a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:29.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.420+0000 7fa821600640 1 --2- 172.21.15.86:0/1722930345 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa8000a1090 0x7fa8000a3550 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009fc0 tx=0x7fa80c005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:29.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.420+0000 7fa821600640 1 -- 172.21.15.86:0/1722930345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c0744f0 msgr2=0x7fa81c19c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:29.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.420+0000 7fa821600640 1 --2- 172.21.15.86:0/1722930345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c0744f0 0x7fa81c19c9b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa804031510 tx=0x7fa8040055a0 comp rx=0 tx=0).stop 2024-09-13T16:08:29.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.420+0000 7fa821600640 1 -- 172.21.15.86:0/1722930345 shutdown_connections 2024-09-13T16:08:29.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.420+0000 7fa821600640 1 --2- 172.21.15.86:0/1722930345 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa8000a1090 0x7fa8000a3550 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:29.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.420+0000 7fa821600640 1 --2- 172.21.15.86:0/1722930345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa81c10c340 0x7fa81c1a3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:29.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.420+0000 7fa821600640 1 --2- 172.21.15.86:0/1722930345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa81c0744f0 0x7fa81c19c9b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:29.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.420+0000 7fa821600640 1 --2- 172.21.15.86:0/1722930345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa81c072f10 0x7fa81c19c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:29.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.420+0000 7fa821600640 1 -- 172.21.15.86:0/1722930345 >> 172.21.15.86:0/1722930345 conn(0x7fa81c0fb4d0 msgr2=0x7fa81c0fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:29.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.420+0000 7fa821600640 1 -- 172.21.15.86:0/1722930345 shutdown_connections 2024-09-13T16:08:29.423 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.420+0000 7fa821600640 1 -- 172.21.15.86:0/1722930345 wait complete. 2024-09-13T16:08:29.439 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-13T16:08:29.439 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-13T16:08:29.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.595+0000 7f66d1000640 1 -- 172.21.15.86:0/1585108270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66cc103170 msgr2=0x7f66cc1035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:29.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.595+0000 7f66d1000640 1 --2- 172.21.15.86:0/1585108270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66cc103170 0x7f66cc1035f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009900 tx=0x7f66b402a410 comp rx=0 tx=0).stop 2024-09-13T16:08:29.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.595+0000 7f66d1000640 1 -- 172.21.15.86:0/1585108270 shutdown_connections 2024-09-13T16:08:29.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.595+0000 7f66d1000640 1 --2- 172.21.15.86:0/1585108270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66cc103b30 0x7f66cc10a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:29.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.595+0000 7f66d1000640 1 --2- 172.21.15.86:0/1585108270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66cc103170 0x7f66cc1035f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:29.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.595+0000 7f66d1000640 1 --2- 172.21.15.86:0/1585108270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66cc101f80 0x7f66cc102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:29.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.595+0000 7f66d1000640 1 -- 172.21.15.86:0/1585108270 >> 172.21.15.86:0/1585108270 conn(0x7f66cc0fd700 msgr2=0x7f66cc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:29.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.595+0000 7f66d1000640 1 -- 172.21.15.86:0/1585108270 shutdown_connections 2024-09-13T16:08:29.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.595+0000 7f66d1000640 1 -- 172.21.15.86:0/1585108270 wait complete. 2024-09-13T16:08:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.596+0000 7f66d1000640 1 Processor -- start 2024-09-13T16:08:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.596+0000 7f66d1000640 1 -- start start 2024-09-13T16:08:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.596+0000 7f66d1000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66cc101f80 0x7f66cc198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.596+0000 7f66d1000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66cc103170 0x7f66cc1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.596+0000 7f66d1000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66cc103b30 0x7f66cc19f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.596+0000 7f66d1000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc19fb70 con 0x7f66cc103170 2024-09-13T16:08:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.596+0000 7f66d1000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc19fce0 con 0x7f66cc101f80 2024-09-13T16:08:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.596+0000 7f66d1000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc19fea0 con 0x7f66cc103b30 2024-09-13T16:08:29.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.597+0000 7f66c1400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66cc103170 0x7f66cc1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:29.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.597+0000 7f66c1400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66cc103170 0x7f66cc1985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44904/0 (socket says 172.21.15.86:44904) 2024-09-13T16:08:29.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.597+0000 7f66c1400640 1 -- 172.21.15.86:0/1194325349 learned_addr learned my addr 172.21.15.86:0/1194325349 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:29.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.597+0000 7f66ca800640 1 --2- 172.21.15.86:0/1194325349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66cc103b30 0x7f66cc19f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:29.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.597+0000 7f66c9e00640 1 --2- 172.21.15.86:0/1194325349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66cc101f80 0x7f66cc198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:29.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.597+0000 7f66c1400640 1 -- 172.21.15.86:0/1194325349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66cc103b30 msgr2=0x7f66cc19f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:29.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.597+0000 7f66c1400640 1 --2- 172.21.15.86:0/1194325349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66cc103b30 0x7f66cc19f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:29.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.597+0000 7f66c1400640 1 -- 172.21.15.86:0/1194325349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66cc101f80 msgr2=0x7f66cc198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:29.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.597+0000 7f66c1400640 1 --2- 172.21.15.86:0/1194325349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66cc101f80 0x7f66cc198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:29.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.597+0000 7f66c1400640 1 -- 172.21.15.86:0/1194325349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b4009560 con 0x7f66cc103170 2024-09-13T16:08:29.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.597+0000 7f66c9e00640 1 --2- 172.21.15.86:0/1194325349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66cc101f80 0x7f66cc198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:29.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.598+0000 7f66c1400640 1 --2- 172.21.15.86:0/1194325349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66cc103170 0x7f66cc1985c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f66b4031510 tx=0x7f66b40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:29.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.598+0000 7f66c3400640 1 -- 172.21.15.86:0/1194325349 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4004b50 con 0x7f66cc103170 2024-09-13T16:08:29.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.598+0000 7f66c3400640 1 -- 172.21.15.86:0/1194325349 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f66b4004cb0 con 0x7f66cc103170 2024-09-13T16:08:29.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.598+0000 7f66d1000640 1 -- 172.21.15.86:0/1194325349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66cc1a0120 con 0x7f66cc103170 2024-09-13T16:08:29.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.598+0000 7f66c3400640 1 -- 172.21.15.86:0/1194325349 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4031ba0 con 0x7f66cc103170 2024-09-13T16:08:29.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.598+0000 7f66d1000640 1 -- 172.21.15.86:0/1194325349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66cc1a0620 con 0x7f66cc103170 2024-09-13T16:08:29.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.599+0000 7f66d1000640 1 -- 172.21.15.86:0/1194325349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66cc109390 con 0x7f66cc103170 2024-09-13T16:08:29.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.601+0000 7f66c3400640 1 -- 172.21.15.86:0/1194325349 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f66b4031d00 con 0x7f66cc103170 2024-09-13T16:08:29.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.602+0000 7f66c3400640 1 --2- 172.21.15.86:0/1194325349 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f66b00a1110 0x7f66b00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:29.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.602+0000 7f66c3400640 1 -- 172.21.15.86:0/1194325349 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f66b40ed960 con 0x7f66cc103170 2024-09-13T16:08:29.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.602+0000 7f66c9e00640 1 --2- 172.21.15.86:0/1194325349 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f66b00a1110 0x7f66b00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:29.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.603+0000 7f66c9e00640 1 --2- 172.21.15.86:0/1194325349 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f66b00a1110 0x7f66b00a35d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f66cc102fd0 tx=0x7f66bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:29.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.606+0000 7f66c3400640 1 -- 172.21.15.86:0/1194325349 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f66b40b6f50 con 0x7f66cc103170 2024-09-13T16:08:29.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:29 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1722930345' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T16:08:29.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:29 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1722930345' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T16:08:29.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:29.812+0000 7f66d1000640 1 -- 172.21.15.86:0/1194325349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f66cc108e00 con 0x7f66cc103170 2024-09-13T16:08:29.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:29 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1722930345' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T16:08:30.421 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.420+0000 7f66c3400640 1 -- 172.21.15.86:0/1194325349 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) v1 ==== 105+0+0 (secure 0 0 0) 0x7f66b40ba570 con 0x7f66cc103170 2024-09-13T16:08:30.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.422+0000 7f66d1000640 1 -- 172.21.15.86:0/1194325349 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f66b00a1110 msgr2=0x7f66b00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:30.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.422+0000 7f66d1000640 1 --2- 172.21.15.86:0/1194325349 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f66b00a1110 0x7f66b00a35d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f66cc102fd0 tx=0x7f66bc005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:30.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.422+0000 7f66d1000640 1 -- 172.21.15.86:0/1194325349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66cc103170 msgr2=0x7f66cc1985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:30.424 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.422+0000 7f66d1000640 1 --2- 172.21.15.86:0/1194325349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66cc103170 0x7f66cc1985c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f66b4031510 tx=0x7f66b40055a0 comp rx=0 tx=0).stop 2024-09-13T16:08:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.422+0000 7f66d1000640 1 -- 172.21.15.86:0/1194325349 shutdown_connections 2024-09-13T16:08:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.422+0000 7f66d1000640 1 --2- 172.21.15.86:0/1194325349 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f66b00a1110 0x7f66b00a35d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.422+0000 7f66d1000640 1 --2- 172.21.15.86:0/1194325349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66cc103b30 0x7f66cc19f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.422+0000 7f66d1000640 1 --2- 172.21.15.86:0/1194325349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66cc103170 0x7f66cc1985c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.422+0000 7f66d1000640 1 --2- 172.21.15.86:0/1194325349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66cc101f80 0x7f66cc198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.422+0000 7f66d1000640 1 -- 172.21.15.86:0/1194325349 >> 172.21.15.86:0/1194325349 conn(0x7f66cc0fd700 msgr2=0x7f66cc106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.423+0000 7f66d1000640 1 -- 172.21.15.86:0/1194325349 shutdown_connections 2024-09-13T16:08:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.423+0000 7f66d1000640 1 -- 172.21.15.86:0/1194325349 wait complete. 2024-09-13T16:08:30.443 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-09-13T16:08:30.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.597+0000 7f78fde00640 1 -- 172.21.15.86:0/987789297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f8103190 msgr2=0x7f78f8103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:30.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.597+0000 7f78fde00640 1 --2- 172.21.15.86:0/987789297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f8103190 0x7f78f8103610 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009900 tx=0x7f78e002a410 comp rx=0 tx=0).stop 2024-09-13T16:08:30.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.598+0000 7f78fde00640 1 -- 172.21.15.86:0/987789297 shutdown_connections 2024-09-13T16:08:30.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.598+0000 7f78fde00640 1 --2- 172.21.15.86:0/987789297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78f8103b50 0x7f78f810a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:30.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.598+0000 7f78fde00640 1 --2- 172.21.15.86:0/987789297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f8103190 0x7f78f8103610 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:30.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.598+0000 7f78fde00640 1 --2- 172.21.15.86:0/987789297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78f8101fa0 0x7f78f81023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:30.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.598+0000 7f78fde00640 1 -- 172.21.15.86:0/987789297 >> 172.21.15.86:0/987789297 conn(0x7f78f80fd700 msgr2=0x7f78f80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:30.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.598+0000 7f78fde00640 1 -- 172.21.15.86:0/987789297 shutdown_connections 2024-09-13T16:08:30.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.598+0000 7f78fde00640 1 -- 172.21.15.86:0/987789297 wait complete. 2024-09-13T16:08:30.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.599+0000 7f78fde00640 1 Processor -- start 2024-09-13T16:08:30.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.599+0000 7f78fde00640 1 -- start start 2024-09-13T16:08:30.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.599+0000 7f78fde00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78f8101fa0 0x7f78f8198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:30.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.599+0000 7f78fde00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f8103190 0x7f78f81985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:30.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.599+0000 7f78fde00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78f8103b50 0x7f78f819f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:30.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.599+0000 7f78fde00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f819fb70 con 0x7f78f8103190 2024-09-13T16:08:30.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.599+0000 7f78fde00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f819fce0 con 0x7f78f8101fa0 2024-09-13T16:08:30.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.599+0000 7f78fde00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f819fea0 con 0x7f78f8103b50 2024-09-13T16:08:30.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.599+0000 7f78efe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f8103190 0x7f78f81985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:30.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.599+0000 7f78f6a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78f8101fa0 0x7f78f8198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:30.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.599+0000 7f78f6a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78f8101fa0 0x7f78f8198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:42680/0 (socket says 172.21.15.86:42680) 2024-09-13T16:08:30.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.599+0000 7f78f6a00640 1 -- 172.21.15.86:0/2668170616 learned_addr learned my addr 172.21.15.86:0/2668170616 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:30.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.599+0000 7f78f7400640 1 --2- 172.21.15.86:0/2668170616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78f8103b50 0x7f78f819f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:30.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.600+0000 7f78f6a00640 1 -- 172.21.15.86:0/2668170616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78f8103b50 msgr2=0x7f78f819f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:30.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.600+0000 7f78f6a00640 1 --2- 172.21.15.86:0/2668170616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78f8103b50 0x7f78f819f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:30.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.600+0000 7f78f6a00640 1 -- 172.21.15.86:0/2668170616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f8103190 msgr2=0x7f78f81985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:30.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.600+0000 7f78f6a00640 1 --2- 172.21.15.86:0/2668170616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f8103190 0x7f78f81985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:30.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.600+0000 7f78f6a00640 1 -- 172.21.15.86:0/2668170616 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e0009560 con 0x7f78f8101fa0 2024-09-13T16:08:30.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.600+0000 7f78f6a00640 1 --2- 172.21.15.86:0/2668170616 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78f8101fa0 0x7f78f8198080 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f78e800e9c0 tx=0x7f78e800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:30.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.600+0000 7f78fca00640 1 -- 172.21.15.86:0/2668170616 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e8009700 con 0x7f78f8101fa0 2024-09-13T16:08:30.604 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.600+0000 7f78fde00640 1 -- 172.21.15.86:0/2668170616 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f81a0180 con 0x7f78f8101fa0 2024-09-13T16:08:30.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.600+0000 7f78fca00640 1 -- 172.21.15.86:0/2668170616 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f78e800cd80 con 0x7f78f8101fa0 2024-09-13T16:08:30.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.600+0000 7f78fca00640 1 -- 172.21.15.86:0/2668170616 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e8010430 con 0x7f78f8101fa0 2024-09-13T16:08:30.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.600+0000 7f78fde00640 1 -- 172.21.15.86:0/2668170616 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f81a0660 con 0x7f78f8101fa0 2024-09-13T16:08:30.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.601+0000 7f78fde00640 1 -- 172.21.15.86:0/2668170616 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f8109430 con 0x7f78f8101fa0 2024-09-13T16:08:30.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.603+0000 7f78fca00640 1 -- 172.21.15.86:0/2668170616 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f78e8003680 con 0x7f78f8101fa0 2024-09-13T16:08:30.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.605+0000 7f78fca00640 1 --2- 172.21.15.86:0/2668170616 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f78dc0a1090 0x7f78dc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:30.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.605+0000 7f78fca00640 1 -- 172.21.15.86:0/2668170616 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f78e8014070 con 0x7f78f8101fa0 2024-09-13T16:08:30.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.605+0000 7f78efe00640 1 --2- 172.21.15.86:0/2668170616 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f78dc0a1090 0x7f78dc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:30.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.606+0000 7f78efe00640 1 --2- 172.21.15.86:0/2668170616 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f78dc0a1090 0x7f78dc0a3550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f78e0005ab0 tx=0x7f78e0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:30.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.607+0000 7f78fca00640 1 -- 172.21.15.86:0/2668170616 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f78e80965b0 con 0x7f78f8101fa0 2024-09-13T16:08:30.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:30 smithi139 ceph-mon[35320]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T16:08:30.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:30 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1722930345' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-13T16:08:30.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:30 smithi139 ceph-mon[35320]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:08:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:30 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1194325349' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-13T16:08:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:30 smithi194 ceph-mon[35694]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T16:08:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:30 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1722930345' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-13T16:08:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:30 smithi194 ceph-mon[35694]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:08:30.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:30 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1194325349' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-13T16:08:30.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:30.814+0000 7f78fde00640 1 -- 172.21.15.86:0/2668170616 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f78f810d9f0 con 0x7f78f8101fa0 2024-09-13T16:08:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:30 smithi086 ceph-mon[30379]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T16:08:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:30 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1722930345' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-13T16:08:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:30 smithi086 ceph-mon[30379]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:08:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:30 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1194325349' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-13T16:08:31.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.436+0000 7f78fca00640 1 -- 172.21.15.86:0/2668170616 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7f78e8099bd0 con 0x7f78f8101fa0 2024-09-13T16:08:31.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.439+0000 7f78fde00640 1 -- 172.21.15.86:0/2668170616 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f78dc0a1090 msgr2=0x7f78dc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:31.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.439+0000 7f78fde00640 1 --2- 172.21.15.86:0/2668170616 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f78dc0a1090 0x7f78dc0a3550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f78e0005ab0 tx=0x7f78e0005a20 comp rx=0 tx=0).stop 2024-09-13T16:08:31.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.439+0000 7f78fde00640 1 -- 172.21.15.86:0/2668170616 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78f8101fa0 msgr2=0x7f78f8198080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:31.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.439+0000 7f78fde00640 1 --2- 172.21.15.86:0/2668170616 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78f8101fa0 0x7f78f8198080 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f78e800e9c0 tx=0x7f78e800ee80 comp rx=0 tx=0).stop 2024-09-13T16:08:31.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.439+0000 7f78fde00640 1 -- 172.21.15.86:0/2668170616 shutdown_connections 2024-09-13T16:08:31.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.439+0000 7f78fde00640 1 --2- 172.21.15.86:0/2668170616 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f78dc0a1090 0x7f78dc0a3550 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:31.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.439+0000 7f78fde00640 1 --2- 172.21.15.86:0/2668170616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78f8103b50 0x7f78f819f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:31.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.439+0000 7f78fde00640 1 --2- 172.21.15.86:0/2668170616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78f8103190 0x7f78f81985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:31.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.439+0000 7f78fde00640 1 --2- 172.21.15.86:0/2668170616 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78f8101fa0 0x7f78f8198080 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:31.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.439+0000 7f78fde00640 1 -- 172.21.15.86:0/2668170616 >> 172.21.15.86:0/2668170616 conn(0x7f78f80fd700 msgr2=0x7f78f8106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:31.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.439+0000 7f78fde00640 1 -- 172.21.15.86:0/2668170616 shutdown_connections 2024-09-13T16:08:31.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.439+0000 7f78fde00640 1 -- 172.21.15.86:0/2668170616 wait complete. 2024-09-13T16:08:31.463 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-09-13T16:08:31.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.621+0000 7f1c77e00640 1 -- 172.21.15.86:0/1651100031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c78101e80 msgr2=0x7f1c78102280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:31.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.621+0000 7f1c77e00640 1 --2- 172.21.15.86:0/1651100031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c78101e80 0x7f1c78102280 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1c68009900 tx=0x7f1c6802a410 comp rx=0 tx=0).stop 2024-09-13T16:08:31.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.621+0000 7f1c77e00640 1 -- 172.21.15.86:0/1651100031 shutdown_connections 2024-09-13T16:08:31.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.621+0000 7f1c77e00640 1 --2- 172.21.15.86:0/1651100031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c78103a20 0x7f1c7810a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:31.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.621+0000 7f1c77e00640 1 --2- 172.21.15.86:0/1651100031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c78103060 0x7f1c781034e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:31.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.621+0000 7f1c77e00640 1 --2- 172.21.15.86:0/1651100031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c78101e80 0x7f1c78102280 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:31.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.621+0000 7f1c77e00640 1 -- 172.21.15.86:0/1651100031 >> 172.21.15.86:0/1651100031 conn(0x7f1c780fd670 msgr2=0x7f1c780ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:31.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.621+0000 7f1c77e00640 1 -- 172.21.15.86:0/1651100031 shutdown_connections 2024-09-13T16:08:31.627 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.621+0000 7f1c77e00640 1 -- 172.21.15.86:0/1651100031 wait complete. 2024-09-13T16:08:31.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.622+0000 7f1c77e00640 1 Processor -- start 2024-09-13T16:08:31.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.622+0000 7f1c77e00640 1 -- start start 2024-09-13T16:08:31.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.622+0000 7f1c77e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c78101e80 0x7f1c78197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:31.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.622+0000 7f1c77e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c78103060 0x7f1c781984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:31.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.622+0000 7f1c77e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c78103a20 0x7f1c7819f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:31.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.622+0000 7f1c77e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7819faa0 con 0x7f1c78103060 2024-09-13T16:08:31.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.622+0000 7f1c77e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7819fc10 con 0x7f1c78103a20 2024-09-13T16:08:31.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.622+0000 7f1c77e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7819fdd0 con 0x7f1c78101e80 2024-09-13T16:08:31.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.622+0000 7f1c76000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c78103060 0x7f1c781984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:31.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.622+0000 7f1c76000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c78103060 0x7f1c781984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44940/0 (socket says 172.21.15.86:44940) 2024-09-13T16:08:31.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.622+0000 7f1c76000640 1 -- 172.21.15.86:0/3459053051 learned_addr learned my addr 172.21.15.86:0/3459053051 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:31.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.623+0000 7f1c77400640 1 --2- 172.21.15.86:0/3459053051 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c78103a20 0x7f1c7819f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:31.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.623+0000 7f1c76a00640 1 --2- 172.21.15.86:0/3459053051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c78101e80 0x7f1c78197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:31.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.623+0000 7f1c76000640 1 -- 172.21.15.86:0/3459053051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c78101e80 msgr2=0x7f1c78197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:31.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.623+0000 7f1c76000640 1 --2- 172.21.15.86:0/3459053051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c78101e80 0x7f1c78197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:31.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.623+0000 7f1c76000640 1 -- 172.21.15.86:0/3459053051 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c78103a20 msgr2=0x7f1c7819f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:31.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.623+0000 7f1c76000640 1 --2- 172.21.15.86:0/3459053051 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c78103a20 0x7f1c7819f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:31.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.623+0000 7f1c76000640 1 -- 172.21.15.86:0/3459053051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c68009560 con 0x7f1c78103060 2024-09-13T16:08:31.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.623+0000 7f1c76000640 1 --2- 172.21.15.86:0/3459053051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c78103060 0x7f1c781984f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400d770 tx=0x7f1c6400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:31.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.623+0000 7f1c6f400640 1 -- 172.21.15.86:0/3459053051 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c64009c30 con 0x7f1c78103060 2024-09-13T16:08:31.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.623+0000 7f1c6f400640 1 -- 172.21.15.86:0/3459053051 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1c6400de80 con 0x7f1c78103060 2024-09-13T16:08:31.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.623+0000 7f1c6f400640 1 -- 172.21.15.86:0/3459053051 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c64004e80 con 0x7f1c78103060 2024-09-13T16:08:31.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.623+0000 7f1c77e00640 1 -- 172.21.15.86:0/3459053051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c781a00b0 con 0x7f1c78103060 2024-09-13T16:08:31.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.624+0000 7f1c77e00640 1 -- 172.21.15.86:0/3459053051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c781a0570 con 0x7f1c78103060 2024-09-13T16:08:31.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.625+0000 7f1c77e00640 1 -- 172.21.15.86:0/3459053051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c78109390 con 0x7f1c78103060 2024-09-13T16:08:31.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.626+0000 7f1c6f400640 1 -- 172.21.15.86:0/3459053051 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1c64005020 con 0x7f1c78103060 2024-09-13T16:08:31.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.628+0000 7f1c6f400640 1 --2- 172.21.15.86:0/3459053051 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1c5c0a1110 0x7f1c5c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:31.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.629+0000 7f1c6f400640 1 -- 172.21.15.86:0/3459053051 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f1c640cc480 con 0x7f1c78103060 2024-09-13T16:08:31.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.629+0000 7f1c76a00640 1 --2- 172.21.15.86:0/3459053051 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1c5c0a1110 0x7f1c5c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:31.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.629+0000 7f1c76a00640 1 --2- 172.21.15.86:0/3459053051 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1c5c0a1110 0x7f1c5c0a35d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1c6802aa00 tx=0x7f1c680058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:31.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.633+0000 7f1c6f400640 1 -- 172.21.15.86:0/3459053051 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1c64095a70 con 0x7f1c78103060 2024-09-13T16:08:31.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:31 smithi139 ceph-mon[35320]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T16:08:31.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:31 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1194325349' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-13T16:08:31.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:31 smithi139 ceph-mon[35320]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T16:08:31.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:31 smithi139 ceph-mon[35320]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:08:31.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:31 smithi139 ceph-mon[35320]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-13T16:08:31.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:31 smithi139 ceph-mon[35320]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-13T16:08:31.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:31 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2668170616' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T16:08:31.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:31 smithi139 ceph-mon[35320]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T16:08:31.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:31 smithi194 ceph-mon[35694]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T16:08:31.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:31 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1194325349' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-13T16:08:31.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:31 smithi194 ceph-mon[35694]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T16:08:31.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:31 smithi194 ceph-mon[35694]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:08:31.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:31 smithi194 ceph-mon[35694]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-13T16:08:31.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:31 smithi194 ceph-mon[35694]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-13T16:08:31.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:31 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2668170616' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T16:08:31.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:31 smithi194 ceph-mon[35694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T16:08:31.840 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:31.838+0000 7f1c77e00640 1 -- 172.21.15.86:0/3459053051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f1c78108e00 con 0x7f1c78103060 2024-09-13T16:08:31.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:31 smithi086 ceph-mon[30379]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T16:08:31.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:31 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1194325349' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-13T16:08:31.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:31 smithi086 ceph-mon[30379]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T16:08:31.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:31 smithi086 ceph-mon[30379]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:08:31.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:31 smithi086 ceph-mon[30379]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-13T16:08:31.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:31 smithi086 ceph-mon[30379]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-13T16:08:31.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:31 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2668170616' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T16:08:31.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:31 smithi086 ceph-mon[30379]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T16:08:32.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.443+0000 7f1c6f400640 1 -- 172.21.15.86:0/3459053051 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) v1 ==== 115+0+0 (secure 0 0 0) 0x7f1c64099090 con 0x7f1c78103060 2024-09-13T16:08:32.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.446+0000 7f1c77e00640 1 -- 172.21.15.86:0/3459053051 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1c5c0a1110 msgr2=0x7f1c5c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:32.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.446+0000 7f1c77e00640 1 --2- 172.21.15.86:0/3459053051 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1c5c0a1110 0x7f1c5c0a35d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1c6802aa00 tx=0x7f1c680058d0 comp rx=0 tx=0).stop 2024-09-13T16:08:32.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.446+0000 7f1c77e00640 1 -- 172.21.15.86:0/3459053051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c78103060 msgr2=0x7f1c781984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:32.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.446+0000 7f1c77e00640 1 --2- 172.21.15.86:0/3459053051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c78103060 0x7f1c781984f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400d770 tx=0x7f1c6400dc30 comp rx=0 tx=0).stop 2024-09-13T16:08:32.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.446+0000 7f1c77e00640 1 -- 172.21.15.86:0/3459053051 shutdown_connections 2024-09-13T16:08:32.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.446+0000 7f1c77e00640 1 --2- 172.21.15.86:0/3459053051 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1c5c0a1110 0x7f1c5c0a35d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:32.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.446+0000 7f1c77e00640 1 --2- 172.21.15.86:0/3459053051 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c78103a20 0x7f1c7819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:32.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.446+0000 7f1c77e00640 1 --2- 172.21.15.86:0/3459053051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c78103060 0x7f1c781984f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:32.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.446+0000 7f1c77e00640 1 --2- 172.21.15.86:0/3459053051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c78101e80 0x7f1c78197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:32.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.446+0000 7f1c77e00640 1 -- 172.21.15.86:0/3459053051 >> 172.21.15.86:0/3459053051 conn(0x7f1c780fd670 msgr2=0x7f1c78106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:32.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.446+0000 7f1c77e00640 1 -- 172.21.15.86:0/3459053051 shutdown_connections 2024-09-13T16:08:32.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.446+0000 7f1c77e00640 1 -- 172.21.15.86:0/3459053051 wait complete. 2024-09-13T16:08:32.467 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-13T16:08:32.467 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-09-13T16:08:32.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.623+0000 7f15ffa00640 1 -- 172.21.15.86:0/4149114179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f80fdb10 msgr2=0x7f15f80fdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:32.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.623+0000 7f15ffa00640 1 --2- 172.21.15.86:0/4149114179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f80fdb10 0x7f15f80fdf10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009900 tx=0x7f15e802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:08:32.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.623+0000 7f15ffa00640 1 -- 172.21.15.86:0/4149114179 shutdown_connections 2024-09-13T16:08:32.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.623+0000 7f15ffa00640 1 --2- 172.21.15.86:0/4149114179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15f8105a00 0x7f15f8107ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:32.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.623+0000 7f15ffa00640 1 --2- 172.21.15.86:0/4149114179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15f80fe450 0x7f15f8105470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:32.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.623+0000 7f15ffa00640 1 --2- 172.21.15.86:0/4149114179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f80fdb10 0x7f15f80fdf10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:32.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.623+0000 7f15ffa00640 1 -- 172.21.15.86:0/4149114179 >> 172.21.15.86:0/4149114179 conn(0x7f15f80f9710 msgr2=0x7f15f80fbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:32.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.623+0000 7f15ffa00640 1 -- 172.21.15.86:0/4149114179 shutdown_connections 2024-09-13T16:08:32.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.623+0000 7f15ffa00640 1 -- 172.21.15.86:0/4149114179 wait complete. 2024-09-13T16:08:32.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.624+0000 7f15ffa00640 1 Processor -- start 2024-09-13T16:08:32.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.624+0000 7f15ffa00640 1 -- start start 2024-09-13T16:08:32.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.625+0000 7f15ffa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15f80fdb10 0x7f15f8195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:32.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.625+0000 7f15ffa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15f80fe450 0x7f15f81963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:32.628 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.625+0000 7f15ffa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f8105a00 0x7f15f819d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:32.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.625+0000 7f15ffa00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f819d950 con 0x7f15f80fe450 2024-09-13T16:08:32.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.625+0000 7f15ffa00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f819dac0 con 0x7f15f80fdb10 2024-09-13T16:08:32.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.625+0000 7f15ffa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f819dc80 con 0x7f15f8105a00 2024-09-13T16:08:32.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.625+0000 7f15efe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15f80fe450 0x7f15f81963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:32.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.625+0000 7f15fda00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f8105a00 0x7f15f819d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:32.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.625+0000 7f15efe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15f80fe450 0x7f15f81963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44966/0 (socket says 172.21.15.86:44966) 2024-09-13T16:08:32.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.625+0000 7f15efe00640 1 -- 172.21.15.86:0/988451792 learned_addr learned my addr 172.21.15.86:0/988451792 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:32.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.625+0000 7f15fd000640 1 --2- 172.21.15.86:0/988451792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15f80fdb10 0x7f15f8195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:32.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.625+0000 7f15fda00640 1 -- 172.21.15.86:0/988451792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15f80fdb10 msgr2=0x7f15f8195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:32.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.625+0000 7f15fda00640 1 --2- 172.21.15.86:0/988451792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15f80fdb10 0x7f15f8195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:32.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.625+0000 7f15fda00640 1 -- 172.21.15.86:0/988451792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15f80fe450 msgr2=0x7f15f81963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:32.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.625+0000 7f15fda00640 1 --2- 172.21.15.86:0/988451792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15f80fe450 0x7f15f81963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:32.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.625+0000 7f15fda00640 1 -- 172.21.15.86:0/988451792 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e8009560 con 0x7f15f8105a00 2024-09-13T16:08:32.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.625+0000 7f15fd000640 1 --2- 172.21.15.86:0/988451792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15f80fdb10 0x7f15f8195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:08:32.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.625+0000 7f15efe00640 1 --2- 172.21.15.86:0/988451792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15f80fe450 0x7f15f81963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:32.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.626+0000 7f15fda00640 1 --2- 172.21.15.86:0/988451792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f8105a00 0x7f15f819d410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009fd0 tx=0x7f15f000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:32.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.626+0000 7f15f6000640 1 -- 172.21.15.86:0/988451792 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f000ce20 con 0x7f15f8105a00 2024-09-13T16:08:32.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.626+0000 7f15f6000640 1 -- 172.21.15.86:0/988451792 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f15f0005020 con 0x7f15f8105a00 2024-09-13T16:08:32.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.626+0000 7f15f6000640 1 -- 172.21.15.86:0/988451792 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f0010690 con 0x7f15f8105a00 2024-09-13T16:08:32.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.626+0000 7f15ffa00640 1 -- 172.21.15.86:0/988451792 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f819df60 con 0x7f15f8105a00 2024-09-13T16:08:32.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.626+0000 7f15ffa00640 1 -- 172.21.15.86:0/988451792 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f819e390 con 0x7f15f8105a00 2024-09-13T16:08:32.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.627+0000 7f15ffa00640 1 -- 172.21.15.86:0/988451792 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f8104280 con 0x7f15f8105a00 2024-09-13T16:08:32.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.629+0000 7f15f6000640 1 -- 172.21.15.86:0/988451792 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f15f0005500 con 0x7f15f8105a00 2024-09-13T16:08:32.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.630+0000 7f15f6000640 1 --2- 172.21.15.86:0/988451792 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f15dc0a1090 0x7f15dc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:32.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.630+0000 7f15f6000640 1 -- 172.21.15.86:0/988451792 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f15f0014070 con 0x7f15f8105a00 2024-09-13T16:08:32.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.630+0000 7f15fd000640 1 --2- 172.21.15.86:0/988451792 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f15dc0a1090 0x7f15dc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:32.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.631+0000 7f15fd000640 1 --2- 172.21.15.86:0/988451792 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f15dc0a1090 0x7f15dc0a3550 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f15e8006010 tx=0x7f15e8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:32.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.634+0000 7f15f6000640 1 -- 172.21.15.86:0/988451792 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f15f0096880 con 0x7f15f8105a00 2024-09-13T16:08:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:32 smithi139 ceph-mon[35320]: pgmap v306: 129 pgs: 129 active+clean; 582 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-09-13T16:08:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:32 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] up:active 2024-09-13T16:08:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:32 smithi139 ceph-mon[35320]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T16:08:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:32 smithi139 ceph-mon[35320]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-13T16:08:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:32 smithi139 ceph-mon[35320]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T16:08:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:32 smithi139 ceph-mon[35320]: Cluster is now healthy 2024-09-13T16:08:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:32 smithi139 ceph-mon[35320]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-13T16:08:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:32 smithi139 ceph-mon[35320]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-13T16:08:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:32 smithi139 ceph-mon[35320]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-13T16:08:32.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:32 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3459053051' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T16:08:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:32 smithi194 ceph-mon[35694]: pgmap v306: 129 pgs: 129 active+clean; 582 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-09-13T16:08:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:32 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] up:active 2024-09-13T16:08:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:32 smithi194 ceph-mon[35694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T16:08:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:32 smithi194 ceph-mon[35694]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-13T16:08:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:32 smithi194 ceph-mon[35694]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T16:08:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:32 smithi194 ceph-mon[35694]: Cluster is now healthy 2024-09-13T16:08:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:32 smithi194 ceph-mon[35694]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-13T16:08:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:32 smithi194 ceph-mon[35694]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-13T16:08:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:32 smithi194 ceph-mon[35694]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-13T16:08:32.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:32 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3459053051' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T16:08:32.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.829+0000 7f15ffa00640 1 -- 172.21.15.86:0/988451792 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f15f802c480 con 0x7f15dc0a1090 2024-09-13T16:08:32.839 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:32 smithi086 ceph-mon[30379]: pgmap v306: 129 pgs: 129 active+clean; 582 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-09-13T16:08:32.839 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:32 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] up:active 2024-09-13T16:08:32.839 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:32 smithi086 ceph-mon[30379]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T16:08:32.839 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:32 smithi086 ceph-mon[30379]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-13T16:08:32.839 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:32 smithi086 ceph-mon[30379]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T16:08:32.839 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:32 smithi086 ceph-mon[30379]: Cluster is now healthy 2024-09-13T16:08:32.839 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:32 smithi086 ceph-mon[30379]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-13T16:08:32.839 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:32 smithi086 ceph-mon[30379]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-13T16:08:32.839 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:32 smithi086 ceph-mon[30379]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-13T16:08:32.839 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:32 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3459053051' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T16:08:32.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.855+0000 7f15f6000640 1 -- 172.21.15.86:0/988451792 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f15f802c480 con 0x7f15dc0a1090 2024-09-13T16:08:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.857+0000 7f15ffa00640 1 -- 172.21.15.86:0/988451792 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f15dc0a1090 msgr2=0x7f15dc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.857+0000 7f15ffa00640 1 --2- 172.21.15.86:0/988451792 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f15dc0a1090 0x7f15dc0a3550 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f15e8006010 tx=0x7f15e8005a20 comp rx=0 tx=0).stop 2024-09-13T16:08:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.857+0000 7f15ffa00640 1 -- 172.21.15.86:0/988451792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f8105a00 msgr2=0x7f15f819d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.857+0000 7f15ffa00640 1 --2- 172.21.15.86:0/988451792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f8105a00 0x7f15f819d410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009fd0 tx=0x7f15f000ef10 comp rx=0 tx=0).stop 2024-09-13T16:08:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.857+0000 7f15ffa00640 1 -- 172.21.15.86:0/988451792 shutdown_connections 2024-09-13T16:08:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.857+0000 7f15ffa00640 1 --2- 172.21.15.86:0/988451792 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f15dc0a1090 0x7f15dc0a3550 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.857+0000 7f15ffa00640 1 --2- 172.21.15.86:0/988451792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f8105a00 0x7f15f819d410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.857+0000 7f15ffa00640 1 --2- 172.21.15.86:0/988451792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15f80fe450 0x7f15f81963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.857+0000 7f15ffa00640 1 --2- 172.21.15.86:0/988451792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15f80fdb10 0x7f15f8195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.857+0000 7f15ffa00640 1 -- 172.21.15.86:0/988451792 >> 172.21.15.86:0/988451792 conn(0x7f15f80f9710 msgr2=0x7f15f8101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:32.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.857+0000 7f15ffa00640 1 -- 172.21.15.86:0/988451792 shutdown_connections 2024-09-13T16:08:32.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:32.857+0000 7f15ffa00640 1 -- 172.21.15.86:0/988451792 wait complete. 2024-09-13T16:08:32.876 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-13T16:08:33.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.034+0000 7fc098200640 1 -- 172.21.15.86:0/2811599356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090103b30 msgr2=0x7fc09010a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:33.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.034+0000 7fc098200640 1 --2- 172.21.15.86:0/2811599356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090103b30 0x7fc09010a3c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc088009ca0 tx=0x7fc08802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.034+0000 7fc098200640 1 -- 172.21.15.86:0/2811599356 shutdown_connections 2024-09-13T16:08:33.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.034+0000 7fc098200640 1 --2- 172.21.15.86:0/2811599356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090103b30 0x7fc09010a3c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.034+0000 7fc098200640 1 --2- 172.21.15.86:0/2811599356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc090103170 0x7fc0901035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.034+0000 7fc098200640 1 --2- 172.21.15.86:0/2811599356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc090101f80 0x7fc090102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.034+0000 7fc098200640 1 -- 172.21.15.86:0/2811599356 >> 172.21.15.86:0/2811599356 conn(0x7fc0900fd700 msgr2=0x7fc0900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:33.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.034+0000 7fc098200640 1 -- 172.21.15.86:0/2811599356 shutdown_connections 2024-09-13T16:08:33.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.034+0000 7fc098200640 1 -- 172.21.15.86:0/2811599356 wait complete. 2024-09-13T16:08:33.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.035+0000 7fc098200640 1 Processor -- start 2024-09-13T16:08:33.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.035+0000 7fc098200640 1 -- start start 2024-09-13T16:08:33.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.035+0000 7fc098200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc090101f80 0x7fc090198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:33.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.036+0000 7fc098200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc090103170 0x7fc090198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:33.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.036+0000 7fc098200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090103b30 0x7fc09019f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:33.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.036+0000 7fc098200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09019fb20 con 0x7fc090103b30 2024-09-13T16:08:33.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.036+0000 7fc098200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09019fc90 con 0x7fc090101f80 2024-09-13T16:08:33.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.036+0000 7fc098200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09019fe50 con 0x7fc090103170 2024-09-13T16:08:33.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.036+0000 7fc096200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090103b30 0x7fc09019f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:33.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.036+0000 7fc095800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc090101f80 0x7fc090198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:33.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.036+0000 7fc094e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc090103170 0x7fc090198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:33.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.036+0000 7fc095800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc090101f80 0x7fc090198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:45530/0 (socket says 172.21.15.86:45530) 2024-09-13T16:08:33.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.036+0000 7fc095800640 1 -- 172.21.15.86:0/4213511931 learned_addr learned my addr 172.21.15.86:0/4213511931 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:33.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.036+0000 7fc094e00640 1 -- 172.21.15.86:0/4213511931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc090101f80 msgr2=0x7fc090198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:33.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.036+0000 7fc094e00640 1 --2- 172.21.15.86:0/4213511931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc090101f80 0x7fc090198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.036+0000 7fc094e00640 1 -- 172.21.15.86:0/4213511931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090103b30 msgr2=0x7fc09019f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:33.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.036+0000 7fc094e00640 1 --2- 172.21.15.86:0/4213511931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090103b30 0x7fc09019f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.036+0000 7fc094e00640 1 -- 172.21.15.86:0/4213511931 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc088009900 con 0x7fc090103170 2024-09-13T16:08:33.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.036+0000 7fc095800640 1 --2- 172.21.15.86:0/4213511931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc090101f80 0x7fc090198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:33.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.036+0000 7fc096200640 1 --2- 172.21.15.86:0/4213511931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090103b30 0x7fc09019f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:33.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.037+0000 7fc094e00640 1 --2- 172.21.15.86:0/4213511931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc090103170 0x7fc090198570 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00e9f0 tx=0x7fc07c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:33.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.037+0000 7fc08e000640 1 -- 172.21.15.86:0/4213511931 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c00ccc0 con 0x7fc090103170 2024-09-13T16:08:33.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.037+0000 7fc098200640 1 -- 172.21.15.86:0/4213511931 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0901a0130 con 0x7fc090103170 2024-09-13T16:08:33.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.037+0000 7fc08e000640 1 -- 172.21.15.86:0/4213511931 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc07c00ce20 con 0x7fc090103170 2024-09-13T16:08:33.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.037+0000 7fc08e000640 1 -- 172.21.15.86:0/4213511931 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c004a00 con 0x7fc090103170 2024-09-13T16:08:33.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.037+0000 7fc098200640 1 -- 172.21.15.86:0/4213511931 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0901a0640 con 0x7fc090103170 2024-09-13T16:08:33.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.038+0000 7fc098200640 1 -- 172.21.15.86:0/4213511931 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0901093c0 con 0x7fc090103170 2024-09-13T16:08:33.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.040+0000 7fc08e000640 1 -- 172.21.15.86:0/4213511931 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc07c004b60 con 0x7fc090103170 2024-09-13T16:08:33.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.041+0000 7fc08e000640 1 --2- 172.21.15.86:0/4213511931 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc0780a1110 0x7fc0780a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:33.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.041+0000 7fc08e000640 1 -- 172.21.15.86:0/4213511931 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc07c014070 con 0x7fc090103170 2024-09-13T16:08:33.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.041+0000 7fc095800640 1 --2- 172.21.15.86:0/4213511931 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc0780a1110 0x7fc0780a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:33.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.042+0000 7fc095800640 1 --2- 172.21.15.86:0/4213511931 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc0780a1110 0x7fc0780a35d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc0840058c0 tx=0x7fc084005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:33.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.043+0000 7fc08e000640 1 -- 172.21.15.86:0/4213511931 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc07c096660 con 0x7fc090103170 2024-09-13T16:08:33.115 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:08:32 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:08:32.836+0000 7f4b6ce00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T16:08:33.115 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:08:32 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:08:32.836+0000 7f4b6ce00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T16:08:33.115 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:08:32 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:08:32.836+0000 7f4b6ce00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T16:08:33.115 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:08:32 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:08:32.836+0000 7f4b6ce00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T16:08:33.115 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:08:32 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:08:32.836+0000 7f4b6ce00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T16:08:33.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.241+0000 7fc098200640 1 -- 172.21.15.86:0/4213511931 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fc09002c450 con 0x7fc0780a1110 2024-09-13T16:08:33.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.265+0000 7fc08e000640 1 -- 172.21.15.86:0/4213511931 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc09002c450 con 0x7fc0780a1110 2024-09-13T16:08:33.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.267+0000 7fc098200640 1 -- 172.21.15.86:0/4213511931 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc0780a1110 msgr2=0x7fc0780a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:33.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.267+0000 7fc098200640 1 --2- 172.21.15.86:0/4213511931 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc0780a1110 0x7fc0780a35d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc0840058c0 tx=0x7fc084005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:33.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.267+0000 7fc098200640 1 -- 172.21.15.86:0/4213511931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc090103170 msgr2=0x7fc090198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:33.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.267+0000 7fc098200640 1 --2- 172.21.15.86:0/4213511931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc090103170 0x7fc090198570 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00e9f0 tx=0x7fc07c00eeb0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.267+0000 7fc098200640 1 -- 172.21.15.86:0/4213511931 shutdown_connections 2024-09-13T16:08:33.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.267+0000 7fc098200640 1 --2- 172.21.15.86:0/4213511931 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc0780a1110 0x7fc0780a35d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.267+0000 7fc098200640 1 --2- 172.21.15.86:0/4213511931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090103b30 0x7fc09019f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.267+0000 7fc098200640 1 --2- 172.21.15.86:0/4213511931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc090103170 0x7fc090198570 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.267+0000 7fc098200640 1 --2- 172.21.15.86:0/4213511931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc090101f80 0x7fc090198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.267+0000 7fc098200640 1 -- 172.21.15.86:0/4213511931 >> 172.21.15.86:0/4213511931 conn(0x7fc0900fd700 msgr2=0x7fc090106590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:33.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.267+0000 7fc098200640 1 -- 172.21.15.86:0/4213511931 shutdown_connections 2024-09-13T16:08:33.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.267+0000 7fc098200640 1 -- 172.21.15.86:0/4213511931 wait complete. 2024-09-13T16:08:33.286 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-13T16:08:33.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.448+0000 7f29f1a00640 1 -- 172.21.15.86:0/1740902182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29ec0fed90 msgr2=0x7f29ec0ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:33.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.448+0000 7f29f1a00640 1 --2- 172.21.15.86:0/1740902182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29ec0fed90 0x7f29ec0ff210 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009860 tx=0x7f29d802a340 comp rx=0 tx=0).stop 2024-09-13T16:08:33.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.448+0000 7f29f1a00640 1 -- 172.21.15.86:0/1740902182 shutdown_connections 2024-09-13T16:08:33.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.448+0000 7f29f1a00640 1 --2- 172.21.15.86:0/1740902182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29ec0ff750 0x7f29ec103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.448+0000 7f29f1a00640 1 --2- 172.21.15.86:0/1740902182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29ec0fed90 0x7f29ec0ff210 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.448+0000 7f29f1a00640 1 --2- 172.21.15.86:0/1740902182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29ec0fe030 0x7f29ec0fe430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.448+0000 7f29f1a00640 1 -- 172.21.15.86:0/1740902182 >> 172.21.15.86:0/1740902182 conn(0x7f29ec0f9b50 msgr2=0x7f29ec0fbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:33.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.448+0000 7f29f1a00640 1 -- 172.21.15.86:0/1740902182 shutdown_connections 2024-09-13T16:08:33.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.448+0000 7f29f1a00640 1 -- 172.21.15.86:0/1740902182 wait complete. 2024-09-13T16:08:33.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.449+0000 7f29f1a00640 1 Processor -- start 2024-09-13T16:08:33.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.449+0000 7f29f1a00640 1 -- start start 2024-09-13T16:08:33.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.449+0000 7f29f1a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29ec0fe030 0x7f29ec19c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:33.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.449+0000 7f29f1a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29ec0fed90 0x7f29ec19ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:33.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.449+0000 7f29f1a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29ec0ff750 0x7f29ec1a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:33.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.449+0000 7f29f1a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec1a3ff0 con 0x7f29ec0fed90 2024-09-13T16:08:33.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.449+0000 7f29f1a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec1a4160 con 0x7f29ec0fe030 2024-09-13T16:08:33.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.449+0000 7f29f1a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec1a4320 con 0x7f29ec0ff750 2024-09-13T16:08:33.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.450+0000 7f29eb400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29ec0ff750 0x7f29ec1a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:33.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.450+0000 7f29ea000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29ec0fed90 0x7f29ec19ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:33.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.450+0000 7f29eaa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29ec0fe030 0x7f29ec19c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:33.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.450+0000 7f29eb400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29ec0ff750 0x7f29ec1a3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:39510/0 (socket says 172.21.15.86:39510) 2024-09-13T16:08:33.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.450+0000 7f29eb400640 1 -- 172.21.15.86:0/4022946420 learned_addr learned my addr 172.21.15.86:0/4022946420 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:33.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.450+0000 7f29eb400640 1 -- 172.21.15.86:0/4022946420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29ec0fe030 msgr2=0x7f29ec19c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:33.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.450+0000 7f29eb400640 1 --2- 172.21.15.86:0/4022946420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29ec0fe030 0x7f29ec19c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.450+0000 7f29eb400640 1 -- 172.21.15.86:0/4022946420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29ec0fed90 msgr2=0x7f29ec19ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:33.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.450+0000 7f29eb400640 1 --2- 172.21.15.86:0/4022946420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29ec0fed90 0x7f29ec19ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.450+0000 7f29eb400640 1 -- 172.21.15.86:0/4022946420 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4009900 con 0x7f29ec0ff750 2024-09-13T16:08:33.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.450+0000 7f29eb400640 1 --2- 172.21.15.86:0/4022946420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29ec0ff750 0x7f29ec1a3ab0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f29e400efc0 tx=0x7f29e400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:33.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.451+0000 7f29e3400640 1 -- 172.21.15.86:0/4022946420 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4003970 con 0x7f29ec0ff750 2024-09-13T16:08:33.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.451+0000 7f29e3400640 1 -- 172.21.15.86:0/4022946420 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f29e4004020 con 0x7f29ec0ff750 2024-09-13T16:08:33.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.451+0000 7f29e3400640 1 -- 172.21.15.86:0/4022946420 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e400b9b0 con 0x7f29ec0ff750 2024-09-13T16:08:33.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.451+0000 7f29f1a00640 1 -- 172.21.15.86:0/4022946420 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d8009490 con 0x7f29ec0ff750 2024-09-13T16:08:33.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.451+0000 7f29f1a00640 1 -- 172.21.15.86:0/4022946420 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ec1a4900 con 0x7f29ec0ff750 2024-09-13T16:08:33.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.452+0000 7f29f1a00640 1 -- 172.21.15.86:0/4022946420 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ec111dd0 con 0x7f29ec0ff750 2024-09-13T16:08:33.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.454+0000 7f29e3400640 1 -- 172.21.15.86:0/4022946420 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f29e400a040 con 0x7f29ec0ff750 2024-09-13T16:08:33.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.456+0000 7f29e3400640 1 --2- 172.21.15.86:0/4022946420 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f29d00a1110 0x7f29d00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:33.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.456+0000 7f29e3400640 1 -- 172.21.15.86:0/4022946420 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f29e40ccad0 con 0x7f29ec0ff750 2024-09-13T16:08:33.459 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.458+0000 7f29eaa00640 1 --2- 172.21.15.86:0/4022946420 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f29d00a1110 0x7f29d00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:33.460 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.459+0000 7f29eaa00640 1 --2- 172.21.15.86:0/4022946420 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f29d00a1110 0x7f29d00a35d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009bd0 tx=0x7f29dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:33.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.460+0000 7f29e3400640 1 -- 172.21.15.86:0/4022946420 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f29e4004500 con 0x7f29ec0ff750 2024-09-13T16:08:33.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.466+0000 7f29e3400640 1 -- 172.21.15.86:0/4022946420 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f29e4004190 con 0x7f29ec0ff750 2024-09-13T16:08:33.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:33 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] up:active 2024-09-13T16:08:33.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:33 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3459053051' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-13T16:08:33.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:33 smithi086 ceph-mon[30379]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-13T16:08:33.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:33 smithi086 ceph-mon[30379]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:08:33.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.666+0000 7f29f1a00640 1 -- 172.21.15.86:0/4022946420 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f29ec0fbe70 con 0x7f29d00a1110 2024-09-13T16:08:33.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.671+0000 7f29e3400640 1 -- 172.21.15.86:0/4022946420 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f29ec0fbe70 con 0x7f29d00a1110 2024-09-13T16:08:33.672 INFO:teuthology.orchestra.run.smithi086.stdout:/volumes/qa/sv_0/c06866cc-c9ba-4cef-8fd7-f22a1a0061bd 2024-09-13T16:08:33.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.673+0000 7f29f1a00640 1 -- 172.21.15.86:0/4022946420 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f29d00a1110 msgr2=0x7f29d00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:33.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.673+0000 7f29f1a00640 1 --2- 172.21.15.86:0/4022946420 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f29d00a1110 0x7f29d00a35d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009bd0 tx=0x7f29dc005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:33.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.673+0000 7f29f1a00640 1 -- 172.21.15.86:0/4022946420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29ec0ff750 msgr2=0x7f29ec1a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:33.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.673+0000 7f29f1a00640 1 --2- 172.21.15.86:0/4022946420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29ec0ff750 0x7f29ec1a3ab0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f29e400efc0 tx=0x7f29e400c800 comp rx=0 tx=0).stop 2024-09-13T16:08:33.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.673+0000 7f29f1a00640 1 -- 172.21.15.86:0/4022946420 shutdown_connections 2024-09-13T16:08:33.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.673+0000 7f29f1a00640 1 --2- 172.21.15.86:0/4022946420 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f29d00a1110 0x7f29d00a35d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.673+0000 7f29f1a00640 1 --2- 172.21.15.86:0/4022946420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29ec0ff750 0x7f29ec1a3ab0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.673+0000 7f29f1a00640 1 --2- 172.21.15.86:0/4022946420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29ec0fed90 0x7f29ec19ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.673+0000 7f29f1a00640 1 --2- 172.21.15.86:0/4022946420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29ec0fe030 0x7f29ec19c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.673+0000 7f29f1a00640 1 -- 172.21.15.86:0/4022946420 >> 172.21.15.86:0/4022946420 conn(0x7f29ec0f9b50 msgr2=0x7f29ec0fa750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:33.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.673+0000 7f29f1a00640 1 -- 172.21.15.86:0/4022946420 shutdown_connections 2024-09-13T16:08:33.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.673+0000 7f29f1a00640 1 -- 172.21.15.86:0/4022946420 wait complete. 2024-09-13T16:08:33.690 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-13T16:08:33.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:33 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] up:active 2024-09-13T16:08:33.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:33 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3459053051' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-13T16:08:33.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:33 smithi139 ceph-mon[35320]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-13T16:08:33.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:33 smithi139 ceph-mon[35320]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:08:33.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:33 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] up:active 2024-09-13T16:08:33.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:33 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3459053051' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-13T16:08:33.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:33 smithi194 ceph-mon[35694]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-13T16:08:33.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:33 smithi194 ceph-mon[35694]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:08:33.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.848+0000 7f21f0a00640 1 -- 172.21.15.86:0/1552752960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21ec1030f0 msgr2=0x7f21ec103570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:33.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.848+0000 7f21f0a00640 1 --2- 172.21.15.86:0/1552752960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21ec1030f0 0x7f21ec103570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009900 tx=0x7f21d402a410 comp rx=0 tx=0).stop 2024-09-13T16:08:33.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.849+0000 7f21f0a00640 1 -- 172.21.15.86:0/1552752960 shutdown_connections 2024-09-13T16:08:33.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.849+0000 7f21f0a00640 1 --2- 172.21.15.86:0/1552752960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21ec103ab0 0x7f21ec10a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.849+0000 7f21f0a00640 1 --2- 172.21.15.86:0/1552752960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21ec1030f0 0x7f21ec103570 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.849+0000 7f21f0a00640 1 --2- 172.21.15.86:0/1552752960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21ec101f20 0x7f21ec102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.849+0000 7f21f0a00640 1 -- 172.21.15.86:0/1552752960 >> 172.21.15.86:0/1552752960 conn(0x7f21ec0fd6f0 msgr2=0x7f21ec0ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:33.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.849+0000 7f21f0a00640 1 -- 172.21.15.86:0/1552752960 shutdown_connections 2024-09-13T16:08:33.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.849+0000 7f21f0a00640 1 -- 172.21.15.86:0/1552752960 wait complete. 2024-09-13T16:08:33.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.849+0000 7f21f0a00640 1 Processor -- start 2024-09-13T16:08:33.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.850+0000 7f21f0a00640 1 -- start start 2024-09-13T16:08:33.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.850+0000 7f21f0a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21ec101f20 0x7f21ec198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:33.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.850+0000 7f21f0a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21ec1030f0 0x7f21ec198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:33.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.850+0000 7f21f0a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21ec103ab0 0x7f21ec19f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:33.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.850+0000 7f21f0a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec19fb30 con 0x7f21ec1030f0 2024-09-13T16:08:33.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.850+0000 7f21f0a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec19fca0 con 0x7f21ec103ab0 2024-09-13T16:08:33.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.850+0000 7f21f0a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec19fe60 con 0x7f21ec101f20 2024-09-13T16:08:33.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.850+0000 7f21e1400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21ec1030f0 0x7f21ec198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:33.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.850+0000 7f21e1400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21ec1030f0 0x7f21ec198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42974/0 (socket says 172.21.15.86:42974) 2024-09-13T16:08:33.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.850+0000 7f21e1400640 1 -- 172.21.15.86:0/1473528283 learned_addr learned my addr 172.21.15.86:0/1473528283 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:33.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.850+0000 7f21e9e00640 1 --2- 172.21.15.86:0/1473528283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21ec101f20 0x7f21ec198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:33.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.850+0000 7f21ea800640 1 --2- 172.21.15.86:0/1473528283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21ec103ab0 0x7f21ec19f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:33.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.851+0000 7f21e1400640 1 -- 172.21.15.86:0/1473528283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21ec101f20 msgr2=0x7f21ec198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:33.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.851+0000 7f21e1400640 1 --2- 172.21.15.86:0/1473528283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21ec101f20 0x7f21ec198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.851+0000 7f21e1400640 1 -- 172.21.15.86:0/1473528283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21ec103ab0 msgr2=0x7f21ec19f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:33.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.851+0000 7f21e1400640 1 --2- 172.21.15.86:0/1473528283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21ec103ab0 0x7f21ec19f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:33.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.851+0000 7f21e1400640 1 -- 172.21.15.86:0/1473528283 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d4009560 con 0x7f21ec1030f0 2024-09-13T16:08:33.854 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.851+0000 7f21ea800640 1 --2- 172.21.15.86:0/1473528283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21ec103ab0 0x7f21ec19f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:08:33.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.851+0000 7f21e1400640 1 --2- 172.21.15.86:0/1473528283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21ec1030f0 0x7f21ec198580 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f21d4031510 tx=0x7f21d4004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:33.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.851+0000 7f21e3400640 1 -- 172.21.15.86:0/1473528283 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4005210 con 0x7f21ec1030f0 2024-09-13T16:08:33.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.851+0000 7f21e3400640 1 -- 172.21.15.86:0/1473528283 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f21d4004ba0 con 0x7f21ec1030f0 2024-09-13T16:08:33.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.851+0000 7f21e3400640 1 -- 172.21.15.86:0/1473528283 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4003b20 con 0x7f21ec1030f0 2024-09-13T16:08:33.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.851+0000 7f21f0a00640 1 -- 172.21.15.86:0/1473528283 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ec1a00e0 con 0x7f21ec1030f0 2024-09-13T16:08:33.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.851+0000 7f21f0a00640 1 -- 172.21.15.86:0/1473528283 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ec1a0540 con 0x7f21ec1030f0 2024-09-13T16:08:33.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.852+0000 7f21f0a00640 1 -- 172.21.15.86:0/1473528283 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ec1093f0 con 0x7f21ec1030f0 2024-09-13T16:08:33.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.854+0000 7f21e3400640 1 -- 172.21.15.86:0/1473528283 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f21d4004d10 con 0x7f21ec1030f0 2024-09-13T16:08:33.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.855+0000 7f21e3400640 1 --2- 172.21.15.86:0/1473528283 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f21d00a1120 0x7f21d00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:33.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.855+0000 7f21e3400640 1 -- 172.21.15.86:0/1473528283 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f21d40ed990 con 0x7f21ec1030f0 2024-09-13T16:08:33.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.855+0000 7f21e9e00640 1 --2- 172.21.15.86:0/1473528283 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f21d00a1120 0x7f21d00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:33.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.856+0000 7f21e9e00640 1 --2- 172.21.15.86:0/1473528283 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f21d00a1120 0x7f21d00a35e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f21dc005fd0 tx=0x7f21dc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:33.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:33.859+0000 7f21e3400640 1 -- 172.21.15.86:0/1473528283 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f21d40b6d70 con 0x7f21ec1030f0 2024-09-13T16:08:34.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.053+0000 7f21f0a00640 1 -- 172.21.15.86:0/1473528283 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f21ec02c450 con 0x7f21d00a1120 2024-09-13T16:08:34.081 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.080+0000 7f21e3400640 1 -- 172.21.15.86:0/1473528283 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f21ec02c450 con 0x7f21d00a1120 2024-09-13T16:08:34.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.082+0000 7f21f0a00640 1 -- 172.21.15.86:0/1473528283 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f21d00a1120 msgr2=0x7f21d00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:34.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.082+0000 7f21f0a00640 1 --2- 172.21.15.86:0/1473528283 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f21d00a1120 0x7f21d00a35e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f21dc005fd0 tx=0x7f21dc00b410 comp rx=0 tx=0).stop 2024-09-13T16:08:34.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.082+0000 7f21f0a00640 1 -- 172.21.15.86:0/1473528283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21ec1030f0 msgr2=0x7f21ec198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:34.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.082+0000 7f21f0a00640 1 --2- 172.21.15.86:0/1473528283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21ec1030f0 0x7f21ec198580 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f21d4031510 tx=0x7f21d4004360 comp rx=0 tx=0).stop 2024-09-13T16:08:34.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.082+0000 7f21f0a00640 1 -- 172.21.15.86:0/1473528283 shutdown_connections 2024-09-13T16:08:34.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.082+0000 7f21f0a00640 1 --2- 172.21.15.86:0/1473528283 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f21d00a1120 0x7f21d00a35e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.082+0000 7f21f0a00640 1 --2- 172.21.15.86:0/1473528283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21ec103ab0 0x7f21ec19f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.082+0000 7f21f0a00640 1 --2- 172.21.15.86:0/1473528283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21ec1030f0 0x7f21ec198580 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.084 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.082+0000 7f21f0a00640 1 --2- 172.21.15.86:0/1473528283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21ec101f20 0x7f21ec198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.082+0000 7f21f0a00640 1 -- 172.21.15.86:0/1473528283 >> 172.21.15.86:0/1473528283 conn(0x7f21ec0fd6f0 msgr2=0x7f21ec1065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:34.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.082+0000 7f21f0a00640 1 -- 172.21.15.86:0/1473528283 shutdown_connections 2024-09-13T16:08:34.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.082+0000 7f21f0a00640 1 -- 172.21.15.86:0/1473528283 wait complete. 2024-09-13T16:08:34.100 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-13T16:08:34.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.257+0000 7f1511000640 1 -- 172.21.15.86:0/1409803541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f150c103130 msgr2=0x7f150c105520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:34.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.257+0000 7f1511000640 1 --2- 172.21.15.86:0/1409803541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f150c103130 0x7f150c105520 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009900 tx=0x7f14f402a410 comp rx=0 tx=0).stop 2024-09-13T16:08:34.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.257+0000 7f1511000640 1 -- 172.21.15.86:0/1409803541 shutdown_connections 2024-09-13T16:08:34.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.257+0000 7f1511000640 1 --2- 172.21.15.86:0/1409803541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f150c105a60 0x7f150c107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.257+0000 7f1511000640 1 --2- 172.21.15.86:0/1409803541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f150c103130 0x7f150c105520 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.257+0000 7f1511000640 1 --2- 172.21.15.86:0/1409803541 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f150c100800 0x7f150c102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.257+0000 7f1511000640 1 -- 172.21.15.86:0/1409803541 >> 172.21.15.86:0/1409803541 conn(0x7f150c0fa3e0 msgr2=0x7f150c0fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:34.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.257+0000 7f1511000640 1 -- 172.21.15.86:0/1409803541 shutdown_connections 2024-09-13T16:08:34.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.257+0000 7f1511000640 1 -- 172.21.15.86:0/1409803541 wait complete. 2024-09-13T16:08:34.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.258+0000 7f1511000640 1 Processor -- start 2024-09-13T16:08:34.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.258+0000 7f1511000640 1 -- start start 2024-09-13T16:08:34.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.259+0000 7f1511000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f150c100800 0x7f150c198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:34.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.259+0000 7f1511000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f150c103130 0x7f150c1986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:34.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.259+0000 7f1511000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f150c105a60 0x7f150c19f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:34.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.259+0000 7f1511000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c19fc60 con 0x7f150c105a60 2024-09-13T16:08:34.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.259+0000 7f1511000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c19fdd0 con 0x7f150c100800 2024-09-13T16:08:34.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.259+0000 7f1511000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c19ff90 con 0x7f150c103130 2024-09-13T16:08:34.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.259+0000 7f150a800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f150c105a60 0x7f150c19f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:34.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.259+0000 7f1509e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f150c100800 0x7f150c198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:34.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.259+0000 7f1509e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f150c100800 0x7f150c198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:45584/0 (socket says 172.21.15.86:45584) 2024-09-13T16:08:34.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.259+0000 7f1503e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f150c103130 0x7f150c1986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:34.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.259+0000 7f1509e00640 1 -- 172.21.15.86:0/634306120 learned_addr learned my addr 172.21.15.86:0/634306120 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:34.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.259+0000 7f150a800640 1 -- 172.21.15.86:0/634306120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f150c103130 msgr2=0x7f150c1986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:34.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.259+0000 7f150a800640 1 --2- 172.21.15.86:0/634306120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f150c103130 0x7f150c1986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.259+0000 7f150a800640 1 -- 172.21.15.86:0/634306120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f150c100800 msgr2=0x7f150c198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:34.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.259+0000 7f150a800640 1 --2- 172.21.15.86:0/634306120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f150c100800 0x7f150c198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.259+0000 7f150a800640 1 -- 172.21.15.86:0/634306120 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1504009840 con 0x7f150c105a60 2024-09-13T16:08:34.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.260+0000 7f150a800640 1 --2- 172.21.15.86:0/634306120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f150c105a60 0x7f150c19f720 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1504005fd0 tx=0x7f150400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:34.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.260+0000 7f1502a00640 1 -- 172.21.15.86:0/634306120 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504003b70 con 0x7f150c105a60 2024-09-13T16:08:34.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.260+0000 7f1502a00640 1 -- 172.21.15.86:0/634306120 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f150400ce70 con 0x7f150c105a60 2024-09-13T16:08:34.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.260+0000 7f1502a00640 1 -- 172.21.15.86:0/634306120 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15040107a0 con 0x7f150c105a60 2024-09-13T16:08:34.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.260+0000 7f1511000640 1 -- 172.21.15.86:0/634306120 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f4009560 con 0x7f150c105a60 2024-09-13T16:08:34.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.260+0000 7f1511000640 1 -- 172.21.15.86:0/634306120 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150c1a0570 con 0x7f150c105a60 2024-09-13T16:08:34.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.261+0000 7f1511000640 1 -- 172.21.15.86:0/634306120 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150c1075d0 con 0x7f150c105a60 2024-09-13T16:08:34.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.263+0000 7f1502a00640 1 -- 172.21.15.86:0/634306120 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1504004020 con 0x7f150c105a60 2024-09-13T16:08:34.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.264+0000 7f1502a00640 1 --2- 172.21.15.86:0/634306120 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f14f00a11a0 0x7f14f00a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:34.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.264+0000 7f1502a00640 1 -- 172.21.15.86:0/634306120 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f1504014070 con 0x7f150c105a60 2024-09-13T16:08:34.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.264+0000 7f1509e00640 1 --2- 172.21.15.86:0/634306120 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f14f00a11a0 0x7f14f00a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:34.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.265+0000 7f1509e00640 1 --2- 172.21.15.86:0/634306120 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f14f00a11a0 0x7f14f00a3660 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009c90 tx=0x7f14fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:34.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.268+0000 7f1502a00640 1 -- 172.21.15.86:0/634306120 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1504096710 con 0x7f150c105a60 2024-09-13T16:08:34.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.466+0000 7f1511000640 1 -- 172.21.15.86:0/634306120 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f150c02c450 con 0x7f14f00a11a0 2024-09-13T16:08:34.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.470+0000 7f1502a00640 1 -- 172.21.15.86:0/634306120 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f150c02c450 con 0x7f14f00a11a0 2024-09-13T16:08:34.472 INFO:teuthology.orchestra.run.smithi086.stdout:/volumes/qa/sv_1/e4490c8e-5d1d-4d4e-bc70-d003b6b499a3 2024-09-13T16:08:34.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.472+0000 7f1511000640 1 -- 172.21.15.86:0/634306120 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f14f00a11a0 msgr2=0x7f14f00a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:34.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.472+0000 7f1511000640 1 --2- 172.21.15.86:0/634306120 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f14f00a11a0 0x7f14f00a3660 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009c90 tx=0x7f14fc005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:34.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.473+0000 7f1511000640 1 -- 172.21.15.86:0/634306120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f150c105a60 msgr2=0x7f150c19f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:34.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.473+0000 7f1511000640 1 --2- 172.21.15.86:0/634306120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f150c105a60 0x7f150c19f720 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1504005fd0 tx=0x7f150400c6a0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.473+0000 7f1511000640 1 -- 172.21.15.86:0/634306120 shutdown_connections 2024-09-13T16:08:34.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.473+0000 7f1511000640 1 --2- 172.21.15.86:0/634306120 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f14f00a11a0 0x7f14f00a3660 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.473+0000 7f1511000640 1 --2- 172.21.15.86:0/634306120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f150c105a60 0x7f150c19f720 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.473+0000 7f1511000640 1 --2- 172.21.15.86:0/634306120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f150c103130 0x7f150c1986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.473+0000 7f1511000640 1 --2- 172.21.15.86:0/634306120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f150c100800 0x7f150c198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.473+0000 7f1511000640 1 -- 172.21.15.86:0/634306120 >> 172.21.15.86:0/634306120 conn(0x7f150c0fa3e0 msgr2=0x7f150c0ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:34.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.473+0000 7f1511000640 1 -- 172.21.15.86:0/634306120 shutdown_connections 2024-09-13T16:08:34.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.473+0000 7f1511000640 1 -- 172.21.15.86:0/634306120 wait complete. 2024-09-13T16:08:34.490 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:08:34.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.641+0000 7fede5e00640 1 -- 172.21.15.86:0/404943223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede0103190 msgr2=0x7fede0103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:34.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.641+0000 7fede5e00640 1 --2- 172.21.15.86:0/404943223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede0103190 0x7fede0103610 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009900 tx=0x7fedcc02a410 comp rx=0 tx=0).stop 2024-09-13T16:08:34.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.641+0000 7fede5e00640 1 -- 172.21.15.86:0/404943223 shutdown_connections 2024-09-13T16:08:34.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.641+0000 7fede5e00640 1 --2- 172.21.15.86:0/404943223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fede0103b50 0x7fede010a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.641+0000 7fede5e00640 1 --2- 172.21.15.86:0/404943223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede0103190 0x7fede0103610 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.641+0000 7fede5e00640 1 --2- 172.21.15.86:0/404943223 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede0101fa0 0x7fede01023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.641+0000 7fede5e00640 1 -- 172.21.15.86:0/404943223 >> 172.21.15.86:0/404943223 conn(0x7fede00fd720 msgr2=0x7fede00ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:34.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.641+0000 7fede5e00640 1 -- 172.21.15.86:0/404943223 shutdown_connections 2024-09-13T16:08:34.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.641+0000 7fede5e00640 1 -- 172.21.15.86:0/404943223 wait complete. 2024-09-13T16:08:34.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.642+0000 7fede5e00640 1 Processor -- start 2024-09-13T16:08:34.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.642+0000 7fede5e00640 1 -- start start 2024-09-13T16:08:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.642+0000 7fede5e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fede0101fa0 0x7fede0198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.642+0000 7fede5e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede0103190 0x7fede0198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.642+0000 7fede5e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede0103b50 0x7fede019f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.642+0000 7fede5e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede019fb00 con 0x7fede0103b50 2024-09-13T16:08:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.642+0000 7fede5e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede019fc70 con 0x7fede0103190 2024-09-13T16:08:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.642+0000 7fede5e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede019fe30 con 0x7fede0101fa0 2024-09-13T16:08:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.642+0000 7feddf400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede0103b50 0x7fede019f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.642+0000 7feddea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fede0101fa0 0x7fede0198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.642+0000 7fedde000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede0103190 0x7fede0198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.643+0000 7feddf400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede0103b50 0x7fede019f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43022/0 (socket says 172.21.15.86:43022) 2024-09-13T16:08:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.643+0000 7feddf400640 1 -- 172.21.15.86:0/2092507103 learned_addr learned my addr 172.21.15.86:0/2092507103 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:34.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.643+0000 7feddea00640 1 -- 172.21.15.86:0/2092507103 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede0103190 msgr2=0x7fede0198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:34.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.643+0000 7feddea00640 1 --2- 172.21.15.86:0/2092507103 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede0103190 0x7fede0198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.643+0000 7feddea00640 1 -- 172.21.15.86:0/2092507103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede0103b50 msgr2=0x7fede019f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:34.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.643+0000 7feddea00640 1 --2- 172.21.15.86:0/2092507103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede0103b50 0x7fede019f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.643+0000 7feddea00640 1 -- 172.21.15.86:0/2092507103 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc009560 con 0x7fede0101fa0 2024-09-13T16:08:34.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.643+0000 7fedde000640 1 --2- 172.21.15.86:0/2092507103 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede0103190 0x7fede0198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:34.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.643+0000 7feddea00640 1 --2- 172.21.15.86:0/2092507103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fede0101fa0 0x7fede0198010 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fedd000e9c0 tx=0x7fedd000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:34.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.643+0000 7fede4a00640 1 -- 172.21.15.86:0/2092507103 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd000ccc0 con 0x7fede0101fa0 2024-09-13T16:08:34.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.643+0000 7fede5e00640 1 -- 172.21.15.86:0/2092507103 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede01a0110 con 0x7fede0101fa0 2024-09-13T16:08:34.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.643+0000 7fede4a00640 1 -- 172.21.15.86:0/2092507103 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fedd000ce20 con 0x7fede0101fa0 2024-09-13T16:08:34.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.643+0000 7fede4a00640 1 -- 172.21.15.86:0/2092507103 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0010430 con 0x7fede0101fa0 2024-09-13T16:08:34.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.644+0000 7fede5e00640 1 -- 172.21.15.86:0/2092507103 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede01a05f0 con 0x7fede0101fa0 2024-09-13T16:08:34.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.645+0000 7fede5e00640 1 -- 172.21.15.86:0/2092507103 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede0109430 con 0x7fede0101fa0 2024-09-13T16:08:34.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.646+0000 7fede4a00640 1 -- 172.21.15.86:0/2092507103 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fedd0003f60 con 0x7fede0101fa0 2024-09-13T16:08:34.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.647+0000 7fede4a00640 1 --2- 172.21.15.86:0/2092507103 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fedc40a1120 0x7fedc40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:34.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.648+0000 7fede4a00640 1 -- 172.21.15.86:0/2092507103 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fedd0014070 con 0x7fede0101fa0 2024-09-13T16:08:34.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.648+0000 7fedde000640 1 --2- 172.21.15.86:0/2092507103 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fedc40a1120 0x7fedc40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:34.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.648+0000 7fedde000640 1 --2- 172.21.15.86:0/2092507103 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fedc40a1120 0x7fedc40a35e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fedcc031510 tx=0x7fedcc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:34.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.650+0000 7fede4a00640 1 -- 172.21.15.86:0/2092507103 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fedd0096d20 con 0x7fede0101fa0 2024-09-13T16:08:34.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:34 smithi139 ceph-mon[35320]: from='client.24823 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:08:34.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:34 smithi139 ceph-mon[35320]: from='client.24835 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:08:34.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:34 smithi139 ceph-mon[35320]: pgmap v307: 129 pgs: 129 active+clean; 582 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s rd, 1.4 KiB/s wr, 3 op/s 2024-09-13T16:08:34.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:34 smithi139 ceph-mon[35320]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-13T16:08:34.749 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:08:34 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-b[64629]: 2024-09-13T16:08:34.662+0000 7f52be69d640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-13T16:08:34.749 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:08:34 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-b[64629]: 2024-09-13T16:08:34.662+0000 7f52be69d640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-13T16:08:34.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:34 smithi194 ceph-mon[35694]: from='client.24823 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:08:34.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:34 smithi194 ceph-mon[35694]: from='client.24835 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:08:34.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:34 smithi194 ceph-mon[35694]: pgmap v307: 129 pgs: 129 active+clean; 582 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s rd, 1.4 KiB/s wr, 3 op/s 2024-09-13T16:08:34.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:34 smithi194 ceph-mon[35694]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-13T16:08:34.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.853+0000 7fede5e00640 1 -- 172.21.15.86:0/2092507103 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fede010d980 con 0x7fede0101fa0 2024-09-13T16:08:34.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.854+0000 7fede4a00640 1 -- 172.21.15.86:0/2092507103 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10877 (secure 0 0 0) 0x7fedd009a340 con 0x7fede0101fa0 2024-09-13T16:08:34.856 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:34.856 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14508,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1509120923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1509120923},{"type":"v1","addr":"172.21.15.86:6839","nonce":1509120923}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6841/1971775519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":1971775519},{"type":"v1","addr":"172.21.15.86:6841","nonce":1971775519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T16:08:09.202262+0000","modified":"2024-09-13T16:08:32.444959+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24544,"mds_2":24530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/1370900762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1370900762},{"type":"v1","addr":"172.21.15.194:6835","nonce":1370900762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/2460451799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":2460451799},{"type":"v1","addr":"172.21.15.194:6837","nonce":2460451799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24530":{"gid":24530,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.139:6837/2399531832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2399531832},{"type":"v1","addr":"172.21.15.139:6837","nonce":2399531832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6839/3799859182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3799859182},{"type":"v1","addr":"172.21.15.194:6839","nonce":3799859182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.139:6839/3370280063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3370280063},{"type":"v1","addr":"172.21.15.139:6839","nonce":3370280063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:08:34.857 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 24 2024-09-13T16:08:34.858 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.857+0000 7fede5e00640 1 -- 172.21.15.86:0/2092507103 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fedc40a1120 msgr2=0x7fedc40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:34.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.857+0000 7fede5e00640 1 --2- 172.21.15.86:0/2092507103 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fedc40a1120 0x7fedc40a35e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fedcc031510 tx=0x7fedcc0058d0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.857+0000 7fede5e00640 1 -- 172.21.15.86:0/2092507103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fede0101fa0 msgr2=0x7fede0198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:34.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.857+0000 7fede5e00640 1 --2- 172.21.15.86:0/2092507103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fede0101fa0 0x7fede0198010 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fedd000e9c0 tx=0x7fedd000ee80 comp rx=0 tx=0).stop 2024-09-13T16:08:34.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.857+0000 7fede5e00640 1 -- 172.21.15.86:0/2092507103 shutdown_connections 2024-09-13T16:08:34.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.857+0000 7fede5e00640 1 --2- 172.21.15.86:0/2092507103 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fedc40a1120 0x7fedc40a35e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.857+0000 7fede5e00640 1 --2- 172.21.15.86:0/2092507103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede0103b50 0x7fede019f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.857+0000 7fede5e00640 1 --2- 172.21.15.86:0/2092507103 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede0103190 0x7fede0198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.859 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.857+0000 7fede5e00640 1 --2- 172.21.15.86:0/2092507103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fede0101fa0 0x7fede0198010 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:34.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.857+0000 7fede5e00640 1 -- 172.21.15.86:0/2092507103 >> 172.21.15.86:0/2092507103 conn(0x7fede00fd720 msgr2=0x7fede0106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:34.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.857+0000 7fede5e00640 1 -- 172.21.15.86:0/2092507103 shutdown_connections 2024-09-13T16:08:34.860 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:34.857+0000 7fede5e00640 1 -- 172.21.15.86:0/2092507103 wait complete. 2024-09-13T16:08:34.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:34 smithi086 ceph-mon[30379]: from='client.24823 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:08:34.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:34 smithi086 ceph-mon[30379]: from='client.24835 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:08:34.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:34 smithi086 ceph-mon[30379]: pgmap v307: 129 pgs: 129 active+clean; 582 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s rd, 1.4 KiB/s wr, 3 op/s 2024-09-13T16:08:34.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:34 smithi086 ceph-mon[30379]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-13T16:08:34.875 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:08:35.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.026+0000 7f5146e00640 1 -- 172.21.15.86:0/1117771578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5140101f90 msgr2=0x7f5140102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.026+0000 7f5146e00640 1 --2- 172.21.15.86:0/1117771578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5140101f90 0x7f5140102390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5130009900 tx=0x7f513002a410 comp rx=0 tx=0).stop 2024-09-13T16:08:35.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.026+0000 7f5146e00640 1 -- 172.21.15.86:0/1117771578 shutdown_connections 2024-09-13T16:08:35.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.026+0000 7f5146e00640 1 --2- 172.21.15.86:0/1117771578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5140103b40 0x7f514010a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.026+0000 7f5146e00640 1 --2- 172.21.15.86:0/1117771578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5140103180 0x7f5140103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.026+0000 7f5146e00640 1 --2- 172.21.15.86:0/1117771578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5140101f90 0x7f5140102390 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.026+0000 7f5146e00640 1 -- 172.21.15.86:0/1117771578 >> 172.21.15.86:0/1117771578 conn(0x7f51400fd730 msgr2=0x7f51400ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:35.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.026+0000 7f5146e00640 1 -- 172.21.15.86:0/1117771578 shutdown_connections 2024-09-13T16:08:35.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.026+0000 7f5146e00640 1 -- 172.21.15.86:0/1117771578 wait complete. 2024-09-13T16:08:35.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.027+0000 7f5146e00640 1 Processor -- start 2024-09-13T16:08:35.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.027+0000 7f5146e00640 1 -- start start 2024-09-13T16:08:35.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.027+0000 7f5146e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5140101f90 0x7f51401980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.027+0000 7f5146e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5140103180 0x7f5140198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.027+0000 7f5146e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5140103b40 0x7f514019f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.027+0000 7f5146e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514019fbb0 con 0x7f5140103b40 2024-09-13T16:08:35.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.027+0000 7f5146e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514019fd20 con 0x7f5140101f90 2024-09-13T16:08:35.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.027+0000 7f5146e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514019fee0 con 0x7f5140103180 2024-09-13T16:08:35.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.027+0000 7f5144e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5140103b40 0x7f514019f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.027+0000 7f5144e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5140103b40 0x7f514019f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43030/0 (socket says 172.21.15.86:43030) 2024-09-13T16:08:35.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.027+0000 7f5144e00640 1 -- 172.21.15.86:0/50427578 learned_addr learned my addr 172.21.15.86:0/50427578 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:35.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.028+0000 7f513fe00640 1 --2- 172.21.15.86:0/50427578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5140101f90 0x7f51401980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.028+0000 7f513f400640 1 --2- 172.21.15.86:0/50427578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5140103180 0x7f5140198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.028+0000 7f5144e00640 1 -- 172.21.15.86:0/50427578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5140103180 msgr2=0x7f5140198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.028+0000 7f5144e00640 1 --2- 172.21.15.86:0/50427578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5140103180 0x7f5140198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.028+0000 7f5144e00640 1 -- 172.21.15.86:0/50427578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5140101f90 msgr2=0x7f51401980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.028+0000 7f5144e00640 1 --2- 172.21.15.86:0/50427578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5140101f90 0x7f51401980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.028+0000 7f5144e00640 1 -- 172.21.15.86:0/50427578 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5138009840 con 0x7f5140103b40 2024-09-13T16:08:35.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.028+0000 7f5144e00640 1 --2- 172.21.15.86:0/50427578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5140103b40 0x7f514019f670 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f513800efd0 tx=0x7f513800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:35.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.028+0000 7f513cc00640 1 -- 172.21.15.86:0/50427578 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5138009b40 con 0x7f5140103b40 2024-09-13T16:08:35.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.028+0000 7f513cc00640 1 -- 172.21.15.86:0/50427578 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5138003b70 con 0x7f5140103b40 2024-09-13T16:08:35.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.028+0000 7f5146e00640 1 -- 172.21.15.86:0/50427578 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5130009560 con 0x7f5140103b40 2024-09-13T16:08:35.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.028+0000 7f513cc00640 1 -- 172.21.15.86:0/50427578 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51380108f0 con 0x7f5140103b40 2024-09-13T16:08:35.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.029+0000 7f5146e00640 1 -- 172.21.15.86:0/50427578 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51401a04f0 con 0x7f5140103b40 2024-09-13T16:08:35.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.029+0000 7f5146e00640 1 -- 172.21.15.86:0/50427578 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5140109420 con 0x7f5140103b40 2024-09-13T16:08:35.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.031+0000 7f513cc00640 1 -- 172.21.15.86:0/50427578 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5138003ce0 con 0x7f5140103b40 2024-09-13T16:08:35.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.032+0000 7f513cc00640 1 --2- 172.21.15.86:0/50427578 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f51240a1120 0x7f51240a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.033+0000 7f513cc00640 1 -- 172.21.15.86:0/50427578 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f5138014070 con 0x7f5140103b40 2024-09-13T16:08:35.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.033+0000 7f513fe00640 1 --2- 172.21.15.86:0/50427578 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f51240a1120 0x7f51240a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.033+0000 7f513fe00640 1 --2- 172.21.15.86:0/50427578 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f51240a1120 0x7f51240a35e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5130009230 tx=0x7f5130005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:35.037 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.036+0000 7f513cc00640 1 -- 172.21.15.86:0/50427578 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5138096640 con 0x7f5140103b40 2024-09-13T16:08:35.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.207+0000 7f5146e00640 1 -- 172.21.15.86:0/50427578 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f514010d9f0 con 0x7f5140103b40 2024-09-13T16:08:35.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.209+0000 7f513cc00640 1 -- 172.21.15.86:0/50427578 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23949 (secure 0 0 0) 0x7f5138099c60 con 0x7f5140103b40 2024-09-13T16:08:35.210 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:35.211 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":90,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:08:13.655740+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:08:35.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.211+0000 7f5146e00640 1 -- 172.21.15.86:0/50427578 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f51240a1120 msgr2=0x7f51240a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.211+0000 7f5146e00640 1 --2- 172.21.15.86:0/50427578 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f51240a1120 0x7f51240a35e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5130009230 tx=0x7f5130005a20 comp rx=0 tx=0).stop 2024-09-13T16:08:35.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.211+0000 7f5146e00640 1 -- 172.21.15.86:0/50427578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5140103b40 msgr2=0x7f514019f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.211+0000 7f5146e00640 1 --2- 172.21.15.86:0/50427578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5140103b40 0x7f514019f670 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f513800efd0 tx=0x7f513800c6a0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.211+0000 7f5146e00640 1 -- 172.21.15.86:0/50427578 shutdown_connections 2024-09-13T16:08:35.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.211+0000 7f5146e00640 1 --2- 172.21.15.86:0/50427578 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f51240a1120 0x7f51240a35e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.211+0000 7f5146e00640 1 --2- 172.21.15.86:0/50427578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5140103b40 0x7f514019f670 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.211+0000 7f5146e00640 1 --2- 172.21.15.86:0/50427578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5140103180 0x7f5140198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.211+0000 7f5146e00640 1 --2- 172.21.15.86:0/50427578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5140101f90 0x7f51401980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.211+0000 7f5146e00640 1 -- 172.21.15.86:0/50427578 >> 172.21.15.86:0/50427578 conn(0x7f51400fd730 msgr2=0x7f51401065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:35.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.211+0000 7f5146e00640 1 -- 172.21.15.86:0/50427578 shutdown_connections 2024-09-13T16:08:35.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.211+0000 7f5146e00640 1 -- 172.21.15.86:0/50427578 wait complete. 2024-09-13T16:08:35.229 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T16:08:35.229 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T16:08:35.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.380+0000 7fc317e00640 1 -- 172.21.15.86:0/2633105498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc310101930 msgr2=0x7fc3101081c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.380+0000 7fc317e00640 1 --2- 172.21.15.86:0/2633105498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc310101930 0x7fc3101081c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc308009ca0 tx=0x7fc30802a8b0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.380+0000 7fc317e00640 1 -- 172.21.15.86:0/2633105498 shutdown_connections 2024-09-13T16:08:35.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.380+0000 7fc317e00640 1 --2- 172.21.15.86:0/2633105498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc310101930 0x7fc3101081c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.380+0000 7fc317e00640 1 --2- 172.21.15.86:0/2633105498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc310100f70 0x7fc3101013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.380+0000 7fc317e00640 1 --2- 172.21.15.86:0/2633105498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3100ffd80 0x7fc310100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.380+0000 7fc317e00640 1 -- 172.21.15.86:0/2633105498 >> 172.21.15.86:0/2633105498 conn(0x7fc3100fb500 msgr2=0x7fc3100fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:35.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.380+0000 7fc317e00640 1 -- 172.21.15.86:0/2633105498 shutdown_connections 2024-09-13T16:08:35.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.381+0000 7fc317e00640 1 -- 172.21.15.86:0/2633105498 wait complete. 2024-09-13T16:08:35.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.381+0000 7fc317e00640 1 Processor -- start 2024-09-13T16:08:35.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.381+0000 7fc317e00640 1 -- start start 2024-09-13T16:08:35.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.382+0000 7fc317e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3100ffd80 0x7fc310074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.382+0000 7fc317e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc310100f70 0x7fc3100728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.382+0000 7fc317e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc310101930 0x7fc310072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.382+0000 7fc317e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc310073540 con 0x7fc3100ffd80 2024-09-13T16:08:35.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.382+0000 7fc317e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100736b0 con 0x7fc310101930 2024-09-13T16:08:35.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.382+0000 7fc317e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31019fea0 con 0x7fc310100f70 2024-09-13T16:08:35.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.382+0000 7fc315400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3100ffd80 0x7fc310074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.382+0000 7fc315400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3100ffd80 0x7fc310074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43056/0 (socket says 172.21.15.86:43056) 2024-09-13T16:08:35.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.382+0000 7fc315400640 1 -- 172.21.15.86:0/1933951112 learned_addr learned my addr 172.21.15.86:0/1933951112 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:35.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.382+0000 7fc315e00640 1 --2- 172.21.15.86:0/1933951112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc310101930 0x7fc310072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.382+0000 7fc314a00640 1 --2- 172.21.15.86:0/1933951112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc310100f70 0x7fc3100728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.382+0000 7fc315400640 1 -- 172.21.15.86:0/1933951112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc310100f70 msgr2=0x7fc3100728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.382+0000 7fc315400640 1 --2- 172.21.15.86:0/1933951112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc310100f70 0x7fc3100728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.382+0000 7fc315400640 1 -- 172.21.15.86:0/1933951112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc310101930 msgr2=0x7fc310072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.382+0000 7fc315400640 1 --2- 172.21.15.86:0/1933951112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc310101930 0x7fc310072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.382+0000 7fc315400640 1 -- 172.21.15.86:0/1933951112 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc308009900 con 0x7fc3100ffd80 2024-09-13T16:08:35.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.383+0000 7fc315400640 1 --2- 172.21.15.86:0/1933951112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3100ffd80 0x7fc310074260 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc30400e9f0 tx=0x7fc30400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:35.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.383+0000 7fc30e000640 1 -- 172.21.15.86:0/1933951112 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc304009700 con 0x7fc3100ffd80 2024-09-13T16:08:35.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.383+0000 7fc30e000640 1 -- 172.21.15.86:0/1933951112 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc30400cd80 con 0x7fc3100ffd80 2024-09-13T16:08:35.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.383+0000 7fc317e00640 1 -- 172.21.15.86:0/1933951112 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3101a0150 con 0x7fc3100ffd80 2024-09-13T16:08:35.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.383+0000 7fc30e000640 1 -- 172.21.15.86:0/1933951112 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc304010490 con 0x7fc3100ffd80 2024-09-13T16:08:35.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.383+0000 7fc317e00640 1 -- 172.21.15.86:0/1933951112 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3101a06b0 con 0x7fc3100ffd80 2024-09-13T16:08:35.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.384+0000 7fc317e00640 1 -- 172.21.15.86:0/1933951112 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc310107170 con 0x7fc3100ffd80 2024-09-13T16:08:35.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.386+0000 7fc30e000640 1 -- 172.21.15.86:0/1933951112 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc3040036f0 con 0x7fc3100ffd80 2024-09-13T16:08:35.388 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.387+0000 7fc30e000640 1 --2- 172.21.15.86:0/1933951112 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc2f80a11a0 0x7fc2f80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.387+0000 7fc30e000640 1 -- 172.21.15.86:0/1933951112 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc304014070 con 0x7fc3100ffd80 2024-09-13T16:08:35.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.387+0000 7fc314a00640 1 --2- 172.21.15.86:0/1933951112 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc2f80a11a0 0x7fc2f80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.388+0000 7fc314a00640 1 --2- 172.21.15.86:0/1933951112 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc2f80a11a0 0x7fc2f80a3660 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc310073fd0 tx=0x7fc2fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:35.392 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.391+0000 7fc30e000640 1 -- 172.21.15.86:0/1933951112 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc304096400 con 0x7fc3100ffd80 2024-09-13T16:08:35.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.558+0000 7fc317e00640 1 -- 172.21.15.86:0/1933951112 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc31002c450 con 0x7fc2f80a11a0 2024-09-13T16:08:35.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.572+0000 7fc30e000640 1 -- 172.21.15.86:0/1933951112 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422959 (secure 0 0 0) 0x7fc31002c450 con 0x7fc2f80a11a0 2024-09-13T16:08:35.580 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-09-13T16:08:35.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.576+0000 7fc317e00640 1 -- 172.21.15.86:0/1933951112 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc2f80a11a0 msgr2=0x7fc2f80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.576+0000 7fc317e00640 1 --2- 172.21.15.86:0/1933951112 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc2f80a11a0 0x7fc2f80a3660 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc310073fd0 tx=0x7fc2fc005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.576+0000 7fc317e00640 1 -- 172.21.15.86:0/1933951112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3100ffd80 msgr2=0x7fc310074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.576+0000 7fc317e00640 1 --2- 172.21.15.86:0/1933951112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3100ffd80 0x7fc310074260 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc30400e9f0 tx=0x7fc30400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.577+0000 7fc317e00640 1 -- 172.21.15.86:0/1933951112 shutdown_connections 2024-09-13T16:08:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.577+0000 7fc317e00640 1 --2- 172.21.15.86:0/1933951112 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc2f80a11a0 0x7fc2f80a3660 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.577+0000 7fc317e00640 1 --2- 172.21.15.86:0/1933951112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc310101930 0x7fc310072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.577+0000 7fc317e00640 1 --2- 172.21.15.86:0/1933951112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc310100f70 0x7fc3100728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.577+0000 7fc317e00640 1 --2- 172.21.15.86:0/1933951112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3100ffd80 0x7fc310074260 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.577+0000 7fc317e00640 1 -- 172.21.15.86:0/1933951112 >> 172.21.15.86:0/1933951112 conn(0x7fc3100fb500 msgr2=0x7fc310104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.577+0000 7fc317e00640 1 -- 172.21.15.86:0/1933951112 shutdown_connections 2024-09-13T16:08:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.577+0000 7fc317e00640 1 -- 172.21.15.86:0/1933951112 wait complete. 2024-09-13T16:08:35.593 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:35 smithi086 ceph-mon[30379]: from='client.24841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:08:35.593 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:35 smithi086 ceph-mon[30379]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:08:35.593 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:35 smithi086 ceph-mon[30379]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:08:35.594 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:35 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2092507103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:08:35.594 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:35 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/50427578' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:35.595 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-09-13T16:08:35.336428+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597604,"num_objects":54,"num_object_clones":0,"num_object_copies":163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":143,"num_read_kb":124,"num_write":291,"num_write_kb":2982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":236,"ondisk_log_size":236,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382780,"kb_used_data":13532,"kb_used_omap":18,"kb_used_meta":369133,"kb_avail":1124559044,"statfs":{"total":1151940427776,"available":1151548461056,"internally_reserved":0,"allocated":13856768,"data_stored":7581383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19130,"internal_metadata":377992518},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4424,"num_objects":30,"num_object_clones":0,"num_object_copies":91,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":64,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003358"},"pg_stats":[{"pgid":"2.1f","version":"85'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.229705+0000","last_change":"2024-09-13T16:08:08.808610+0000","last_active":"2024-09-13T16:08:13.229705+0000","last_peered":"2024-09-13T16:08:13.229705+0000","last_clean":"2024-09-13T16:08:13.229705+0000","last_became_active":"2024-09-13T16:08:08.808267+0000","last_became_peered":"2024-09-13T16:08:08.808267+0000","last_unstale":"2024-09-13T16:08:13.229705+0000","last_undegraded":"2024-09-13T16:08:13.229705+0000","last_fullsized":"2024-09-13T16:08:13.229705+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:56.867501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617488+0000","last_change":"2024-09-13T16:08:09.228268+0000","last_active":"2024-09-13T16:08:13.617488+0000","last_peered":"2024-09-13T16:08:13.617488+0000","last_clean":"2024-09-13T16:08:13.617488+0000","last_became_active":"2024-09-13T16:08:09.224689+0000","last_became_peered":"2024-09-13T16:08:09.224689+0000","last_unstale":"2024-09-13T16:08:13.617488+0000","last_undegraded":"2024-09-13T16:08:13.617488+0000","last_fullsized":"2024-09-13T16:08:13.617488+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:02.777936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.466284+0000","last_change":"2024-09-13T16:08:13.245650+0000","last_active":"2024-09-13T16:08:14.466284+0000","last_peered":"2024-09-13T16:08:14.466284+0000","last_clean":"2024-09-13T16:08:14.466284+0000","last_became_active":"2024-09-13T16:08:13.245346+0000","last_became_peered":"2024-09-13T16:08:13.245346+0000","last_unstale":"2024-09-13T16:08:14.466284+0000","last_undegraded":"2024-09-13T16:08:14.466284+0000","last_fullsized":"2024-09-13T16:08:14.466284+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:49.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.924805+0000","last_change":"2024-09-13T16:08:08.820385+0000","last_active":"2024-09-13T16:08:13.924805+0000","last_peered":"2024-09-13T16:08:13.924805+0000","last_clean":"2024-09-13T16:08:13.924805+0000","last_became_active":"2024-09-13T16:08:08.819874+0000","last_became_peered":"2024-09-13T16:08:08.819874+0000","last_unstale":"2024-09-13T16:08:13.924805+0000","last_undegraded":"2024-09-13T16:08:13.924805+0000","last_fullsized":"2024-09-13T16:08:13.924805+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:02.566058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.249932+0000","last_change":"2024-09-13T16:08:09.235517+0000","last_active":"2024-09-13T16:08:13.249932+0000","last_peered":"2024-09-13T16:08:13.249932+0000","last_clean":"2024-09-13T16:08:13.249932+0000","last_became_active":"2024-09-13T16:08:09.235157+0000","last_became_peered":"2024-09-13T16:08:09.235157+0000","last_unstale":"2024-09-13T16:08:13.249932+0000","last_undegraded":"2024-09-13T16:08:13.249932+0000","last_fullsized":"2024-09-13T16:08:13.249932+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:11.651025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.510945+0000","last_change":"2024-09-13T16:08:13.243422+0000","last_active":"2024-09-13T16:08:13.510945+0000","last_peered":"2024-09-13T16:08:13.510945+0000","last_clean":"2024-09-13T16:08:13.510945+0000","last_became_active":"2024-09-13T16:08:13.243075+0000","last_became_peered":"2024-09-13T16:08:13.243075+0000","last_unstale":"2024-09-13T16:08:13.510945+0000","last_undegraded":"2024-09-13T16:08:13.510945+0000","last_fullsized":"2024-09-13T16:08:13.510945+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:56.457343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:31.449116+0000","last_change":"2024-09-13T16:08:08.807410+0000","last_active":"2024-09-13T16:08:31.449116+0000","last_peered":"2024-09-13T16:08:31.449116+0000","last_clean":"2024-09-13T16:08:31.449116+0000","last_became_active":"2024-09-13T16:08:08.807041+0000","last_became_peered":"2024-09-13T16:08:08.807041+0000","last_unstale":"2024-09-13T16:08:31.449116+0000","last_undegraded":"2024-09-13T16:08:31.449116+0000","last_fullsized":"2024-09-13T16:08:31.449116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:58.198019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.235930+0000","last_change":"2024-09-13T16:08:09.228643+0000","last_active":"2024-09-13T16:08:13.235930+0000","last_peered":"2024-09-13T16:08:13.235930+0000","last_clean":"2024-09-13T16:08:13.235930+0000","last_became_active":"2024-09-13T16:08:09.228329+0000","last_became_peered":"2024-09-13T16:08:09.228329+0000","last_unstale":"2024-09-13T16:08:13.235930+0000","last_undegraded":"2024-09-13T16:08:13.235930+0000","last_fullsized":"2024-09-13T16:08:13.235930+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:03.306471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.511005+0000","last_change":"2024-09-13T16:08:13.250671+0000","last_active":"2024-09-13T16:08:13.511005+0000","last_peered":"2024-09-13T16:08:13.511005+0000","last_clean":"2024-09-13T16:08:13.511005+0000","last_became_active":"2024-09-13T16:08:13.250267+0000","last_became_peered":"2024-09-13T16:08:13.250267+0000","last_unstale":"2024-09-13T16:08:13.511005+0000","last_undegraded":"2024-09-13T16:08:13.511005+0000","last_fullsized":"2024-09-13T16:08:13.511005+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:30.939774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.238081+0000","last_change":"2024-09-13T16:08:08.805379+0000","last_active":"2024-09-13T16:08:13.238081+0000","last_peered":"2024-09-13T16:08:13.238081+0000","last_clean":"2024-09-13T16:08:13.238081+0000","last_became_active":"2024-09-13T16:08:08.804848+0000","last_became_peered":"2024-09-13T16:08:08.804848+0000","last_unstale":"2024-09-13T16:08:13.238081+0000","last_undegraded":"2024-09-13T16:08:13.238081+0000","last_fullsized":"2024-09-13T16:08:13.238081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:46.380684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.236440+0000","last_change":"2024-09-13T16:08:09.228613+0000","last_active":"2024-09-13T16:08:13.236440+0000","last_peered":"2024-09-13T16:08:13.236440+0000","last_clean":"2024-09-13T16:08:13.236440+0000","last_became_active":"2024-09-13T16:08:09.228302+0000","last_became_peered":"2024-09-13T16:08:09.228302+0000","last_unstale":"2024-09-13T16:08:13.236440+0000","last_undegraded":"2024-09-13T16:08:13.236440+0000","last_fullsized":"2024-09-13T16:08:13.236440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:16.137380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.510980+0000","last_change":"2024-09-13T16:08:13.244886+0000","last_active":"2024-09-13T16:08:13.510980+0000","last_peered":"2024-09-13T16:08:13.510980+0000","last_clean":"2024-09-13T16:08:13.510980+0000","last_became_active":"2024-09-13T16:08:13.244476+0000","last_became_peered":"2024-09-13T16:08:13.244476+0000","last_unstale":"2024-09-13T16:08:13.510980+0000","last_undegraded":"2024-09-13T16:08:13.510980+0000","last_fullsized":"2024-09-13T16:08:13.510980+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:55.359807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.428741+0000","last_change":"2024-09-13T16:08:09.234804+0000","last_active":"2024-09-13T16:08:13.428741+0000","last_peered":"2024-09-13T16:08:13.428741+0000","last_clean":"2024-09-13T16:08:13.428741+0000","last_became_active":"2024-09-13T16:08:09.234358+0000","last_became_peered":"2024-09-13T16:08:09.234358+0000","last_unstale":"2024-09-13T16:08:13.428741+0000","last_undegraded":"2024-09-13T16:08:13.428741+0000","last_fullsized":"2024-09-13T16:08:13.428741+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:48:51.454586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.436566+0000","last_change":"2024-09-13T16:08:08.807412+0000","last_active":"2024-09-13T16:08:30.436566+0000","last_peered":"2024-09-13T16:08:30.436566+0000","last_clean":"2024-09-13T16:08:30.436566+0000","last_became_active":"2024-09-13T16:08:08.806940+0000","last_became_peered":"2024-09-13T16:08:08.806940+0000","last_unstale":"2024-09-13T16:08:30.436566+0000","last_undegraded":"2024-09-13T16:08:30.436566+0000","last_fullsized":"2024-09-13T16:08:30.436566+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:38.678823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.511071+0000","last_change":"2024-09-13T16:08:13.494327+0000","last_active":"2024-09-13T16:08:13.511071+0000","last_peered":"2024-09-13T16:08:13.511071+0000","last_clean":"2024-09-13T16:08:13.511071+0000","last_became_active":"2024-09-13T16:08:13.493850+0000","last_became_peered":"2024-09-13T16:08:13.493850+0000","last_unstale":"2024-09-13T16:08:13.511071+0000","last_undegraded":"2024-09-13T16:08:13.511071+0000","last_fullsized":"2024-09-13T16:08:13.511071+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:12.123640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617480+0000","last_change":"2024-09-13T16:08:09.233638+0000","last_active":"2024-09-13T16:08:13.617480+0000","last_peered":"2024-09-13T16:08:13.617480+0000","last_clean":"2024-09-13T16:08:13.617480+0000","last_became_active":"2024-09-13T16:08:09.233323+0000","last_became_peered":"2024-09-13T16:08:09.233323+0000","last_unstale":"2024-09-13T16:08:13.617480+0000","last_undegraded":"2024-09-13T16:08:13.617480+0000","last_fullsized":"2024-09-13T16:08:13.617480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:47.313442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.229264+0000","last_change":"2024-09-13T16:08:08.820002+0000","last_active":"2024-09-13T16:08:13.229264+0000","last_peered":"2024-09-13T16:08:13.229264+0000","last_clean":"2024-09-13T16:08:13.229264+0000","last_became_active":"2024-09-13T16:08:08.819675+0000","last_became_peered":"2024-09-13T16:08:08.819675+0000","last_unstale":"2024-09-13T16:08:13.229264+0000","last_undegraded":"2024-09-13T16:08:13.229264+0000","last_fullsized":"2024-09-13T16:08:13.229264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:13.691478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.511023+0000","last_change":"2024-09-13T16:08:13.257847+0000","last_active":"2024-09-13T16:08:13.511023+0000","last_peered":"2024-09-13T16:08:13.511023+0000","last_clean":"2024-09-13T16:08:13.511023+0000","last_became_active":"2024-09-13T16:08:13.257472+0000","last_became_peered":"2024-09-13T16:08:13.257472+0000","last_unstale":"2024-09-13T16:08:13.511023+0000","last_undegraded":"2024-09-13T16:08:13.511023+0000","last_fullsized":"2024-09-13T16:08:13.511023+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:53.002153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.234507+0000","last_change":"2024-09-13T16:08:09.221868+0000","last_active":"2024-09-13T16:08:13.234507+0000","last_peered":"2024-09-13T16:08:13.234507+0000","last_clean":"2024-09-13T16:08:13.234507+0000","last_became_active":"2024-09-13T16:08:09.221130+0000","last_became_peered":"2024-09-13T16:08:09.221130+0000","last_unstale":"2024-09-13T16:08:13.234507+0000","last_undegraded":"2024-09-13T16:08:13.234507+0000","last_fullsized":"2024-09-13T16:08:13.234507+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:12:54.102303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.436111+0000","last_change":"2024-09-13T16:08:08.807413+0000","last_active":"2024-09-13T16:08:30.436111+0000","last_peered":"2024-09-13T16:08:30.436111+0000","last_clean":"2024-09-13T16:08:30.436111+0000","last_became_active":"2024-09-13T16:08:08.807040+0000","last_became_peered":"2024-09-13T16:08:08.807040+0000","last_unstale":"2024-09-13T16:08:30.436111+0000","last_undegraded":"2024-09-13T16:08:30.436111+0000","last_fullsized":"2024-09-13T16:08:30.436111+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:00.580572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.922307+0000","last_change":"2024-09-13T16:08:13.257060+0000","last_active":"2024-09-13T16:08:13.922307+0000","last_peered":"2024-09-13T16:08:13.922307+0000","last_clean":"2024-09-13T16:08:13.922307+0000","last_became_active":"2024-09-13T16:08:13.256665+0000","last_became_peered":"2024-09-13T16:08:13.256665+0000","last_unstale":"2024-09-13T16:08:13.922307+0000","last_undegraded":"2024-09-13T16:08:13.922307+0000","last_fullsized":"2024-09-13T16:08:13.922307+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:33.139558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.233458+0000","last_change":"2024-09-13T16:08:09.231289+0000","last_active":"2024-09-13T16:08:13.233458+0000","last_peered":"2024-09-13T16:08:13.233458+0000","last_clean":"2024-09-13T16:08:13.233458+0000","last_became_active":"2024-09-13T16:08:09.230247+0000","last_became_peered":"2024-09-13T16:08:09.230247+0000","last_unstale":"2024-09-13T16:08:13.233458+0000","last_undegraded":"2024-09-13T16:08:13.233458+0000","last_fullsized":"2024-09-13T16:08:13.233458+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:34.765694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.435878+0000","last_change":"2024-09-13T16:08:08.797980+0000","last_active":"2024-09-13T16:08:30.435878+0000","last_peered":"2024-09-13T16:08:30.435878+0000","last_clean":"2024-09-13T16:08:30.435878+0000","last_became_active":"2024-09-13T16:08:08.797601+0000","last_became_peered":"2024-09-13T16:08:08.797601+0000","last_unstale":"2024-09-13T16:08:30.435878+0000","last_undegraded":"2024-09-13T16:08:30.435878+0000","last_fullsized":"2024-09-13T16:08:30.435878+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:37.985497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.511081+0000","last_change":"2024-09-13T16:08:13.494332+0000","last_active":"2024-09-13T16:08:13.511081+0000","last_peered":"2024-09-13T16:08:13.511081+0000","last_clean":"2024-09-13T16:08:13.511081+0000","last_became_active":"2024-09-13T16:08:13.493846+0000","last_became_peered":"2024-09-13T16:08:13.493846+0000","last_unstale":"2024-09-13T16:08:13.511081+0000","last_undegraded":"2024-09-13T16:08:13.511081+0000","last_fullsized":"2024-09-13T16:08:13.511081+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:08:17.342575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.251864+0000","last_change":"2024-09-13T16:08:09.241373+0000","last_active":"2024-09-13T16:08:13.251864+0000","last_peered":"2024-09-13T16:08:13.251864+0000","last_clean":"2024-09-13T16:08:13.251864+0000","last_became_active":"2024-09-13T16:08:09.240846+0000","last_became_peered":"2024-09-13T16:08:09.240846+0000","last_unstale":"2024-09-13T16:08:13.251864+0000","last_undegraded":"2024-09-13T16:08:13.251864+0000","last_fullsized":"2024-09-13T16:08:13.251864+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:11.315423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.435045+0000","last_change":"2024-09-13T16:08:08.805428+0000","last_active":"2024-09-13T16:08:30.435045+0000","last_peered":"2024-09-13T16:08:30.435045+0000","last_clean":"2024-09-13T16:08:30.435045+0000","last_became_active":"2024-09-13T16:08:08.805109+0000","last_became_peered":"2024-09-13T16:08:08.805109+0000","last_unstale":"2024-09-13T16:08:30.435045+0000","last_undegraded":"2024-09-13T16:08:30.435045+0000","last_fullsized":"2024-09-13T16:08:30.435045+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:30.335761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.466409+0000","last_change":"2024-09-13T16:08:13.240929+0000","last_active":"2024-09-13T16:08:14.466409+0000","last_peered":"2024-09-13T16:08:14.466409+0000","last_clean":"2024-09-13T16:08:14.466409+0000","last_became_active":"2024-09-13T16:08:13.240554+0000","last_became_peered":"2024-09-13T16:08:13.240554+0000","last_unstale":"2024-09-13T16:08:14.466409+0000","last_undegraded":"2024-09-13T16:08:14.466409+0000","last_fullsized":"2024-09-13T16:08:14.466409+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:20.853764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617511+0000","last_change":"2024-09-13T16:08:09.225824+0000","last_active":"2024-09-13T16:08:13.617511+0000","last_peered":"2024-09-13T16:08:13.617511+0000","last_clean":"2024-09-13T16:08:13.617511+0000","last_became_active":"2024-09-13T16:08:09.225568+0000","last_became_peered":"2024-09-13T16:08:09.225568+0000","last_unstale":"2024-09-13T16:08:13.617511+0000","last_undegraded":"2024-09-13T16:08:13.617511+0000","last_fullsized":"2024-09-13T16:08:13.617511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:05:13.423381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.922333+0000","last_change":"2024-09-13T16:08:08.812752+0000","last_active":"2024-09-13T16:08:13.922333+0000","last_peered":"2024-09-13T16:08:13.922333+0000","last_clean":"2024-09-13T16:08:13.922333+0000","last_became_active":"2024-09-13T16:08:08.810994+0000","last_became_peered":"2024-09-13T16:08:08.810994+0000","last_unstale":"2024-09-13T16:08:13.922333+0000","last_undegraded":"2024-09-13T16:08:13.922333+0000","last_fullsized":"2024-09-13T16:08:13.922333+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:46.449871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617397+0000","last_change":"2024-09-13T16:08:13.494450+0000","last_active":"2024-09-13T16:08:13.617397+0000","last_peered":"2024-09-13T16:08:13.617397+0000","last_clean":"2024-09-13T16:08:13.617397+0000","last_became_active":"2024-09-13T16:08:13.494008+0000","last_became_peered":"2024-09-13T16:08:13.494008+0000","last_unstale":"2024-09-13T16:08:13.617397+0000","last_undegraded":"2024-09-13T16:08:13.617397+0000","last_fullsized":"2024-09-13T16:08:13.617397+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:05.427801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.240765+0000","last_change":"2024-09-13T16:08:09.220790+0000","last_active":"2024-09-13T16:08:13.240765+0000","last_peered":"2024-09-13T16:08:13.240765+0000","last_clean":"2024-09-13T16:08:13.240765+0000","last_became_active":"2024-09-13T16:08:09.219420+0000","last_became_peered":"2024-09-13T16:08:09.219420+0000","last_unstale":"2024-09-13T16:08:13.240765+0000","last_undegraded":"2024-09-13T16:08:13.240765+0000","last_fullsized":"2024-09-13T16:08:13.240765+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:29.674270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.436490+0000","last_change":"2024-09-13T16:08:08.815272+0000","last_active":"2024-09-13T16:08:30.436490+0000","last_peered":"2024-09-13T16:08:30.436490+0000","last_clean":"2024-09-13T16:08:30.436490+0000","last_became_active":"2024-09-13T16:08:08.815018+0000","last_became_peered":"2024-09-13T16:08:08.815018+0000","last_unstale":"2024-09-13T16:08:30.436490+0000","last_undegraded":"2024-09-13T16:08:30.436490+0000","last_fullsized":"2024-09-13T16:08:30.436490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:29.277253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.492181+0000","last_change":"2024-09-13T16:08:13.249856+0000","last_active":"2024-09-13T16:08:14.492181+0000","last_peered":"2024-09-13T16:08:14.492181+0000","last_clean":"2024-09-13T16:08:14.492181+0000","last_became_active":"2024-09-13T16:08:13.249433+0000","last_became_peered":"2024-09-13T16:08:13.249433+0000","last_unstale":"2024-09-13T16:08:14.492181+0000","last_undegraded":"2024-09-13T16:08:14.492181+0000","last_fullsized":"2024-09-13T16:08:14.492181+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:18.805858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.493038+0000","last_change":"2024-09-13T16:08:09.239244+0000","last_active":"2024-09-13T16:08:13.493038+0000","last_peered":"2024-09-13T16:08:13.493038+0000","last_clean":"2024-09-13T16:08:13.493038+0000","last_became_active":"2024-09-13T16:08:09.238966+0000","last_became_peered":"2024-09-13T16:08:09.238966+0000","last_unstale":"2024-09-13T16:08:13.493038+0000","last_undegraded":"2024-09-13T16:08:13.493038+0000","last_fullsized":"2024-09-13T16:08:13.493038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:16:48.832090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.228550+0000","last_change":"2024-09-13T16:08:08.813429+0000","last_active":"2024-09-13T16:08:13.228550+0000","last_peered":"2024-09-13T16:08:13.228550+0000","last_clean":"2024-09-13T16:08:13.228550+0000","last_became_active":"2024-09-13T16:08:08.810497+0000","last_became_peered":"2024-09-13T16:08:08.810497+0000","last_unstale":"2024-09-13T16:08:13.228550+0000","last_undegraded":"2024-09-13T16:08:13.228550+0000","last_fullsized":"2024-09-13T16:08:13.228550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:59.728094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.495036+0000","last_change":"2024-09-13T16:08:13.494341+0000","last_active":"2024-09-13T16:08:13.495036+0000","last_peered":"2024-09-13T16:08:13.495036+0000","last_clean":"2024-09-13T16:08:13.495036+0000","last_became_active":"2024-09-13T16:08:13.493851+0000","last_became_peered":"2024-09-13T16:08:13.493851+0000","last_unstale":"2024-09-13T16:08:13.495036+0000","last_undegraded":"2024-09-13T16:08:13.495036+0000","last_fullsized":"2024-09-13T16:08:13.495036+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:27.389086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.492889+0000","last_change":"2024-09-13T16:08:09.241722+0000","last_active":"2024-09-13T16:08:13.492889+0000","last_peered":"2024-09-13T16:08:13.492889+0000","last_clean":"2024-09-13T16:08:13.492889+0000","last_became_active":"2024-09-13T16:08:09.241270+0000","last_became_peered":"2024-09-13T16:08:09.241270+0000","last_unstale":"2024-09-13T16:08:13.492889+0000","last_undegraded":"2024-09-13T16:08:13.492889+0000","last_fullsized":"2024-09-13T16:08:13.492889+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:38.909163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.220371+0000","last_change":"2024-09-13T16:08:08.807099+0000","last_active":"2024-09-13T16:08:14.220371+0000","last_peered":"2024-09-13T16:08:14.220371+0000","last_clean":"2024-09-13T16:08:14.220371+0000","last_became_active":"2024-09-13T16:08:08.806760+0000","last_became_peered":"2024-09-13T16:08:08.806760+0000","last_unstale":"2024-09-13T16:08:14.220371+0000","last_undegraded":"2024-09-13T16:08:14.220371+0000","last_fullsized":"2024-09-13T16:08:14.220371+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:31.077377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.662212+0000","last_change":"2024-09-13T16:08:13.258033+0000","last_active":"2024-09-13T16:08:13.662212+0000","last_peered":"2024-09-13T16:08:13.662212+0000","last_clean":"2024-09-13T16:08:13.662212+0000","last_became_active":"2024-09-13T16:08:13.257195+0000","last_became_peered":"2024-09-13T16:08:13.257195+0000","last_unstale":"2024-09-13T16:08:13.662212+0000","last_undegraded":"2024-09-13T16:08:13.662212+0000","last_fullsized":"2024-09-13T16:08:13.662212+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:38.599985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.236403+0000","last_change":"2024-09-13T16:08:09.223766+0000","last_active":"2024-09-13T16:08:13.236403+0000","last_peered":"2024-09-13T16:08:13.236403+0000","last_clean":"2024-09-13T16:08:13.236403+0000","last_became_active":"2024-09-13T16:08:09.223485+0000","last_became_peered":"2024-09-13T16:08:09.223485+0000","last_unstale":"2024-09-13T16:08:13.236403+0000","last_undegraded":"2024-09-13T16:08:13.236403+0000","last_fullsized":"2024-09-13T16:08:13.236403+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:32.222545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:33.456396+0000","last_change":"2024-09-13T16:08:08.812793+0000","last_active":"2024-09-13T16:08:33.456396+0000","last_peered":"2024-09-13T16:08:33.456396+0000","last_clean":"2024-09-13T16:08:33.456396+0000","last_became_active":"2024-09-13T16:08:08.811513+0000","last_became_peered":"2024-09-13T16:08:08.811513+0000","last_unstale":"2024-09-13T16:08:33.456396+0000","last_undegraded":"2024-09-13T16:08:33.456396+0000","last_fullsized":"2024-09-13T16:08:33.456396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:42.396184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.662292+0000","last_change":"2024-09-13T16:08:13.494286+0000","last_active":"2024-09-13T16:08:13.662292+0000","last_peered":"2024-09-13T16:08:13.662292+0000","last_clean":"2024-09-13T16:08:13.662292+0000","last_became_active":"2024-09-13T16:08:13.493848+0000","last_became_peered":"2024-09-13T16:08:13.493848+0000","last_unstale":"2024-09-13T16:08:13.662292+0000","last_undegraded":"2024-09-13T16:08:13.662292+0000","last_fullsized":"2024-09-13T16:08:13.662292+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:45.466478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.238786+0000","last_change":"2024-09-13T16:08:09.216137+0000","last_active":"2024-09-13T16:08:13.238786+0000","last_peered":"2024-09-13T16:08:13.238786+0000","last_clean":"2024-09-13T16:08:13.238786+0000","last_became_active":"2024-09-13T16:08:09.215801+0000","last_became_peered":"2024-09-13T16:08:09.215801+0000","last_unstale":"2024-09-13T16:08:13.238786+0000","last_undegraded":"2024-09-13T16:08:13.238786+0000","last_fullsized":"2024-09-13T16:08:13.238786+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:58.860711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:31.449252+0000","last_change":"2024-09-13T16:08:08.804138+0000","last_active":"2024-09-13T16:08:31.449252+0000","last_peered":"2024-09-13T16:08:31.449252+0000","last_clean":"2024-09-13T16:08:31.449252+0000","last_became_active":"2024-09-13T16:08:08.803812+0000","last_became_peered":"2024-09-13T16:08:08.803812+0000","last_unstale":"2024-09-13T16:08:31.449252+0000","last_undegraded":"2024-09-13T16:08:31.449252+0000","last_fullsized":"2024-09-13T16:08:31.449252+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:39.388227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.492987+0000","last_change":"2024-09-13T16:08:13.494259+0000","last_active":"2024-09-13T16:08:14.492987+0000","last_peered":"2024-09-13T16:08:14.492987+0000","last_clean":"2024-09-13T16:08:14.492987+0000","last_became_active":"2024-09-13T16:08:13.493792+0000","last_became_peered":"2024-09-13T16:08:13.493792+0000","last_unstale":"2024-09-13T16:08:14.492987+0000","last_undegraded":"2024-09-13T16:08:14.492987+0000","last_fullsized":"2024-09-13T16:08:14.492987+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:03:12.977792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617471+0000","last_change":"2024-09-13T16:08:09.226177+0000","last_active":"2024-09-13T16:08:13.617471+0000","last_peered":"2024-09-13T16:08:13.617471+0000","last_clean":"2024-09-13T16:08:13.617471+0000","last_became_active":"2024-09-13T16:08:09.225334+0000","last_became_peered":"2024-09-13T16:08:09.225334+0000","last_unstale":"2024-09-13T16:08:13.617471+0000","last_undegraded":"2024-09-13T16:08:13.617471+0000","last_fullsized":"2024-09-13T16:08:13.617471+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:15.539497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:32.451638+0000","last_change":"2024-09-13T16:08:08.807616+0000","last_active":"2024-09-13T16:08:32.451638+0000","last_peered":"2024-09-13T16:08:32.451638+0000","last_clean":"2024-09-13T16:08:32.451638+0000","last_became_active":"2024-09-13T16:08:08.807234+0000","last_became_peered":"2024-09-13T16:08:08.807234+0000","last_unstale":"2024-09-13T16:08:32.451638+0000","last_undegraded":"2024-09-13T16:08:32.451638+0000","last_fullsized":"2024-09-13T16:08:32.451638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:16.270075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":331,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.232265+0000","last_change":"2024-09-13T16:06:54.461102+0000","last_active":"2024-09-13T16:08:13.232265+0000","last_peered":"2024-09-13T16:08:13.232265+0000","last_clean":"2024-09-13T16:08:13.232265+0000","last_became_active":"2024-09-13T16:06:54.460531+0000","last_became_peered":"2024-09-13T16:06:54.460531+0000","last_unstale":"2024-09-13T16:08:13.232265+0000","last_undegraded":"2024-09-13T16:08:13.232265+0000","last_fullsized":"2024-09-13T16:08:13.232265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:03:28.200529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:03:28.200529+0000","last_clean_scrub_stamp":"2024-09-13T16:03:28.200529+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:30.260436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.220482+0000","last_change":"2024-09-13T16:08:13.246406+0000","last_active":"2024-09-13T16:08:14.220482+0000","last_peered":"2024-09-13T16:08:14.220482+0000","last_clean":"2024-09-13T16:08:14.220482+0000","last_became_active":"2024-09-13T16:08:13.246026+0000","last_became_peered":"2024-09-13T16:08:13.246026+0000","last_unstale":"2024-09-13T16:08:14.220482+0000","last_undegraded":"2024-09-13T16:08:14.220482+0000","last_fullsized":"2024-09-13T16:08:14.220482+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:28.665873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.428851+0000","last_change":"2024-09-13T16:08:09.233241+0000","last_active":"2024-09-13T16:08:13.428851+0000","last_peered":"2024-09-13T16:08:13.428851+0000","last_clean":"2024-09-13T16:08:13.428851+0000","last_became_active":"2024-09-13T16:08:09.232948+0000","last_became_peered":"2024-09-13T16:08:09.232948+0000","last_unstale":"2024-09-13T16:08:13.428851+0000","last_undegraded":"2024-09-13T16:08:13.428851+0000","last_fullsized":"2024-09-13T16:08:13.428851+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:09:45.475066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.229909+0000","last_change":"2024-09-13T16:08:08.808529+0000","last_active":"2024-09-13T16:08:13.229909+0000","last_peered":"2024-09-13T16:08:13.229909+0000","last_clean":"2024-09-13T16:08:13.229909+0000","last_became_active":"2024-09-13T16:08:08.808147+0000","last_became_peered":"2024-09-13T16:08:08.808147+0000","last_unstale":"2024-09-13T16:08:13.229909+0000","last_undegraded":"2024-09-13T16:08:13.229909+0000","last_fullsized":"2024-09-13T16:08:13.229909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:20.003116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.662162+0000","last_change":"2024-09-13T16:08:13.254834+0000","last_active":"2024-09-13T16:08:13.662162+0000","last_peered":"2024-09-13T16:08:13.662162+0000","last_clean":"2024-09-13T16:08:13.662162+0000","last_became_active":"2024-09-13T16:08:13.254367+0000","last_became_peered":"2024-09-13T16:08:13.254367+0000","last_unstale":"2024-09-13T16:08:13.662162+0000","last_undegraded":"2024-09-13T16:08:13.662162+0000","last_fullsized":"2024-09-13T16:08:13.662162+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:41.300674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.428799+0000","last_change":"2024-09-13T16:08:09.236082+0000","last_active":"2024-09-13T16:08:13.428799+0000","last_peered":"2024-09-13T16:08:13.428799+0000","last_clean":"2024-09-13T16:08:13.428799+0000","last_became_active":"2024-09-13T16:08:09.235750+0000","last_became_peered":"2024-09-13T16:08:09.235750+0000","last_unstale":"2024-09-13T16:08:13.428799+0000","last_undegraded":"2024-09-13T16:08:13.428799+0000","last_fullsized":"2024-09-13T16:08:13.428799+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:32.953680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.237101+0000","last_change":"2024-09-13T16:08:08.804210+0000","last_active":"2024-09-13T16:08:13.237101+0000","last_peered":"2024-09-13T16:08:13.237101+0000","last_clean":"2024-09-13T16:08:13.237101+0000","last_became_active":"2024-09-13T16:08:08.803910+0000","last_became_peered":"2024-09-13T16:08:08.803910+0000","last_unstale":"2024-09-13T16:08:13.237101+0000","last_undegraded":"2024-09-13T16:08:13.237101+0000","last_fullsized":"2024-09-13T16:08:13.237101+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:43.572010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.491945+0000","last_change":"2024-09-13T16:08:13.252873+0000","last_active":"2024-09-13T16:08:14.491945+0000","last_peered":"2024-09-13T16:08:14.491945+0000","last_clean":"2024-09-13T16:08:14.491945+0000","last_became_active":"2024-09-13T16:08:13.252051+0000","last_became_peered":"2024-09-13T16:08:13.252051+0000","last_unstale":"2024-09-13T16:08:14.491945+0000","last_undegraded":"2024-09-13T16:08:14.491945+0000","last_fullsized":"2024-09-13T16:08:14.491945+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:28.163552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.428868+0000","last_change":"2024-09-13T16:08:09.228033+0000","last_active":"2024-09-13T16:08:13.428868+0000","last_peered":"2024-09-13T16:08:13.428868+0000","last_clean":"2024-09-13T16:08:13.428868+0000","last_became_active":"2024-09-13T16:08:09.227741+0000","last_became_peered":"2024-09-13T16:08:09.227741+0000","last_unstale":"2024-09-13T16:08:13.428868+0000","last_undegraded":"2024-09-13T16:08:13.428868+0000","last_fullsized":"2024-09-13T16:08:13.428868+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:49.607147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.248534+0000","last_change":"2024-09-13T16:08:08.812963+0000","last_active":"2024-09-13T16:08:13.248534+0000","last_peered":"2024-09-13T16:08:13.248534+0000","last_clean":"2024-09-13T16:08:13.248534+0000","last_became_active":"2024-09-13T16:08:08.812627+0000","last_became_peered":"2024-09-13T16:08:08.812627+0000","last_unstale":"2024-09-13T16:08:13.248534+0000","last_undegraded":"2024-09-13T16:08:13.248534+0000","last_fullsized":"2024-09-13T16:08:13.248534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:11.237846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.491804+0000","last_change":"2024-09-13T16:08:13.242146+0000","last_active":"2024-09-13T16:08:14.491804+0000","last_peered":"2024-09-13T16:08:14.491804+0000","last_clean":"2024-09-13T16:08:14.491804+0000","last_became_active":"2024-09-13T16:08:13.241794+0000","last_became_peered":"2024-09-13T16:08:13.241794+0000","last_unstale":"2024-09-13T16:08:14.491804+0000","last_undegraded":"2024-09-13T16:08:14.491804+0000","last_fullsized":"2024-09-13T16:08:14.491804+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:55.392157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.234394+0000","last_change":"2024-09-13T16:08:09.221415+0000","last_active":"2024-09-13T16:08:13.234394+0000","last_peered":"2024-09-13T16:08:13.234394+0000","last_clean":"2024-09-13T16:08:13.234394+0000","last_became_active":"2024-09-13T16:08:09.221121+0000","last_became_peered":"2024-09-13T16:08:09.221121+0000","last_unstale":"2024-09-13T16:08:13.234394+0000","last_undegraded":"2024-09-13T16:08:13.234394+0000","last_fullsized":"2024-09-13T16:08:13.234394+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:37.839721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.924743+0000","last_change":"2024-09-13T16:08:08.805604+0000","last_active":"2024-09-13T16:08:13.924743+0000","last_peered":"2024-09-13T16:08:13.924743+0000","last_clean":"2024-09-13T16:08:13.924743+0000","last_became_active":"2024-09-13T16:08:08.805285+0000","last_became_peered":"2024-09-13T16:08:08.805285+0000","last_unstale":"2024-09-13T16:08:13.924743+0000","last_undegraded":"2024-09-13T16:08:13.924743+0000","last_fullsized":"2024-09-13T16:08:13.924743+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:53.534980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.491992+0000","last_change":"2024-09-13T16:08:13.253080+0000","last_active":"2024-09-13T16:08:14.491992+0000","last_peered":"2024-09-13T16:08:14.491992+0000","last_clean":"2024-09-13T16:08:14.491992+0000","last_became_active":"2024-09-13T16:08:13.252803+0000","last_became_peered":"2024-09-13T16:08:13.252803+0000","last_unstale":"2024-09-13T16:08:14.491992+0000","last_undegraded":"2024-09-13T16:08:14.491992+0000","last_fullsized":"2024-09-13T16:08:14.491992+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:45.074295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.236171+0000","last_change":"2024-09-13T16:08:09.226784+0000","last_active":"2024-09-13T16:08:13.236171+0000","last_peered":"2024-09-13T16:08:13.236171+0000","last_clean":"2024-09-13T16:08:13.236171+0000","last_became_active":"2024-09-13T16:08:09.226464+0000","last_became_peered":"2024-09-13T16:08:09.226464+0000","last_unstale":"2024-09-13T16:08:13.236171+0000","last_undegraded":"2024-09-13T16:08:13.236171+0000","last_fullsized":"2024-09-13T16:08:13.236171+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:42.808510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:31.451604+0000","last_change":"2024-09-13T16:08:08.814647+0000","last_active":"2024-09-13T16:08:31.451604+0000","last_peered":"2024-09-13T16:08:31.451604+0000","last_clean":"2024-09-13T16:08:31.451604+0000","last_became_active":"2024-09-13T16:08:08.814325+0000","last_became_peered":"2024-09-13T16:08:08.814325+0000","last_unstale":"2024-09-13T16:08:31.451604+0000","last_undegraded":"2024-09-13T16:08:31.451604+0000","last_fullsized":"2024-09-13T16:08:31.451604+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:15.358731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.662308+0000","last_change":"2024-09-13T16:08:13.259693+0000","last_active":"2024-09-13T16:08:13.662308+0000","last_peered":"2024-09-13T16:08:13.662308+0000","last_clean":"2024-09-13T16:08:13.662308+0000","last_became_active":"2024-09-13T16:08:13.254908+0000","last_became_peered":"2024-09-13T16:08:13.254908+0000","last_unstale":"2024-09-13T16:08:13.662308+0000","last_undegraded":"2024-09-13T16:08:13.662308+0000","last_fullsized":"2024-09-13T16:08:13.662308+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:57.130633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.428680+0000","last_change":"2024-09-13T16:08:09.231371+0000","last_active":"2024-09-13T16:08:13.428680+0000","last_peered":"2024-09-13T16:08:13.428680+0000","last_clean":"2024-09-13T16:08:13.428680+0000","last_became_active":"2024-09-13T16:08:09.231054+0000","last_became_peered":"2024-09-13T16:08:09.231054+0000","last_unstale":"2024-09-13T16:08:13.428680+0000","last_undegraded":"2024-09-13T16:08:13.428680+0000","last_fullsized":"2024-09-13T16:08:13.428680+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:59.921297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:33.457077+0000","last_change":"2024-09-13T16:08:08.803541+0000","last_active":"2024-09-13T16:08:33.457077+0000","last_peered":"2024-09-13T16:08:33.457077+0000","last_clean":"2024-09-13T16:08:33.457077+0000","last_became_active":"2024-09-13T16:08:08.803183+0000","last_became_peered":"2024-09-13T16:08:08.803183+0000","last_unstale":"2024-09-13T16:08:33.457077+0000","last_undegraded":"2024-09-13T16:08:33.457077+0000","last_fullsized":"2024-09-13T16:08:33.457077+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:09.210442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":932,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.922250+0000","last_change":"2024-09-13T16:08:13.259229+0000","last_active":"2024-09-13T16:08:13.922250+0000","last_peered":"2024-09-13T16:08:13.922250+0000","last_clean":"2024-09-13T16:08:13.922250+0000","last_became_active":"2024-09-13T16:08:13.258625+0000","last_became_peered":"2024-09-13T16:08:13.258625+0000","last_unstale":"2024-09-13T16:08:13.922250+0000","last_undegraded":"2024-09-13T16:08:13.922250+0000","last_fullsized":"2024-09-13T16:08:13.922250+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:09.660175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.428781+0000","last_change":"2024-09-13T16:08:09.229192+0000","last_active":"2024-09-13T16:08:13.428781+0000","last_peered":"2024-09-13T16:08:13.428781+0000","last_clean":"2024-09-13T16:08:13.428781+0000","last_became_active":"2024-09-13T16:08:09.227639+0000","last_became_peered":"2024-09-13T16:08:09.227639+0000","last_unstale":"2024-09-13T16:08:13.428781+0000","last_undegraded":"2024-09-13T16:08:13.428781+0000","last_fullsized":"2024-09-13T16:08:13.428781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:59.646494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.436741+0000","last_change":"2024-09-13T16:08:08.803645+0000","last_active":"2024-09-13T16:08:30.436741+0000","last_peered":"2024-09-13T16:08:30.436741+0000","last_clean":"2024-09-13T16:08:30.436741+0000","last_became_active":"2024-09-13T16:08:08.803248+0000","last_became_peered":"2024-09-13T16:08:08.803248+0000","last_unstale":"2024-09-13T16:08:30.436741+0000","last_undegraded":"2024-09-13T16:08:30.436741+0000","last_fullsized":"2024-09-13T16:08:30.436741+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:34.875141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.492619+0000","last_change":"2024-09-13T16:08:13.256058+0000","last_active":"2024-09-13T16:08:14.492619+0000","last_peered":"2024-09-13T16:08:14.492619+0000","last_clean":"2024-09-13T16:08:14.492619+0000","last_became_active":"2024-09-13T16:08:13.255760+0000","last_became_peered":"2024-09-13T16:08:13.255760+0000","last_unstale":"2024-09-13T16:08:14.492619+0000","last_undegraded":"2024-09-13T16:08:14.492619+0000","last_fullsized":"2024-09-13T16:08:14.492619+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:58.830340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.240066+0000","last_change":"2024-09-13T16:08:09.222978+0000","last_active":"2024-09-13T16:08:13.240066+0000","last_peered":"2024-09-13T16:08:13.240066+0000","last_clean":"2024-09-13T16:08:13.240066+0000","last_became_active":"2024-09-13T16:08:09.222646+0000","last_became_peered":"2024-09-13T16:08:09.222646+0000","last_unstale":"2024-09-13T16:08:13.240066+0000","last_undegraded":"2024-09-13T16:08:13.240066+0000","last_fullsized":"2024-09-13T16:08:13.240066+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:05.335298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"90'4","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.435355+0000","last_change":"2024-09-13T16:08:08.820187+0000","last_active":"2024-09-13T16:08:30.435355+0000","last_peered":"2024-09-13T16:08:30.435355+0000","last_clean":"2024-09-13T16:08:30.435355+0000","last_became_active":"2024-09-13T16:08:08.819825+0000","last_became_peered":"2024-09-13T16:08:08.819825+0000","last_unstale":"2024-09-13T16:08:30.435355+0000","last_undegraded":"2024-09-13T16:08:30.435355+0000","last_fullsized":"2024-09-13T16:08:30.435355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:13.175211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.492908+0000","last_change":"2024-09-13T16:08:13.247359+0000","last_active":"2024-09-13T16:08:14.492908+0000","last_peered":"2024-09-13T16:08:14.492908+0000","last_clean":"2024-09-13T16:08:14.492908+0000","last_became_active":"2024-09-13T16:08:13.247000+0000","last_became_peered":"2024-09-13T16:08:13.247000+0000","last_unstale":"2024-09-13T16:08:14.492908+0000","last_undegraded":"2024-09-13T16:08:14.492908+0000","last_fullsized":"2024-09-13T16:08:14.492908+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:24.447814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.236253+0000","last_change":"2024-09-13T16:08:09.235838+0000","last_active":"2024-09-13T16:08:13.236253+0000","last_peered":"2024-09-13T16:08:13.236253+0000","last_clean":"2024-09-13T16:08:13.236253+0000","last_became_active":"2024-09-13T16:08:09.235545+0000","last_became_peered":"2024-09-13T16:08:09.235545+0000","last_unstale":"2024-09-13T16:08:13.236253+0000","last_undegraded":"2024-09-13T16:08:13.236253+0000","last_fullsized":"2024-09-13T16:08:13.236253+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.842273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'12","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.435747+0000","last_change":"2024-09-13T16:08:08.798172+0000","last_active":"2024-09-13T16:08:30.435747+0000","last_peered":"2024-09-13T16:08:30.435747+0000","last_clean":"2024-09-13T16:08:30.435747+0000","last_became_active":"2024-09-13T16:08:08.797852+0000","last_became_peered":"2024-09-13T16:08:08.797852+0000","last_unstale":"2024-09-13T16:08:30.435747+0000","last_undegraded":"2024-09-13T16:08:30.435747+0000","last_fullsized":"2024-09-13T16:08:30.435747+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:19.455595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.921831+0000","last_change":"2024-09-13T16:08:13.246905+0000","last_active":"2024-09-13T16:08:13.921831+0000","last_peered":"2024-09-13T16:08:13.921831+0000","last_clean":"2024-09-13T16:08:13.921831+0000","last_became_active":"2024-09-13T16:08:13.246446+0000","last_became_peered":"2024-09-13T16:08:13.246446+0000","last_unstale":"2024-09-13T16:08:13.921831+0000","last_undegraded":"2024-09-13T16:08:13.921831+0000","last_fullsized":"2024-09-13T16:08:13.921831+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:10.282057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.236002+0000","last_change":"2024-09-13T16:08:09.223545+0000","last_active":"2024-09-13T16:08:13.236002+0000","last_peered":"2024-09-13T16:08:13.236002+0000","last_clean":"2024-09-13T16:08:13.236002+0000","last_became_active":"2024-09-13T16:08:09.223224+0000","last_became_peered":"2024-09-13T16:08:09.223224+0000","last_unstale":"2024-09-13T16:08:13.236002+0000","last_undegraded":"2024-09-13T16:08:13.236002+0000","last_fullsized":"2024-09-13T16:08:13.236002+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:43.886882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.493023+0000","last_change":"2024-09-13T16:08:08.811078+0000","last_active":"2024-09-13T16:08:14.493023+0000","last_peered":"2024-09-13T16:08:14.493023+0000","last_clean":"2024-09-13T16:08:14.493023+0000","last_became_active":"2024-09-13T16:08:08.810743+0000","last_became_peered":"2024-09-13T16:08:08.810743+0000","last_unstale":"2024-09-13T16:08:14.493023+0000","last_undegraded":"2024-09-13T16:08:14.493023+0000","last_fullsized":"2024-09-13T16:08:14.493023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:48.355869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.510992+0000","last_change":"2024-09-13T16:08:13.243634+0000","last_active":"2024-09-13T16:08:13.510992+0000","last_peered":"2024-09-13T16:08:13.510992+0000","last_clean":"2024-09-13T16:08:13.510992+0000","last_became_active":"2024-09-13T16:08:13.243283+0000","last_became_peered":"2024-09-13T16:08:13.243283+0000","last_unstale":"2024-09-13T16:08:13.510992+0000","last_undegraded":"2024-09-13T16:08:13.510992+0000","last_fullsized":"2024-09-13T16:08:13.510992+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:50.226378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.249885+0000","last_change":"2024-09-13T16:08:09.236851+0000","last_active":"2024-09-13T16:08:13.249885+0000","last_peered":"2024-09-13T16:08:13.249885+0000","last_clean":"2024-09-13T16:08:13.249885+0000","last_became_active":"2024-09-13T16:08:09.233841+0000","last_became_peered":"2024-09-13T16:08:09.233841+0000","last_unstale":"2024-09-13T16:08:13.249885+0000","last_undegraded":"2024-09-13T16:08:13.249885+0000","last_fullsized":"2024-09-13T16:08:13.249885+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.543328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.435973+0000","last_change":"2024-09-13T16:08:08.804942+0000","last_active":"2024-09-13T16:08:30.435973+0000","last_peered":"2024-09-13T16:08:30.435973+0000","last_clean":"2024-09-13T16:08:30.435973+0000","last_became_active":"2024-09-13T16:08:08.804618+0000","last_became_peered":"2024-09-13T16:08:08.804618+0000","last_unstale":"2024-09-13T16:08:30.435973+0000","last_undegraded":"2024-09-13T16:08:30.435973+0000","last_fullsized":"2024-09-13T16:08:30.435973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:54.798241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.921704+0000","last_change":"2024-09-13T16:08:13.255246+0000","last_active":"2024-09-13T16:08:13.921704+0000","last_peered":"2024-09-13T16:08:13.921704+0000","last_clean":"2024-09-13T16:08:13.921704+0000","last_became_active":"2024-09-13T16:08:13.249738+0000","last_became_peered":"2024-09-13T16:08:13.249738+0000","last_unstale":"2024-09-13T16:08:13.921704+0000","last_undegraded":"2024-09-13T16:08:13.921704+0000","last_fullsized":"2024-09-13T16:08:13.921704+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:59.917028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.237997+0000","last_change":"2024-09-13T16:08:09.232237+0000","last_active":"2024-09-13T16:08:13.237997+0000","last_peered":"2024-09-13T16:08:13.237997+0000","last_clean":"2024-09-13T16:08:13.237997+0000","last_became_active":"2024-09-13T16:08:09.231936+0000","last_became_peered":"2024-09-13T16:08:09.231936+0000","last_unstale":"2024-09-13T16:08:13.237997+0000","last_undegraded":"2024-09-13T16:08:13.237997+0000","last_fullsized":"2024-09-13T16:08:13.237997+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:14.154719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.436500+0000","last_change":"2024-09-13T16:08:08.807354+0000","last_active":"2024-09-13T16:08:30.436500+0000","last_peered":"2024-09-13T16:08:30.436500+0000","last_clean":"2024-09-13T16:08:30.436500+0000","last_became_active":"2024-09-13T16:08:08.807040+0000","last_became_peered":"2024-09-13T16:08:08.807040+0000","last_unstale":"2024-09-13T16:08:30.436500+0000","last_undegraded":"2024-09-13T16:08:30.436500+0000","last_fullsized":"2024-09-13T16:08:30.436500+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:38.861647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617430+0000","last_change":"2024-09-13T16:08:13.243743+0000","last_active":"2024-09-13T16:08:13.617430+0000","last_peered":"2024-09-13T16:08:13.617430+0000","last_clean":"2024-09-13T16:08:13.617430+0000","last_became_active":"2024-09-13T16:08:13.243197+0000","last_became_peered":"2024-09-13T16:08:13.243197+0000","last_unstale":"2024-09-13T16:08:13.617430+0000","last_undegraded":"2024-09-13T16:08:13.617430+0000","last_fullsized":"2024-09-13T16:08:13.617430+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:53.731019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.492180+0000","last_change":"2024-09-13T16:08:13.255518+0000","last_active":"2024-09-13T16:08:14.492180+0000","last_peered":"2024-09-13T16:08:14.492180+0000","last_clean":"2024-09-13T16:08:14.492180+0000","last_became_active":"2024-09-13T16:08:13.255082+0000","last_became_peered":"2024-09-13T16:08:13.255082+0000","last_unstale":"2024-09-13T16:08:14.492180+0000","last_undegraded":"2024-09-13T16:08:14.492180+0000","last_fullsized":"2024-09-13T16:08:14.492180+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:09.010691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.229197+0000","last_change":"2024-09-13T16:08:09.231940+0000","last_active":"2024-09-13T16:08:13.229197+0000","last_peered":"2024-09-13T16:08:13.229197+0000","last_clean":"2024-09-13T16:08:13.229197+0000","last_became_active":"2024-09-13T16:08:09.231587+0000","last_became_peered":"2024-09-13T16:08:09.231587+0000","last_unstale":"2024-09-13T16:08:13.229197+0000","last_undegraded":"2024-09-13T16:08:13.229197+0000","last_fullsized":"2024-09-13T16:08:13.229197+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:40.508328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.492436+0000","last_change":"2024-09-13T16:08:08.803903+0000","last_active":"2024-09-13T16:08:14.492436+0000","last_peered":"2024-09-13T16:08:14.492436+0000","last_clean":"2024-09-13T16:08:14.492436+0000","last_became_active":"2024-09-13T16:08:08.803412+0000","last_became_peered":"2024-09-13T16:08:08.803412+0000","last_unstale":"2024-09-13T16:08:14.492436+0000","last_undegraded":"2024-09-13T16:08:14.492436+0000","last_fullsized":"2024-09-13T16:08:14.492436+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:20.472012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.492723+0000","last_change":"2024-09-13T16:08:13.258590+0000","last_active":"2024-09-13T16:08:14.492723+0000","last_peered":"2024-09-13T16:08:14.492723+0000","last_clean":"2024-09-13T16:08:14.492723+0000","last_became_active":"2024-09-13T16:08:13.258181+0000","last_became_peered":"2024-09-13T16:08:13.258181+0000","last_unstale":"2024-09-13T16:08:14.492723+0000","last_undegraded":"2024-09-13T16:08:14.492723+0000","last_fullsized":"2024-09-13T16:08:14.492723+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:36.631501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617421+0000","last_change":"2024-09-13T16:08:09.228506+0000","last_active":"2024-09-13T16:08:13.617421+0000","last_peered":"2024-09-13T16:08:13.617421+0000","last_clean":"2024-09-13T16:08:13.617421+0000","last_became_active":"2024-09-13T16:08:09.226565+0000","last_became_peered":"2024-09-13T16:08:09.226565+0000","last_unstale":"2024-09-13T16:08:13.617421+0000","last_undegraded":"2024-09-13T16:08:13.617421+0000","last_fullsized":"2024-09-13T16:08:13.617421+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:46.333106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:31.452532+0000","last_change":"2024-09-13T16:08:08.807615+0000","last_active":"2024-09-13T16:08:31.452532+0000","last_peered":"2024-09-13T16:08:31.452532+0000","last_clean":"2024-09-13T16:08:31.452532+0000","last_became_active":"2024-09-13T16:08:08.807318+0000","last_became_peered":"2024-09-13T16:08:08.807318+0000","last_unstale":"2024-09-13T16:08:31.452532+0000","last_undegraded":"2024-09-13T16:08:31.452532+0000","last_fullsized":"2024-09-13T16:08:31.452532+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:36.901859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.492815+0000","last_change":"2024-09-13T16:08:08.806438+0000","last_active":"2024-09-13T16:08:13.492815+0000","last_peered":"2024-09-13T16:08:13.492815+0000","last_clean":"2024-09-13T16:08:13.492815+0000","last_became_active":"2024-09-13T16:08:08.806109+0000","last_became_peered":"2024-09-13T16:08:08.806109+0000","last_unstale":"2024-09-13T16:08:13.492815+0000","last_undegraded":"2024-09-13T16:08:13.492815+0000","last_fullsized":"2024-09-13T16:08:13.492815+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:31.862771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.236487+0000","last_change":"2024-09-13T16:08:09.228933+0000","last_active":"2024-09-13T16:08:13.236487+0000","last_peered":"2024-09-13T16:08:13.236487+0000","last_clean":"2024-09-13T16:08:13.236487+0000","last_became_active":"2024-09-13T16:08:09.228613+0000","last_became_peered":"2024-09-13T16:08:09.228613+0000","last_unstale":"2024-09-13T16:08:13.236487+0000","last_undegraded":"2024-09-13T16:08:13.236487+0000","last_fullsized":"2024-09-13T16:08:13.236487+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:25.110672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.466589+0000","last_change":"2024-09-13T16:08:13.244314+0000","last_active":"2024-09-13T16:08:14.466589+0000","last_peered":"2024-09-13T16:08:14.466589+0000","last_clean":"2024-09-13T16:08:14.466589+0000","last_became_active":"2024-09-13T16:08:13.243895+0000","last_became_peered":"2024-09-13T16:08:13.243895+0000","last_unstale":"2024-09-13T16:08:14.466589+0000","last_undegraded":"2024-09-13T16:08:14.466589+0000","last_fullsized":"2024-09-13T16:08:14.466589+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:54.639780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.436332+0000","last_change":"2024-09-13T16:08:08.803669+0000","last_active":"2024-09-13T16:08:30.436332+0000","last_peered":"2024-09-13T16:08:30.436332+0000","last_clean":"2024-09-13T16:08:30.436332+0000","last_became_active":"2024-09-13T16:08:08.803319+0000","last_became_peered":"2024-09-13T16:08:08.803319+0000","last_unstale":"2024-09-13T16:08:30.436332+0000","last_undegraded":"2024-09-13T16:08:30.436332+0000","last_fullsized":"2024-09-13T16:08:30.436332+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:05.791715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.236482+0000","last_change":"2024-09-13T16:08:09.225131+0000","last_active":"2024-09-13T16:08:13.236482+0000","last_peered":"2024-09-13T16:08:13.236482+0000","last_clean":"2024-09-13T16:08:13.236482+0000","last_became_active":"2024-09-13T16:08:09.224705+0000","last_became_peered":"2024-09-13T16:08:09.224705+0000","last_unstale":"2024-09-13T16:08:13.236482+0000","last_undegraded":"2024-09-13T16:08:13.236482+0000","last_fullsized":"2024-09-13T16:08:13.236482+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:54.676364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.466685+0000","last_change":"2024-09-13T16:08:13.240680+0000","last_active":"2024-09-13T16:08:14.466685+0000","last_peered":"2024-09-13T16:08:14.466685+0000","last_clean":"2024-09-13T16:08:14.466685+0000","last_became_active":"2024-09-13T16:08:13.240296+0000","last_became_peered":"2024-09-13T16:08:13.240296+0000","last_unstale":"2024-09-13T16:08:14.466685+0000","last_undegraded":"2024-09-13T16:08:14.466685+0000","last_fullsized":"2024-09-13T16:08:14.466685+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:32.990479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.234416+0000","last_change":"2024-09-13T16:08:09.221827+0000","last_active":"2024-09-13T16:08:13.234416+0000","last_peered":"2024-09-13T16:08:13.234416+0000","last_clean":"2024-09-13T16:08:13.234416+0000","last_became_active":"2024-09-13T16:08:09.220698+0000","last_became_peered":"2024-09-13T16:08:09.220698+0000","last_unstale":"2024-09-13T16:08:13.234416+0000","last_undegraded":"2024-09-13T16:08:13.234416+0000","last_fullsized":"2024-09-13T16:08:13.234416+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:17.721497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.229277+0000","last_change":"2024-09-13T16:08:09.217094+0000","last_active":"2024-09-13T16:08:13.229277+0000","last_peered":"2024-09-13T16:08:13.229277+0000","last_clean":"2024-09-13T16:08:13.229277+0000","last_became_active":"2024-09-13T16:08:09.216775+0000","last_became_peered":"2024-09-13T16:08:09.216775+0000","last_unstale":"2024-09-13T16:08:13.229277+0000","last_undegraded":"2024-09-13T16:08:13.229277+0000","last_fullsized":"2024-09-13T16:08:13.229277+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:32.350130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.229056+0000","last_change":"2024-09-13T16:08:09.227411+0000","last_active":"2024-09-13T16:08:13.229056+0000","last_peered":"2024-09-13T16:08:13.229056+0000","last_clean":"2024-09-13T16:08:13.229056+0000","last_became_active":"2024-09-13T16:08:09.227142+0000","last_became_peered":"2024-09-13T16:08:09.227142+0000","last_unstale":"2024-09-13T16:08:13.229056+0000","last_undegraded":"2024-09-13T16:08:13.229056+0000","last_fullsized":"2024-09-13T16:08:13.229056+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:46.883864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.251561+0000","last_change":"2024-09-13T16:08:09.229160+0000","last_active":"2024-09-13T16:08:13.251561+0000","last_peered":"2024-09-13T16:08:13.251561+0000","last_clean":"2024-09-13T16:08:13.251561+0000","last_became_active":"2024-09-13T16:08:09.228843+0000","last_became_peered":"2024-09-13T16:08:09.228843+0000","last_unstale":"2024-09-13T16:08:13.251561+0000","last_undegraded":"2024-09-13T16:08:13.251561+0000","last_fullsized":"2024-09-13T16:08:13.251561+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:11.667437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.240683+0000","last_change":"2024-09-13T16:08:09.228008+0000","last_active":"2024-09-13T16:08:13.240683+0000","last_peered":"2024-09-13T16:08:13.240683+0000","last_clean":"2024-09-13T16:08:13.240683+0000","last_became_active":"2024-09-13T16:08:09.227700+0000","last_became_peered":"2024-09-13T16:08:09.227700+0000","last_unstale":"2024-09-13T16:08:13.240683+0000","last_undegraded":"2024-09-13T16:08:13.240683+0000","last_fullsized":"2024-09-13T16:08:13.240683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:58.993532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.235321+0000","last_change":"2024-09-13T16:08:09.218650+0000","last_active":"2024-09-13T16:08:13.235321+0000","last_peered":"2024-09-13T16:08:13.235321+0000","last_clean":"2024-09-13T16:08:13.235321+0000","last_became_active":"2024-09-13T16:08:09.218347+0000","last_became_peered":"2024-09-13T16:08:09.218347+0000","last_unstale":"2024-09-13T16:08:13.235321+0000","last_undegraded":"2024-09-13T16:08:13.235321+0000","last_fullsized":"2024-09-13T16:08:13.235321+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:31.331274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.230192+0000","last_change":"2024-09-13T16:08:09.217256+0000","last_active":"2024-09-13T16:08:13.230192+0000","last_peered":"2024-09-13T16:08:13.230192+0000","last_clean":"2024-09-13T16:08:13.230192+0000","last_became_active":"2024-09-13T16:08:09.216960+0000","last_became_peered":"2024-09-13T16:08:09.216960+0000","last_unstale":"2024-09-13T16:08:13.230192+0000","last_undegraded":"2024-09-13T16:08:13.230192+0000","last_fullsized":"2024-09-13T16:08:13.230192+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:44.473317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617503+0000","last_change":"2024-09-13T16:08:09.225677+0000","last_active":"2024-09-13T16:08:13.617503+0000","last_peered":"2024-09-13T16:08:13.617503+0000","last_clean":"2024-09-13T16:08:13.617503+0000","last_became_active":"2024-09-13T16:08:09.224474+0000","last_became_peered":"2024-09-13T16:08:09.224474+0000","last_unstale":"2024-09-13T16:08:13.617503+0000","last_undegraded":"2024-09-13T16:08:13.617503+0000","last_fullsized":"2024-09-13T16:08:13.617503+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:01.474204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.235999+0000","last_change":"2024-09-13T16:08:09.229125+0000","last_active":"2024-09-13T16:08:13.235999+0000","last_peered":"2024-09-13T16:08:13.235999+0000","last_clean":"2024-09-13T16:08:13.235999+0000","last_became_active":"2024-09-13T16:08:09.228611+0000","last_became_peered":"2024-09-13T16:08:09.228611+0000","last_unstale":"2024-09-13T16:08:13.235999+0000","last_undegraded":"2024-09-13T16:08:13.235999+0000","last_fullsized":"2024-09-13T16:08:13.235999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:51.910316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617438+0000","last_change":"2024-09-13T16:08:09.226355+0000","last_active":"2024-09-13T16:08:13.617438+0000","last_peered":"2024-09-13T16:08:13.617438+0000","last_clean":"2024-09-13T16:08:13.617438+0000","last_became_active":"2024-09-13T16:08:09.225304+0000","last_became_peered":"2024-09-13T16:08:09.225304+0000","last_unstale":"2024-09-13T16:08:13.617438+0000","last_undegraded":"2024-09-13T16:08:13.617438+0000","last_fullsized":"2024-09-13T16:08:13.617438+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:01.714833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.236861+0000","last_change":"2024-09-13T16:08:09.223744+0000","last_active":"2024-09-13T16:08:13.236861+0000","last_peered":"2024-09-13T16:08:13.236861+0000","last_clean":"2024-09-13T16:08:13.236861+0000","last_became_active":"2024-09-13T16:08:09.223433+0000","last_became_peered":"2024-09-13T16:08:09.223433+0000","last_unstale":"2024-09-13T16:08:13.236861+0000","last_undegraded":"2024-09-13T16:08:13.236861+0000","last_fullsized":"2024-09-13T16:08:13.236861+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:32.406142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.240527+0000","last_change":"2024-09-13T16:08:09.227752+0000","last_active":"2024-09-13T16:08:13.240527+0000","last_peered":"2024-09-13T16:08:13.240527+0000","last_clean":"2024-09-13T16:08:13.240527+0000","last_became_active":"2024-09-13T16:08:09.227459+0000","last_became_peered":"2024-09-13T16:08:09.227459+0000","last_unstale":"2024-09-13T16:08:13.240527+0000","last_undegraded":"2024-09-13T16:08:13.240527+0000","last_fullsized":"2024-09-13T16:08:13.240527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:57.357214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.235094+0000","last_change":"2024-09-13T16:08:09.221624+0000","last_active":"2024-09-13T16:08:13.235094+0000","last_peered":"2024-09-13T16:08:13.235094+0000","last_clean":"2024-09-13T16:08:13.235094+0000","last_became_active":"2024-09-13T16:08:09.220573+0000","last_became_peered":"2024-09-13T16:08:09.220573+0000","last_unstale":"2024-09-13T16:08:13.235094+0000","last_undegraded":"2024-09-13T16:08:13.235094+0000","last_fullsized":"2024-09-13T16:08:13.235094+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:29.862958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.229979+0000","last_change":"2024-09-13T16:08:09.223575+0000","last_active":"2024-09-13T16:08:13.229979+0000","last_peered":"2024-09-13T16:08:13.229979+0000","last_clean":"2024-09-13T16:08:13.229979+0000","last_became_active":"2024-09-13T16:08:09.223312+0000","last_became_peered":"2024-09-13T16:08:09.223312+0000","last_unstale":"2024-09-13T16:08:13.229979+0000","last_undegraded":"2024-09-13T16:08:13.229979+0000","last_fullsized":"2024-09-13T16:08:13.229979+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:32.926562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.228595+0000","last_change":"2024-09-13T16:08:09.236371+0000","last_active":"2024-09-13T16:08:13.228595+0000","last_peered":"2024-09-13T16:08:13.228595+0000","last_clean":"2024-09-13T16:08:13.228595+0000","last_became_active":"2024-09-13T16:08:09.234906+0000","last_became_peered":"2024-09-13T16:08:09.234906+0000","last_unstale":"2024-09-13T16:08:13.228595+0000","last_undegraded":"2024-09-13T16:08:13.228595+0000","last_fullsized":"2024-09-13T16:08:13.228595+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:45.305622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.235435+0000","last_change":"2024-09-13T16:08:09.238765+0000","last_active":"2024-09-13T16:08:13.235435+0000","last_peered":"2024-09-13T16:08:13.235435+0000","last_clean":"2024-09-13T16:08:13.235435+0000","last_became_active":"2024-09-13T16:08:09.238469+0000","last_became_peered":"2024-09-13T16:08:09.238469+0000","last_unstale":"2024-09-13T16:08:13.235435+0000","last_undegraded":"2024-09-13T16:08:13.235435+0000","last_fullsized":"2024-09-13T16:08:13.235435+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:58.665620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.238684+0000","last_change":"2024-09-13T16:08:09.226472+0000","last_active":"2024-09-13T16:08:13.238684+0000","last_peered":"2024-09-13T16:08:13.238684+0000","last_clean":"2024-09-13T16:08:13.238684+0000","last_became_active":"2024-09-13T16:08:09.225988+0000","last_became_peered":"2024-09-13T16:08:09.225988+0000","last_unstale":"2024-09-13T16:08:13.238684+0000","last_undegraded":"2024-09-13T16:08:13.238684+0000","last_fullsized":"2024-09-13T16:08:13.238684+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:41.785752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.245936+0000","last_change":"2024-09-13T16:08:09.219313+0000","last_active":"2024-09-13T16:08:13.245936+0000","last_peered":"2024-09-13T16:08:13.245936+0000","last_clean":"2024-09-13T16:08:13.245936+0000","last_became_active":"2024-09-13T16:08:09.219030+0000","last_became_peered":"2024-09-13T16:08:09.219030+0000","last_unstale":"2024-09-13T16:08:13.245936+0000","last_undegraded":"2024-09-13T16:08:13.245936+0000","last_fullsized":"2024-09-13T16:08:13.245936+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:26.561305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.249877+0000","last_change":"2024-09-13T16:08:09.240585+0000","last_active":"2024-09-13T16:08:13.249877+0000","last_peered":"2024-09-13T16:08:13.249877+0000","last_clean":"2024-09-13T16:08:13.249877+0000","last_became_active":"2024-09-13T16:08:09.238960+0000","last_became_peered":"2024-09-13T16:08:09.238960+0000","last_unstale":"2024-09-13T16:08:13.249877+0000","last_undegraded":"2024-09-13T16:08:13.249877+0000","last_fullsized":"2024-09-13T16:08:13.249877+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:24.086723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.240443+0000","last_change":"2024-09-13T16:08:09.234963+0000","last_active":"2024-09-13T16:08:13.240443+0000","last_peered":"2024-09-13T16:08:13.240443+0000","last_clean":"2024-09-13T16:08:13.240443+0000","last_became_active":"2024-09-13T16:08:09.234649+0000","last_became_peered":"2024-09-13T16:08:09.234649+0000","last_unstale":"2024-09-13T16:08:13.240443+0000","last_undegraded":"2024-09-13T16:08:13.240443+0000","last_fullsized":"2024-09-13T16:08:13.240443+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:38.972344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.511045+0000","last_change":"2024-09-13T16:08:09.226425+0000","last_active":"2024-09-13T16:08:13.511045+0000","last_peered":"2024-09-13T16:08:13.511045+0000","last_clean":"2024-09-13T16:08:13.511045+0000","last_became_active":"2024-09-13T16:08:09.226121+0000","last_became_peered":"2024-09-13T16:08:09.226121+0000","last_unstale":"2024-09-13T16:08:13.511045+0000","last_undegraded":"2024-09-13T16:08:13.511045+0000","last_fullsized":"2024-09-13T16:08:13.511045+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:10.035414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.428820+0000","last_change":"2024-09-13T16:08:09.234592+0000","last_active":"2024-09-13T16:08:13.428820+0000","last_peered":"2024-09-13T16:08:13.428820+0000","last_clean":"2024-09-13T16:08:13.428820+0000","last_became_active":"2024-09-13T16:08:09.234293+0000","last_became_peered":"2024-09-13T16:08:09.234293+0000","last_unstale":"2024-09-13T16:08:13.428820+0000","last_undegraded":"2024-09-13T16:08:13.428820+0000","last_fullsized":"2024-09-13T16:08:13.428820+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:44.196400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.493136+0000","last_change":"2024-09-13T16:08:09.231974+0000","last_active":"2024-09-13T16:08:13.493136+0000","last_peered":"2024-09-13T16:08:13.493136+0000","last_clean":"2024-09-13T16:08:13.493136+0000","last_became_active":"2024-09-13T16:08:09.231667+0000","last_became_peered":"2024-09-13T16:08:09.231667+0000","last_unstale":"2024-09-13T16:08:13.493136+0000","last_undegraded":"2024-09-13T16:08:13.493136+0000","last_fullsized":"2024-09-13T16:08:13.493136+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:05.595837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.237697+0000","last_change":"2024-09-13T16:08:09.225322+0000","last_active":"2024-09-13T16:08:13.237697+0000","last_peered":"2024-09-13T16:08:13.237697+0000","last_clean":"2024-09-13T16:08:13.237697+0000","last_became_active":"2024-09-13T16:08:09.224969+0000","last_became_peered":"2024-09-13T16:08:09.224969+0000","last_unstale":"2024-09-13T16:08:13.237697+0000","last_undegraded":"2024-09-13T16:08:13.237697+0000","last_fullsized":"2024-09-13T16:08:13.237697+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:36.797080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617412+0000","last_change":"2024-09-13T16:08:09.231870+0000","last_active":"2024-09-13T16:08:13.617412+0000","last_peered":"2024-09-13T16:08:13.617412+0000","last_clean":"2024-09-13T16:08:13.617412+0000","last_became_active":"2024-09-13T16:08:09.231606+0000","last_became_peered":"2024-09-13T16:08:09.231606+0000","last_unstale":"2024-09-13T16:08:13.617412+0000","last_undegraded":"2024-09-13T16:08:13.617412+0000","last_fullsized":"2024-09-13T16:08:13.617412+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:49.235264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.428725+0000","last_change":"2024-09-13T16:08:09.224800+0000","last_active":"2024-09-13T16:08:13.428725+0000","last_peered":"2024-09-13T16:08:13.428725+0000","last_clean":"2024-09-13T16:08:13.428725+0000","last_became_active":"2024-09-13T16:08:09.224487+0000","last_became_peered":"2024-09-13T16:08:09.224487+0000","last_unstale":"2024-09-13T16:08:13.428725+0000","last_undegraded":"2024-09-13T16:08:13.428725+0000","last_fullsized":"2024-09-13T16:08:13.428725+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:33.619689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.492749+0000","last_change":"2024-09-13T16:08:09.230428+0000","last_active":"2024-09-13T16:08:13.492749+0000","last_peered":"2024-09-13T16:08:13.492749+0000","last_clean":"2024-09-13T16:08:13.492749+0000","last_became_active":"2024-09-13T16:08:09.230139+0000","last_became_peered":"2024-09-13T16:08:09.230139+0000","last_unstale":"2024-09-13T16:08:13.492749+0000","last_undegraded":"2024-09-13T16:08:13.492749+0000","last_fullsized":"2024-09-13T16:08:13.492749+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:56.475566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.235602+0000","last_change":"2024-09-13T16:08:09.223142+0000","last_active":"2024-09-13T16:08:13.235602+0000","last_peered":"2024-09-13T16:08:13.235602+0000","last_clean":"2024-09-13T16:08:13.235602+0000","last_became_active":"2024-09-13T16:08:09.222718+0000","last_became_peered":"2024-09-13T16:08:09.222718+0000","last_unstale":"2024-09-13T16:08:13.235602+0000","last_undegraded":"2024-09-13T16:08:13.235602+0000","last_fullsized":"2024-09-13T16:08:13.235602+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:00.737875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.511034+0000","last_change":"2024-09-13T16:08:09.220060+0000","last_active":"2024-09-13T16:08:13.511034+0000","last_peered":"2024-09-13T16:08:13.511034+0000","last_clean":"2024-09-13T16:08:13.511034+0000","last_became_active":"2024-09-13T16:08:09.219751+0000","last_became_peered":"2024-09-13T16:08:09.219751+0000","last_unstale":"2024-09-13T16:08:13.511034+0000","last_undegraded":"2024-09-13T16:08:13.511034+0000","last_fullsized":"2024-09-13T16:08:13.511034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:47.103762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.247254+0000","last_change":"2024-09-13T16:08:09.230914+0000","last_active":"2024-09-13T16:08:13.247254+0000","last_peered":"2024-09-13T16:08:13.247254+0000","last_clean":"2024-09-13T16:08:13.247254+0000","last_became_active":"2024-09-13T16:08:09.230500+0000","last_became_peered":"2024-09-13T16:08:09.230500+0000","last_unstale":"2024-09-13T16:08:13.247254+0000","last_undegraded":"2024-09-13T16:08:13.247254+0000","last_fullsized":"2024-09-13T16:08:13.247254+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:02.096851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.248817+0000","last_change":"2024-09-13T16:08:09.239818+0000","last_active":"2024-09-13T16:08:13.248817+0000","last_peered":"2024-09-13T16:08:13.248817+0000","last_clean":"2024-09-13T16:08:13.248817+0000","last_became_active":"2024-09-13T16:08:09.238707+0000","last_became_peered":"2024-09-13T16:08:09.238707+0000","last_unstale":"2024-09-13T16:08:13.248817+0000","last_undegraded":"2024-09-13T16:08:13.248817+0000","last_fullsized":"2024-09-13T16:08:13.248817+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:46.937934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.235259+0000","last_change":"2024-09-13T16:08:09.238796+0000","last_active":"2024-09-13T16:08:13.235259+0000","last_peered":"2024-09-13T16:08:13.235259+0000","last_clean":"2024-09-13T16:08:13.235259+0000","last_became_active":"2024-09-13T16:08:09.238510+0000","last_became_peered":"2024-09-13T16:08:09.238510+0000","last_unstale":"2024-09-13T16:08:13.235259+0000","last_undegraded":"2024-09-13T16:08:13.235259+0000","last_fullsized":"2024-09-13T16:08:13.235259+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:18.691940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7119,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":109,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":58039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350992,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":987136,"data_stored":479614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.48199999999999998}]},{"osd":1,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.77000000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.501},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.52300000000000002}]},{"osd":6,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.71799999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":9,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.748},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.67700000000000005}]},{"osd":10,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.78500000000000003}]}]},{"osd":10,"up_from":73,"seq":313532612630,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1617920,"data_stored":1074733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.38},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.65500000000000003}]},{"osd":3,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.68500000000000005}]},{"osd":4,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.5},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.78200000000000003}]},{"osd":6,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.377},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.39900000000000002}]},{"osd":8,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.747}]},{"osd":9,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.73699999999999999}]},{"osd":11,"last update":"Fri Sep 13 16:08:16 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.69999999999999996}]}]},{"osd":9,"up_from":68,"seq":292057776155,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":480398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.39700000000000002}]},{"osd":1,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.495}]},{"osd":3,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.503}]},{"osd":4,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.54700000000000004}]},{"osd":7,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.745},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.64900000000000002}]},{"osd":8,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.55700000000000005}]},{"osd":10,"last update":"Fri Sep 13 16:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.68200000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":8,"up_from":60,"seq":257698037793,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":1003520,"data_stored":480021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.751,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Sep 13 16:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71099999999999997,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.58199999999999996,"15min":0.59199999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73699999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.68999999999999995}]},{"osd":2,"last update":"Fri Sep 13 16:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.39500000000000002,"15min":0.39800000000000002},"min":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.32600000000000001}]},{"osd":3,"last update":"Fri Sep 13 16:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.625,"15min":0.63900000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72199999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Sep 13 16:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56899999999999995,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72799999999999998,"5min":0.75,"15min":0.75},"last":0.45800000000000002}]},{"osd":5,"last update":"Fri Sep 13 16:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72699999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.34499999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70099999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68799999999999994,"15min":0.69099999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.64100000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82999999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.65300000000000002}]},{"osd":9,"last update":"Fri Sep 13 16:08:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.65700000000000003,"15min":0.66000000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.50600000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95799999999999996,"5min":1.401,"15min":1.401},"last":0.54700000000000004}]},{"osd":10,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.66600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":7,"up_from":52,"seq":223338299430,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36764,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708388,"statfs":{"total":95995035648,"available":95957389312,"internally_reserved":0,"allocated":1593344,"data_stored":1071397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.432,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.37,"15min":0.36899999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.373,"15min":0.37},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.39400000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.439,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76900000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.41399999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47399999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.58299999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.501},{"interface":"front","average":{"1min":0.623,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57899999999999996}]},{"osd":4,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.442,"15min":0.441},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.46400000000000002,"15min":0.46500000000000002},"min":{"1min":0.30399999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72799999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.375}]},{"osd":5,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84899999999999998,"5min":1.022,"15min":1.022},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.42099999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.433}]},{"osd":6,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.621},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66800000000000004,"15min":0.66600000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88500000000000001,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58999999999999997}]},{"osd":8,"last update":"Fri Sep 13 16:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.44800000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.45000000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.55300000000000005}]},{"osd":9,"last update":"Fri Sep 13 16:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72199999999999998,"15min":0.72799999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.56499999999999995}]},{"osd":10,"last update":"Fri Sep 13 16:07:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.51900000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":6,"up_from":47,"seq":201863462955,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":479431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:08:19 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.33200000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70299999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.46200000000000002,"15min":0.45300000000000001},"min":{"1min":0.309,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.438}]},{"osd":1,"last update":"Fri Sep 13 16:08:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.68899999999999995,"15min":0.67300000000000004},"min":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93999999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63700000000000001,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.84299999999999997,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Sep 13 16:08:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.622},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.81399999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.62},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70099999999999996,"15min":0.68700000000000006},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.78100000000000003}]},{"osd":3,"last update":"Fri Sep 13 16:08:19 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.59899999999999998},"min":{"1min":0.38700000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.82299999999999995,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Sep 13 16:08:19 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82699999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.745,"15min":0.73099999999999998},"min":{"1min":0.52800000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.01,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:08:19 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67700000000000005,"15min":0.66700000000000004},"min":{"1min":0.503,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90100000000000002,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Sep 13 16:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70899999999999996,"15min":0.70599999999999996},"min":{"1min":0.51200000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.95999999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.749,"15min":0.74099999999999999},"min":{"1min":0.56399999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.753}]},{"osd":8,"last update":"Fri Sep 13 16:08:04 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77300000000000002,"15min":0.76700000000000002},"min":{"1min":0.57499999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73099999999999998,"15min":0.72999999999999998},"min":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.92000000000000004,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.72899999999999998}]},{"osd":9,"last update":"Fri Sep 13 16:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.83899999999999997,"15min":0.84699999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.752,"15min":0.75800000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96099999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.63}]},{"osd":10,"last update":"Fri Sep 13 16:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.80000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":5,"up_from":39,"seq":167503724591,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36780,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708372,"statfs":{"total":95995035648,"available":95957372928,"internally_reserved":0,"allocated":1609728,"data_stored":1071410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:07:46 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82499999999999996,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.439},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75700000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.496}]},{"osd":1,"last update":"Fri Sep 13 16:07:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72699999999999998,"5min":0.748,"15min":0.748},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51300000000000001,"15min":0.50700000000000001},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.47399999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:07:46 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.373,"15min":0.36699999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52900000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.379,"15min":0.375},"min":{"1min":0.25,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.58799999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.35799999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:07:46 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.42299999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.45600000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.58099999999999996}]},{"osd":4,"last update":"Fri Sep 13 16:07:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77600000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.377}]},{"osd":6,"last update":"Fri Sep 13 16:08:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.71899999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61199999999999999,"15min":0.60599999999999998},"min":{"1min":0.42199999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73499999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.626}]},{"osd":7,"last update":"Fri Sep 13 16:07:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58799999999999997,"15min":0.59099999999999997},"min":{"1min":0.439,"5min":0.437,"15min":0.437},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.66100000000000003}]},{"osd":8,"last update":"Fri Sep 13 16:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71399999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.64300000000000002}]},{"osd":9,"last update":"Fri Sep 13 16:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.70799999999999996,"15min":0.71999999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.755,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.73999999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.71999999999999997}]},{"osd":10,"last update":"Fri Sep 13 16:07:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.69499999999999995}]}]},{"osd":4,"up_from":34,"seq":146028888117,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":999424,"data_stored":480210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:07:28 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.51800000000000002,"15min":0.49099999999999999},"min":{"1min":0.438,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.48199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.436}]},{"osd":1,"last update":"Fri Sep 13 16:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35099999999999998,"15min":0.33200000000000002},"min":{"1min":0.24399999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.36299999999999999,"15min":0.34200000000000003},"min":{"1min":0.27800000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.59999999999999998,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.33800000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.33400000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71499999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51300000000000001,"15min":0.50600000000000001},"min":{"1min":0.309,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.622}]},{"osd":3,"last update":"Fri Sep 13 16:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55800000000000005,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76200000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.54000000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81699999999999995,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:07:45 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.53700000000000003},"min":{"1min":0.47599999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.436,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.56699999999999995}]},{"osd":6,"last update":"Fri Sep 13 16:08:14 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61099999999999999,"15min":0.59799999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82599999999999996,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.623,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81299999999999994,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Sep 13 16:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.64900000000000002,"15min":0.67700000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68799999999999994,"5min":3.4660000000000002,"15min":3.4660000000000002},"last":0.495},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.61299999999999999,"15min":0.63},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76300000000000001,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.64000000000000001}]},{"osd":8,"last update":"Fri Sep 13 16:08:00 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.48099999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.62,"15min":0.61499999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58699999999999997}]},{"osd":9,"last update":"Fri Sep 13 16:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.72799999999999998}]},{"osd":10,"last update":"Fri Sep 13 16:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.66700000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":3,"up_from":26,"seq":111669149754,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":479567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:08:08 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.42499999999999999,"15min":0.38600000000000001},"min":{"1min":0.28000000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64900000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.434,"15min":0.40600000000000003},"min":{"1min":0.316,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.748,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.34599999999999997}]},{"osd":1,"last update":"Fri Sep 13 16:08:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59899999999999998,"15min":0.57999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90400000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63500000000000001,"15min":0.58699999999999997},"min":{"1min":0.496,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.72999999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:08:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65300000000000002,"15min":0.60299999999999998},"min":{"1min":0.498,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85299999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.65900000000000003,"15min":0.59499999999999997},"min":{"1min":0.57499999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90000000000000002,"5min":1.179,"15min":1.179},"last":0.70499999999999996}]},{"osd":4,"last update":"Fri Sep 13 16:08:20 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63700000000000001,"15min":0.60999999999999999},"min":{"1min":0.40500000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82099999999999995,"5min":1.016,"15min":1.016},"last":0.623},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.66600000000000004,"15min":0.625},"min":{"1min":0.52100000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.91900000000000004,"5min":0.995,"15min":0.995},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:07:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.68400000000000005,"15min":0.67100000000000004},"min":{"1min":0.54900000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66300000000000003,"15min":0.65500000000000003},"min":{"1min":0.498,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.65900000000000003}]},{"osd":6,"last update":"Fri Sep 13 16:08:12 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64900000000000002,"15min":0.64400000000000002},"min":{"1min":0.47799999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.038,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.439,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89200000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.39900000000000002}]},{"osd":7,"last update":"Fri Sep 13 16:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93999999999999995,"5min":1.105,"15min":1.105},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78600000000000003,"15min":0.78300000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1040000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.64300000000000002}]},{"osd":8,"last update":"Fri Sep 13 16:07:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82099999999999995,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.0069999999999999,"5min":1.2,"15min":1.2},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78000000000000003,"15min":0.78600000000000003},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.86399999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.623}]},{"osd":9,"last update":"Fri Sep 13 16:08:29 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.80000000000000004,"15min":0.80400000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0049999999999999,"5min":1.042,"15min":1.042},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.85699999999999998,"15min":0.86699999999999999},"min":{"1min":0.54300000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0429999999999999,"5min":1.073,"15min":1.073},"last":0.81100000000000005}]},{"osd":10,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.76200000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":484017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:07:32 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.38700000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.442,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.751,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.505}]},{"osd":1,"last update":"Fri Sep 13 16:07:32 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.53200000000000003,"15min":0.502},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.501,"15min":0.47099999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68700000000000006,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.628}]},{"osd":3,"last update":"Fri Sep 13 16:07:58 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80100000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81799999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58599999999999997}]},{"osd":4,"last update":"Fri Sep 13 16:07:20 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.55700000000000005,"15min":0.54000000000000004},"min":{"1min":0.39200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77900000000000003,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.55200000000000005,"15min":0.53300000000000003},"min":{"1min":0.38500000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.85599999999999998}]},{"osd":5,"last update":"Fri Sep 13 16:07:49 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.41799999999999998,"15min":0.40799999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.69899999999999995,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47599999999999998,"15min":0.46200000000000002},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69099999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.75800000000000001}]},{"osd":6,"last update":"Fri Sep 13 16:08:19 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65200000000000002,"15min":0.64900000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.748,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75800000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65100000000000002,"15min":0.64900000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.878},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.81000000000000005}]},{"osd":8,"last update":"Fri Sep 13 16:07:58 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65100000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76500000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.81799999999999995}]},{"osd":9,"last update":"Fri Sep 13 16:08:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.70199999999999996,"15min":0.70699999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93000000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.75}]},{"osd":10,"last update":"Fri Sep 13 16:07:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.78600000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":1032192,"data_stored":519766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.309,"15min":0.309},"max":{"1min":0.78300000000000003,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.441},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.38600000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.49399999999999999},"min":{"1min":0.30399999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.78400000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51100000000000001,"15min":0.504},"min":{"1min":0.32100000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.71399999999999997}]},{"osd":3,"last update":"Fri Sep 13 16:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.56599999999999995,"15min":0.53700000000000003},"min":{"1min":0.432,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.497}]},{"osd":4,"last update":"Fri Sep 13 16:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67500000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.375},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.44700000000000001,"15min":0.436},"min":{"1min":0.315,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72799999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.626}]},{"osd":5,"last update":"Fri Sep 13 16:07:49 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.53300000000000003,"15min":0.52500000000000002},"min":{"1min":0.40200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.755}]},{"osd":6,"last update":"Fri Sep 13 16:08:14 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60699999999999998,"15min":0.59199999999999997},"min":{"1min":0.44400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61299999999999999,"15min":0.59099999999999997},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51400000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.439,"15min":0.436},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.46899999999999997,"15min":0.46500000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.40600000000000003}]},{"osd":8,"last update":"Fri Sep 13 16:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82599999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.434,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.72999999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.61499999999999999}]},{"osd":9,"last update":"Fri Sep 13 16:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.69299999999999995,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.95299999999999996,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.66100000000000003}]},{"osd":10,"last update":"Fri Sep 13 16:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":1011712,"data_stored":480819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58199999999999996,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.57799999999999996,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83499999999999996,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Sep 13 16:07:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64000000000000001,"15min":0.61699999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.028,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.64800000000000002,"15min":0.626},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.77800000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:07:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.505,"15min":0.47499999999999998},"min":{"1min":0.38400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.47099999999999997,"15min":0.441},"min":{"1min":0.36399999999999999,"5min":0.308,"15min":0.308},"max":{"1min":1,"5min":1,"15min":1},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:08:23 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60399999999999998,"15min":0.57999999999999996},"min":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78800000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.59899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92600000000000005,"5min":1.006,"15min":1.006},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Sep 13 16:07:47 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98599999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84199999999999997,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63900000000000001,"15min":0.625},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.89300000000000002,"5min":1.004,"15min":1.004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.65600000000000003,"15min":0.63800000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78800000000000003,"5min":1.141,"15min":1.141},"last":0.72699999999999998}]},{"osd":7,"last update":"Fri Sep 13 16:07:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73799999999999999,"15min":0.74299999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.57099999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.85999999999999999}]},{"osd":8,"last update":"Fri Sep 13 16:07:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.095,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.264,"5min":0.91200000000000003,"15min":0.85399999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":13.347,"5min":13.347,"15min":13.347},"last":0.66500000000000004}]},{"osd":9,"last update":"Fri Sep 13 16:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.87,"15min":0.89800000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.016,"5min":1.224,"15min":1.224},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.83499999999999996,"15min":0.85899999999999999},"min":{"1min":0.499,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88800000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.64800000000000002}]},{"osd":10,"last update":"Fri Sep 13 16:07:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.82499999999999996}]},{"osd":11,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.79000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":40425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:08:35.605 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T16:08:35.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:35 smithi139 ceph-mon[35320]: from='client.24841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:08:35.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:35 smithi139 ceph-mon[35320]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:08:35.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:35 smithi139 ceph-mon[35320]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:08:35.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:35 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2092507103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:08:35.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:35 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/50427578' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:35.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:35 smithi194 ceph-mon[35694]: from='client.24841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:08:35.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:35 smithi194 ceph-mon[35694]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:08:35.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:35 smithi194 ceph-mon[35694]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:08:35.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:35 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2092507103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:08:35.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:35 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/50427578' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:35.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.787+0000 7fb726a00640 1 -- 172.21.15.86:0/2184762741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7201039a0 msgr2=0x7fb72010a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.787+0000 7fb726a00640 1 --2- 172.21.15.86:0/2184762741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7201039a0 0x7fb72010a230 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb718009be0 tx=0x7fb71802a6c0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.787+0000 7fb726a00640 1 -- 172.21.15.86:0/2184762741 shutdown_connections 2024-09-13T16:08:35.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.787+0000 7fb726a00640 1 --2- 172.21.15.86:0/2184762741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7201039a0 0x7fb72010a230 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.787+0000 7fb726a00640 1 --2- 172.21.15.86:0/2184762741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb720102fe0 0x7fb720103460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.787+0000 7fb726a00640 1 --2- 172.21.15.86:0/2184762741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb720101df0 0x7fb7201021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.787+0000 7fb726a00640 1 -- 172.21.15.86:0/2184762741 >> 172.21.15.86:0/2184762741 conn(0x7fb7200fd570 msgr2=0x7fb7200ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:35.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.787+0000 7fb726a00640 1 -- 172.21.15.86:0/2184762741 shutdown_connections 2024-09-13T16:08:35.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.787+0000 7fb726a00640 1 -- 172.21.15.86:0/2184762741 wait complete. 2024-09-13T16:08:35.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.788+0000 7fb726a00640 1 Processor -- start 2024-09-13T16:08:35.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.788+0000 7fb726a00640 1 -- start start 2024-09-13T16:08:35.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.788+0000 7fb726a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb720101df0 0x7fb720197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.789+0000 7fb726a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb720102fe0 0x7fb7201983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.789+0000 7fb726a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7201039a0 0x7fb72019f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.789+0000 7fb726a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72019f950 con 0x7fb720101df0 2024-09-13T16:08:35.792 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.789+0000 7fb726a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72019fac0 con 0x7fb720102fe0 2024-09-13T16:08:35.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.789+0000 7fb726a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72019fc80 con 0x7fb7201039a0 2024-09-13T16:08:35.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.789+0000 7fb725600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb720101df0 0x7fb720197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.789+0000 7fb725600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb720101df0 0x7fb720197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43084/0 (socket says 172.21.15.86:43084) 2024-09-13T16:08:35.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.789+0000 7fb725600640 1 -- 172.21.15.86:0/1279763253 learned_addr learned my addr 172.21.15.86:0/1279763253 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:35.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.789+0000 7fb724c00640 1 --2- 172.21.15.86:0/1279763253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb720102fe0 0x7fb7201983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.789+0000 7fb726000640 1 --2- 172.21.15.86:0/1279763253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7201039a0 0x7fb72019f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.789+0000 7fb724c00640 1 -- 172.21.15.86:0/1279763253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7201039a0 msgr2=0x7fb72019f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.789+0000 7fb724c00640 1 --2- 172.21.15.86:0/1279763253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7201039a0 0x7fb72019f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.789+0000 7fb724c00640 1 -- 172.21.15.86:0/1279763253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb720101df0 msgr2=0x7fb720197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.789+0000 7fb724c00640 1 --2- 172.21.15.86:0/1279763253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb720101df0 0x7fb720197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.789+0000 7fb724c00640 1 -- 172.21.15.86:0/1279763253 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb718009840 con 0x7fb720102fe0 2024-09-13T16:08:35.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.789+0000 7fb725600640 1 --2- 172.21.15.86:0/1279763253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb720101df0 0x7fb720197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:35.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.790+0000 7fb724c00640 1 --2- 172.21.15.86:0/1279763253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb720102fe0 0x7fb7201983a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00e790 tx=0x7fb70c00ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:35.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.790+0000 7fb71e000640 1 -- 172.21.15.86:0/1279763253 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c00ccc0 con 0x7fb720102fe0 2024-09-13T16:08:35.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.790+0000 7fb726a00640 1 -- 172.21.15.86:0/1279763253 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72019ff60 con 0x7fb720102fe0 2024-09-13T16:08:35.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.790+0000 7fb71e000640 1 -- 172.21.15.86:0/1279763253 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb70c00eea0 con 0x7fb720102fe0 2024-09-13T16:08:35.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.790+0000 7fb71e000640 1 -- 172.21.15.86:0/1279763253 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c018730 con 0x7fb720102fe0 2024-09-13T16:08:35.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.790+0000 7fb726a00640 1 -- 172.21.15.86:0/1279763253 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7201a0430 con 0x7fb720102fe0 2024-09-13T16:08:35.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.791+0000 7fb726a00640 1 -- 172.21.15.86:0/1279763253 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb720109250 con 0x7fb720102fe0 2024-09-13T16:08:35.794 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.793+0000 7fb71e000640 1 -- 172.21.15.86:0/1279763253 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb70c010430 con 0x7fb720102fe0 2024-09-13T16:08:35.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.794+0000 7fb71e000640 1 --2- 172.21.15.86:0/1279763253 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb7080a11a0 0x7fb7080a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.794+0000 7fb71e000640 1 -- 172.21.15.86:0/1279763253 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb70c014070 con 0x7fb720102fe0 2024-09-13T16:08:35.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.794+0000 7fb725600640 1 --2- 172.21.15.86:0/1279763253 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb7080a11a0 0x7fb7080a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.796 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.795+0000 7fb725600640 1 --2- 172.21.15.86:0/1279763253 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb7080a11a0 0x7fb7080a3660 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb7140058c0 tx=0x7fb714005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:35.800 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.798+0000 7fb71e000640 1 -- 172.21.15.86:0/1279763253 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb70c052e20 con 0x7fb720102fe0 2024-09-13T16:08:35.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.965+0000 7fb726a00640 1 -- 172.21.15.86:0/1279763253 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb72002c480 con 0x7fb7080a11a0 2024-09-13T16:08:35.978 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.977+0000 7fb71e000640 1 -- 172.21.15.86:0/1279763253 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422959 (secure 0 0 0) 0x7fb72002c480 con 0x7fb7080a11a0 2024-09-13T16:08:35.983 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:35.987 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-09-13T16:08:35.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.981+0000 7fb726a00640 1 -- 172.21.15.86:0/1279763253 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb7080a11a0 msgr2=0x7fb7080a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.981+0000 7fb726a00640 1 --2- 172.21.15.86:0/1279763253 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb7080a11a0 0x7fb7080a3660 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb7140058c0 tx=0x7fb714005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:35.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.981+0000 7fb726a00640 1 -- 172.21.15.86:0/1279763253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb720102fe0 msgr2=0x7fb7201983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.981+0000 7fb726a00640 1 --2- 172.21.15.86:0/1279763253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb720102fe0 0x7fb7201983a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00e790 tx=0x7fb70c00ec50 comp rx=0 tx=0).stop 2024-09-13T16:08:35.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.981+0000 7fb726a00640 1 -- 172.21.15.86:0/1279763253 shutdown_connections 2024-09-13T16:08:35.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.982+0000 7fb726a00640 1 --2- 172.21.15.86:0/1279763253 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb7080a11a0 0x7fb7080a3660 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.982+0000 7fb726a00640 1 --2- 172.21.15.86:0/1279763253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7201039a0 0x7fb72019f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.982+0000 7fb726a00640 1 --2- 172.21.15.86:0/1279763253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb720102fe0 0x7fb7201983a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.982+0000 7fb726a00640 1 --2- 172.21.15.86:0/1279763253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb720101df0 0x7fb720197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.982+0000 7fb726a00640 1 -- 172.21.15.86:0/1279763253 >> 172.21.15.86:0/1279763253 conn(0x7fb7200fd570 msgr2=0x7fb720106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:35.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.982+0000 7fb726a00640 1 -- 172.21.15.86:0/1279763253 shutdown_connections 2024-09-13T16:08:35.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:35.982+0000 7fb726a00640 1 -- 172.21.15.86:0/1279763253 wait complete. 2024-09-13T16:08:35.999 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-09-13T16:08:35.336428+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597604,"num_objects":54,"num_object_clones":0,"num_object_copies":163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":143,"num_read_kb":124,"num_write":291,"num_write_kb":2982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":236,"ondisk_log_size":236,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382780,"kb_used_data":13532,"kb_used_omap":18,"kb_used_meta":369133,"kb_avail":1124559044,"statfs":{"total":1151940427776,"available":1151548461056,"internally_reserved":0,"allocated":13856768,"data_stored":7581383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19130,"internal_metadata":377992518},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4424,"num_objects":30,"num_object_clones":0,"num_object_copies":91,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":64,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003358"},"pg_stats":[{"pgid":"2.1f","version":"85'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.229705+0000","last_change":"2024-09-13T16:08:08.808610+0000","last_active":"2024-09-13T16:08:13.229705+0000","last_peered":"2024-09-13T16:08:13.229705+0000","last_clean":"2024-09-13T16:08:13.229705+0000","last_became_active":"2024-09-13T16:08:08.808267+0000","last_became_peered":"2024-09-13T16:08:08.808267+0000","last_unstale":"2024-09-13T16:08:13.229705+0000","last_undegraded":"2024-09-13T16:08:13.229705+0000","last_fullsized":"2024-09-13T16:08:13.229705+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:56.867501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617488+0000","last_change":"2024-09-13T16:08:09.228268+0000","last_active":"2024-09-13T16:08:13.617488+0000","last_peered":"2024-09-13T16:08:13.617488+0000","last_clean":"2024-09-13T16:08:13.617488+0000","last_became_active":"2024-09-13T16:08:09.224689+0000","last_became_peered":"2024-09-13T16:08:09.224689+0000","last_unstale":"2024-09-13T16:08:13.617488+0000","last_undegraded":"2024-09-13T16:08:13.617488+0000","last_fullsized":"2024-09-13T16:08:13.617488+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:02.777936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.466284+0000","last_change":"2024-09-13T16:08:13.245650+0000","last_active":"2024-09-13T16:08:14.466284+0000","last_peered":"2024-09-13T16:08:14.466284+0000","last_clean":"2024-09-13T16:08:14.466284+0000","last_became_active":"2024-09-13T16:08:13.245346+0000","last_became_peered":"2024-09-13T16:08:13.245346+0000","last_unstale":"2024-09-13T16:08:14.466284+0000","last_undegraded":"2024-09-13T16:08:14.466284+0000","last_fullsized":"2024-09-13T16:08:14.466284+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:49.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.924805+0000","last_change":"2024-09-13T16:08:08.820385+0000","last_active":"2024-09-13T16:08:13.924805+0000","last_peered":"2024-09-13T16:08:13.924805+0000","last_clean":"2024-09-13T16:08:13.924805+0000","last_became_active":"2024-09-13T16:08:08.819874+0000","last_became_peered":"2024-09-13T16:08:08.819874+0000","last_unstale":"2024-09-13T16:08:13.924805+0000","last_undegraded":"2024-09-13T16:08:13.924805+0000","last_fullsized":"2024-09-13T16:08:13.924805+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:02.566058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.249932+0000","last_change":"2024-09-13T16:08:09.235517+0000","last_active":"2024-09-13T16:08:13.249932+0000","last_peered":"2024-09-13T16:08:13.249932+0000","last_clean":"2024-09-13T16:08:13.249932+0000","last_became_active":"2024-09-13T16:08:09.235157+0000","last_became_peered":"2024-09-13T16:08:09.235157+0000","last_unstale":"2024-09-13T16:08:13.249932+0000","last_undegraded":"2024-09-13T16:08:13.249932+0000","last_fullsized":"2024-09-13T16:08:13.249932+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:11.651025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.510945+0000","last_change":"2024-09-13T16:08:13.243422+0000","last_active":"2024-09-13T16:08:13.510945+0000","last_peered":"2024-09-13T16:08:13.510945+0000","last_clean":"2024-09-13T16:08:13.510945+0000","last_became_active":"2024-09-13T16:08:13.243075+0000","last_became_peered":"2024-09-13T16:08:13.243075+0000","last_unstale":"2024-09-13T16:08:13.510945+0000","last_undegraded":"2024-09-13T16:08:13.510945+0000","last_fullsized":"2024-09-13T16:08:13.510945+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:56.457343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:31.449116+0000","last_change":"2024-09-13T16:08:08.807410+0000","last_active":"2024-09-13T16:08:31.449116+0000","last_peered":"2024-09-13T16:08:31.449116+0000","last_clean":"2024-09-13T16:08:31.449116+0000","last_became_active":"2024-09-13T16:08:08.807041+0000","last_became_peered":"2024-09-13T16:08:08.807041+0000","last_unstale":"2024-09-13T16:08:31.449116+0000","last_undegraded":"2024-09-13T16:08:31.449116+0000","last_fullsized":"2024-09-13T16:08:31.449116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:58.198019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.235930+0000","last_change":"2024-09-13T16:08:09.228643+0000","last_active":"2024-09-13T16:08:13.235930+0000","last_peered":"2024-09-13T16:08:13.235930+0000","last_clean":"2024-09-13T16:08:13.235930+0000","last_became_active":"2024-09-13T16:08:09.228329+0000","last_became_peered":"2024-09-13T16:08:09.228329+0000","last_unstale":"2024-09-13T16:08:13.235930+0000","last_undegraded":"2024-09-13T16:08:13.235930+0000","last_fullsized":"2024-09-13T16:08:13.235930+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:03.306471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.511005+0000","last_change":"2024-09-13T16:08:13.250671+0000","last_active":"2024-09-13T16:08:13.511005+0000","last_peered":"2024-09-13T16:08:13.511005+0000","last_clean":"2024-09-13T16:08:13.511005+0000","last_became_active":"2024-09-13T16:08:13.250267+0000","last_became_peered":"2024-09-13T16:08:13.250267+0000","last_unstale":"2024-09-13T16:08:13.511005+0000","last_undegraded":"2024-09-13T16:08:13.511005+0000","last_fullsized":"2024-09-13T16:08:13.511005+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:30.939774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.238081+0000","last_change":"2024-09-13T16:08:08.805379+0000","last_active":"2024-09-13T16:08:13.238081+0000","last_peered":"2024-09-13T16:08:13.238081+0000","last_clean":"2024-09-13T16:08:13.238081+0000","last_became_active":"2024-09-13T16:08:08.804848+0000","last_became_peered":"2024-09-13T16:08:08.804848+0000","last_unstale":"2024-09-13T16:08:13.238081+0000","last_undegraded":"2024-09-13T16:08:13.238081+0000","last_fullsized":"2024-09-13T16:08:13.238081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:46.380684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.236440+0000","last_change":"2024-09-13T16:08:09.228613+0000","last_active":"2024-09-13T16:08:13.236440+0000","last_peered":"2024-09-13T16:08:13.236440+0000","last_clean":"2024-09-13T16:08:13.236440+0000","last_became_active":"2024-09-13T16:08:09.228302+0000","last_became_peered":"2024-09-13T16:08:09.228302+0000","last_unstale":"2024-09-13T16:08:13.236440+0000","last_undegraded":"2024-09-13T16:08:13.236440+0000","last_fullsized":"2024-09-13T16:08:13.236440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:16.137380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.510980+0000","last_change":"2024-09-13T16:08:13.244886+0000","last_active":"2024-09-13T16:08:13.510980+0000","last_peered":"2024-09-13T16:08:13.510980+0000","last_clean":"2024-09-13T16:08:13.510980+0000","last_became_active":"2024-09-13T16:08:13.244476+0000","last_became_peered":"2024-09-13T16:08:13.244476+0000","last_unstale":"2024-09-13T16:08:13.510980+0000","last_undegraded":"2024-09-13T16:08:13.510980+0000","last_fullsized":"2024-09-13T16:08:13.510980+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:55.359807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.428741+0000","last_change":"2024-09-13T16:08:09.234804+0000","last_active":"2024-09-13T16:08:13.428741+0000","last_peered":"2024-09-13T16:08:13.428741+0000","last_clean":"2024-09-13T16:08:13.428741+0000","last_became_active":"2024-09-13T16:08:09.234358+0000","last_became_peered":"2024-09-13T16:08:09.234358+0000","last_unstale":"2024-09-13T16:08:13.428741+0000","last_undegraded":"2024-09-13T16:08:13.428741+0000","last_fullsized":"2024-09-13T16:08:13.428741+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:48:51.454586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.436566+0000","last_change":"2024-09-13T16:08:08.807412+0000","last_active":"2024-09-13T16:08:30.436566+0000","last_peered":"2024-09-13T16:08:30.436566+0000","last_clean":"2024-09-13T16:08:30.436566+0000","last_became_active":"2024-09-13T16:08:08.806940+0000","last_became_peered":"2024-09-13T16:08:08.806940+0000","last_unstale":"2024-09-13T16:08:30.436566+0000","last_undegraded":"2024-09-13T16:08:30.436566+0000","last_fullsized":"2024-09-13T16:08:30.436566+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:38.678823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.511071+0000","last_change":"2024-09-13T16:08:13.494327+0000","last_active":"2024-09-13T16:08:13.511071+0000","last_peered":"2024-09-13T16:08:13.511071+0000","last_clean":"2024-09-13T16:08:13.511071+0000","last_became_active":"2024-09-13T16:08:13.493850+0000","last_became_peered":"2024-09-13T16:08:13.493850+0000","last_unstale":"2024-09-13T16:08:13.511071+0000","last_undegraded":"2024-09-13T16:08:13.511071+0000","last_fullsized":"2024-09-13T16:08:13.511071+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:12.123640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617480+0000","last_change":"2024-09-13T16:08:09.233638+0000","last_active":"2024-09-13T16:08:13.617480+0000","last_peered":"2024-09-13T16:08:13.617480+0000","last_clean":"2024-09-13T16:08:13.617480+0000","last_became_active":"2024-09-13T16:08:09.233323+0000","last_became_peered":"2024-09-13T16:08:09.233323+0000","last_unstale":"2024-09-13T16:08:13.617480+0000","last_undegraded":"2024-09-13T16:08:13.617480+0000","last_fullsized":"2024-09-13T16:08:13.617480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:47.313442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.229264+0000","last_change":"2024-09-13T16:08:08.820002+0000","last_active":"2024-09-13T16:08:13.229264+0000","last_peered":"2024-09-13T16:08:13.229264+0000","last_clean":"2024-09-13T16:08:13.229264+0000","last_became_active":"2024-09-13T16:08:08.819675+0000","last_became_peered":"2024-09-13T16:08:08.819675+0000","last_unstale":"2024-09-13T16:08:13.229264+0000","last_undegraded":"2024-09-13T16:08:13.229264+0000","last_fullsized":"2024-09-13T16:08:13.229264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:13.691478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.511023+0000","last_change":"2024-09-13T16:08:13.257847+0000","last_active":"2024-09-13T16:08:13.511023+0000","last_peered":"2024-09-13T16:08:13.511023+0000","last_clean":"2024-09-13T16:08:13.511023+0000","last_became_active":"2024-09-13T16:08:13.257472+0000","last_became_peered":"2024-09-13T16:08:13.257472+0000","last_unstale":"2024-09-13T16:08:13.511023+0000","last_undegraded":"2024-09-13T16:08:13.511023+0000","last_fullsized":"2024-09-13T16:08:13.511023+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:53.002153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.234507+0000","last_change":"2024-09-13T16:08:09.221868+0000","last_active":"2024-09-13T16:08:13.234507+0000","last_peered":"2024-09-13T16:08:13.234507+0000","last_clean":"2024-09-13T16:08:13.234507+0000","last_became_active":"2024-09-13T16:08:09.221130+0000","last_became_peered":"2024-09-13T16:08:09.221130+0000","last_unstale":"2024-09-13T16:08:13.234507+0000","last_undegraded":"2024-09-13T16:08:13.234507+0000","last_fullsized":"2024-09-13T16:08:13.234507+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:12:54.102303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.436111+0000","last_change":"2024-09-13T16:08:08.807413+0000","last_active":"2024-09-13T16:08:30.436111+0000","last_peered":"2024-09-13T16:08:30.436111+0000","last_clean":"2024-09-13T16:08:30.436111+0000","last_became_active":"2024-09-13T16:08:08.807040+0000","last_became_peered":"2024-09-13T16:08:08.807040+0000","last_unstale":"2024-09-13T16:08:30.436111+0000","last_undegraded":"2024-09-13T16:08:30.436111+0000","last_fullsized":"2024-09-13T16:08:30.436111+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:00.580572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.922307+0000","last_change":"2024-09-13T16:08:13.257060+0000","last_active":"2024-09-13T16:08:13.922307+0000","last_peered":"2024-09-13T16:08:13.922307+0000","last_clean":"2024-09-13T16:08:13.922307+0000","last_became_active":"2024-09-13T16:08:13.256665+0000","last_became_peered":"2024-09-13T16:08:13.256665+0000","last_unstale":"2024-09-13T16:08:13.922307+0000","last_undegraded":"2024-09-13T16:08:13.922307+0000","last_fullsized":"2024-09-13T16:08:13.922307+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:33.139558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.233458+0000","last_change":"2024-09-13T16:08:09.231289+0000","last_active":"2024-09-13T16:08:13.233458+0000","last_peered":"2024-09-13T16:08:13.233458+0000","last_clean":"2024-09-13T16:08:13.233458+0000","last_became_active":"2024-09-13T16:08:09.230247+0000","last_became_peered":"2024-09-13T16:08:09.230247+0000","last_unstale":"2024-09-13T16:08:13.233458+0000","last_undegraded":"2024-09-13T16:08:13.233458+0000","last_fullsized":"2024-09-13T16:08:13.233458+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:34.765694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.435878+0000","last_change":"2024-09-13T16:08:08.797980+0000","last_active":"2024-09-13T16:08:30.435878+0000","last_peered":"2024-09-13T16:08:30.435878+0000","last_clean":"2024-09-13T16:08:30.435878+0000","last_became_active":"2024-09-13T16:08:08.797601+0000","last_became_peered":"2024-09-13T16:08:08.797601+0000","last_unstale":"2024-09-13T16:08:30.435878+0000","last_undegraded":"2024-09-13T16:08:30.435878+0000","last_fullsized":"2024-09-13T16:08:30.435878+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:37.985497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.511081+0000","last_change":"2024-09-13T16:08:13.494332+0000","last_active":"2024-09-13T16:08:13.511081+0000","last_peered":"2024-09-13T16:08:13.511081+0000","last_clean":"2024-09-13T16:08:13.511081+0000","last_became_active":"2024-09-13T16:08:13.493846+0000","last_became_peered":"2024-09-13T16:08:13.493846+0000","last_unstale":"2024-09-13T16:08:13.511081+0000","last_undegraded":"2024-09-13T16:08:13.511081+0000","last_fullsized":"2024-09-13T16:08:13.511081+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:08:17.342575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.251864+0000","last_change":"2024-09-13T16:08:09.241373+0000","last_active":"2024-09-13T16:08:13.251864+0000","last_peered":"2024-09-13T16:08:13.251864+0000","last_clean":"2024-09-13T16:08:13.251864+0000","last_became_active":"2024-09-13T16:08:09.240846+0000","last_became_peered":"2024-09-13T16:08:09.240846+0000","last_unstale":"2024-09-13T16:08:13.251864+0000","last_undegraded":"2024-09-13T16:08:13.251864+0000","last_fullsized":"2024-09-13T16:08:13.251864+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:11.315423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.435045+0000","last_change":"2024-09-13T16:08:08.805428+0000","last_active":"2024-09-13T16:08:30.435045+0000","last_peered":"2024-09-13T16:08:30.435045+0000","last_clean":"2024-09-13T16:08:30.435045+0000","last_became_active":"2024-09-13T16:08:08.805109+0000","last_became_peered":"2024-09-13T16:08:08.805109+0000","last_unstale":"2024-09-13T16:08:30.435045+0000","last_undegraded":"2024-09-13T16:08:30.435045+0000","last_fullsized":"2024-09-13T16:08:30.435045+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:30.335761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.466409+0000","last_change":"2024-09-13T16:08:13.240929+0000","last_active":"2024-09-13T16:08:14.466409+0000","last_peered":"2024-09-13T16:08:14.466409+0000","last_clean":"2024-09-13T16:08:14.466409+0000","last_became_active":"2024-09-13T16:08:13.240554+0000","last_became_peered":"2024-09-13T16:08:13.240554+0000","last_unstale":"2024-09-13T16:08:14.466409+0000","last_undegraded":"2024-09-13T16:08:14.466409+0000","last_fullsized":"2024-09-13T16:08:14.466409+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:20.853764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617511+0000","last_change":"2024-09-13T16:08:09.225824+0000","last_active":"2024-09-13T16:08:13.617511+0000","last_peered":"2024-09-13T16:08:13.617511+0000","last_clean":"2024-09-13T16:08:13.617511+0000","last_became_active":"2024-09-13T16:08:09.225568+0000","last_became_peered":"2024-09-13T16:08:09.225568+0000","last_unstale":"2024-09-13T16:08:13.617511+0000","last_undegraded":"2024-09-13T16:08:13.617511+0000","last_fullsized":"2024-09-13T16:08:13.617511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:05:13.423381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.922333+0000","last_change":"2024-09-13T16:08:08.812752+0000","last_active":"2024-09-13T16:08:13.922333+0000","last_peered":"2024-09-13T16:08:13.922333+0000","last_clean":"2024-09-13T16:08:13.922333+0000","last_became_active":"2024-09-13T16:08:08.810994+0000","last_became_peered":"2024-09-13T16:08:08.810994+0000","last_unstale":"2024-09-13T16:08:13.922333+0000","last_undegraded":"2024-09-13T16:08:13.922333+0000","last_fullsized":"2024-09-13T16:08:13.922333+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:46.449871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617397+0000","last_change":"2024-09-13T16:08:13.494450+0000","last_active":"2024-09-13T16:08:13.617397+0000","last_peered":"2024-09-13T16:08:13.617397+0000","last_clean":"2024-09-13T16:08:13.617397+0000","last_became_active":"2024-09-13T16:08:13.494008+0000","last_became_peered":"2024-09-13T16:08:13.494008+0000","last_unstale":"2024-09-13T16:08:13.617397+0000","last_undegraded":"2024-09-13T16:08:13.617397+0000","last_fullsized":"2024-09-13T16:08:13.617397+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:05.427801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.240765+0000","last_change":"2024-09-13T16:08:09.220790+0000","last_active":"2024-09-13T16:08:13.240765+0000","last_peered":"2024-09-13T16:08:13.240765+0000","last_clean":"2024-09-13T16:08:13.240765+0000","last_became_active":"2024-09-13T16:08:09.219420+0000","last_became_peered":"2024-09-13T16:08:09.219420+0000","last_unstale":"2024-09-13T16:08:13.240765+0000","last_undegraded":"2024-09-13T16:08:13.240765+0000","last_fullsized":"2024-09-13T16:08:13.240765+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:29.674270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.436490+0000","last_change":"2024-09-13T16:08:08.815272+0000","last_active":"2024-09-13T16:08:30.436490+0000","last_peered":"2024-09-13T16:08:30.436490+0000","last_clean":"2024-09-13T16:08:30.436490+0000","last_became_active":"2024-09-13T16:08:08.815018+0000","last_became_peered":"2024-09-13T16:08:08.815018+0000","last_unstale":"2024-09-13T16:08:30.436490+0000","last_undegraded":"2024-09-13T16:08:30.436490+0000","last_fullsized":"2024-09-13T16:08:30.436490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:29.277253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.492181+0000","last_change":"2024-09-13T16:08:13.249856+0000","last_active":"2024-09-13T16:08:14.492181+0000","last_peered":"2024-09-13T16:08:14.492181+0000","last_clean":"2024-09-13T16:08:14.492181+0000","last_became_active":"2024-09-13T16:08:13.249433+0000","last_became_peered":"2024-09-13T16:08:13.249433+0000","last_unstale":"2024-09-13T16:08:14.492181+0000","last_undegraded":"2024-09-13T16:08:14.492181+0000","last_fullsized":"2024-09-13T16:08:14.492181+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:18.805858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.493038+0000","last_change":"2024-09-13T16:08:09.239244+0000","last_active":"2024-09-13T16:08:13.493038+0000","last_peered":"2024-09-13T16:08:13.493038+0000","last_clean":"2024-09-13T16:08:13.493038+0000","last_became_active":"2024-09-13T16:08:09.238966+0000","last_became_peered":"2024-09-13T16:08:09.238966+0000","last_unstale":"2024-09-13T16:08:13.493038+0000","last_undegraded":"2024-09-13T16:08:13.493038+0000","last_fullsized":"2024-09-13T16:08:13.493038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:16:48.832090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.228550+0000","last_change":"2024-09-13T16:08:08.813429+0000","last_active":"2024-09-13T16:08:13.228550+0000","last_peered":"2024-09-13T16:08:13.228550+0000","last_clean":"2024-09-13T16:08:13.228550+0000","last_became_active":"2024-09-13T16:08:08.810497+0000","last_became_peered":"2024-09-13T16:08:08.810497+0000","last_unstale":"2024-09-13T16:08:13.228550+0000","last_undegraded":"2024-09-13T16:08:13.228550+0000","last_fullsized":"2024-09-13T16:08:13.228550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:59.728094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.495036+0000","last_change":"2024-09-13T16:08:13.494341+0000","last_active":"2024-09-13T16:08:13.495036+0000","last_peered":"2024-09-13T16:08:13.495036+0000","last_clean":"2024-09-13T16:08:13.495036+0000","last_became_active":"2024-09-13T16:08:13.493851+0000","last_became_peered":"2024-09-13T16:08:13.493851+0000","last_unstale":"2024-09-13T16:08:13.495036+0000","last_undegraded":"2024-09-13T16:08:13.495036+0000","last_fullsized":"2024-09-13T16:08:13.495036+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:27.389086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.492889+0000","last_change":"2024-09-13T16:08:09.241722+0000","last_active":"2024-09-13T16:08:13.492889+0000","last_peered":"2024-09-13T16:08:13.492889+0000","last_clean":"2024-09-13T16:08:13.492889+0000","last_became_active":"2024-09-13T16:08:09.241270+0000","last_became_peered":"2024-09-13T16:08:09.241270+0000","last_unstale":"2024-09-13T16:08:13.492889+0000","last_undegraded":"2024-09-13T16:08:13.492889+0000","last_fullsized":"2024-09-13T16:08:13.492889+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:38.909163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.220371+0000","last_change":"2024-09-13T16:08:08.807099+0000","last_active":"2024-09-13T16:08:14.220371+0000","last_peered":"2024-09-13T16:08:14.220371+0000","last_clean":"2024-09-13T16:08:14.220371+0000","last_became_active":"2024-09-13T16:08:08.806760+0000","last_became_peered":"2024-09-13T16:08:08.806760+0000","last_unstale":"2024-09-13T16:08:14.220371+0000","last_undegraded":"2024-09-13T16:08:14.220371+0000","last_fullsized":"2024-09-13T16:08:14.220371+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:31.077377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.662212+0000","last_change":"2024-09-13T16:08:13.258033+0000","last_active":"2024-09-13T16:08:13.662212+0000","last_peered":"2024-09-13T16:08:13.662212+0000","last_clean":"2024-09-13T16:08:13.662212+0000","last_became_active":"2024-09-13T16:08:13.257195+0000","last_became_peered":"2024-09-13T16:08:13.257195+0000","last_unstale":"2024-09-13T16:08:13.662212+0000","last_undegraded":"2024-09-13T16:08:13.662212+0000","last_fullsized":"2024-09-13T16:08:13.662212+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:38.599985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.236403+0000","last_change":"2024-09-13T16:08:09.223766+0000","last_active":"2024-09-13T16:08:13.236403+0000","last_peered":"2024-09-13T16:08:13.236403+0000","last_clean":"2024-09-13T16:08:13.236403+0000","last_became_active":"2024-09-13T16:08:09.223485+0000","last_became_peered":"2024-09-13T16:08:09.223485+0000","last_unstale":"2024-09-13T16:08:13.236403+0000","last_undegraded":"2024-09-13T16:08:13.236403+0000","last_fullsized":"2024-09-13T16:08:13.236403+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:32.222545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:33.456396+0000","last_change":"2024-09-13T16:08:08.812793+0000","last_active":"2024-09-13T16:08:33.456396+0000","last_peered":"2024-09-13T16:08:33.456396+0000","last_clean":"2024-09-13T16:08:33.456396+0000","last_became_active":"2024-09-13T16:08:08.811513+0000","last_became_peered":"2024-09-13T16:08:08.811513+0000","last_unstale":"2024-09-13T16:08:33.456396+0000","last_undegraded":"2024-09-13T16:08:33.456396+0000","last_fullsized":"2024-09-13T16:08:33.456396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:42.396184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.662292+0000","last_change":"2024-09-13T16:08:13.494286+0000","last_active":"2024-09-13T16:08:13.662292+0000","last_peered":"2024-09-13T16:08:13.662292+0000","last_clean":"2024-09-13T16:08:13.662292+0000","last_became_active":"2024-09-13T16:08:13.493848+0000","last_became_peered":"2024-09-13T16:08:13.493848+0000","last_unstale":"2024-09-13T16:08:13.662292+0000","last_undegraded":"2024-09-13T16:08:13.662292+0000","last_fullsized":"2024-09-13T16:08:13.662292+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:45.466478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.238786+0000","last_change":"2024-09-13T16:08:09.216137+0000","last_active":"2024-09-13T16:08:13.238786+0000","last_peered":"2024-09-13T16:08:13.238786+0000","last_clean":"2024-09-13T16:08:13.238786+0000","last_became_active":"2024-09-13T16:08:09.215801+0000","last_became_peered":"2024-09-13T16:08:09.215801+0000","last_unstale":"2024-09-13T16:08:13.238786+0000","last_undegraded":"2024-09-13T16:08:13.238786+0000","last_fullsized":"2024-09-13T16:08:13.238786+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:58.860711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:31.449252+0000","last_change":"2024-09-13T16:08:08.804138+0000","last_active":"2024-09-13T16:08:31.449252+0000","last_peered":"2024-09-13T16:08:31.449252+0000","last_clean":"2024-09-13T16:08:31.449252+0000","last_became_active":"2024-09-13T16:08:08.803812+0000","last_became_peered":"2024-09-13T16:08:08.803812+0000","last_unstale":"2024-09-13T16:08:31.449252+0000","last_undegraded":"2024-09-13T16:08:31.449252+0000","last_fullsized":"2024-09-13T16:08:31.449252+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:39.388227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.492987+0000","last_change":"2024-09-13T16:08:13.494259+0000","last_active":"2024-09-13T16:08:14.492987+0000","last_peered":"2024-09-13T16:08:14.492987+0000","last_clean":"2024-09-13T16:08:14.492987+0000","last_became_active":"2024-09-13T16:08:13.493792+0000","last_became_peered":"2024-09-13T16:08:13.493792+0000","last_unstale":"2024-09-13T16:08:14.492987+0000","last_undegraded":"2024-09-13T16:08:14.492987+0000","last_fullsized":"2024-09-13T16:08:14.492987+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:03:12.977792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617471+0000","last_change":"2024-09-13T16:08:09.226177+0000","last_active":"2024-09-13T16:08:13.617471+0000","last_peered":"2024-09-13T16:08:13.617471+0000","last_clean":"2024-09-13T16:08:13.617471+0000","last_became_active":"2024-09-13T16:08:09.225334+0000","last_became_peered":"2024-09-13T16:08:09.225334+0000","last_unstale":"2024-09-13T16:08:13.617471+0000","last_undegraded":"2024-09-13T16:08:13.617471+0000","last_fullsized":"2024-09-13T16:08:13.617471+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:15.539497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:32.451638+0000","last_change":"2024-09-13T16:08:08.807616+0000","last_active":"2024-09-13T16:08:32.451638+0000","last_peered":"2024-09-13T16:08:32.451638+0000","last_clean":"2024-09-13T16:08:32.451638+0000","last_became_active":"2024-09-13T16:08:08.807234+0000","last_became_peered":"2024-09-13T16:08:08.807234+0000","last_unstale":"2024-09-13T16:08:32.451638+0000","last_undegraded":"2024-09-13T16:08:32.451638+0000","last_fullsized":"2024-09-13T16:08:32.451638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:16.270075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":331,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.232265+0000","last_change":"2024-09-13T16:06:54.461102+0000","last_active":"2024-09-13T16:08:13.232265+0000","last_peered":"2024-09-13T16:08:13.232265+0000","last_clean":"2024-09-13T16:08:13.232265+0000","last_became_active":"2024-09-13T16:06:54.460531+0000","last_became_peered":"2024-09-13T16:06:54.460531+0000","last_unstale":"2024-09-13T16:08:13.232265+0000","last_undegraded":"2024-09-13T16:08:13.232265+0000","last_fullsized":"2024-09-13T16:08:13.232265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:03:28.200529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:03:28.200529+0000","last_clean_scrub_stamp":"2024-09-13T16:03:28.200529+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:30.260436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.220482+0000","last_change":"2024-09-13T16:08:13.246406+0000","last_active":"2024-09-13T16:08:14.220482+0000","last_peered":"2024-09-13T16:08:14.220482+0000","last_clean":"2024-09-13T16:08:14.220482+0000","last_became_active":"2024-09-13T16:08:13.246026+0000","last_became_peered":"2024-09-13T16:08:13.246026+0000","last_unstale":"2024-09-13T16:08:14.220482+0000","last_undegraded":"2024-09-13T16:08:14.220482+0000","last_fullsized":"2024-09-13T16:08:14.220482+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:28.665873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.428851+0000","last_change":"2024-09-13T16:08:09.233241+0000","last_active":"2024-09-13T16:08:13.428851+0000","last_peered":"2024-09-13T16:08:13.428851+0000","last_clean":"2024-09-13T16:08:13.428851+0000","last_became_active":"2024-09-13T16:08:09.232948+0000","last_became_peered":"2024-09-13T16:08:09.232948+0000","last_unstale":"2024-09-13T16:08:13.428851+0000","last_undegraded":"2024-09-13T16:08:13.428851+0000","last_fullsized":"2024-09-13T16:08:13.428851+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:09:45.475066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.229909+0000","last_change":"2024-09-13T16:08:08.808529+0000","last_active":"2024-09-13T16:08:13.229909+0000","last_peered":"2024-09-13T16:08:13.229909+0000","last_clean":"2024-09-13T16:08:13.229909+0000","last_became_active":"2024-09-13T16:08:08.808147+0000","last_became_peered":"2024-09-13T16:08:08.808147+0000","last_unstale":"2024-09-13T16:08:13.229909+0000","last_undegraded":"2024-09-13T16:08:13.229909+0000","last_fullsized":"2024-09-13T16:08:13.229909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:20.003116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.662162+0000","last_change":"2024-09-13T16:08:13.254834+0000","last_active":"2024-09-13T16:08:13.662162+0000","last_peered":"2024-09-13T16:08:13.662162+0000","last_clean":"2024-09-13T16:08:13.662162+0000","last_became_active":"2024-09-13T16:08:13.254367+0000","last_became_peered":"2024-09-13T16:08:13.254367+0000","last_unstale":"2024-09-13T16:08:13.662162+0000","last_undegraded":"2024-09-13T16:08:13.662162+0000","last_fullsized":"2024-09-13T16:08:13.662162+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:41.300674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.428799+0000","last_change":"2024-09-13T16:08:09.236082+0000","last_active":"2024-09-13T16:08:13.428799+0000","last_peered":"2024-09-13T16:08:13.428799+0000","last_clean":"2024-09-13T16:08:13.428799+0000","last_became_active":"2024-09-13T16:08:09.235750+0000","last_became_peered":"2024-09-13T16:08:09.235750+0000","last_unstale":"2024-09-13T16:08:13.428799+0000","last_undegraded":"2024-09-13T16:08:13.428799+0000","last_fullsized":"2024-09-13T16:08:13.428799+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:32.953680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.237101+0000","last_change":"2024-09-13T16:08:08.804210+0000","last_active":"2024-09-13T16:08:13.237101+0000","last_peered":"2024-09-13T16:08:13.237101+0000","last_clean":"2024-09-13T16:08:13.237101+0000","last_became_active":"2024-09-13T16:08:08.803910+0000","last_became_peered":"2024-09-13T16:08:08.803910+0000","last_unstale":"2024-09-13T16:08:13.237101+0000","last_undegraded":"2024-09-13T16:08:13.237101+0000","last_fullsized":"2024-09-13T16:08:13.237101+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:43.572010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.491945+0000","last_change":"2024-09-13T16:08:13.252873+0000","last_active":"2024-09-13T16:08:14.491945+0000","last_peered":"2024-09-13T16:08:14.491945+0000","last_clean":"2024-09-13T16:08:14.491945+0000","last_became_active":"2024-09-13T16:08:13.252051+0000","last_became_peered":"2024-09-13T16:08:13.252051+0000","last_unstale":"2024-09-13T16:08:14.491945+0000","last_undegraded":"2024-09-13T16:08:14.491945+0000","last_fullsized":"2024-09-13T16:08:14.491945+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:28.163552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.428868+0000","last_change":"2024-09-13T16:08:09.228033+0000","last_active":"2024-09-13T16:08:13.428868+0000","last_peered":"2024-09-13T16:08:13.428868+0000","last_clean":"2024-09-13T16:08:13.428868+0000","last_became_active":"2024-09-13T16:08:09.227741+0000","last_became_peered":"2024-09-13T16:08:09.227741+0000","last_unstale":"2024-09-13T16:08:13.428868+0000","last_undegraded":"2024-09-13T16:08:13.428868+0000","last_fullsized":"2024-09-13T16:08:13.428868+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:49.607147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.248534+0000","last_change":"2024-09-13T16:08:08.812963+0000","last_active":"2024-09-13T16:08:13.248534+0000","last_peered":"2024-09-13T16:08:13.248534+0000","last_clean":"2024-09-13T16:08:13.248534+0000","last_became_active":"2024-09-13T16:08:08.812627+0000","last_became_peered":"2024-09-13T16:08:08.812627+0000","last_unstale":"2024-09-13T16:08:13.248534+0000","last_undegraded":"2024-09-13T16:08:13.248534+0000","last_fullsized":"2024-09-13T16:08:13.248534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:11.237846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.491804+0000","last_change":"2024-09-13T16:08:13.242146+0000","last_active":"2024-09-13T16:08:14.491804+0000","last_peered":"2024-09-13T16:08:14.491804+0000","last_clean":"2024-09-13T16:08:14.491804+0000","last_became_active":"2024-09-13T16:08:13.241794+0000","last_became_peered":"2024-09-13T16:08:13.241794+0000","last_unstale":"2024-09-13T16:08:14.491804+0000","last_undegraded":"2024-09-13T16:08:14.491804+0000","last_fullsized":"2024-09-13T16:08:14.491804+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:55.392157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.234394+0000","last_change":"2024-09-13T16:08:09.221415+0000","last_active":"2024-09-13T16:08:13.234394+0000","last_peered":"2024-09-13T16:08:13.234394+0000","last_clean":"2024-09-13T16:08:13.234394+0000","last_became_active":"2024-09-13T16:08:09.221121+0000","last_became_peered":"2024-09-13T16:08:09.221121+0000","last_unstale":"2024-09-13T16:08:13.234394+0000","last_undegraded":"2024-09-13T16:08:13.234394+0000","last_fullsized":"2024-09-13T16:08:13.234394+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:37.839721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.924743+0000","last_change":"2024-09-13T16:08:08.805604+0000","last_active":"2024-09-13T16:08:13.924743+0000","last_peered":"2024-09-13T16:08:13.924743+0000","last_clean":"2024-09-13T16:08:13.924743+0000","last_became_active":"2024-09-13T16:08:08.805285+0000","last_became_peered":"2024-09-13T16:08:08.805285+0000","last_unstale":"2024-09-13T16:08:13.924743+0000","last_undegraded":"2024-09-13T16:08:13.924743+0000","last_fullsized":"2024-09-13T16:08:13.924743+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:53.534980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.491992+0000","last_change":"2024-09-13T16:08:13.253080+0000","last_active":"2024-09-13T16:08:14.491992+0000","last_peered":"2024-09-13T16:08:14.491992+0000","last_clean":"2024-09-13T16:08:14.491992+0000","last_became_active":"2024-09-13T16:08:13.252803+0000","last_became_peered":"2024-09-13T16:08:13.252803+0000","last_unstale":"2024-09-13T16:08:14.491992+0000","last_undegraded":"2024-09-13T16:08:14.491992+0000","last_fullsized":"2024-09-13T16:08:14.491992+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:45.074295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.236171+0000","last_change":"2024-09-13T16:08:09.226784+0000","last_active":"2024-09-13T16:08:13.236171+0000","last_peered":"2024-09-13T16:08:13.236171+0000","last_clean":"2024-09-13T16:08:13.236171+0000","last_became_active":"2024-09-13T16:08:09.226464+0000","last_became_peered":"2024-09-13T16:08:09.226464+0000","last_unstale":"2024-09-13T16:08:13.236171+0000","last_undegraded":"2024-09-13T16:08:13.236171+0000","last_fullsized":"2024-09-13T16:08:13.236171+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:42.808510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:31.451604+0000","last_change":"2024-09-13T16:08:08.814647+0000","last_active":"2024-09-13T16:08:31.451604+0000","last_peered":"2024-09-13T16:08:31.451604+0000","last_clean":"2024-09-13T16:08:31.451604+0000","last_became_active":"2024-09-13T16:08:08.814325+0000","last_became_peered":"2024-09-13T16:08:08.814325+0000","last_unstale":"2024-09-13T16:08:31.451604+0000","last_undegraded":"2024-09-13T16:08:31.451604+0000","last_fullsized":"2024-09-13T16:08:31.451604+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:15.358731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.662308+0000","last_change":"2024-09-13T16:08:13.259693+0000","last_active":"2024-09-13T16:08:13.662308+0000","last_peered":"2024-09-13T16:08:13.662308+0000","last_clean":"2024-09-13T16:08:13.662308+0000","last_became_active":"2024-09-13T16:08:13.254908+0000","last_became_peered":"2024-09-13T16:08:13.254908+0000","last_unstale":"2024-09-13T16:08:13.662308+0000","last_undegraded":"2024-09-13T16:08:13.662308+0000","last_fullsized":"2024-09-13T16:08:13.662308+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:57.130633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.428680+0000","last_change":"2024-09-13T16:08:09.231371+0000","last_active":"2024-09-13T16:08:13.428680+0000","last_peered":"2024-09-13T16:08:13.428680+0000","last_clean":"2024-09-13T16:08:13.428680+0000","last_became_active":"2024-09-13T16:08:09.231054+0000","last_became_peered":"2024-09-13T16:08:09.231054+0000","last_unstale":"2024-09-13T16:08:13.428680+0000","last_undegraded":"2024-09-13T16:08:13.428680+0000","last_fullsized":"2024-09-13T16:08:13.428680+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:59.921297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:33.457077+0000","last_change":"2024-09-13T16:08:08.803541+0000","last_active":"2024-09-13T16:08:33.457077+0000","last_peered":"2024-09-13T16:08:33.457077+0000","last_clean":"2024-09-13T16:08:33.457077+0000","last_became_active":"2024-09-13T16:08:08.803183+0000","last_became_peered":"2024-09-13T16:08:08.803183+0000","last_unstale":"2024-09-13T16:08:33.457077+0000","last_undegraded":"2024-09-13T16:08:33.457077+0000","last_fullsized":"2024-09-13T16:08:33.457077+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:09.210442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":932,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.922250+0000","last_change":"2024-09-13T16:08:13.259229+0000","last_active":"2024-09-13T16:08:13.922250+0000","last_peered":"2024-09-13T16:08:13.922250+0000","last_clean":"2024-09-13T16:08:13.922250+0000","last_became_active":"2024-09-13T16:08:13.258625+0000","last_became_peered":"2024-09-13T16:08:13.258625+0000","last_unstale":"2024-09-13T16:08:13.922250+0000","last_undegraded":"2024-09-13T16:08:13.922250+0000","last_fullsized":"2024-09-13T16:08:13.922250+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:09.660175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.428781+0000","last_change":"2024-09-13T16:08:09.229192+0000","last_active":"2024-09-13T16:08:13.428781+0000","last_peered":"2024-09-13T16:08:13.428781+0000","last_clean":"2024-09-13T16:08:13.428781+0000","last_became_active":"2024-09-13T16:08:09.227639+0000","last_became_peered":"2024-09-13T16:08:09.227639+0000","last_unstale":"2024-09-13T16:08:13.428781+0000","last_undegraded":"2024-09-13T16:08:13.428781+0000","last_fullsized":"2024-09-13T16:08:13.428781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:59.646494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.436741+0000","last_change":"2024-09-13T16:08:08.803645+0000","last_active":"2024-09-13T16:08:30.436741+0000","last_peered":"2024-09-13T16:08:30.436741+0000","last_clean":"2024-09-13T16:08:30.436741+0000","last_became_active":"2024-09-13T16:08:08.803248+0000","last_became_peered":"2024-09-13T16:08:08.803248+0000","last_unstale":"2024-09-13T16:08:30.436741+0000","last_undegraded":"2024-09-13T16:08:30.436741+0000","last_fullsized":"2024-09-13T16:08:30.436741+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:34.875141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.492619+0000","last_change":"2024-09-13T16:08:13.256058+0000","last_active":"2024-09-13T16:08:14.492619+0000","last_peered":"2024-09-13T16:08:14.492619+0000","last_clean":"2024-09-13T16:08:14.492619+0000","last_became_active":"2024-09-13T16:08:13.255760+0000","last_became_peered":"2024-09-13T16:08:13.255760+0000","last_unstale":"2024-09-13T16:08:14.492619+0000","last_undegraded":"2024-09-13T16:08:14.492619+0000","last_fullsized":"2024-09-13T16:08:14.492619+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:58.830340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.240066+0000","last_change":"2024-09-13T16:08:09.222978+0000","last_active":"2024-09-13T16:08:13.240066+0000","last_peered":"2024-09-13T16:08:13.240066+0000","last_clean":"2024-09-13T16:08:13.240066+0000","last_became_active":"2024-09-13T16:08:09.222646+0000","last_became_peered":"2024-09-13T16:08:09.222646+0000","last_unstale":"2024-09-13T16:08:13.240066+0000","last_undegraded":"2024-09-13T16:08:13.240066+0000","last_fullsized":"2024-09-13T16:08:13.240066+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:05.335298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"90'4","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.435355+0000","last_change":"2024-09-13T16:08:08.820187+0000","last_active":"2024-09-13T16:08:30.435355+0000","last_peered":"2024-09-13T16:08:30.435355+0000","last_clean":"2024-09-13T16:08:30.435355+0000","last_became_active":"2024-09-13T16:08:08.819825+0000","last_became_peered":"2024-09-13T16:08:08.819825+0000","last_unstale":"2024-09-13T16:08:30.435355+0000","last_undegraded":"2024-09-13T16:08:30.435355+0000","last_fullsized":"2024-09-13T16:08:30.435355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:13.175211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.492908+0000","last_change":"2024-09-13T16:08:13.247359+0000","last_active":"2024-09-13T16:08:14.492908+0000","last_peered":"2024-09-13T16:08:14.492908+0000","last_clean":"2024-09-13T16:08:14.492908+0000","last_became_active":"2024-09-13T16:08:13.247000+0000","last_became_peered":"2024-09-13T16:08:13.247000+0000","last_unstale":"2024-09-13T16:08:14.492908+0000","last_undegraded":"2024-09-13T16:08:14.492908+0000","last_fullsized":"2024-09-13T16:08:14.492908+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:24.447814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.236253+0000","last_change":"2024-09-13T16:08:09.235838+0000","last_active":"2024-09-13T16:08:13.236253+0000","last_peered":"2024-09-13T16:08:13.236253+0000","last_clean":"2024-09-13T16:08:13.236253+0000","last_became_active":"2024-09-13T16:08:09.235545+0000","last_became_peered":"2024-09-13T16:08:09.235545+0000","last_unstale":"2024-09-13T16:08:13.236253+0000","last_undegraded":"2024-09-13T16:08:13.236253+0000","last_fullsized":"2024-09-13T16:08:13.236253+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.842273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'12","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.435747+0000","last_change":"2024-09-13T16:08:08.798172+0000","last_active":"2024-09-13T16:08:30.435747+0000","last_peered":"2024-09-13T16:08:30.435747+0000","last_clean":"2024-09-13T16:08:30.435747+0000","last_became_active":"2024-09-13T16:08:08.797852+0000","last_became_peered":"2024-09-13T16:08:08.797852+0000","last_unstale":"2024-09-13T16:08:30.435747+0000","last_undegraded":"2024-09-13T16:08:30.435747+0000","last_fullsized":"2024-09-13T16:08:30.435747+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:19.455595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.921831+0000","last_change":"2024-09-13T16:08:13.246905+0000","last_active":"2024-09-13T16:08:13.921831+0000","last_peered":"2024-09-13T16:08:13.921831+0000","last_clean":"2024-09-13T16:08:13.921831+0000","last_became_active":"2024-09-13T16:08:13.246446+0000","last_became_peered":"2024-09-13T16:08:13.246446+0000","last_unstale":"2024-09-13T16:08:13.921831+0000","last_undegraded":"2024-09-13T16:08:13.921831+0000","last_fullsized":"2024-09-13T16:08:13.921831+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:10.282057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.236002+0000","last_change":"2024-09-13T16:08:09.223545+0000","last_active":"2024-09-13T16:08:13.236002+0000","last_peered":"2024-09-13T16:08:13.236002+0000","last_clean":"2024-09-13T16:08:13.236002+0000","last_became_active":"2024-09-13T16:08:09.223224+0000","last_became_peered":"2024-09-13T16:08:09.223224+0000","last_unstale":"2024-09-13T16:08:13.236002+0000","last_undegraded":"2024-09-13T16:08:13.236002+0000","last_fullsized":"2024-09-13T16:08:13.236002+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:43.886882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.493023+0000","last_change":"2024-09-13T16:08:08.811078+0000","last_active":"2024-09-13T16:08:14.493023+0000","last_peered":"2024-09-13T16:08:14.493023+0000","last_clean":"2024-09-13T16:08:14.493023+0000","last_became_active":"2024-09-13T16:08:08.810743+0000","last_became_peered":"2024-09-13T16:08:08.810743+0000","last_unstale":"2024-09-13T16:08:14.493023+0000","last_undegraded":"2024-09-13T16:08:14.493023+0000","last_fullsized":"2024-09-13T16:08:14.493023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:48.355869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.510992+0000","last_change":"2024-09-13T16:08:13.243634+0000","last_active":"2024-09-13T16:08:13.510992+0000","last_peered":"2024-09-13T16:08:13.510992+0000","last_clean":"2024-09-13T16:08:13.510992+0000","last_became_active":"2024-09-13T16:08:13.243283+0000","last_became_peered":"2024-09-13T16:08:13.243283+0000","last_unstale":"2024-09-13T16:08:13.510992+0000","last_undegraded":"2024-09-13T16:08:13.510992+0000","last_fullsized":"2024-09-13T16:08:13.510992+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:50.226378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.249885+0000","last_change":"2024-09-13T16:08:09.236851+0000","last_active":"2024-09-13T16:08:13.249885+0000","last_peered":"2024-09-13T16:08:13.249885+0000","last_clean":"2024-09-13T16:08:13.249885+0000","last_became_active":"2024-09-13T16:08:09.233841+0000","last_became_peered":"2024-09-13T16:08:09.233841+0000","last_unstale":"2024-09-13T16:08:13.249885+0000","last_undegraded":"2024-09-13T16:08:13.249885+0000","last_fullsized":"2024-09-13T16:08:13.249885+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.543328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.435973+0000","last_change":"2024-09-13T16:08:08.804942+0000","last_active":"2024-09-13T16:08:30.435973+0000","last_peered":"2024-09-13T16:08:30.435973+0000","last_clean":"2024-09-13T16:08:30.435973+0000","last_became_active":"2024-09-13T16:08:08.804618+0000","last_became_peered":"2024-09-13T16:08:08.804618+0000","last_unstale":"2024-09-13T16:08:30.435973+0000","last_undegraded":"2024-09-13T16:08:30.435973+0000","last_fullsized":"2024-09-13T16:08:30.435973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:54.798241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.921704+0000","last_change":"2024-09-13T16:08:13.255246+0000","last_active":"2024-09-13T16:08:13.921704+0000","last_peered":"2024-09-13T16:08:13.921704+0000","last_clean":"2024-09-13T16:08:13.921704+0000","last_became_active":"2024-09-13T16:08:13.249738+0000","last_became_peered":"2024-09-13T16:08:13.249738+0000","last_unstale":"2024-09-13T16:08:13.921704+0000","last_undegraded":"2024-09-13T16:08:13.921704+0000","last_fullsized":"2024-09-13T16:08:13.921704+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:59.917028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.237997+0000","last_change":"2024-09-13T16:08:09.232237+0000","last_active":"2024-09-13T16:08:13.237997+0000","last_peered":"2024-09-13T16:08:13.237997+0000","last_clean":"2024-09-13T16:08:13.237997+0000","last_became_active":"2024-09-13T16:08:09.231936+0000","last_became_peered":"2024-09-13T16:08:09.231936+0000","last_unstale":"2024-09-13T16:08:13.237997+0000","last_undegraded":"2024-09-13T16:08:13.237997+0000","last_fullsized":"2024-09-13T16:08:13.237997+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:14.154719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.436500+0000","last_change":"2024-09-13T16:08:08.807354+0000","last_active":"2024-09-13T16:08:30.436500+0000","last_peered":"2024-09-13T16:08:30.436500+0000","last_clean":"2024-09-13T16:08:30.436500+0000","last_became_active":"2024-09-13T16:08:08.807040+0000","last_became_peered":"2024-09-13T16:08:08.807040+0000","last_unstale":"2024-09-13T16:08:30.436500+0000","last_undegraded":"2024-09-13T16:08:30.436500+0000","last_fullsized":"2024-09-13T16:08:30.436500+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:38.861647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617430+0000","last_change":"2024-09-13T16:08:13.243743+0000","last_active":"2024-09-13T16:08:13.617430+0000","last_peered":"2024-09-13T16:08:13.617430+0000","last_clean":"2024-09-13T16:08:13.617430+0000","last_became_active":"2024-09-13T16:08:13.243197+0000","last_became_peered":"2024-09-13T16:08:13.243197+0000","last_unstale":"2024-09-13T16:08:13.617430+0000","last_undegraded":"2024-09-13T16:08:13.617430+0000","last_fullsized":"2024-09-13T16:08:13.617430+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:53.731019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.492180+0000","last_change":"2024-09-13T16:08:13.255518+0000","last_active":"2024-09-13T16:08:14.492180+0000","last_peered":"2024-09-13T16:08:14.492180+0000","last_clean":"2024-09-13T16:08:14.492180+0000","last_became_active":"2024-09-13T16:08:13.255082+0000","last_became_peered":"2024-09-13T16:08:13.255082+0000","last_unstale":"2024-09-13T16:08:14.492180+0000","last_undegraded":"2024-09-13T16:08:14.492180+0000","last_fullsized":"2024-09-13T16:08:14.492180+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:09.010691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.229197+0000","last_change":"2024-09-13T16:08:09.231940+0000","last_active":"2024-09-13T16:08:13.229197+0000","last_peered":"2024-09-13T16:08:13.229197+0000","last_clean":"2024-09-13T16:08:13.229197+0000","last_became_active":"2024-09-13T16:08:09.231587+0000","last_became_peered":"2024-09-13T16:08:09.231587+0000","last_unstale":"2024-09-13T16:08:13.229197+0000","last_undegraded":"2024-09-13T16:08:13.229197+0000","last_fullsized":"2024-09-13T16:08:13.229197+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:40.508328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.492436+0000","last_change":"2024-09-13T16:08:08.803903+0000","last_active":"2024-09-13T16:08:14.492436+0000","last_peered":"2024-09-13T16:08:14.492436+0000","last_clean":"2024-09-13T16:08:14.492436+0000","last_became_active":"2024-09-13T16:08:08.803412+0000","last_became_peered":"2024-09-13T16:08:08.803412+0000","last_unstale":"2024-09-13T16:08:14.492436+0000","last_undegraded":"2024-09-13T16:08:14.492436+0000","last_fullsized":"2024-09-13T16:08:14.492436+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:20.472012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.492723+0000","last_change":"2024-09-13T16:08:13.258590+0000","last_active":"2024-09-13T16:08:14.492723+0000","last_peered":"2024-09-13T16:08:14.492723+0000","last_clean":"2024-09-13T16:08:14.492723+0000","last_became_active":"2024-09-13T16:08:13.258181+0000","last_became_peered":"2024-09-13T16:08:13.258181+0000","last_unstale":"2024-09-13T16:08:14.492723+0000","last_undegraded":"2024-09-13T16:08:14.492723+0000","last_fullsized":"2024-09-13T16:08:14.492723+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:36.631501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617421+0000","last_change":"2024-09-13T16:08:09.228506+0000","last_active":"2024-09-13T16:08:13.617421+0000","last_peered":"2024-09-13T16:08:13.617421+0000","last_clean":"2024-09-13T16:08:13.617421+0000","last_became_active":"2024-09-13T16:08:09.226565+0000","last_became_peered":"2024-09-13T16:08:09.226565+0000","last_unstale":"2024-09-13T16:08:13.617421+0000","last_undegraded":"2024-09-13T16:08:13.617421+0000","last_fullsized":"2024-09-13T16:08:13.617421+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:46.333106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:31.452532+0000","last_change":"2024-09-13T16:08:08.807615+0000","last_active":"2024-09-13T16:08:31.452532+0000","last_peered":"2024-09-13T16:08:31.452532+0000","last_clean":"2024-09-13T16:08:31.452532+0000","last_became_active":"2024-09-13T16:08:08.807318+0000","last_became_peered":"2024-09-13T16:08:08.807318+0000","last_unstale":"2024-09-13T16:08:31.452532+0000","last_undegraded":"2024-09-13T16:08:31.452532+0000","last_fullsized":"2024-09-13T16:08:31.452532+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:36.901859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.492815+0000","last_change":"2024-09-13T16:08:08.806438+0000","last_active":"2024-09-13T16:08:13.492815+0000","last_peered":"2024-09-13T16:08:13.492815+0000","last_clean":"2024-09-13T16:08:13.492815+0000","last_became_active":"2024-09-13T16:08:08.806109+0000","last_became_peered":"2024-09-13T16:08:08.806109+0000","last_unstale":"2024-09-13T16:08:13.492815+0000","last_undegraded":"2024-09-13T16:08:13.492815+0000","last_fullsized":"2024-09-13T16:08:13.492815+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:31.862771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.236487+0000","last_change":"2024-09-13T16:08:09.228933+0000","last_active":"2024-09-13T16:08:13.236487+0000","last_peered":"2024-09-13T16:08:13.236487+0000","last_clean":"2024-09-13T16:08:13.236487+0000","last_became_active":"2024-09-13T16:08:09.228613+0000","last_became_peered":"2024-09-13T16:08:09.228613+0000","last_unstale":"2024-09-13T16:08:13.236487+0000","last_undegraded":"2024-09-13T16:08:13.236487+0000","last_fullsized":"2024-09-13T16:08:13.236487+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:25.110672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.466589+0000","last_change":"2024-09-13T16:08:13.244314+0000","last_active":"2024-09-13T16:08:14.466589+0000","last_peered":"2024-09-13T16:08:14.466589+0000","last_clean":"2024-09-13T16:08:14.466589+0000","last_became_active":"2024-09-13T16:08:13.243895+0000","last_became_peered":"2024-09-13T16:08:13.243895+0000","last_unstale":"2024-09-13T16:08:14.466589+0000","last_undegraded":"2024-09-13T16:08:14.466589+0000","last_fullsized":"2024-09-13T16:08:14.466589+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:54.639780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:30.436332+0000","last_change":"2024-09-13T16:08:08.803669+0000","last_active":"2024-09-13T16:08:30.436332+0000","last_peered":"2024-09-13T16:08:30.436332+0000","last_clean":"2024-09-13T16:08:30.436332+0000","last_became_active":"2024-09-13T16:08:08.803319+0000","last_became_peered":"2024-09-13T16:08:08.803319+0000","last_unstale":"2024-09-13T16:08:30.436332+0000","last_undegraded":"2024-09-13T16:08:30.436332+0000","last_fullsized":"2024-09-13T16:08:30.436332+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:05.791715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.236482+0000","last_change":"2024-09-13T16:08:09.225131+0000","last_active":"2024-09-13T16:08:13.236482+0000","last_peered":"2024-09-13T16:08:13.236482+0000","last_clean":"2024-09-13T16:08:13.236482+0000","last_became_active":"2024-09-13T16:08:09.224705+0000","last_became_peered":"2024-09-13T16:08:09.224705+0000","last_unstale":"2024-09-13T16:08:13.236482+0000","last_undegraded":"2024-09-13T16:08:13.236482+0000","last_fullsized":"2024-09-13T16:08:13.236482+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:54.676364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T16:08:14.466685+0000","last_change":"2024-09-13T16:08:13.240680+0000","last_active":"2024-09-13T16:08:14.466685+0000","last_peered":"2024-09-13T16:08:14.466685+0000","last_clean":"2024-09-13T16:08:14.466685+0000","last_became_active":"2024-09-13T16:08:13.240296+0000","last_became_peered":"2024-09-13T16:08:13.240296+0000","last_unstale":"2024-09-13T16:08:14.466685+0000","last_undegraded":"2024-09-13T16:08:14.466685+0000","last_fullsized":"2024-09-13T16:08:14.466685+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:32.990479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.234416+0000","last_change":"2024-09-13T16:08:09.221827+0000","last_active":"2024-09-13T16:08:13.234416+0000","last_peered":"2024-09-13T16:08:13.234416+0000","last_clean":"2024-09-13T16:08:13.234416+0000","last_became_active":"2024-09-13T16:08:09.220698+0000","last_became_peered":"2024-09-13T16:08:09.220698+0000","last_unstale":"2024-09-13T16:08:13.234416+0000","last_undegraded":"2024-09-13T16:08:13.234416+0000","last_fullsized":"2024-09-13T16:08:13.234416+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:17.721497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.229277+0000","last_change":"2024-09-13T16:08:09.217094+0000","last_active":"2024-09-13T16:08:13.229277+0000","last_peered":"2024-09-13T16:08:13.229277+0000","last_clean":"2024-09-13T16:08:13.229277+0000","last_became_active":"2024-09-13T16:08:09.216775+0000","last_became_peered":"2024-09-13T16:08:09.216775+0000","last_unstale":"2024-09-13T16:08:13.229277+0000","last_undegraded":"2024-09-13T16:08:13.229277+0000","last_fullsized":"2024-09-13T16:08:13.229277+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:32.350130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.229056+0000","last_change":"2024-09-13T16:08:09.227411+0000","last_active":"2024-09-13T16:08:13.229056+0000","last_peered":"2024-09-13T16:08:13.229056+0000","last_clean":"2024-09-13T16:08:13.229056+0000","last_became_active":"2024-09-13T16:08:09.227142+0000","last_became_peered":"2024-09-13T16:08:09.227142+0000","last_unstale":"2024-09-13T16:08:13.229056+0000","last_undegraded":"2024-09-13T16:08:13.229056+0000","last_fullsized":"2024-09-13T16:08:13.229056+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:46.883864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.251561+0000","last_change":"2024-09-13T16:08:09.229160+0000","last_active":"2024-09-13T16:08:13.251561+0000","last_peered":"2024-09-13T16:08:13.251561+0000","last_clean":"2024-09-13T16:08:13.251561+0000","last_became_active":"2024-09-13T16:08:09.228843+0000","last_became_peered":"2024-09-13T16:08:09.228843+0000","last_unstale":"2024-09-13T16:08:13.251561+0000","last_undegraded":"2024-09-13T16:08:13.251561+0000","last_fullsized":"2024-09-13T16:08:13.251561+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:11.667437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.240683+0000","last_change":"2024-09-13T16:08:09.228008+0000","last_active":"2024-09-13T16:08:13.240683+0000","last_peered":"2024-09-13T16:08:13.240683+0000","last_clean":"2024-09-13T16:08:13.240683+0000","last_became_active":"2024-09-13T16:08:09.227700+0000","last_became_peered":"2024-09-13T16:08:09.227700+0000","last_unstale":"2024-09-13T16:08:13.240683+0000","last_undegraded":"2024-09-13T16:08:13.240683+0000","last_fullsized":"2024-09-13T16:08:13.240683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:58.993532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.235321+0000","last_change":"2024-09-13T16:08:09.218650+0000","last_active":"2024-09-13T16:08:13.235321+0000","last_peered":"2024-09-13T16:08:13.235321+0000","last_clean":"2024-09-13T16:08:13.235321+0000","last_became_active":"2024-09-13T16:08:09.218347+0000","last_became_peered":"2024-09-13T16:08:09.218347+0000","last_unstale":"2024-09-13T16:08:13.235321+0000","last_undegraded":"2024-09-13T16:08:13.235321+0000","last_fullsized":"2024-09-13T16:08:13.235321+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:31.331274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.230192+0000","last_change":"2024-09-13T16:08:09.217256+0000","last_active":"2024-09-13T16:08:13.230192+0000","last_peered":"2024-09-13T16:08:13.230192+0000","last_clean":"2024-09-13T16:08:13.230192+0000","last_became_active":"2024-09-13T16:08:09.216960+0000","last_became_peered":"2024-09-13T16:08:09.216960+0000","last_unstale":"2024-09-13T16:08:13.230192+0000","last_undegraded":"2024-09-13T16:08:13.230192+0000","last_fullsized":"2024-09-13T16:08:13.230192+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:44.473317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617503+0000","last_change":"2024-09-13T16:08:09.225677+0000","last_active":"2024-09-13T16:08:13.617503+0000","last_peered":"2024-09-13T16:08:13.617503+0000","last_clean":"2024-09-13T16:08:13.617503+0000","last_became_active":"2024-09-13T16:08:09.224474+0000","last_became_peered":"2024-09-13T16:08:09.224474+0000","last_unstale":"2024-09-13T16:08:13.617503+0000","last_undegraded":"2024-09-13T16:08:13.617503+0000","last_fullsized":"2024-09-13T16:08:13.617503+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:01.474204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.235999+0000","last_change":"2024-09-13T16:08:09.229125+0000","last_active":"2024-09-13T16:08:13.235999+0000","last_peered":"2024-09-13T16:08:13.235999+0000","last_clean":"2024-09-13T16:08:13.235999+0000","last_became_active":"2024-09-13T16:08:09.228611+0000","last_became_peered":"2024-09-13T16:08:09.228611+0000","last_unstale":"2024-09-13T16:08:13.235999+0000","last_undegraded":"2024-09-13T16:08:13.235999+0000","last_fullsized":"2024-09-13T16:08:13.235999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:51.910316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617438+0000","last_change":"2024-09-13T16:08:09.226355+0000","last_active":"2024-09-13T16:08:13.617438+0000","last_peered":"2024-09-13T16:08:13.617438+0000","last_clean":"2024-09-13T16:08:13.617438+0000","last_became_active":"2024-09-13T16:08:09.225304+0000","last_became_peered":"2024-09-13T16:08:09.225304+0000","last_unstale":"2024-09-13T16:08:13.617438+0000","last_undegraded":"2024-09-13T16:08:13.617438+0000","last_fullsized":"2024-09-13T16:08:13.617438+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:01.714833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.236861+0000","last_change":"2024-09-13T16:08:09.223744+0000","last_active":"2024-09-13T16:08:13.236861+0000","last_peered":"2024-09-13T16:08:13.236861+0000","last_clean":"2024-09-13T16:08:13.236861+0000","last_became_active":"2024-09-13T16:08:09.223433+0000","last_became_peered":"2024-09-13T16:08:09.223433+0000","last_unstale":"2024-09-13T16:08:13.236861+0000","last_undegraded":"2024-09-13T16:08:13.236861+0000","last_fullsized":"2024-09-13T16:08:13.236861+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:32.406142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.240527+0000","last_change":"2024-09-13T16:08:09.227752+0000","last_active":"2024-09-13T16:08:13.240527+0000","last_peered":"2024-09-13T16:08:13.240527+0000","last_clean":"2024-09-13T16:08:13.240527+0000","last_became_active":"2024-09-13T16:08:09.227459+0000","last_became_peered":"2024-09-13T16:08:09.227459+0000","last_unstale":"2024-09-13T16:08:13.240527+0000","last_undegraded":"2024-09-13T16:08:13.240527+0000","last_fullsized":"2024-09-13T16:08:13.240527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:57.357214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.235094+0000","last_change":"2024-09-13T16:08:09.221624+0000","last_active":"2024-09-13T16:08:13.235094+0000","last_peered":"2024-09-13T16:08:13.235094+0000","last_clean":"2024-09-13T16:08:13.235094+0000","last_became_active":"2024-09-13T16:08:09.220573+0000","last_became_peered":"2024-09-13T16:08:09.220573+0000","last_unstale":"2024-09-13T16:08:13.235094+0000","last_undegraded":"2024-09-13T16:08:13.235094+0000","last_fullsized":"2024-09-13T16:08:13.235094+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:29.862958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.229979+0000","last_change":"2024-09-13T16:08:09.223575+0000","last_active":"2024-09-13T16:08:13.229979+0000","last_peered":"2024-09-13T16:08:13.229979+0000","last_clean":"2024-09-13T16:08:13.229979+0000","last_became_active":"2024-09-13T16:08:09.223312+0000","last_became_peered":"2024-09-13T16:08:09.223312+0000","last_unstale":"2024-09-13T16:08:13.229979+0000","last_undegraded":"2024-09-13T16:08:13.229979+0000","last_fullsized":"2024-09-13T16:08:13.229979+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:32.926562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.228595+0000","last_change":"2024-09-13T16:08:09.236371+0000","last_active":"2024-09-13T16:08:13.228595+0000","last_peered":"2024-09-13T16:08:13.228595+0000","last_clean":"2024-09-13T16:08:13.228595+0000","last_became_active":"2024-09-13T16:08:09.234906+0000","last_became_peered":"2024-09-13T16:08:09.234906+0000","last_unstale":"2024-09-13T16:08:13.228595+0000","last_undegraded":"2024-09-13T16:08:13.228595+0000","last_fullsized":"2024-09-13T16:08:13.228595+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:45.305622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.235435+0000","last_change":"2024-09-13T16:08:09.238765+0000","last_active":"2024-09-13T16:08:13.235435+0000","last_peered":"2024-09-13T16:08:13.235435+0000","last_clean":"2024-09-13T16:08:13.235435+0000","last_became_active":"2024-09-13T16:08:09.238469+0000","last_became_peered":"2024-09-13T16:08:09.238469+0000","last_unstale":"2024-09-13T16:08:13.235435+0000","last_undegraded":"2024-09-13T16:08:13.235435+0000","last_fullsized":"2024-09-13T16:08:13.235435+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:58.665620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.238684+0000","last_change":"2024-09-13T16:08:09.226472+0000","last_active":"2024-09-13T16:08:13.238684+0000","last_peered":"2024-09-13T16:08:13.238684+0000","last_clean":"2024-09-13T16:08:13.238684+0000","last_became_active":"2024-09-13T16:08:09.225988+0000","last_became_peered":"2024-09-13T16:08:09.225988+0000","last_unstale":"2024-09-13T16:08:13.238684+0000","last_undegraded":"2024-09-13T16:08:13.238684+0000","last_fullsized":"2024-09-13T16:08:13.238684+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:41.785752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.245936+0000","last_change":"2024-09-13T16:08:09.219313+0000","last_active":"2024-09-13T16:08:13.245936+0000","last_peered":"2024-09-13T16:08:13.245936+0000","last_clean":"2024-09-13T16:08:13.245936+0000","last_became_active":"2024-09-13T16:08:09.219030+0000","last_became_peered":"2024-09-13T16:08:09.219030+0000","last_unstale":"2024-09-13T16:08:13.245936+0000","last_undegraded":"2024-09-13T16:08:13.245936+0000","last_fullsized":"2024-09-13T16:08:13.245936+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:26.561305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.249877+0000","last_change":"2024-09-13T16:08:09.240585+0000","last_active":"2024-09-13T16:08:13.249877+0000","last_peered":"2024-09-13T16:08:13.249877+0000","last_clean":"2024-09-13T16:08:13.249877+0000","last_became_active":"2024-09-13T16:08:09.238960+0000","last_became_peered":"2024-09-13T16:08:09.238960+0000","last_unstale":"2024-09-13T16:08:13.249877+0000","last_undegraded":"2024-09-13T16:08:13.249877+0000","last_fullsized":"2024-09-13T16:08:13.249877+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:24.086723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.240443+0000","last_change":"2024-09-13T16:08:09.234963+0000","last_active":"2024-09-13T16:08:13.240443+0000","last_peered":"2024-09-13T16:08:13.240443+0000","last_clean":"2024-09-13T16:08:13.240443+0000","last_became_active":"2024-09-13T16:08:09.234649+0000","last_became_peered":"2024-09-13T16:08:09.234649+0000","last_unstale":"2024-09-13T16:08:13.240443+0000","last_undegraded":"2024-09-13T16:08:13.240443+0000","last_fullsized":"2024-09-13T16:08:13.240443+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:38.972344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.511045+0000","last_change":"2024-09-13T16:08:09.226425+0000","last_active":"2024-09-13T16:08:13.511045+0000","last_peered":"2024-09-13T16:08:13.511045+0000","last_clean":"2024-09-13T16:08:13.511045+0000","last_became_active":"2024-09-13T16:08:09.226121+0000","last_became_peered":"2024-09-13T16:08:09.226121+0000","last_unstale":"2024-09-13T16:08:13.511045+0000","last_undegraded":"2024-09-13T16:08:13.511045+0000","last_fullsized":"2024-09-13T16:08:13.511045+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:10.035414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.428820+0000","last_change":"2024-09-13T16:08:09.234592+0000","last_active":"2024-09-13T16:08:13.428820+0000","last_peered":"2024-09-13T16:08:13.428820+0000","last_clean":"2024-09-13T16:08:13.428820+0000","last_became_active":"2024-09-13T16:08:09.234293+0000","last_became_peered":"2024-09-13T16:08:09.234293+0000","last_unstale":"2024-09-13T16:08:13.428820+0000","last_undegraded":"2024-09-13T16:08:13.428820+0000","last_fullsized":"2024-09-13T16:08:13.428820+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:44.196400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.493136+0000","last_change":"2024-09-13T16:08:09.231974+0000","last_active":"2024-09-13T16:08:13.493136+0000","last_peered":"2024-09-13T16:08:13.493136+0000","last_clean":"2024-09-13T16:08:13.493136+0000","last_became_active":"2024-09-13T16:08:09.231667+0000","last_became_peered":"2024-09-13T16:08:09.231667+0000","last_unstale":"2024-09-13T16:08:13.493136+0000","last_undegraded":"2024-09-13T16:08:13.493136+0000","last_fullsized":"2024-09-13T16:08:13.493136+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:05.595837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.237697+0000","last_change":"2024-09-13T16:08:09.225322+0000","last_active":"2024-09-13T16:08:13.237697+0000","last_peered":"2024-09-13T16:08:13.237697+0000","last_clean":"2024-09-13T16:08:13.237697+0000","last_became_active":"2024-09-13T16:08:09.224969+0000","last_became_peered":"2024-09-13T16:08:09.224969+0000","last_unstale":"2024-09-13T16:08:13.237697+0000","last_undegraded":"2024-09-13T16:08:13.237697+0000","last_fullsized":"2024-09-13T16:08:13.237697+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:36.797080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.617412+0000","last_change":"2024-09-13T16:08:09.231870+0000","last_active":"2024-09-13T16:08:13.617412+0000","last_peered":"2024-09-13T16:08:13.617412+0000","last_clean":"2024-09-13T16:08:13.617412+0000","last_became_active":"2024-09-13T16:08:09.231606+0000","last_became_peered":"2024-09-13T16:08:09.231606+0000","last_unstale":"2024-09-13T16:08:13.617412+0000","last_undegraded":"2024-09-13T16:08:13.617412+0000","last_fullsized":"2024-09-13T16:08:13.617412+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:49.235264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.428725+0000","last_change":"2024-09-13T16:08:09.224800+0000","last_active":"2024-09-13T16:08:13.428725+0000","last_peered":"2024-09-13T16:08:13.428725+0000","last_clean":"2024-09-13T16:08:13.428725+0000","last_became_active":"2024-09-13T16:08:09.224487+0000","last_became_peered":"2024-09-13T16:08:09.224487+0000","last_unstale":"2024-09-13T16:08:13.428725+0000","last_undegraded":"2024-09-13T16:08:13.428725+0000","last_fullsized":"2024-09-13T16:08:13.428725+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:33.619689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.492749+0000","last_change":"2024-09-13T16:08:09.230428+0000","last_active":"2024-09-13T16:08:13.492749+0000","last_peered":"2024-09-13T16:08:13.492749+0000","last_clean":"2024-09-13T16:08:13.492749+0000","last_became_active":"2024-09-13T16:08:09.230139+0000","last_became_peered":"2024-09-13T16:08:09.230139+0000","last_unstale":"2024-09-13T16:08:13.492749+0000","last_undegraded":"2024-09-13T16:08:13.492749+0000","last_fullsized":"2024-09-13T16:08:13.492749+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:56.475566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.235602+0000","last_change":"2024-09-13T16:08:09.223142+0000","last_active":"2024-09-13T16:08:13.235602+0000","last_peered":"2024-09-13T16:08:13.235602+0000","last_clean":"2024-09-13T16:08:13.235602+0000","last_became_active":"2024-09-13T16:08:09.222718+0000","last_became_peered":"2024-09-13T16:08:09.222718+0000","last_unstale":"2024-09-13T16:08:13.235602+0000","last_undegraded":"2024-09-13T16:08:13.235602+0000","last_fullsized":"2024-09-13T16:08:13.235602+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:00.737875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.511034+0000","last_change":"2024-09-13T16:08:09.220060+0000","last_active":"2024-09-13T16:08:13.511034+0000","last_peered":"2024-09-13T16:08:13.511034+0000","last_clean":"2024-09-13T16:08:13.511034+0000","last_became_active":"2024-09-13T16:08:09.219751+0000","last_became_peered":"2024-09-13T16:08:09.219751+0000","last_unstale":"2024-09-13T16:08:13.511034+0000","last_undegraded":"2024-09-13T16:08:13.511034+0000","last_fullsized":"2024-09-13T16:08:13.511034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:47.103762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.247254+0000","last_change":"2024-09-13T16:08:09.230914+0000","last_active":"2024-09-13T16:08:13.247254+0000","last_peered":"2024-09-13T16:08:13.247254+0000","last_clean":"2024-09-13T16:08:13.247254+0000","last_became_active":"2024-09-13T16:08:09.230500+0000","last_became_peered":"2024-09-13T16:08:09.230500+0000","last_unstale":"2024-09-13T16:08:13.247254+0000","last_undegraded":"2024-09-13T16:08:13.247254+0000","last_fullsized":"2024-09-13T16:08:13.247254+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:02.096851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.248817+0000","last_change":"2024-09-13T16:08:09.239818+0000","last_active":"2024-09-13T16:08:13.248817+0000","last_peered":"2024-09-13T16:08:13.248817+0000","last_clean":"2024-09-13T16:08:13.248817+0000","last_became_active":"2024-09-13T16:08:09.238707+0000","last_became_peered":"2024-09-13T16:08:09.238707+0000","last_unstale":"2024-09-13T16:08:13.248817+0000","last_undegraded":"2024-09-13T16:08:13.248817+0000","last_fullsized":"2024-09-13T16:08:13.248817+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:46.937934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:08:13.235259+0000","last_change":"2024-09-13T16:08:09.238796+0000","last_active":"2024-09-13T16:08:13.235259+0000","last_peered":"2024-09-13T16:08:13.235259+0000","last_clean":"2024-09-13T16:08:13.235259+0000","last_became_active":"2024-09-13T16:08:09.238510+0000","last_became_peered":"2024-09-13T16:08:09.238510+0000","last_unstale":"2024-09-13T16:08:13.235259+0000","last_undegraded":"2024-09-13T16:08:13.235259+0000","last_fullsized":"2024-09-13T16:08:13.235259+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:18.691940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7119,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":109,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":58039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350992,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":987136,"data_stored":479614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.48199999999999998}]},{"osd":1,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.77000000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.501},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.52300000000000002}]},{"osd":6,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.71799999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":9,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.748},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.67700000000000005}]},{"osd":10,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.78500000000000003}]}]},{"osd":10,"up_from":73,"seq":313532612630,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1617920,"data_stored":1074733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.38},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.65500000000000003}]},{"osd":3,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.68500000000000005}]},{"osd":4,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.5},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.78200000000000003}]},{"osd":6,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.377},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.39900000000000002}]},{"osd":8,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.747}]},{"osd":9,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.73699999999999999}]},{"osd":11,"last update":"Fri Sep 13 16:08:16 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.69999999999999996}]}]},{"osd":9,"up_from":68,"seq":292057776155,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":480398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.39700000000000002}]},{"osd":1,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.495}]},{"osd":3,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.503}]},{"osd":4,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.54700000000000004}]},{"osd":7,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.745},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.64900000000000002}]},{"osd":8,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.55700000000000005}]},{"osd":10,"last update":"Fri Sep 13 16:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.68200000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":8,"up_from":60,"seq":257698037793,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":1003520,"data_stored":480021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.751,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Sep 13 16:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71099999999999997,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.58199999999999996,"15min":0.59199999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73699999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.68999999999999995}]},{"osd":2,"last update":"Fri Sep 13 16:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.39500000000000002,"15min":0.39800000000000002},"min":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.32600000000000001}]},{"osd":3,"last update":"Fri Sep 13 16:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.625,"15min":0.63900000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72199999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Sep 13 16:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56899999999999995,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72799999999999998,"5min":0.75,"15min":0.75},"last":0.45800000000000002}]},{"osd":5,"last update":"Fri Sep 13 16:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72699999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.34499999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70099999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68799999999999994,"15min":0.69099999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.64100000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82999999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.65300000000000002}]},{"osd":9,"last update":"Fri Sep 13 16:08:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.65700000000000003,"15min":0.66000000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.50600000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95799999999999996,"5min":1.401,"15min":1.401},"last":0.54700000000000004}]},{"osd":10,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.66600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":7,"up_from":52,"seq":223338299430,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36764,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708388,"statfs":{"total":95995035648,"available":95957389312,"internally_reserved":0,"allocated":1593344,"data_stored":1071397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.432,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.37,"15min":0.36899999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.373,"15min":0.37},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.39400000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.439,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76900000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.41399999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47399999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.58299999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.501},{"interface":"front","average":{"1min":0.623,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57899999999999996}]},{"osd":4,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.442,"15min":0.441},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.46400000000000002,"15min":0.46500000000000002},"min":{"1min":0.30399999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72799999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.375}]},{"osd":5,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84899999999999998,"5min":1.022,"15min":1.022},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.42099999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.433}]},{"osd":6,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.621},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66800000000000004,"15min":0.66600000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88500000000000001,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58999999999999997}]},{"osd":8,"last update":"Fri Sep 13 16:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.44800000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.45000000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.55300000000000005}]},{"osd":9,"last update":"Fri Sep 13 16:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72199999999999998,"15min":0.72799999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.56499999999999995}]},{"osd":10,"last update":"Fri Sep 13 16:07:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.51900000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":6,"up_from":47,"seq":201863462955,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":479431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:08:19 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.33200000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70299999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.46200000000000002,"15min":0.45300000000000001},"min":{"1min":0.309,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.438}]},{"osd":1,"last update":"Fri Sep 13 16:08:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.68899999999999995,"15min":0.67300000000000004},"min":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93999999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63700000000000001,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.84299999999999997,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Sep 13 16:08:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.622},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.81399999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.62},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70099999999999996,"15min":0.68700000000000006},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.78100000000000003}]},{"osd":3,"last update":"Fri Sep 13 16:08:19 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.59899999999999998},"min":{"1min":0.38700000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.82299999999999995,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Sep 13 16:08:19 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82699999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.745,"15min":0.73099999999999998},"min":{"1min":0.52800000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.01,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:08:19 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67700000000000005,"15min":0.66700000000000004},"min":{"1min":0.503,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90100000000000002,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Sep 13 16:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70899999999999996,"15min":0.70599999999999996},"min":{"1min":0.51200000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.95999999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.749,"15min":0.74099999999999999},"min":{"1min":0.56399999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.753}]},{"osd":8,"last update":"Fri Sep 13 16:08:04 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77300000000000002,"15min":0.76700000000000002},"min":{"1min":0.57499999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73099999999999998,"15min":0.72999999999999998},"min":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.92000000000000004,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.72899999999999998}]},{"osd":9,"last update":"Fri Sep 13 16:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.83899999999999997,"15min":0.84699999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.752,"15min":0.75800000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96099999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.63}]},{"osd":10,"last update":"Fri Sep 13 16:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.80000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":5,"up_from":39,"seq":167503724591,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36780,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708372,"statfs":{"total":95995035648,"available":95957372928,"internally_reserved":0,"allocated":1609728,"data_stored":1071410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:07:46 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82499999999999996,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.439},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75700000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.496}]},{"osd":1,"last update":"Fri Sep 13 16:07:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72699999999999998,"5min":0.748,"15min":0.748},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51300000000000001,"15min":0.50700000000000001},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.47399999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:07:46 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.373,"15min":0.36699999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52900000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.379,"15min":0.375},"min":{"1min":0.25,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.58799999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.35799999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:07:46 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.42299999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.45600000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.58099999999999996}]},{"osd":4,"last update":"Fri Sep 13 16:07:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77600000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.377}]},{"osd":6,"last update":"Fri Sep 13 16:08:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.71899999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61199999999999999,"15min":0.60599999999999998},"min":{"1min":0.42199999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73499999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.626}]},{"osd":7,"last update":"Fri Sep 13 16:07:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58799999999999997,"15min":0.59099999999999997},"min":{"1min":0.439,"5min":0.437,"15min":0.437},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.66100000000000003}]},{"osd":8,"last update":"Fri Sep 13 16:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71399999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.64300000000000002}]},{"osd":9,"last update":"Fri Sep 13 16:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.70799999999999996,"15min":0.71999999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.755,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.73999999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.71999999999999997}]},{"osd":10,"last update":"Fri Sep 13 16:07:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.69499999999999995}]}]},{"osd":4,"up_from":34,"seq":146028888117,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":999424,"data_stored":480210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:07:28 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.51800000000000002,"15min":0.49099999999999999},"min":{"1min":0.438,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.48199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.436}]},{"osd":1,"last update":"Fri Sep 13 16:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35099999999999998,"15min":0.33200000000000002},"min":{"1min":0.24399999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.36299999999999999,"15min":0.34200000000000003},"min":{"1min":0.27800000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.59999999999999998,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.33800000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.33400000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71499999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51300000000000001,"15min":0.50600000000000001},"min":{"1min":0.309,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.622}]},{"osd":3,"last update":"Fri Sep 13 16:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55800000000000005,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76200000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.54000000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81699999999999995,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:07:45 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.53700000000000003},"min":{"1min":0.47599999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.436,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.56699999999999995}]},{"osd":6,"last update":"Fri Sep 13 16:08:14 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61099999999999999,"15min":0.59799999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82599999999999996,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.623,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81299999999999994,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Sep 13 16:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.64900000000000002,"15min":0.67700000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68799999999999994,"5min":3.4660000000000002,"15min":3.4660000000000002},"last":0.495},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.61299999999999999,"15min":0.63},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76300000000000001,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.64000000000000001}]},{"osd":8,"last update":"Fri Sep 13 16:08:00 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.48099999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.62,"15min":0.61499999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58699999999999997}]},{"osd":9,"last update":"Fri Sep 13 16:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.72799999999999998}]},{"osd":10,"last update":"Fri Sep 13 16:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.66700000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":3,"up_from":26,"seq":111669149754,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":479567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:08:08 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.42499999999999999,"15min":0.38600000000000001},"min":{"1min":0.28000000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64900000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.434,"15min":0.40600000000000003},"min":{"1min":0.316,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.748,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.34599999999999997}]},{"osd":1,"last update":"Fri Sep 13 16:08:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59899999999999998,"15min":0.57999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90400000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63500000000000001,"15min":0.58699999999999997},"min":{"1min":0.496,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.72999999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:08:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65300000000000002,"15min":0.60299999999999998},"min":{"1min":0.498,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85299999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.65900000000000003,"15min":0.59499999999999997},"min":{"1min":0.57499999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90000000000000002,"5min":1.179,"15min":1.179},"last":0.70499999999999996}]},{"osd":4,"last update":"Fri Sep 13 16:08:20 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63700000000000001,"15min":0.60999999999999999},"min":{"1min":0.40500000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82099999999999995,"5min":1.016,"15min":1.016},"last":0.623},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.66600000000000004,"15min":0.625},"min":{"1min":0.52100000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.91900000000000004,"5min":0.995,"15min":0.995},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:07:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.68400000000000005,"15min":0.67100000000000004},"min":{"1min":0.54900000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66300000000000003,"15min":0.65500000000000003},"min":{"1min":0.498,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.65900000000000003}]},{"osd":6,"last update":"Fri Sep 13 16:08:12 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64900000000000002,"15min":0.64400000000000002},"min":{"1min":0.47799999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.038,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.439,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89200000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.39900000000000002}]},{"osd":7,"last update":"Fri Sep 13 16:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93999999999999995,"5min":1.105,"15min":1.105},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78600000000000003,"15min":0.78300000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1040000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.64300000000000002}]},{"osd":8,"last update":"Fri Sep 13 16:07:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82099999999999995,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.0069999999999999,"5min":1.2,"15min":1.2},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78000000000000003,"15min":0.78600000000000003},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.86399999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.623}]},{"osd":9,"last update":"Fri Sep 13 16:08:29 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.80000000000000004,"15min":0.80400000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0049999999999999,"5min":1.042,"15min":1.042},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.85699999999999998,"15min":0.86699999999999999},"min":{"1min":0.54300000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0429999999999999,"5min":1.073,"15min":1.073},"last":0.81100000000000005}]},{"osd":10,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.76200000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":484017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:07:32 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.38700000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.442,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.751,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.505}]},{"osd":1,"last update":"Fri Sep 13 16:07:32 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.53200000000000003,"15min":0.502},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.501,"15min":0.47099999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68700000000000006,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.628}]},{"osd":3,"last update":"Fri Sep 13 16:07:58 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80100000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81799999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58599999999999997}]},{"osd":4,"last update":"Fri Sep 13 16:07:20 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.55700000000000005,"15min":0.54000000000000004},"min":{"1min":0.39200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77900000000000003,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.55200000000000005,"15min":0.53300000000000003},"min":{"1min":0.38500000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.85599999999999998}]},{"osd":5,"last update":"Fri Sep 13 16:07:49 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.41799999999999998,"15min":0.40799999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.69899999999999995,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47599999999999998,"15min":0.46200000000000002},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69099999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.75800000000000001}]},{"osd":6,"last update":"Fri Sep 13 16:08:19 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65200000000000002,"15min":0.64900000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.748,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75800000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65100000000000002,"15min":0.64900000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.878},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.81000000000000005}]},{"osd":8,"last update":"Fri Sep 13 16:07:58 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65100000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76500000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.81799999999999995}]},{"osd":9,"last update":"Fri Sep 13 16:08:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.70199999999999996,"15min":0.70699999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93000000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.75}]},{"osd":10,"last update":"Fri Sep 13 16:07:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.78600000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":1032192,"data_stored":519766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.309,"15min":0.309},"max":{"1min":0.78300000000000003,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.441},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.38600000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.49399999999999999},"min":{"1min":0.30399999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.78400000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51100000000000001,"15min":0.504},"min":{"1min":0.32100000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.71399999999999997}]},{"osd":3,"last update":"Fri Sep 13 16:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.56599999999999995,"15min":0.53700000000000003},"min":{"1min":0.432,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.497}]},{"osd":4,"last update":"Fri Sep 13 16:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67500000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.375},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.44700000000000001,"15min":0.436},"min":{"1min":0.315,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72799999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.626}]},{"osd":5,"last update":"Fri Sep 13 16:07:49 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.53300000000000003,"15min":0.52500000000000002},"min":{"1min":0.40200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.755}]},{"osd":6,"last update":"Fri Sep 13 16:08:14 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60699999999999998,"15min":0.59199999999999997},"min":{"1min":0.44400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61299999999999999,"15min":0.59099999999999997},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51400000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.439,"15min":0.436},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.46899999999999997,"15min":0.46500000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.40600000000000003}]},{"osd":8,"last update":"Fri Sep 13 16:08:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82599999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.434,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.72999999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.61499999999999999}]},{"osd":9,"last update":"Fri Sep 13 16:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.69299999999999995,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.95299999999999996,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.66100000000000003}]},{"osd":10,"last update":"Fri Sep 13 16:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":1011712,"data_stored":480819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58199999999999996,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.57799999999999996,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83499999999999996,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Sep 13 16:07:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64000000000000001,"15min":0.61699999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.028,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.64800000000000002,"15min":0.626},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.77800000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:07:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.505,"15min":0.47499999999999998},"min":{"1min":0.38400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.47099999999999997,"15min":0.441},"min":{"1min":0.36399999999999999,"5min":0.308,"15min":0.308},"max":{"1min":1,"5min":1,"15min":1},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:08:23 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60399999999999998,"15min":0.57999999999999996},"min":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78800000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.59899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92600000000000005,"5min":1.006,"15min":1.006},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Sep 13 16:07:47 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98599999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84199999999999997,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63900000000000001,"15min":0.625},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.89300000000000002,"5min":1.004,"15min":1.004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.65600000000000003,"15min":0.63800000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78800000000000003,"5min":1.141,"15min":1.141},"last":0.72699999999999998}]},{"osd":7,"last update":"Fri Sep 13 16:07:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73799999999999999,"15min":0.74299999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.57099999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.85999999999999999}]},{"osd":8,"last update":"Fri Sep 13 16:07:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.095,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.264,"5min":0.91200000000000003,"15min":0.85399999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":13.347,"5min":13.347,"15min":13.347},"last":0.66500000000000004}]},{"osd":9,"last update":"Fri Sep 13 16:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.87,"15min":0.89800000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.016,"5min":1.224,"15min":1.224},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.83499999999999996,"15min":0.85899999999999999},"min":{"1min":0.499,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88800000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.64800000000000002}]},{"osd":10,"last update":"Fri Sep 13 16:07:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.82499999999999996}]},{"osd":11,"last update":"Fri Sep 13 16:08:18 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.79000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":40425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:08:36.006 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T16:08:36.007 INFO:tasks.cephadm:Setting up client nodes... 2024-09-13T16:08:36.007 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T16:08:36.350 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:08:36.722 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:36 smithi086 ceph-mon[30379]: pgmap v308: 129 pgs: 129 active+clean; 584 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.4 KiB/s wr, 6 op/s 2024-09-13T16:08:36.722 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:36 smithi086 ceph-mon[30379]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:08:36.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:36 smithi139 ceph-mon[35320]: pgmap v308: 129 pgs: 129 active+clean; 584 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.4 KiB/s wr, 6 op/s 2024-09-13T16:08:36.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:36 smithi139 ceph-mon[35320]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:08:36.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:36 smithi194 ceph-mon[35694]: pgmap v308: 129 pgs: 129 active+clean; 584 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.4 KiB/s wr, 6 op/s 2024-09-13T16:08:36.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:36 smithi194 ceph-mon[35694]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:08:37.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:37 smithi086 ceph-mon[30379]: from='client.24875 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:08:37.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:37 smithi139 ceph-mon[35320]: from='client.24875 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:08:37.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:37 smithi194 ceph-mon[35694]: from='client.24875 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:08:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.466+0000 7fdbe5e00640 1 -- 172.21.15.86:0/3727843879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbe0107c70 msgr2=0x7fdbe010a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.466+0000 7fdbe5e00640 1 --2- 172.21.15.86:0/3727843879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbe0107c70 0x7fdbe010a130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009ca0 tx=0x7fdbd802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:08:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.466+0000 7fdbe5e00640 1 -- 172.21.15.86:0/3727843879 shutdown_connections 2024-09-13T16:08:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.466+0000 7fdbe5e00640 1 --2- 172.21.15.86:0/3727843879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbe0107c70 0x7fdbe010a130 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.466+0000 7fdbe5e00640 1 --2- 172.21.15.86:0/3727843879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbe0072f10 0x7fdbe0073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.466+0000 7fdbe5e00640 1 --2- 172.21.15.86:0/3727843879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbe00744e0 0x7fdbe0072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.466+0000 7fdbe5e00640 1 -- 172.21.15.86:0/3727843879 >> 172.21.15.86:0/3727843879 conn(0x7fdbe00fb5a0 msgr2=0x7fdbe00fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.466+0000 7fdbe5e00640 1 -- 172.21.15.86:0/3727843879 shutdown_connections 2024-09-13T16:08:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.466+0000 7fdbe5e00640 1 -- 172.21.15.86:0/3727843879 wait complete. 2024-09-13T16:08:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.467+0000 7fdbe5e00640 1 Processor -- start 2024-09-13T16:08:38.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.467+0000 7fdbe5e00640 1 -- start start 2024-09-13T16:08:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.467+0000 7fdbe5e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbe0072f10 0x7fdbe0197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.467+0000 7fdbe5e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbe00744e0 0x7fdbe0198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.467+0000 7fdbe5e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbe0107c70 0x7fdbe019f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.467+0000 7fdbe5e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe019faf0 con 0x7fdbe00744e0 2024-09-13T16:08:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.467+0000 7fdbe5e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe019fc60 con 0x7fdbe0072f10 2024-09-13T16:08:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.467+0000 7fdbe5e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe019fe20 con 0x7fdbe0107c70 2024-09-13T16:08:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.468+0000 7fdbde000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbe00744e0 0x7fdbe0198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.468+0000 7fdbdf400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbe0107c70 0x7fdbe019f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.468+0000 7fdbdea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbe0072f10 0x7fdbe0197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.468+0000 7fdbdea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbe0072f10 0x7fdbe0197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:45680/0 (socket says 172.21.15.86:45680) 2024-09-13T16:08:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.468+0000 7fdbdea00640 1 -- 172.21.15.86:0/2137476823 learned_addr learned my addr 172.21.15.86:0/2137476823 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.468+0000 7fdbdf400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbe0107c70 0x7fdbe019f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:39652/0 (socket says 172.21.15.86:39652) 2024-09-13T16:08:38.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.468+0000 7fdbdea00640 1 -- 172.21.15.86:0/2137476823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbe0107c70 msgr2=0x7fdbe019f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:38.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.468+0000 7fdbdea00640 1 --2- 172.21.15.86:0/2137476823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbe0107c70 0x7fdbe019f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:38.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.468+0000 7fdbdea00640 1 -- 172.21.15.86:0/2137476823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbe00744e0 msgr2=0x7fdbe0198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:38.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.468+0000 7fdbdea00640 1 --2- 172.21.15.86:0/2137476823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbe00744e0 0x7fdbe0198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:38.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.468+0000 7fdbdea00640 1 -- 172.21.15.86:0/2137476823 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc009490 con 0x7fdbe0072f10 2024-09-13T16:08:38.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.469+0000 7fdbdea00640 1 --2- 172.21.15.86:0/2137476823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbe0072f10 0x7fdbe0197ff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdbd000e9c0 tx=0x7fdbd000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:38.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.472+0000 7fdbe4a00640 1 -- 172.21.15.86:0/2137476823 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0009700 con 0x7fdbe0072f10 2024-09-13T16:08:38.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.472+0000 7fdbe4a00640 1 -- 172.21.15.86:0/2137476823 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdbd000cd80 con 0x7fdbe0072f10 2024-09-13T16:08:38.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.472+0000 7fdbe4a00640 1 -- 172.21.15.86:0/2137476823 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0010430 con 0x7fdbe0072f10 2024-09-13T16:08:38.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.472+0000 7fdbe5e00640 1 -- 172.21.15.86:0/2137476823 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd8009900 con 0x7fdbe0072f10 2024-09-13T16:08:38.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.472+0000 7fdbe5e00640 1 -- 172.21.15.86:0/2137476823 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe01a0420 con 0x7fdbe0072f10 2024-09-13T16:08:38.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.474+0000 7fdbe5e00640 1 -- 172.21.15.86:0/2137476823 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe01069f0 con 0x7fdbe0072f10 2024-09-13T16:08:38.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.475+0000 7fdbe4a00640 1 -- 172.21.15.86:0/2137476823 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fdbd0005020 con 0x7fdbe0072f10 2024-09-13T16:08:38.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.476+0000 7fdbe4a00640 1 --2- 172.21.15.86:0/2137476823 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fdbc40a11c0 0x7fdbc40a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:38.491 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.476+0000 7fdbe4a00640 1 -- 172.21.15.86:0/2137476823 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fdbd0014070 con 0x7fdbe0072f10 2024-09-13T16:08:38.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.476+0000 7fdbde000640 1 --2- 172.21.15.86:0/2137476823 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fdbc40a11c0 0x7fdbc40a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:38.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.477+0000 7fdbde000640 1 --2- 172.21.15.86:0/2137476823 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fdbc40a11c0 0x7fdbc40a3680 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0199510 tx=0x7fdbcc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:38.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.480+0000 7fdbe4a00640 1 -- 172.21.15.86:0/2137476823 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdbd0096490 con 0x7fdbe0072f10 2024-09-13T16:08:38.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:38 smithi086 ceph-mon[30379]: pgmap v309: 129 pgs: 129 active+clean; 620 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2024-09-13T16:08:38.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.727+0000 7fdbe5e00640 1 -- 172.21.15.86:0/2137476823 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fdbe010d9f0 con 0x7fdbe0072f10 2024-09-13T16:08:38.736 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.735+0000 7fdbe4a00640 1 -- 172.21.15.86:0/2137476823 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7fdbd0099ab0 con 0x7fdbe0072f10 2024-09-13T16:08:38.737 INFO:teuthology.orchestra.run.smithi086.stdout:[client.0] 2024-09-13T16:08:38.737 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCGY+Rm1W9+KxAAmKfpPIUiG7gLnwSKeFoyjQ== 2024-09-13T16:08:38.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.737+0000 7fdbe5e00640 1 -- 172.21.15.86:0/2137476823 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fdbc40a11c0 msgr2=0x7fdbc40a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:38.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.737+0000 7fdbe5e00640 1 --2- 172.21.15.86:0/2137476823 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fdbc40a11c0 0x7fdbc40a3680 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0199510 tx=0x7fdbcc005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:38.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.737+0000 7fdbe5e00640 1 -- 172.21.15.86:0/2137476823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbe0072f10 msgr2=0x7fdbe0197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:38.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.737+0000 7fdbe5e00640 1 --2- 172.21.15.86:0/2137476823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbe0072f10 0x7fdbe0197ff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdbd000e9c0 tx=0x7fdbd000ee80 comp rx=0 tx=0).stop 2024-09-13T16:08:38.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.737+0000 7fdbe5e00640 1 -- 172.21.15.86:0/2137476823 shutdown_connections 2024-09-13T16:08:38.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.737+0000 7fdbe5e00640 1 --2- 172.21.15.86:0/2137476823 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fdbc40a11c0 0x7fdbc40a3680 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:38.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.737+0000 7fdbe5e00640 1 --2- 172.21.15.86:0/2137476823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbe0107c70 0x7fdbe019f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:38.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.737+0000 7fdbe5e00640 1 --2- 172.21.15.86:0/2137476823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbe00744e0 0x7fdbe0198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:38.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.737+0000 7fdbe5e00640 1 --2- 172.21.15.86:0/2137476823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbe0072f10 0x7fdbe0197ff0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:38.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.737+0000 7fdbe5e00640 1 -- 172.21.15.86:0/2137476823 >> 172.21.15.86:0/2137476823 conn(0x7fdbe00fb5a0 msgr2=0x7fdbe0103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:38.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.738+0000 7fdbe5e00640 1 -- 172.21.15.86:0/2137476823 shutdown_connections 2024-09-13T16:08:38.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:38.738+0000 7fdbe5e00640 1 -- 172.21.15.86:0/2137476823 wait complete. 2024-09-13T16:08:38.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:38 smithi139 ceph-mon[35320]: pgmap v309: 129 pgs: 129 active+clean; 620 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2024-09-13T16:08:38.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:38 smithi194 ceph-mon[35694]: pgmap v309: 129 pgs: 129 active+clean; 620 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2024-09-13T16:08:39.628 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T16:08:39.628 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-13T16:08:39.628 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T16:08:39.712 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T16:08:39.712 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-13T16:08:39.712 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-13T16:08:39.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:39 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2137476823' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T16:08:39.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:39 smithi139 ceph-mon[35320]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T16:08:39.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:39 smithi139 ceph-mon[35320]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T16:08:39.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:39 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2137476823' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T16:08:39.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:39 smithi194 ceph-mon[35694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T16:08:39.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:39 smithi194 ceph-mon[35694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T16:08:39.799 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:39 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2137476823' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T16:08:39.799 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:39 smithi086 ceph-mon[30379]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T16:08:39.799 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:39 smithi086 ceph-mon[30379]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T16:08:40.065 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:08:40.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:40 smithi139 ceph-mon[35320]: pgmap v310: 129 pgs: 129 active+clean; 620 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.9 KiB/s wr, 12 op/s 2024-09-13T16:08:40.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:40 smithi194 ceph-mon[35694]: pgmap v310: 129 pgs: 129 active+clean; 620 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.9 KiB/s wr, 12 op/s 2024-09-13T16:08:40.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:40 smithi086 ceph-mon[30379]: pgmap v310: 129 pgs: 129 active+clean; 620 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.9 KiB/s wr, 12 op/s 2024-09-13T16:08:42.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.121+0000 7f5015600640 1 -- 172.21.15.86:0/4277378143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5010110c40 msgr2=0x7f5010113030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:42.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.121+0000 7f5015600640 1 --2- 172.21.15.86:0/4277378143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5010110c40 0x7f5010113030 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5008009900 tx=0x7f500802a410 comp rx=0 tx=0).stop 2024-09-13T16:08:42.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.121+0000 7f5015600640 1 -- 172.21.15.86:0/4277378143 shutdown_connections 2024-09-13T16:08:42.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.121+0000 7f5015600640 1 --2- 172.21.15.86:0/4277378143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5010110c40 0x7f5010113030 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:42.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.121+0000 7f5015600640 1 --2- 172.21.15.86:0/4277378143 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5010075300 0x7f5010110700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:42.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.121+0000 7f5015600640 1 --2- 172.21.15.86:0/4277378143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50100749e0 0x7f5010074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:42.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.121+0000 7f5015600640 1 -- 172.21.15.86:0/4277378143 >> 172.21.15.86:0/4277378143 conn(0x7f50100fdc60 msgr2=0x7f5010100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:42.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.121+0000 7f5015600640 1 -- 172.21.15.86:0/4277378143 shutdown_connections 2024-09-13T16:08:42.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.122+0000 7f5015600640 1 -- 172.21.15.86:0/4277378143 wait complete. 2024-09-13T16:08:42.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.123+0000 7f5015600640 1 Processor -- start 2024-09-13T16:08:42.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.123+0000 7f5015600640 1 -- start start 2024-09-13T16:08:42.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.123+0000 7f5015600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50100749e0 0x7f501019ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:42.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.123+0000 7f5015600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5010075300 0x7f501019cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:42.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.123+0000 7f5015600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5010110c40 0x7f50101a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:42.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.123+0000 7f5015600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50101a1970 con 0x7f5010075300 2024-09-13T16:08:42.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.123+0000 7f5015600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50101a1ae0 con 0x7f50100749e0 2024-09-13T16:08:42.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.123+0000 7f5015600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50101a1ca0 con 0x7f5010110c40 2024-09-13T16:08:42.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.124+0000 7f5006000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5010075300 0x7f501019cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:42.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.124+0000 7f500f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5010110c40 0x7f50101a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:42.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.124+0000 7f500ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50100749e0 0x7f501019ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:42.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.124+0000 7f500f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5010110c40 0x7f50101a1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:39680/0 (socket says 172.21.15.86:39680) 2024-09-13T16:08:42.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.124+0000 7f500f400640 1 -- 172.21.15.86:0/1770050613 learned_addr learned my addr 172.21.15.86:0/1770050613 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:42.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.124+0000 7f500ea00640 1 -- 172.21.15.86:0/1770050613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5010110c40 msgr2=0x7f50101a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:42.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.124+0000 7f500ea00640 1 --2- 172.21.15.86:0/1770050613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5010110c40 0x7f50101a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:42.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.124+0000 7f500ea00640 1 -- 172.21.15.86:0/1770050613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5010075300 msgr2=0x7f501019cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:42.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.124+0000 7f500ea00640 1 --2- 172.21.15.86:0/1770050613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5010075300 0x7f501019cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:42.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.124+0000 7f500ea00640 1 -- 172.21.15.86:0/1770050613 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5008009560 con 0x7f50100749e0 2024-09-13T16:08:42.203 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.124+0000 7f5006000640 1 --2- 172.21.15.86:0/1770050613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5010075300 0x7f501019cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:42.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.124+0000 7f500ea00640 1 --2- 172.21.15.86:0/1770050613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50100749e0 0x7f501019ca00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f500000eb00 tx=0x7f500000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:42.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.125+0000 7f5007e00640 1 -- 172.21.15.86:0/1770050613 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000010430 con 0x7f50100749e0 2024-09-13T16:08:42.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.125+0000 7f5007e00640 1 -- 172.21.15.86:0/1770050613 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5000010a70 con 0x7f50100749e0 2024-09-13T16:08:42.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.125+0000 7f5015600640 1 -- 172.21.15.86:0/1770050613 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50101a1f80 con 0x7f50100749e0 2024-09-13T16:08:42.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.125+0000 7f5007e00640 1 -- 172.21.15.86:0/1770050613 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000017b70 con 0x7f50100749e0 2024-09-13T16:08:42.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.125+0000 7f5015600640 1 -- 172.21.15.86:0/1770050613 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50101a97f0 con 0x7f50100749e0 2024-09-13T16:08:42.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.126+0000 7f5015600640 1 -- 172.21.15.86:0/1770050613 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5010076120 con 0x7f50100749e0 2024-09-13T16:08:42.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.128+0000 7f5007e00640 1 -- 172.21.15.86:0/1770050613 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5000017cd0 con 0x7f50100749e0 2024-09-13T16:08:42.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.129+0000 7f5007e00640 1 --2- 172.21.15.86:0/1770050613 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4ff40a1110 0x7f4ff40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:42.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.129+0000 7f5007e00640 1 -- 172.21.15.86:0/1770050613 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f5000014070 con 0x7f50100749e0 2024-09-13T16:08:42.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.129+0000 7f5006000640 1 --2- 172.21.15.86:0/1770050613 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4ff40a1110 0x7f4ff40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:42.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.130+0000 7f5006000640 1 --2- 172.21.15.86:0/1770050613 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4ff40a1110 0x7f4ff40a35d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f501019dfb0 tx=0x7f4ff8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:42.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.131+0000 7f5007e00640 1 -- 172.21.15.86:0/1770050613 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5000096b70 con 0x7f50100749e0 2024-09-13T16:08:42.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.349+0000 7f5015600640 1 -- 172.21.15.86:0/1770050613 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f5010074dc0 con 0x7f50100749e0 2024-09-13T16:08:42.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.354+0000 7f5007e00640 1 -- 172.21.15.86:0/1770050613 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260283 (secure 0 0 0) 0x7f500009a190 con 0x7f50100749e0 2024-09-13T16:08:42.360 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:42.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.358+0000 7f5015600640 1 -- 172.21.15.86:0/1770050613 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4ff40a1110 msgr2=0x7f4ff40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:42.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.358+0000 7f5015600640 1 --2- 172.21.15.86:0/1770050613 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4ff40a1110 0x7f4ff40a35d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f501019dfb0 tx=0x7f4ff8005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:42.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.358+0000 7f5015600640 1 -- 172.21.15.86:0/1770050613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50100749e0 msgr2=0x7f501019ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:42.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.358+0000 7f5015600640 1 --2- 172.21.15.86:0/1770050613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50100749e0 0x7f501019ca00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f500000eb00 tx=0x7f500000c2d0 comp rx=0 tx=0).stop 2024-09-13T16:08:42.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.358+0000 7f5015600640 1 -- 172.21.15.86:0/1770050613 shutdown_connections 2024-09-13T16:08:42.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.358+0000 7f5015600640 1 --2- 172.21.15.86:0/1770050613 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4ff40a1110 0x7f4ff40a35d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:42.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.358+0000 7f5015600640 1 --2- 172.21.15.86:0/1770050613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5010110c40 0x7f50101a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:42.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.358+0000 7f5015600640 1 --2- 172.21.15.86:0/1770050613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5010075300 0x7f501019cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:42.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.358+0000 7f5015600640 1 --2- 172.21.15.86:0/1770050613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50100749e0 0x7f501019ca00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:42.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.358+0000 7f5015600640 1 -- 172.21.15.86:0/1770050613 >> 172.21.15.86:0/1770050613 conn(0x7f50100fdc60 msgr2=0x7f5010100050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:42.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.359+0000 7f5015600640 1 -- 172.21.15.86:0/1770050613 shutdown_connections 2024-09-13T16:08:42.363 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:42.359+0000 7f5015600640 1 -- 172.21.15.86:0/1770050613 wait complete. 2024-09-13T16:08:42.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:42 smithi086 ceph-mon[30379]: pgmap v311: 129 pgs: 129 active+clean; 633 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2024-09-13T16:08:42.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:42 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1770050613' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T16:08:42.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:42 smithi139 ceph-mon[35320]: pgmap v311: 129 pgs: 129 active+clean; 633 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2024-09-13T16:08:42.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:42 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1770050613' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T16:08:42.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:42 smithi194 ceph-mon[35694]: pgmap v311: 129 pgs: 129 active+clean; 633 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2024-09-13T16:08:42.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:42 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1770050613' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T16:08:43.083 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1239909622},{"type":"v1","addr":"172.21.15.86:6801","nonce":1239909622}]},"active_addr":"172.21.15.86:6801/1239909622","active_change":"2024-09-13T16:00:59.245596+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.86:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":3918454201}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":3724876715}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":68660500}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":316649138}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":2557453553}]}]} 2024-09-13T16:08:43.093 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-13T16:08:43.093 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-13T16:08:43.094 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T16:08:43.404 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:08:44.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:44 smithi139 ceph-mon[35320]: pgmap v312: 129 pgs: 129 active+clean; 633 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.8 KiB/s wr, 13 op/s 2024-09-13T16:08:44.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:44 smithi194 ceph-mon[35694]: pgmap v312: 129 pgs: 129 active+clean; 633 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.8 KiB/s wr, 13 op/s 2024-09-13T16:08:44.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:44 smithi086 ceph-mon[30379]: pgmap v312: 129 pgs: 129 active+clean; 633 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.8 KiB/s wr, 13 op/s 2024-09-13T16:08:45.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.588+0000 7fb727200640 1 -- 172.21.15.86:0/1835085114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb72810c480 msgr2=0x7fb72810e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:45.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.588+0000 7fb727200640 1 --2- 172.21.15.86:0/1835085114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb72810c480 0x7fb72810e870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb720009ca0 tx=0x7fb72002a950 comp rx=0 tx=0).stop 2024-09-13T16:08:45.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.588+0000 7fb727200640 1 -- 172.21.15.86:0/1835085114 shutdown_connections 2024-09-13T16:08:45.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.588+0000 7fb727200640 1 --2- 172.21.15.86:0/1835085114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb72810c480 0x7fb72810e870 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:45.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.588+0000 7fb727200640 1 --2- 172.21.15.86:0/1835085114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7280730f0 0x7fb72810bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:45.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.588+0000 7fb727200640 1 --2- 172.21.15.86:0/1835085114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7280727d0 0x7fb728072bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:45.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.588+0000 7fb727200640 1 -- 172.21.15.86:0/1835085114 >> 172.21.15.86:0/1835085114 conn(0x7fb7280fb900 msgr2=0x7fb7280fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:45.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.588+0000 7fb727200640 1 -- 172.21.15.86:0/1835085114 shutdown_connections 2024-09-13T16:08:45.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.588+0000 7fb727200640 1 -- 172.21.15.86:0/1835085114 wait complete. 2024-09-13T16:08:45.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.589+0000 7fb727200640 1 Processor -- start 2024-09-13T16:08:45.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.589+0000 7fb727200640 1 -- start start 2024-09-13T16:08:45.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.590+0000 7fb727200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7280727d0 0x7fb728198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:45.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.590+0000 7fb727200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7280730f0 0x7fb7281988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:45.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.590+0000 7fb727200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb72810c480 0x7fb72819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:45.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.590+0000 7fb727200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72819d2d0 con 0x7fb7280727d0 2024-09-13T16:08:45.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.590+0000 7fb727200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72819d440 con 0x7fb7280730f0 2024-09-13T16:08:45.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.590+0000 7fb727200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72819d5b0 con 0x7fb72810c480 2024-09-13T16:08:45.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.590+0000 7fb725e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7280727d0 0x7fb728198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:45.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.590+0000 7fb725e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7280727d0 0x7fb728198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58014/0 (socket says 172.21.15.86:58014) 2024-09-13T16:08:45.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.590+0000 7fb725e00640 1 -- 172.21.15.86:0/613423008 learned_addr learned my addr 172.21.15.86:0/613423008 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:45.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.590+0000 7fb71d400640 1 --2- 172.21.15.86:0/613423008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7280730f0 0x7fb7281988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:45.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.590+0000 7fb726800640 1 --2- 172.21.15.86:0/613423008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb72810c480 0x7fb72819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:45.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.590+0000 7fb71d400640 1 -- 172.21.15.86:0/613423008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb72810c480 msgr2=0x7fb72819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:45.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.590+0000 7fb71d400640 1 --2- 172.21.15.86:0/613423008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb72810c480 0x7fb72819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:45.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.590+0000 7fb71d400640 1 -- 172.21.15.86:0/613423008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7280727d0 msgr2=0x7fb728198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:45.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.590+0000 7fb71d400640 1 --2- 172.21.15.86:0/613423008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7280727d0 0x7fb728198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:45.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.590+0000 7fb71d400640 1 -- 172.21.15.86:0/613423008 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720009900 con 0x7fb7280730f0 2024-09-13T16:08:45.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.591+0000 7fb71d400640 1 --2- 172.21.15.86:0/613423008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7280730f0 0x7fb7281988d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb71000e9f0 tx=0x7fb71000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:45.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.591+0000 7fb71f400640 1 -- 172.21.15.86:0/613423008 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71000ccc0 con 0x7fb7280730f0 2024-09-13T16:08:45.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.591+0000 7fb727200640 1 -- 172.21.15.86:0/613423008 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72819d890 con 0x7fb7280730f0 2024-09-13T16:08:45.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.591+0000 7fb71f400640 1 -- 172.21.15.86:0/613423008 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb71000ce20 con 0x7fb7280730f0 2024-09-13T16:08:45.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.591+0000 7fb71f400640 1 -- 172.21.15.86:0/613423008 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7100188c0 con 0x7fb7280730f0 2024-09-13T16:08:45.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.591+0000 7fb727200640 1 -- 172.21.15.86:0/613423008 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7281a5150 con 0x7fb7280730f0 2024-09-13T16:08:45.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.592+0000 7fb727200640 1 -- 172.21.15.86:0/613423008 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb72819db00 con 0x7fb7280730f0 2024-09-13T16:08:45.596 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.594+0000 7fb71f400640 1 -- 172.21.15.86:0/613423008 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb710018a20 con 0x7fb7280730f0 2024-09-13T16:08:45.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.595+0000 7fb71f400640 1 --2- 172.21.15.86:0/613423008 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb70c0a1100 0x7fb70c0a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:45.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.595+0000 7fb71f400640 1 -- 172.21.15.86:0/613423008 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb710014070 con 0x7fb7280730f0 2024-09-13T16:08:45.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.595+0000 7fb725e00640 1 --2- 172.21.15.86:0/613423008 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb70c0a1100 0x7fb70c0a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:45.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.596+0000 7fb725e00640 1 --2- 172.21.15.86:0/613423008 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb70c0a1100 0x7fb70c0a35c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb718009c90 tx=0x7fb718005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:45.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.599+0000 7fb71f400640 1 -- 172.21.15.86:0/613423008 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb710052e20 con 0x7fb7280730f0 2024-09-13T16:08:45.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.770+0000 7fb727200640 1 -- 172.21.15.86:0/613423008 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb728072bb0 con 0x7fb7280730f0 2024-09-13T16:08:45.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.772+0000 7fb71f400640 1 -- 172.21.15.86:0/613423008 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23949 (secure 0 0 0) 0x7fb710099dd0 con 0x7fb7280730f0 2024-09-13T16:08:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:45.774 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":90,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:08:13.655740+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:08:45.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.774+0000 7fb727200640 1 -- 172.21.15.86:0/613423008 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb70c0a1100 msgr2=0x7fb70c0a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:45.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.774+0000 7fb727200640 1 --2- 172.21.15.86:0/613423008 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb70c0a1100 0x7fb70c0a35c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb718009c90 tx=0x7fb718005f90 comp rx=0 tx=0).stop 2024-09-13T16:08:45.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.774+0000 7fb727200640 1 -- 172.21.15.86:0/613423008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7280730f0 msgr2=0x7fb7281988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:45.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.774+0000 7fb727200640 1 --2- 172.21.15.86:0/613423008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7280730f0 0x7fb7281988d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb71000e9f0 tx=0x7fb71000eeb0 comp rx=0 tx=0).stop 2024-09-13T16:08:45.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.774+0000 7fb727200640 1 -- 172.21.15.86:0/613423008 shutdown_connections 2024-09-13T16:08:45.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.774+0000 7fb727200640 1 --2- 172.21.15.86:0/613423008 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb70c0a1100 0x7fb70c0a35c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:45.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.774+0000 7fb727200640 1 --2- 172.21.15.86:0/613423008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb72810c480 0x7fb72819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:45.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.774+0000 7fb727200640 1 --2- 172.21.15.86:0/613423008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7280730f0 0x7fb7281988d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:45.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.774+0000 7fb727200640 1 --2- 172.21.15.86:0/613423008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7280727d0 0x7fb728198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:45.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.774+0000 7fb727200640 1 -- 172.21.15.86:0/613423008 >> 172.21.15.86:0/613423008 conn(0x7fb7280fb900 msgr2=0x7fb7280fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:45.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.774+0000 7fb727200640 1 -- 172.21.15.86:0/613423008 shutdown_connections 2024-09-13T16:08:45.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:45.774+0000 7fb727200640 1 -- 172.21.15.86:0/613423008 wait complete. 2024-09-13T16:08:46.557 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-13T16:08:46.557 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T16:08:46.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:46 smithi139 ceph-mon[35320]: pgmap v313: 129 pgs: 129 active+clean; 633 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.1 KiB/s wr, 12 op/s 2024-09-13T16:08:46.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:46 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/613423008' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:46.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:46 smithi194 ceph-mon[35694]: pgmap v313: 129 pgs: 129 active+clean; 633 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.1 KiB/s wr, 12 op/s 2024-09-13T16:08:46.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:46 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/613423008' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:46.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:46 smithi086 ceph-mon[30379]: pgmap v313: 129 pgs: 129 active+clean; 633 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.1 KiB/s wr, 12 op/s 2024-09-13T16:08:46.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:46 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/613423008' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:46.874 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:08:48.604 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:48 smithi086 ceph-mon[30379]: pgmap v314: 129 pgs: 129 active+clean; 637 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.6 KiB/s wr, 11 op/s 2024-09-13T16:08:48.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.711+0000 7fd9e1000640 1 -- 172.21.15.86:0/2089228888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9dc106fa0 msgr2=0x7fd9dc10aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:48.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.711+0000 7fd9e1000640 1 --2- 172.21.15.86:0/2089228888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9dc106fa0 0x7fd9dc10aff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009930 tx=0x7fd9c802a440 comp rx=0 tx=0).stop 2024-09-13T16:08:48.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.711+0000 7fd9e1000640 1 -- 172.21.15.86:0/2089228888 shutdown_connections 2024-09-13T16:08:48.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.711+0000 7fd9e1000640 1 --2- 172.21.15.86:0/2089228888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9dc10b720 0x7fd9dc1132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.711+0000 7fd9e1000640 1 --2- 172.21.15.86:0/2089228888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9dc106fa0 0x7fd9dc10aff0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.711+0000 7fd9e1000640 1 --2- 172.21.15.86:0/2089228888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9dc1065f0 0x7fd9dc1069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.711+0000 7fd9e1000640 1 -- 172.21.15.86:0/2089228888 >> 172.21.15.86:0/2089228888 conn(0x7fd9dc075d10 msgr2=0x7fd9dc078130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:48.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.711+0000 7fd9e1000640 1 -- 172.21.15.86:0/2089228888 shutdown_connections 2024-09-13T16:08:48.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.711+0000 7fd9e1000640 1 -- 172.21.15.86:0/2089228888 wait complete. 2024-09-13T16:08:48.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.712+0000 7fd9e1000640 1 Processor -- start 2024-09-13T16:08:48.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.712+0000 7fd9e1000640 1 -- start start 2024-09-13T16:08:48.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.712+0000 7fd9e1000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9dc1065f0 0x7fd9dc1a2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.712+0000 7fd9e1000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9dc106fa0 0x7fd9dc1a2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.712+0000 7fd9e1000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9dc10b720 0x7fd9dc19c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.712+0000 7fd9e1000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc19d020 con 0x7fd9dc106fa0 2024-09-13T16:08:48.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.712+0000 7fd9e1000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc19d190 con 0x7fd9dc1065f0 2024-09-13T16:08:48.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.712+0000 7fd9e1000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc19d350 con 0x7fd9dc10b720 2024-09-13T16:08:48.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.713+0000 7fd9d9400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9dc106fa0 0x7fd9dc1a2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.713+0000 7fd9d9400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9dc106fa0 0x7fd9dc1a2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58022/0 (socket says 172.21.15.86:58022) 2024-09-13T16:08:48.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.713+0000 7fd9d9400640 1 -- 172.21.15.86:0/3843126047 learned_addr learned my addr 172.21.15.86:0/3843126047 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:08:48.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.713+0000 7fd9da800640 1 --2- 172.21.15.86:0/3843126047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9dc10b720 0x7fd9dc19c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.713+0000 7fd9d9e00640 1 --2- 172.21.15.86:0/3843126047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9dc1065f0 0x7fd9dc1a2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.713+0000 7fd9d9400640 1 -- 172.21.15.86:0/3843126047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9dc10b720 msgr2=0x7fd9dc19c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:48.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.713+0000 7fd9d9400640 1 --2- 172.21.15.86:0/3843126047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9dc10b720 0x7fd9dc19c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.713+0000 7fd9d9400640 1 -- 172.21.15.86:0/3843126047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9dc1065f0 msgr2=0x7fd9dc1a2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:48.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.713+0000 7fd9d9400640 1 --2- 172.21.15.86:0/3843126047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9dc1065f0 0x7fd9dc1a2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.713+0000 7fd9d9400640 1 -- 172.21.15.86:0/3843126047 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c8009560 con 0x7fd9dc106fa0 2024-09-13T16:08:48.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.714+0000 7fd9d9400640 1 --2- 172.21.15.86:0/3843126047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9dc106fa0 0x7fd9dc1a2cd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8005ab0 tx=0x7fd9c8005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:48.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.714+0000 7fd9d2a00640 1 -- 172.21.15.86:0/3843126047 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8004b50 con 0x7fd9dc106fa0 2024-09-13T16:08:48.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.714+0000 7fd9e1000640 1 -- 172.21.15.86:0/3843126047 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9dc19d5d0 con 0x7fd9dc106fa0 2024-09-13T16:08:48.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.714+0000 7fd9d2a00640 1 -- 172.21.15.86:0/3843126047 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd9c8004cb0 con 0x7fd9dc106fa0 2024-09-13T16:08:48.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.714+0000 7fd9e1000640 1 -- 172.21.15.86:0/3843126047 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9dc1a9780 con 0x7fd9dc106fa0 2024-09-13T16:08:48.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.714+0000 7fd9d2a00640 1 -- 172.21.15.86:0/3843126047 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8031a70 con 0x7fd9dc106fa0 2024-09-13T16:08:48.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.715+0000 7fd9e1000640 1 -- 172.21.15.86:0/3843126047 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9dc107ad0 con 0x7fd9dc106fa0 2024-09-13T16:08:48.718 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.717+0000 7fd9d2a00640 1 -- 172.21.15.86:0/3843126047 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fd9c8003cf0 con 0x7fd9dc106fa0 2024-09-13T16:08:48.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.718+0000 7fd9d2a00640 1 --2- 172.21.15.86:0/3843126047 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd9c00a1110 0x7fd9c00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.718+0000 7fd9d2a00640 1 -- 172.21.15.86:0/3843126047 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd9c80eddd0 con 0x7fd9dc106fa0 2024-09-13T16:08:48.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.718+0000 7fd9d9e00640 1 --2- 172.21.15.86:0/3843126047 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd9c00a1110 0x7fd9c00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.719+0000 7fd9d9e00640 1 --2- 172.21.15.86:0/3843126047 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd9c00a1110 0x7fd9c00a35d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc005fd0 tx=0x7fd9cc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:48.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.722+0000 7fd9d2a00640 1 -- 172.21.15.86:0/3843126047 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd9c80b7260 con 0x7fd9dc106fa0 2024-09-13T16:08:48.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:48 smithi139 ceph-mon[35320]: pgmap v314: 129 pgs: 129 active+clean; 637 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.6 KiB/s wr, 11 op/s 2024-09-13T16:08:48.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:48 smithi194 ceph-mon[35694]: pgmap v314: 129 pgs: 129 active+clean; 637 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.6 KiB/s wr, 11 op/s 2024-09-13T16:08:48.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.897+0000 7fd9e1000640 1 -- 172.21.15.86:0/3843126047 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9dc1069d0 con 0x7fd9dc106fa0 2024-09-13T16:08:48.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.899+0000 7fd9d2a00640 1 -- 172.21.15.86:0/3843126047 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23949 (secure 0 0 0) 0x7fd9c80ba880 con 0x7fd9dc106fa0 2024-09-13T16:08:48.901 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:08:48.901 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":90,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:08:13.655740+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:08:48.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.901+0000 7fd9e1000640 1 -- 172.21.15.86:0/3843126047 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd9c00a1110 msgr2=0x7fd9c00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:48.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.901+0000 7fd9e1000640 1 --2- 172.21.15.86:0/3843126047 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd9c00a1110 0x7fd9c00a35d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc005fd0 tx=0x7fd9cc009500 comp rx=0 tx=0).stop 2024-09-13T16:08:48.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.901+0000 7fd9e1000640 1 -- 172.21.15.86:0/3843126047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9dc106fa0 msgr2=0x7fd9dc1a2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:48.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.901+0000 7fd9e1000640 1 --2- 172.21.15.86:0/3843126047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9dc106fa0 0x7fd9dc1a2cd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8005ab0 tx=0x7fd9c8005620 comp rx=0 tx=0).stop 2024-09-13T16:08:48.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.901+0000 7fd9e1000640 1 -- 172.21.15.86:0/3843126047 shutdown_connections 2024-09-13T16:08:48.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.901+0000 7fd9e1000640 1 --2- 172.21.15.86:0/3843126047 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd9c00a1110 0x7fd9c00a35d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.901+0000 7fd9e1000640 1 --2- 172.21.15.86:0/3843126047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9dc10b720 0x7fd9dc19c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.901+0000 7fd9e1000640 1 --2- 172.21.15.86:0/3843126047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9dc106fa0 0x7fd9dc1a2cd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.901+0000 7fd9e1000640 1 --2- 172.21.15.86:0/3843126047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9dc1065f0 0x7fd9dc1a2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.901+0000 7fd9e1000640 1 -- 172.21.15.86:0/3843126047 >> 172.21.15.86:0/3843126047 conn(0x7fd9dc075d10 msgr2=0x7fd9dc077160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:48.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.902+0000 7fd9e1000640 1 -- 172.21.15.86:0/3843126047 shutdown_connections 2024-09-13T16:08:48.904 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:48.902+0000 7fd9e1000640 1 -- 172.21.15.86:0/3843126047 wait complete. 2024-09-13T16:08:49.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:49 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3843126047' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:49.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:49 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3843126047' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:49.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:49 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3843126047' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:08:49.870 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-13T16:08:49.871 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-13T16:08:49.871 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-13T16:08:49.871 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-13T16:08:49.872 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-13T16:08:49.872 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-13T16:08:49.873 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-13T16:08:49.873 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-13T16:08:49.874 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-13T16:08:49.874 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-13T16:08:49.874 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-13T16:08:49.875 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-13T16:08:50.697 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:08:50.720 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:08:50.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:50 smithi139 ceph-mon[35320]: pgmap v315: 129 pgs: 129 active+clean; 637 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-13T16:08:50.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:50 smithi194 ceph-mon[35694]: pgmap v315: 129 pgs: 129 active+clean; 637 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-13T16:08:50.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:50 smithi086 ceph-mon[30379]: pgmap v315: 129 pgs: 129 active+clean; 637 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-13T16:08:51.843 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:08:51.851 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:08:51.852 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:08:51.852 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:08:52.485 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:08:52.485 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:08:52.487 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:08:52.489 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:08:52.610 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:52 smithi086 ceph-mon[30379]: pgmap v316: 129 pgs: 129 active+clean; 640 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-13T16:08:52.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:52 smithi194 ceph-mon[35694]: pgmap v316: 129 pgs: 129 active+clean; 640 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-13T16:08:52.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:52 smithi139 ceph-mon[35320]: pgmap v316: 129 pgs: 129 active+clean; 640 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-13T16:08:54.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:54 smithi194 ceph-mon[35694]: pgmap v317: 129 pgs: 129 active+clean; 640 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-13T16:08:54.784 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:54 smithi086 ceph-mon[30379]: pgmap v317: 129 pgs: 129 active+clean; 640 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-13T16:08:54.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:54 smithi139 ceph-mon[35320]: pgmap v317: 129 pgs: 129 active+clean; 640 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-13T16:08:56.775 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:56 smithi086 ceph-mon[30379]: pgmap v318: 129 pgs: 129 active+clean; 640 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-13T16:08:56.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:56 smithi139 ceph-mon[35320]: pgmap v318: 129 pgs: 129 active+clean; 640 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-13T16:08:57.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:56 smithi194 ceph-mon[35694]: pgmap v318: 129 pgs: 129 active+clean; 640 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-13T16:08:58.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:58 smithi086 ceph-mon[30379]: pgmap v319: 129 pgs: 129 active+clean; 640 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-13T16:08:58.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:58 smithi139 ceph-mon[35320]: pgmap v319: 129 pgs: 129 active+clean; 640 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-13T16:08:59.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:58 smithi194 ceph-mon[35694]: pgmap v319: 129 pgs: 129 active+clean; 640 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-13T16:08:59.762 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 7]}]: dispatch 2024-09-13T16:08:59.762 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 8]}]: dispatch 2024-09-13T16:08:59.762 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-09-13T16:08:59.762 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-13T16:08:59.762 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]: dispatch 2024-09-13T16:08:59.762 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-13T16:08:59.762 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-13T16:08:59.763 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2f", "id": [1, 9]}]: dispatch 2024-09-13T16:08:59.763 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]: dispatch 2024-09-13T16:08:59.763 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:08:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]: dispatch 2024-09-13T16:08:59.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:59 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 7]}]: dispatch 2024-09-13T16:08:59.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:59 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 8]}]: dispatch 2024-09-13T16:08:59.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:59 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-09-13T16:08:59.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:59 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-13T16:08:59.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:59 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]: dispatch 2024-09-13T16:08:59.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:59 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-13T16:08:59.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:59 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-13T16:08:59.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:59 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2f", "id": [1, 9]}]: dispatch 2024-09-13T16:08:59.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:59 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]: dispatch 2024-09-13T16:08:59.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:08:59 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]: dispatch 2024-09-13T16:09:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 7]}]: dispatch 2024-09-13T16:09:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 8]}]: dispatch 2024-09-13T16:09:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-09-13T16:09:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-13T16:09:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]: dispatch 2024-09-13T16:09:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-13T16:09:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-13T16:09:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2f", "id": [1, 9]}]: dispatch 2024-09-13T16:09:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]: dispatch 2024-09-13T16:09:00.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:08:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]: dispatch 2024-09-13T16:09:00.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.551+0000 7fe0b8a00640 1 -- 172.21.15.86:0/3014858777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0b41007d0 msgr2=0x7fe0b4104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:00.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.551+0000 7fe0b8a00640 1 --2- 172.21.15.86:0/3014858777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0b41007d0 0x7fe0b4104820 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0009930 tx=0x7fe0a002a420 comp rx=0 tx=0).stop 2024-09-13T16:09:00.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.551+0000 7fe0b8a00640 1 -- 172.21.15.86:0/3014858777 shutdown_connections 2024-09-13T16:09:00.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.551+0000 7fe0b8a00640 1 --2- 172.21.15.86:0/3014858777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0b4104f50 0x7fe0b410cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:00.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.551+0000 7fe0b8a00640 1 --2- 172.21.15.86:0/3014858777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0b41007d0 0x7fe0b4104820 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:00.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.551+0000 7fe0b8a00640 1 --2- 172.21.15.86:0/3014858777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0b40ffe20 0x7fe0b4100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:00.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.551+0000 7fe0b8a00640 1 -- 172.21.15.86:0/3014858777 >> 172.21.15.86:0/3014858777 conn(0x7fe0b40fb900 msgr2=0x7fe0b40fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:00.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.551+0000 7fe0b8a00640 1 -- 172.21.15.86:0/3014858777 shutdown_connections 2024-09-13T16:09:00.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.551+0000 7fe0b8a00640 1 -- 172.21.15.86:0/3014858777 wait complete. 2024-09-13T16:09:00.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.552+0000 7fe0b8a00640 1 Processor -- start 2024-09-13T16:09:00.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.552+0000 7fe0b8a00640 1 -- start start 2024-09-13T16:09:00.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.553+0000 7fe0b8a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0b40ffe20 0x7fe0b41983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:00.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.553+0000 7fe0b8a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0b41007d0 0x7fe0b4198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:00.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.553+0000 7fe0b8a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0b4104f50 0x7fe0b419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:00.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.553+0000 7fe0b8a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b419d310 con 0x7fe0b40ffe20 2024-09-13T16:09:00.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.553+0000 7fe0b8a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b419d480 con 0x7fe0b4104f50 2024-09-13T16:09:00.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.553+0000 7fe0b8a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b419d5f0 con 0x7fe0b41007d0 2024-09-13T16:09:00.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.553+0000 7fe0b3400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0b40ffe20 0x7fe0b41983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:00.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.553+0000 7fe0b3400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0b40ffe20 0x7fe0b41983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37980/0 (socket says 172.21.15.86:37980) 2024-09-13T16:09:00.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.553+0000 7fe0b3400640 1 -- 172.21.15.86:0/2268597836 learned_addr learned my addr 172.21.15.86:0/2268597836 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:00.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.553+0000 7fe0b3e00640 1 --2- 172.21.15.86:0/2268597836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0b4104f50 0x7fe0b419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:00.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.553+0000 7fe0b3400640 1 -- 172.21.15.86:0/2268597836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0b41007d0 msgr2=0x7fe0b4198910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T16:09:00.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.553+0000 7fe0b3400640 1 --2- 172.21.15.86:0/2268597836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0b41007d0 0x7fe0b4198910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:00.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.553+0000 7fe0b3400640 1 -- 172.21.15.86:0/2268597836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0b4104f50 msgr2=0x7fe0b419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:00.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.553+0000 7fe0b3400640 1 --2- 172.21.15.86:0/2268597836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0b4104f50 0x7fe0b419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:00.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.553+0000 7fe0b3400640 1 -- 172.21.15.86:0/2268597836 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0009560 con 0x7fe0b40ffe20 2024-09-13T16:09:00.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.554+0000 7fe0b3400640 1 --2- 172.21.15.86:0/2268597836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0b40ffe20 0x7fe0b41983d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe0a400e9f0 tx=0x7fe0a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:00.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.554+0000 7fe0abe00640 1 -- 172.21.15.86:0/2268597836 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4009700 con 0x7fe0b40ffe20 2024-09-13T16:09:00.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.554+0000 7fe0abe00640 1 -- 172.21.15.86:0/2268597836 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe0a400cd80 con 0x7fe0b40ffe20 2024-09-13T16:09:00.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.554+0000 7fe0abe00640 1 -- 172.21.15.86:0/2268597836 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4018920 con 0x7fe0b40ffe20 2024-09-13T16:09:00.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.554+0000 7fe0b8a00640 1 -- 172.21.15.86:0/2268597836 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b419d8d0 con 0x7fe0b40ffe20 2024-09-13T16:09:00.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.554+0000 7fe0b8a00640 1 -- 172.21.15.86:0/2268597836 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b41a5190 con 0x7fe0b40ffe20 2024-09-13T16:09:00.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.555+0000 7fe0b8a00640 1 -- 172.21.15.86:0/2268597836 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe0b419dbb0 con 0x7fe0b40ffe20 2024-09-13T16:09:00.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.557+0000 7fe0abe00640 1 -- 172.21.15.86:0/2268597836 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe0a4018a80 con 0x7fe0b40ffe20 2024-09-13T16:09:00.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.559+0000 7fe0abe00640 1 --2- 172.21.15.86:0/2268597836 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe0980a1100 0x7fe0980a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:00.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.559+0000 7fe0abe00640 1 -- 172.21.15.86:0/2268597836 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe0a4014070 con 0x7fe0b40ffe20 2024-09-13T16:09:00.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.559+0000 7fe0b2a00640 1 --2- 172.21.15.86:0/2268597836 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe0980a1100 0x7fe0980a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:00.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.559+0000 7fe0abe00640 1 --2- 172.21.15.86:0/2268597836 >> [v2:172.21.15.139:6808/2161852608,v1:172.21.15.139:6809/2161852608] conn(0x7fe0980ac190 0x7fe0980ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:00.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.559+0000 7fe0abe00640 1 -- 172.21.15.86:0/2268597836 --> [v2:172.21.15.139:6808/2161852608,v1:172.21.15.139:6809/2161852608] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe0980aed00 con 0x7fe0980ac190 2024-09-13T16:09:00.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.559+0000 7fe0abe00640 1 -- 172.21.15.86:0/2268597836 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0a40cf5c0 con 0x7fe0b40ffe20 2024-09-13T16:09:00.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.560+0000 7fe0b3e00640 1 --2- 172.21.15.86:0/2268597836 >> [v2:172.21.15.139:6808/2161852608,v1:172.21.15.139:6809/2161852608] conn(0x7fe0980ac190 0x7fe0980ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:00.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.560+0000 7fe0b2a00640 1 --2- 172.21.15.86:0/2268597836 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe0980a1100 0x7fe0980a35c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe0a002a940 tx=0x7fe0a0005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:00.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.560+0000 7fe0b3e00640 1 --2- 172.21.15.86:0/2268597836 >> [v2:172.21.15.139:6808/2161852608,v1:172.21.15.139:6809/2161852608] conn(0x7fe0980ac190 0x7fe0980ae630 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:00.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.561+0000 7fe0abe00640 1 -- 172.21.15.86:0/2268597836 <== osd.4 v2:172.21.15.139:6808/2161852608 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe0980aed00 con 0x7fe0980ac190 2024-09-13T16:09:00.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.580+0000 7fe0b8a00640 1 -- 172.21.15.86:0/2268597836 --> [v2:172.21.15.139:6808/2161852608,v1:172.21.15.139:6809/2161852608] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe0b410ffc0 con 0x7fe0980ac190 2024-09-13T16:09:00.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.581+0000 7fe0abe00640 1 -- 172.21.15.86:0/2268597836 <== osd.4 v2:172.21.15.139:6808/2161852608 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe0b410ffc0 con 0x7fe0980ac190 2024-09-13T16:09:00.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.582+0000 7fe0b8a00640 1 -- 172.21.15.86:0/2268597836 >> [v2:172.21.15.139:6808/2161852608,v1:172.21.15.139:6809/2161852608] conn(0x7fe0980ac190 msgr2=0x7fe0980ae630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:00.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.582+0000 7fe0b8a00640 1 --2- 172.21.15.86:0/2268597836 >> [v2:172.21.15.139:6808/2161852608,v1:172.21.15.139:6809/2161852608] conn(0x7fe0980ac190 0x7fe0980ae630 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:00.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.582+0000 7fe0b8a00640 1 -- 172.21.15.86:0/2268597836 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe0980a1100 msgr2=0x7fe0980a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:00.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.582+0000 7fe0b8a00640 1 --2- 172.21.15.86:0/2268597836 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe0980a1100 0x7fe0980a35c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe0a002a940 tx=0x7fe0a0005fd0 comp rx=0 tx=0).stop 2024-09-13T16:09:00.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.582+0000 7fe0b8a00640 1 -- 172.21.15.86:0/2268597836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0b40ffe20 msgr2=0x7fe0b41983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:00.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.582+0000 7fe0b8a00640 1 --2- 172.21.15.86:0/2268597836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0b40ffe20 0x7fe0b41983d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe0a400e9f0 tx=0x7fe0a400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:09:00.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.582+0000 7fe0b3e00640 1 -- 172.21.15.86:0/2268597836 reap_dead start 2024-09-13T16:09:00.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.582+0000 7fe0b8a00640 1 -- 172.21.15.86:0/2268597836 shutdown_connections 2024-09-13T16:09:00.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.582+0000 7fe0b8a00640 1 -- 172.21.15.86:0/2268597836 >> 172.21.15.86:0/2268597836 conn(0x7fe0b40fb900 msgr2=0x7fe0b40fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:00.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.582+0000 7fe0b8a00640 1 -- 172.21.15.86:0/2268597836 shutdown_connections 2024-09-13T16:09:00.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:00.582+0000 7fe0b8a00640 1 -- 172.21.15.86:0/2268597836 wait complete. 2024-09-13T16:09:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:00 smithi086 ceph-mon[30379]: pgmap v320: 129 pgs: 129 active+clean; 640 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-13T16:09:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 7]}]': finished 2024-09-13T16:09:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 8]}]': finished 2024-09-13T16:09:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-09-13T16:09:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-13T16:09:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-09-13T16:09:00.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-13T16:09:00.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-13T16:09:00.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2f", "id": [1, 9]}]': finished 2024-09-13T16:09:00.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2024-09-13T16:09:00.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-09-13T16:09:00.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:00 smithi086 ceph-mon[30379]: osdmap e91: 12 total, 12 up, 12 in 2024-09-13T16:09:00.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:00 smithi194 ceph-mon[35694]: pgmap v320: 129 pgs: 129 active+clean; 640 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-13T16:09:00.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 7]}]': finished 2024-09-13T16:09:00.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 8]}]': finished 2024-09-13T16:09:00.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-09-13T16:09:00.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-13T16:09:00.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-09-13T16:09:00.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-13T16:09:00.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-13T16:09:00.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2f", "id": [1, 9]}]': finished 2024-09-13T16:09:00.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2024-09-13T16:09:00.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-09-13T16:09:00.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:00 smithi194 ceph-mon[35694]: osdmap e91: 12 total, 12 up, 12 in 2024-09-13T16:09:00.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:00 smithi139 ceph-mon[35320]: pgmap v320: 129 pgs: 129 active+clean; 640 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-13T16:09:00.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 7]}]': finished 2024-09-13T16:09:00.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 8]}]': finished 2024-09-13T16:09:00.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-09-13T16:09:00.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-13T16:09:00.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-09-13T16:09:00.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-13T16:09:00.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-13T16:09:00.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2f", "id": [1, 9]}]': finished 2024-09-13T16:09:00.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2024-09-13T16:09:00.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-09-13T16:09:00.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:00 smithi139 ceph-mon[35320]: osdmap e91: 12 total, 12 up, 12 in 2024-09-13T16:09:01.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.470+0000 7f288be00640 1 -- 172.21.15.86:0/777558019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f288c1029e0 msgr2=0x7f288c106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:01.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.470+0000 7f288be00640 1 --2- 172.21.15.86:0/777558019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f288c1029e0 0x7f288c106a30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2874009930 tx=0x7f287402a420 comp rx=0 tx=0).stop 2024-09-13T16:09:01.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.470+0000 7f288be00640 1 -- 172.21.15.86:0/777558019 shutdown_connections 2024-09-13T16:09:01.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.470+0000 7f288be00640 1 --2- 172.21.15.86:0/777558019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f288c107160 0x7f288c10ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:01.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.470+0000 7f288be00640 1 --2- 172.21.15.86:0/777558019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f288c1029e0 0x7f288c106a30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:01.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.470+0000 7f288be00640 1 --2- 172.21.15.86:0/777558019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f288c102030 0x7f288c102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:01.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.470+0000 7f288be00640 1 -- 172.21.15.86:0/777558019 >> 172.21.15.86:0/777558019 conn(0x7f288c0fda90 msgr2=0x7f288c0ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:01.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.470+0000 7f288be00640 1 -- 172.21.15.86:0/777558019 shutdown_connections 2024-09-13T16:09:01.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.471+0000 7f288be00640 1 -- 172.21.15.86:0/777558019 wait complete. 2024-09-13T16:09:01.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.471+0000 7f288be00640 1 Processor -- start 2024-09-13T16:09:01.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.472+0000 7f288be00640 1 -- start start 2024-09-13T16:09:01.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.472+0000 7f288be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f288c102030 0x7f288c198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:01.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.472+0000 7f288be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f288c1029e0 0x7f288c198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:01.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.472+0000 7f288be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f288c107160 0x7f288c19ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:01.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.472+0000 7f288be00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c19d440 con 0x7f288c1029e0 2024-09-13T16:09:01.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.472+0000 7f288be00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c19d5b0 con 0x7f288c102030 2024-09-13T16:09:01.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.472+0000 7f288be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c19d720 con 0x7f288c107160 2024-09-13T16:09:01.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.472+0000 7f2882000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f288c1029e0 0x7f288c198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:01.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.472+0000 7f2882000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f288c1029e0 0x7f288c198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37958/0 (socket says 172.21.15.86:37958) 2024-09-13T16:09:01.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.472+0000 7f2882000640 1 -- 172.21.15.86:0/3685557501 learned_addr learned my addr 172.21.15.86:0/3685557501 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:01.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.472+0000 7f288b400640 1 --2- 172.21.15.86:0/3685557501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f288c107160 0x7f288c19ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.472+0000 7f288aa00640 1 --2- 172.21.15.86:0/3685557501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f288c102030 0x7f288c198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.473+0000 7f2882000640 1 -- 172.21.15.86:0/3685557501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f288c107160 msgr2=0x7f288c19ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.473+0000 7f2882000640 1 --2- 172.21.15.86:0/3685557501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f288c107160 0x7f288c19ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.473+0000 7f2882000640 1 -- 172.21.15.86:0/3685557501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f288c102030 msgr2=0x7f288c198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.473+0000 7f2882000640 1 --2- 172.21.15.86:0/3685557501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f288c102030 0x7f288c198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.473+0000 7f2882000640 1 -- 172.21.15.86:0/3685557501 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874009560 con 0x7f288c1029e0 2024-09-13T16:09:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.473+0000 7f288aa00640 1 --2- 172.21.15.86:0/3685557501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f288c102030 0x7f288c198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:09:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.473+0000 7f2882000640 1 --2- 172.21.15.86:0/3685557501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f288c1029e0 0x7f288c198a90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2874005ab0 tx=0x7f2874005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.473+0000 7f2883e00640 1 -- 172.21.15.86:0/3685557501 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874004b50 con 0x7f288c1029e0 2024-09-13T16:09:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.473+0000 7f2883e00640 1 -- 172.21.15.86:0/3685557501 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2874004cb0 con 0x7f288c1029e0 2024-09-13T16:09:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.473+0000 7f288be00640 1 -- 172.21.15.86:0/3685557501 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288c19d9a0 con 0x7f288c1029e0 2024-09-13T16:09:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.473+0000 7f2883e00640 1 -- 172.21.15.86:0/3685557501 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874031a30 con 0x7f288c1029e0 2024-09-13T16:09:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.473+0000 7f288be00640 1 -- 172.21.15.86:0/3685557501 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288c1a50f0 con 0x7f288c1029e0 2024-09-13T16:09:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.474+0000 7f288be00640 1 -- 172.21.15.86:0/3685557501 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f288c112260 con 0x7f288c1029e0 2024-09-13T16:09:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.476+0000 7f2883e00640 1 -- 172.21.15.86:0/3685557501 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2874003c40 con 0x7f288c1029e0 2024-09-13T16:09:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.478+0000 7f2883e00640 1 --2- 172.21.15.86:0/3685557501 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f28700a1100 0x7f28700a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.478+0000 7f2883e00640 1 -- 172.21.15.86:0/3685557501 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f28740edef0 con 0x7f288c1029e0 2024-09-13T16:09:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.478+0000 7f288aa00640 1 --2- 172.21.15.86:0/3685557501 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f28700a1100 0x7f28700a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.478+0000 7f2883e00640 1 --2- 172.21.15.86:0/3685557501 >> [v2:172.21.15.139:6816/2698233714,v1:172.21.15.139:6817/2698233714] conn(0x7f28700abcf0 0x7f28700ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.478+0000 7f2883e00640 1 -- 172.21.15.86:0/3685557501 --> [v2:172.21.15.139:6816/2698233714,v1:172.21.15.139:6817/2698233714] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f28700ae800 con 0x7f28700abcf0 2024-09-13T16:09:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.478+0000 7f2883e00640 1 -- 172.21.15.86:0/3685557501 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28740ee260 con 0x7f288c1029e0 2024-09-13T16:09:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.479+0000 7f288b400640 1 --2- 172.21.15.86:0/3685557501 >> [v2:172.21.15.139:6816/2698233714,v1:172.21.15.139:6817/2698233714] conn(0x7f28700abcf0 0x7f28700ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.479+0000 7f288aa00640 1 --2- 172.21.15.86:0/3685557501 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f28700a1100 0x7f28700a35c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f287c005fd0 tx=0x7f287c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:01.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.479+0000 7f288b400640 1 --2- 172.21.15.86:0/3685557501 >> [v2:172.21.15.139:6816/2698233714,v1:172.21.15.139:6817/2698233714] conn(0x7f28700abcf0 0x7f28700ae130 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:01.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.480+0000 7f2883e00640 1 -- 172.21.15.86:0/3685557501 <== osd.7 v2:172.21.15.139:6816/2698233714 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f28700ae800 con 0x7f28700abcf0 2024-09-13T16:09:01.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.494+0000 7f288be00640 1 -- 172.21.15.86:0/3685557501 --> [v2:172.21.15.139:6816/2698233714,v1:172.21.15.139:6817/2698233714] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f288c060b30 con 0x7f28700abcf0 2024-09-13T16:09:01.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.494+0000 7f2883e00640 1 -- 172.21.15.86:0/3685557501 <== osd.7 v2:172.21.15.139:6816/2698233714 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f288c060b30 con 0x7f28700abcf0 2024-09-13T16:09:01.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.495+0000 7f288be00640 1 -- 172.21.15.86:0/3685557501 >> [v2:172.21.15.139:6816/2698233714,v1:172.21.15.139:6817/2698233714] conn(0x7f28700abcf0 msgr2=0x7f28700ae130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:01.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.495+0000 7f288be00640 1 --2- 172.21.15.86:0/3685557501 >> [v2:172.21.15.139:6816/2698233714,v1:172.21.15.139:6817/2698233714] conn(0x7f28700abcf0 0x7f28700ae130 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:01.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.495+0000 7f288be00640 1 -- 172.21.15.86:0/3685557501 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f28700a1100 msgr2=0x7f28700a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:01.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.495+0000 7f288be00640 1 --2- 172.21.15.86:0/3685557501 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f28700a1100 0x7f28700a35c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f287c005fd0 tx=0x7f287c009500 comp rx=0 tx=0).stop 2024-09-13T16:09:01.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.495+0000 7f288be00640 1 -- 172.21.15.86:0/3685557501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f288c1029e0 msgr2=0x7f288c198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:01.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.495+0000 7f288be00640 1 --2- 172.21.15.86:0/3685557501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f288c1029e0 0x7f288c198a90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2874005ab0 tx=0x7f2874005620 comp rx=0 tx=0).stop 2024-09-13T16:09:01.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.495+0000 7f288b400640 1 -- 172.21.15.86:0/3685557501 reap_dead start 2024-09-13T16:09:01.095 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.495+0000 7f288be00640 1 -- 172.21.15.86:0/3685557501 shutdown_connections 2024-09-13T16:09:01.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.495+0000 7f288be00640 1 -- 172.21.15.86:0/3685557501 >> 172.21.15.86:0/3685557501 conn(0x7f288c0fda90 msgr2=0x7f288c0fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:01.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.495+0000 7f288be00640 1 -- 172.21.15.86:0/3685557501 shutdown_connections 2024-09-13T16:09:01.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:08:59.495+0000 7f288be00640 1 -- 172.21.15.86:0/3685557501 wait complete. 2024-09-13T16:09:01.780 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:01 smithi086 ceph-mon[30379]: osdmap e92: 12 total, 12 up, 12 in 2024-09-13T16:09:01.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:01 smithi139 ceph-mon[35320]: osdmap e92: 12 total, 12 up, 12 in 2024-09-13T16:09:02.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:01 smithi194 ceph-mon[35694]: osdmap e92: 12 total, 12 up, 12 in 2024-09-13T16:09:02.857 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:02 smithi086 ceph-mon[30379]: pgmap v323: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 8 op/s 2024-09-13T16:09:02.885 INFO:teuthology.orchestra.run.smithi086.stdout:146028888123 2024-09-13T16:09:02.885 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-13T16:09:02.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:02 smithi139 ceph-mon[35320]: pgmap v323: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 8 op/s 2024-09-13T16:09:03.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:02 smithi194 ceph-mon[35694]: pgmap v323: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 8 op/s 2024-09-13T16:09:03.238 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:09:03.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.439+0000 7f143f200640 1 -- 172.21.15.86:0/4131068975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1440104f50 msgr2=0x7f144010cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:03.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.439+0000 7f143f200640 1 --2- 172.21.15.86:0/4131068975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1440104f50 0x7f144010cad0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1438009cd0 tx=0x7f143802a8e0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.439+0000 7f143f200640 1 -- 172.21.15.86:0/4131068975 shutdown_connections 2024-09-13T16:09:03.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.439+0000 7f143f200640 1 --2- 172.21.15.86:0/4131068975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1440104f50 0x7f144010cad0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.439+0000 7f143f200640 1 --2- 172.21.15.86:0/4131068975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14401007d0 0x7f1440104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.439+0000 7f143f200640 1 --2- 172.21.15.86:0/4131068975 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14400ffe20 0x7f1440100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.439+0000 7f143f200640 1 -- 172.21.15.86:0/4131068975 >> 172.21.15.86:0/4131068975 conn(0x7f14400fb900 msgr2=0x7f14400fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:03.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.439+0000 7f143f200640 1 -- 172.21.15.86:0/4131068975 shutdown_connections 2024-09-13T16:09:03.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.439+0000 7f143f200640 1 -- 172.21.15.86:0/4131068975 wait complete. 2024-09-13T16:09:03.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.440+0000 7f143f200640 1 Processor -- start 2024-09-13T16:09:03.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.440+0000 7f143f200640 1 -- start start 2024-09-13T16:09:03.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.441+0000 7f143f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14400ffe20 0x7f1440198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.441+0000 7f143f200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14401007d0 0x7f14401989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.441+0000 7f143f200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1440104f50 0x7f144019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.441+0000 7f143f200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144019d3b0 con 0x7f1440104f50 2024-09-13T16:09:03.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.441+0000 7f143f200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144019d520 con 0x7f14401007d0 2024-09-13T16:09:03.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.441+0000 7f143f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144019d690 con 0x7f14400ffe20 2024-09-13T16:09:03.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.441+0000 7f143e800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1440104f50 0x7f144019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.441+0000 7f143e800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1440104f50 0x7f144019cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60556/0 (socket says 172.21.15.86:60556) 2024-09-13T16:09:03.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.441+0000 7f143e800640 1 -- 172.21.15.86:0/3335304369 learned_addr learned my addr 172.21.15.86:0/3335304369 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:03.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.441+0000 7f143de00640 1 --2- 172.21.15.86:0/3335304369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14400ffe20 0x7f1440198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.444 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.441+0000 7f1437e00640 1 --2- 172.21.15.86:0/3335304369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14401007d0 0x7f14401989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.442+0000 7f143e800640 1 -- 172.21.15.86:0/3335304369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14400ffe20 msgr2=0x7f1440198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:03.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.442+0000 7f143e800640 1 --2- 172.21.15.86:0/3335304369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14400ffe20 0x7f1440198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.442+0000 7f143e800640 1 -- 172.21.15.86:0/3335304369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14401007d0 msgr2=0x7f14401989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:03.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.442+0000 7f143e800640 1 --2- 172.21.15.86:0/3335304369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14401007d0 0x7f14401989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.442+0000 7f143e800640 1 -- 172.21.15.86:0/3335304369 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1438009900 con 0x7f1440104f50 2024-09-13T16:09:03.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.442+0000 7f1437e00640 1 --2- 172.21.15.86:0/3335304369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14401007d0 0x7f14401989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:09:03.445 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.442+0000 7f143e800640 1 --2- 172.21.15.86:0/3335304369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1440104f50 0x7f144019cdb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1438009ca0 tx=0x7f14380307b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:03.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.442+0000 7f1436a00640 1 -- 172.21.15.86:0/3335304369 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438031d00 con 0x7f1440104f50 2024-09-13T16:09:03.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.442+0000 7f1436a00640 1 -- 172.21.15.86:0/3335304369 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1438003e50 con 0x7f1440104f50 2024-09-13T16:09:03.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.442+0000 7f1436a00640 1 -- 172.21.15.86:0/3335304369 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14380048a0 con 0x7f1440104f50 2024-09-13T16:09:03.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.442+0000 7f143f200640 1 -- 172.21.15.86:0/3335304369 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144019d910 con 0x7f1440104f50 2024-09-13T16:09:03.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.442+0000 7f143f200640 1 -- 172.21.15.86:0/3335304369 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14401a5230 con 0x7f1440104f50 2024-09-13T16:09:03.446 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.443+0000 7f143f200640 1 -- 172.21.15.86:0/3335304369 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1440110050 con 0x7f1440104f50 2024-09-13T16:09:03.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.446+0000 7f1436a00640 1 -- 172.21.15.86:0/3335304369 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f143800a040 con 0x7f1440104f50 2024-09-13T16:09:03.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.447+0000 7f1436a00640 1 --2- 172.21.15.86:0/3335304369 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f14240a1180 0x7f14240a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.447+0000 7f1436a00640 1 -- 172.21.15.86:0/3335304369 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f14380edfa0 con 0x7f1440104f50 2024-09-13T16:09:03.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.447+0000 7f143de00640 1 --2- 172.21.15.86:0/3335304369 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f14240a1180 0x7f14240a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.447+0000 7f1436a00640 1 --2- 172.21.15.86:0/3335304369 >> [v2:172.21.15.194:6800/2776695129,v1:172.21.15.194:6801/2776695129] conn(0x7f14240ac0e0 0x7f14240ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.447+0000 7f1436a00640 1 -- 172.21.15.86:0/3335304369 --> [v2:172.21.15.194:6800/2776695129,v1:172.21.15.194:6801/2776695129] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14240aec50 con 0x7f14240ac0e0 2024-09-13T16:09:03.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.447+0000 7f1436a00640 1 -- 172.21.15.86:0/3335304369 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14380ee310 con 0x7f1440104f50 2024-09-13T16:09:03.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.448+0000 7f1437e00640 1 --2- 172.21.15.86:0/3335304369 >> [v2:172.21.15.194:6800/2776695129,v1:172.21.15.194:6801/2776695129] conn(0x7f14240ac0e0 0x7f14240ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.448+0000 7f143de00640 1 --2- 172.21.15.86:0/3335304369 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f14240a1180 0x7f14240a3640 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1430009bd0 tx=0x7f1430005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:03.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.448+0000 7f1437e00640 1 --2- 172.21.15.86:0/3335304369 >> [v2:172.21.15.194:6800/2776695129,v1:172.21.15.194:6801/2776695129] conn(0x7f14240ac0e0 0x7f14240ae580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:03.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.449+0000 7f1436a00640 1 -- 172.21.15.86:0/3335304369 <== osd.2 v2:172.21.15.194:6800/2776695129 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f14240aec50 con 0x7f14240ac0e0 2024-09-13T16:09:03.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.472+0000 7f143f200640 1 -- 172.21.15.86:0/3335304369 --> [v2:172.21.15.194:6800/2776695129,v1:172.21.15.194:6801/2776695129] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1440101300 con 0x7f14240ac0e0 2024-09-13T16:09:03.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.472+0000 7f1436a00640 1 -- 172.21.15.86:0/3335304369 <== osd.2 v2:172.21.15.194:6800/2776695129 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1440101300 con 0x7f14240ac0e0 2024-09-13T16:09:03.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.473+0000 7f143f200640 1 -- 172.21.15.86:0/3335304369 >> [v2:172.21.15.194:6800/2776695129,v1:172.21.15.194:6801/2776695129] conn(0x7f14240ac0e0 msgr2=0x7f14240ae580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:03.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.473+0000 7f143f200640 1 --2- 172.21.15.86:0/3335304369 >> [v2:172.21.15.194:6800/2776695129,v1:172.21.15.194:6801/2776695129] conn(0x7f14240ac0e0 0x7f14240ae580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.473+0000 7f143f200640 1 -- 172.21.15.86:0/3335304369 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f14240a1180 msgr2=0x7f14240a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:03.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.473+0000 7f143f200640 1 --2- 172.21.15.86:0/3335304369 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f14240a1180 0x7f14240a3640 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1430009bd0 tx=0x7f1430005f90 comp rx=0 tx=0).stop 2024-09-13T16:09:03.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.473+0000 7f143f200640 1 -- 172.21.15.86:0/3335304369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1440104f50 msgr2=0x7f144019cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:03.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.473+0000 7f143f200640 1 --2- 172.21.15.86:0/3335304369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1440104f50 0x7f144019cdb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1438009ca0 tx=0x7f14380307b0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.473+0000 7f143e800640 1 -- 172.21.15.86:0/3335304369 reap_dead start 2024-09-13T16:09:03.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.473+0000 7f143f200640 1 -- 172.21.15.86:0/3335304369 shutdown_connections 2024-09-13T16:09:03.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.473+0000 7f143f200640 1 -- 172.21.15.86:0/3335304369 >> 172.21.15.86:0/3335304369 conn(0x7f14400fb900 msgr2=0x7f14400fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:03.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.473+0000 7f143f200640 1 -- 172.21.15.86:0/3335304369 shutdown_connections 2024-09-13T16:09:03.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:03.473+0000 7f143f200640 1 -- 172.21.15.86:0/3335304369 wait complete. 2024-09-13T16:09:04.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:04 smithi086 ceph-mon[30379]: pgmap v324: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 383 B/s wr, 6 op/s 2024-09-13T16:09:04.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:04 smithi139 ceph-mon[35320]: pgmap v324: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 383 B/s wr, 6 op/s 2024-09-13T16:09:05.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:04 smithi194 ceph-mon[35694]: pgmap v324: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 383 B/s wr, 6 op/s 2024-09-13T16:09:05.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.588+0000 7ff42ae00640 1 -- 172.21.15.86:0/582431273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff424073200 msgr2=0x7ff42410bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:05.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.588+0000 7ff42ae00640 1 --2- 172.21.15.86:0/582431273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff424073200 0x7ff42410bec0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff410009900 tx=0x7ff41002a480 comp rx=0 tx=0).stop 2024-09-13T16:09:05.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.588+0000 7ff42ae00640 1 -- 172.21.15.86:0/582431273 shutdown_connections 2024-09-13T16:09:05.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.588+0000 7ff42ae00640 1 --2- 172.21.15.86:0/582431273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff42410c400 0x7ff42410e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:05.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.588+0000 7ff42ae00640 1 --2- 172.21.15.86:0/582431273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff424073200 0x7ff42410bec0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:05.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.588+0000 7ff42ae00640 1 --2- 172.21.15.86:0/582431273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4240728e0 0x7ff424072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:05.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.588+0000 7ff42ae00640 1 -- 172.21.15.86:0/582431273 >> 172.21.15.86:0/582431273 conn(0x7ff4240fb900 msgr2=0x7ff4240fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:05.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.588+0000 7ff42ae00640 1 -- 172.21.15.86:0/582431273 shutdown_connections 2024-09-13T16:09:05.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.588+0000 7ff42ae00640 1 -- 172.21.15.86:0/582431273 wait complete. 2024-09-13T16:09:05.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.589+0000 7ff42ae00640 1 Processor -- start 2024-09-13T16:09:05.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.589+0000 7ff42ae00640 1 -- start start 2024-09-13T16:09:05.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.590+0000 7ff42ae00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4240728e0 0x7ff424198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:05.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.590+0000 7ff42ae00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff424073200 0x7ff4241989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:05.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.590+0000 7ff42ae00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff42410c400 0x7ff42419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:05.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.590+0000 7ff42ae00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42419d380 con 0x7ff42410c400 2024-09-13T16:09:05.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.590+0000 7ff42ae00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42419d4f0 con 0x7ff4240728e0 2024-09-13T16:09:05.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.590+0000 7ff42ae00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42419d660 con 0x7ff424073200 2024-09-13T16:09:05.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.590+0000 7ff42a400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff42410c400 0x7ff42419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:05.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.590+0000 7ff429a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4240728e0 0x7ff424198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:05.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.590+0000 7ff42a400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff42410c400 0x7ff42419cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60584/0 (socket says 172.21.15.86:60584) 2024-09-13T16:09:05.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.590+0000 7ff429000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff424073200 0x7ff4241989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:05.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.590+0000 7ff42a400640 1 -- 172.21.15.86:0/2486778386 learned_addr learned my addr 172.21.15.86:0/2486778386 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:05.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.591+0000 7ff429a00640 1 -- 172.21.15.86:0/2486778386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff424073200 msgr2=0x7ff4241989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:05.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.591+0000 7ff429a00640 1 --2- 172.21.15.86:0/2486778386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff424073200 0x7ff4241989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:05.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.591+0000 7ff429a00640 1 -- 172.21.15.86:0/2486778386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff42410c400 msgr2=0x7ff42419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:05.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.591+0000 7ff429a00640 1 --2- 172.21.15.86:0/2486778386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff42410c400 0x7ff42419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:05.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.591+0000 7ff429a00640 1 -- 172.21.15.86:0/2486778386 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff410009560 con 0x7ff4240728e0 2024-09-13T16:09:05.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.591+0000 7ff429a00640 1 --2- 172.21.15.86:0/2486778386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4240728e0 0x7ff424198490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff41800e9f0 tx=0x7ff41800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:05.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.591+0000 7ff422000640 1 -- 172.21.15.86:0/2486778386 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41800ccc0 con 0x7ff4240728e0 2024-09-13T16:09:05.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.591+0000 7ff42ae00640 1 -- 172.21.15.86:0/2486778386 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42419d940 con 0x7ff4240728e0 2024-09-13T16:09:05.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.591+0000 7ff422000640 1 -- 172.21.15.86:0/2486778386 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff41800ce20 con 0x7ff4240728e0 2024-09-13T16:09:05.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.591+0000 7ff422000640 1 -- 172.21.15.86:0/2486778386 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418018920 con 0x7ff4240728e0 2024-09-13T16:09:05.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.591+0000 7ff42ae00640 1 -- 172.21.15.86:0/2486778386 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4241a5200 con 0x7ff4240728e0 2024-09-13T16:09:05.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.592+0000 7ff42ae00640 1 -- 172.21.15.86:0/2486778386 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff424073f90 con 0x7ff4240728e0 2024-09-13T16:09:05.595 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.595+0000 7ff422000640 1 -- 172.21.15.86:0/2486778386 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff418018a80 con 0x7ff4240728e0 2024-09-13T16:09:05.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.596+0000 7ff422000640 1 --2- 172.21.15.86:0/2486778386 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff40c0a1100 0x7ff40c0a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:05.597 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.596+0000 7ff422000640 1 -- 172.21.15.86:0/2486778386 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff418014070 con 0x7ff4240728e0 2024-09-13T16:09:05.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.597+0000 7ff429000640 1 --2- 172.21.15.86:0/2486778386 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff40c0a1100 0x7ff40c0a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:05.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.597+0000 7ff422000640 1 --2- 172.21.15.86:0/2486778386 >> [v2:172.21.15.139:6824/4290408323,v1:172.21.15.139:6825/4290408323] conn(0x7ff40c0ac110 0x7ff40c0ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:05.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.597+0000 7ff422000640 1 -- 172.21.15.86:0/2486778386 --> [v2:172.21.15.139:6824/4290408323,v1:172.21.15.139:6825/4290408323] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff40c0aec80 con 0x7ff40c0ac110 2024-09-13T16:09:05.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.597+0000 7ff422000640 1 -- 172.21.15.86:0/2486778386 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4180cd720 con 0x7ff4240728e0 2024-09-13T16:09:05.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.597+0000 7ff42a400640 1 --2- 172.21.15.86:0/2486778386 >> [v2:172.21.15.139:6824/4290408323,v1:172.21.15.139:6825/4290408323] conn(0x7ff40c0ac110 0x7ff40c0ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:05.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.598+0000 7ff429000640 1 --2- 172.21.15.86:0/2486778386 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff40c0a1100 0x7ff40c0a35c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff410005ec0 tx=0x7ff410005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:05.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.598+0000 7ff42a400640 1 --2- 172.21.15.86:0/2486778386 >> [v2:172.21.15.139:6824/4290408323,v1:172.21.15.139:6825/4290408323] conn(0x7ff40c0ac110 0x7ff40c0ae5b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:05.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.599+0000 7ff422000640 1 -- 172.21.15.86:0/2486778386 <== osd.10 v2:172.21.15.139:6824/4290408323 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff40c0aec80 con 0x7ff40c0ac110 2024-09-13T16:09:05.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.612+0000 7ff42ae00640 1 -- 172.21.15.86:0/2486778386 --> [v2:172.21.15.139:6824/4290408323,v1:172.21.15.139:6825/4290408323] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff424112280 con 0x7ff40c0ac110 2024-09-13T16:09:05.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.613+0000 7ff422000640 1 -- 172.21.15.86:0/2486778386 <== osd.10 v2:172.21.15.139:6824/4290408323 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff41c009c00 con 0x7ff40c0ac110 2024-09-13T16:09:05.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.613+0000 7ff42ae00640 1 -- 172.21.15.86:0/2486778386 >> [v2:172.21.15.139:6824/4290408323,v1:172.21.15.139:6825/4290408323] conn(0x7ff40c0ac110 msgr2=0x7ff40c0ae5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:05.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.613+0000 7ff42ae00640 1 --2- 172.21.15.86:0/2486778386 >> [v2:172.21.15.139:6824/4290408323,v1:172.21.15.139:6825/4290408323] conn(0x7ff40c0ac110 0x7ff40c0ae5b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:05.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.613+0000 7ff42ae00640 1 -- 172.21.15.86:0/2486778386 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff40c0a1100 msgr2=0x7ff40c0a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:05.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.613+0000 7ff42ae00640 1 --2- 172.21.15.86:0/2486778386 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff40c0a1100 0x7ff40c0a35c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff410005ec0 tx=0x7ff410005a20 comp rx=0 tx=0).stop 2024-09-13T16:09:05.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.613+0000 7ff42ae00640 1 -- 172.21.15.86:0/2486778386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4240728e0 msgr2=0x7ff424198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:05.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.613+0000 7ff42ae00640 1 --2- 172.21.15.86:0/2486778386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4240728e0 0x7ff424198490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff41800e9f0 tx=0x7ff41800eeb0 comp rx=0 tx=0).stop 2024-09-13T16:09:05.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.613+0000 7ff42a400640 1 -- 172.21.15.86:0/2486778386 reap_dead start 2024-09-13T16:09:05.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.614+0000 7ff42ae00640 1 -- 172.21.15.86:0/2486778386 shutdown_connections 2024-09-13T16:09:05.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.614+0000 7ff42ae00640 1 -- 172.21.15.86:0/2486778386 >> 172.21.15.86:0/2486778386 conn(0x7ff4240fb900 msgr2=0x7ff4240fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:05.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.614+0000 7ff42ae00640 1 -- 172.21.15.86:0/2486778386 shutdown_connections 2024-09-13T16:09:05.615 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:05.614+0000 7ff42ae00640 1 -- 172.21.15.86:0/2486778386 wait complete. 2024-09-13T16:09:06.007 INFO:teuthology.orchestra.run.smithi086.stdout:77309411397 2024-09-13T16:09:06.007 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-13T16:09:06.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:06 smithi086 ceph-mon[30379]: pgmap v325: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 383 B/s wr, 5 op/s 2024-09-13T16:09:06.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:06 smithi139 ceph-mon[35320]: pgmap v325: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 383 B/s wr, 5 op/s 2024-09-13T16:09:07.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:06 smithi194 ceph-mon[35694]: pgmap v325: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 383 B/s wr, 5 op/s 2024-09-13T16:09:08.204 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.203+0000 7fb106600640 1 -- 172.21.15.86:0/4181591414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb100106fa0 msgr2=0x7fb10010aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:08.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.203+0000 7fb106600640 1 --2- 172.21.15.86:0/4181591414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb100106fa0 0x7fb10010aff0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009930 tx=0x7fb0e802a420 comp rx=0 tx=0).stop 2024-09-13T16:09:08.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.203+0000 7fb106600640 1 -- 172.21.15.86:0/4181591414 shutdown_connections 2024-09-13T16:09:08.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.203+0000 7fb106600640 1 --2- 172.21.15.86:0/4181591414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb10010b720 0x7fb1001132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:08.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.203+0000 7fb106600640 1 --2- 172.21.15.86:0/4181591414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb100106fa0 0x7fb10010aff0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:08.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.203+0000 7fb106600640 1 --2- 172.21.15.86:0/4181591414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1001065f0 0x7fb1001069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:08.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.203+0000 7fb106600640 1 -- 172.21.15.86:0/4181591414 >> 172.21.15.86:0/4181591414 conn(0x7fb100075d10 msgr2=0x7fb100078130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:08.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.204+0000 7fb106600640 1 -- 172.21.15.86:0/4181591414 shutdown_connections 2024-09-13T16:09:08.205 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.204+0000 7fb106600640 1 -- 172.21.15.86:0/4181591414 wait complete. 2024-09-13T16:09:08.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.204+0000 7fb106600640 1 Processor -- start 2024-09-13T16:09:08.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.205+0000 7fb106600640 1 -- start start 2024-09-13T16:09:08.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.205+0000 7fb106600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1001065f0 0x7fb1001a26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:08.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.205+0000 7fb106600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb100106fa0 0x7fb1001a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:08.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.205+0000 7fb106600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb10010b720 0x7fb10019c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:08.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.205+0000 7fb106600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10019cf10 con 0x7fb100106fa0 2024-09-13T16:09:08.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.205+0000 7fb106600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10019d080 con 0x7fb10010b720 2024-09-13T16:09:08.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.205+0000 7fb106600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10019d240 con 0x7fb1001065f0 2024-09-13T16:09:08.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.205+0000 7fb0f7e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb100106fa0 0x7fb1001a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:08.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.205+0000 7fb0ffe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb10010b720 0x7fb10019c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:08.207 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.205+0000 7fb0f7e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb100106fa0 0x7fb1001a2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60598/0 (socket says 172.21.15.86:60598) 2024-09-13T16:09:08.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.205+0000 7fb0f7e00640 1 -- 172.21.15.86:0/1950147196 learned_addr learned my addr 172.21.15.86:0/1950147196 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:08.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.205+0000 7fb0ff400640 1 --2- 172.21.15.86:0/1950147196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1001065f0 0x7fb1001a26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:08.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.206+0000 7fb0ffe00640 1 -- 172.21.15.86:0/1950147196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1001065f0 msgr2=0x7fb1001a26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:08.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.206+0000 7fb0ffe00640 1 --2- 172.21.15.86:0/1950147196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1001065f0 0x7fb1001a26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:08.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.206+0000 7fb0ffe00640 1 -- 172.21.15.86:0/1950147196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb100106fa0 msgr2=0x7fb1001a2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:08.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.206+0000 7fb0ffe00640 1 --2- 172.21.15.86:0/1950147196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb100106fa0 0x7fb1001a2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:08.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.206+0000 7fb0ffe00640 1 -- 172.21.15.86:0/1950147196 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e8009560 con 0x7fb10010b720 2024-09-13T16:09:08.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.206+0000 7fb0ffe00640 1 --2- 172.21.15.86:0/1950147196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb10010b720 0x7fb10019c810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009fd0 tx=0x7fb0f800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:08.208 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.206+0000 7fb0fcc00640 1 -- 172.21.15.86:0/1950147196 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f800ce20 con 0x7fb10010b720 2024-09-13T16:09:08.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.207+0000 7fb106600640 1 -- 172.21.15.86:0/1950147196 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10019d520 con 0x7fb10010b720 2024-09-13T16:09:08.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.207+0000 7fb0fcc00640 1 -- 172.21.15.86:0/1950147196 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb0f8005020 con 0x7fb10010b720 2024-09-13T16:09:08.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.207+0000 7fb0fcc00640 1 -- 172.21.15.86:0/1950147196 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8010690 con 0x7fb10010b720 2024-09-13T16:09:08.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.207+0000 7fb106600640 1 -- 172.21.15.86:0/1950147196 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1001a96c0 con 0x7fb10010b720 2024-09-13T16:09:08.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.208+0000 7fb106600640 1 -- 172.21.15.86:0/1950147196 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb100116810 con 0x7fb10010b720 2024-09-13T16:09:08.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.210+0000 7fb0fcc00640 1 -- 172.21.15.86:0/1950147196 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb0f8005500 con 0x7fb10010b720 2024-09-13T16:09:08.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.211+0000 7fb0fcc00640 1 --2- 172.21.15.86:0/1950147196 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb0e40a1110 0x7fb0e40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:08.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.211+0000 7fb0fcc00640 1 -- 172.21.15.86:0/1950147196 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb0f8014070 con 0x7fb10010b720 2024-09-13T16:09:08.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.211+0000 7fb0ff400640 1 --2- 172.21.15.86:0/1950147196 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb0e40a1110 0x7fb0e40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:08.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.212+0000 7fb0fcc00640 1 --2- 172.21.15.86:0/1950147196 >> [v2:172.21.15.194:6808/290656117,v1:172.21.15.194:6809/290656117] conn(0x7fb0e40ac1a0 0x7fb0e40ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:08.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.212+0000 7fb0fcc00640 1 -- 172.21.15.86:0/1950147196 --> [v2:172.21.15.194:6808/290656117,v1:172.21.15.194:6809/290656117] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0e40aed10 con 0x7fb0e40ac1a0 2024-09-13T16:09:08.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.212+0000 7fb0fcc00640 1 -- 172.21.15.86:0/1950147196 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0f80cd7a0 con 0x7fb10010b720 2024-09-13T16:09:08.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.212+0000 7fb0f7e00640 1 --2- 172.21.15.86:0/1950147196 >> [v2:172.21.15.194:6808/290656117,v1:172.21.15.194:6809/290656117] conn(0x7fb0e40ac1a0 0x7fb0e40ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:08.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.212+0000 7fb0ff400640 1 --2- 172.21.15.86:0/1950147196 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb0e40a1110 0x7fb0e40a35d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb0f000bbc0 tx=0x7fb0f000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:08.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.213+0000 7fb0f7e00640 1 --2- 172.21.15.86:0/1950147196 >> [v2:172.21.15.194:6808/290656117,v1:172.21.15.194:6809/290656117] conn(0x7fb0e40ac1a0 0x7fb0e40ae640 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:08.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.213+0000 7fb0fcc00640 1 -- 172.21.15.86:0/1950147196 <== osd.5 v2:172.21.15.194:6808/290656117 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb0e40aed10 con 0x7fb0e40ac1a0 2024-09-13T16:09:08.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.227+0000 7fb106600640 1 -- 172.21.15.86:0/1950147196 --> [v2:172.21.15.194:6808/290656117,v1:172.21.15.194:6809/290656117] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb100107ad0 con 0x7fb0e40ac1a0 2024-09-13T16:09:08.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.228+0000 7fb0fcc00640 1 -- 172.21.15.86:0/1950147196 <== osd.5 v2:172.21.15.194:6808/290656117 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb100107ad0 con 0x7fb0e40ac1a0 2024-09-13T16:09:08.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.228+0000 7fb106600640 1 -- 172.21.15.86:0/1950147196 >> [v2:172.21.15.194:6808/290656117,v1:172.21.15.194:6809/290656117] conn(0x7fb0e40ac1a0 msgr2=0x7fb0e40ae640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:08.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.228+0000 7fb106600640 1 --2- 172.21.15.86:0/1950147196 >> [v2:172.21.15.194:6808/290656117,v1:172.21.15.194:6809/290656117] conn(0x7fb0e40ac1a0 0x7fb0e40ae640 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:08.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.229+0000 7fb106600640 1 -- 172.21.15.86:0/1950147196 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb0e40a1110 msgr2=0x7fb0e40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:08.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.229+0000 7fb106600640 1 --2- 172.21.15.86:0/1950147196 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb0e40a1110 0x7fb0e40a35d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb0f000bbc0 tx=0x7fb0f000b390 comp rx=0 tx=0).stop 2024-09-13T16:09:08.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.229+0000 7fb106600640 1 -- 172.21.15.86:0/1950147196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb10010b720 msgr2=0x7fb10019c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:08.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.229+0000 7fb106600640 1 --2- 172.21.15.86:0/1950147196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb10010b720 0x7fb10019c810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009fd0 tx=0x7fb0f800ef10 comp rx=0 tx=0).stop 2024-09-13T16:09:08.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.229+0000 7fb0ffe00640 1 -- 172.21.15.86:0/1950147196 reap_dead start 2024-09-13T16:09:08.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.229+0000 7fb106600640 1 -- 172.21.15.86:0/1950147196 shutdown_connections 2024-09-13T16:09:08.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.229+0000 7fb106600640 1 -- 172.21.15.86:0/1950147196 >> 172.21.15.86:0/1950147196 conn(0x7fb100075d10 msgr2=0x7fb1000771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:08.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.229+0000 7fb106600640 1 -- 172.21.15.86:0/1950147196 shutdown_connections 2024-09-13T16:09:08.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.229+0000 7fb106600640 1 -- 172.21.15.86:0/1950147196 wait complete. 2024-09-13T16:09:08.537 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:09:08.558 INFO:teuthology.orchestra.run.smithi086.stdout:223338299436 2024-09-13T16:09:08.559 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-13T16:09:08.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.756+0000 7f4753200640 1 -- 172.21.15.86:0/2553814438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47540ffe20 msgr2=0x7f4754100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:08.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.756+0000 7f4753200640 1 --2- 172.21.15.86:0/2553814438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47540ffe20 0x7f4754100200 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4744009930 tx=0x7f474402a420 comp rx=0 tx=0).stop 2024-09-13T16:09:08.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.756+0000 7f4753200640 1 -- 172.21.15.86:0/2553814438 shutdown_connections 2024-09-13T16:09:08.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.756+0000 7f4753200640 1 --2- 172.21.15.86:0/2553814438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4754104f50 0x7f475410cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:08.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.756+0000 7f4753200640 1 --2- 172.21.15.86:0/2553814438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47541007d0 0x7f4754104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:08.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.756+0000 7f4753200640 1 --2- 172.21.15.86:0/2553814438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47540ffe20 0x7f4754100200 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:08.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.756+0000 7f4753200640 1 -- 172.21.15.86:0/2553814438 >> 172.21.15.86:0/2553814438 conn(0x7f47540fb900 msgr2=0x7f47540fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:08.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.757+0000 7f4753200640 1 -- 172.21.15.86:0/2553814438 shutdown_connections 2024-09-13T16:09:08.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.757+0000 7f4753200640 1 -- 172.21.15.86:0/2553814438 wait complete. 2024-09-13T16:09:08.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.758+0000 7f4753200640 1 Processor -- start 2024-09-13T16:09:08.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.758+0000 7f4753200640 1 -- start start 2024-09-13T16:09:08.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.759+0000 7f4753200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47540ffe20 0x7f47540727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:08.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.759+0000 7f4753200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47541007d0 0x7f4754072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:08.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.759+0000 7f4753200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4754104f50 0x7f4754073230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:08.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.759+0000 7f4753200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47541a4540 con 0x7f47541007d0 2024-09-13T16:09:08.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.759+0000 7f4753200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47541a46b0 con 0x7f4754104f50 2024-09-13T16:09:08.760 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.759+0000 7f4753200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47541a4870 con 0x7f47540ffe20 2024-09-13T16:09:08.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.759+0000 7f4751400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47541007d0 0x7f4754072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:08.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.759+0000 7f4751e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47540ffe20 0x7f47540727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:08.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.759+0000 7f4752800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4754104f50 0x7f4754073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:08.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.759+0000 7f4751400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47541007d0 0x7f4754072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60612/0 (socket says 172.21.15.86:60612) 2024-09-13T16:09:08.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.759+0000 7f4751e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47540ffe20 0x7f47540727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:39446/0 (socket says 172.21.15.86:39446) 2024-09-13T16:09:08.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.759+0000 7f4751400640 1 -- 172.21.15.86:0/1589367824 learned_addr learned my addr 172.21.15.86:0/1589367824 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:08.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.760+0000 7f4751e00640 1 -- 172.21.15.86:0/1589367824 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4754104f50 msgr2=0x7f4754073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:08.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.760+0000 7f4751e00640 1 --2- 172.21.15.86:0/1589367824 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4754104f50 0x7f4754073230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:08.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.760+0000 7f4751e00640 1 -- 172.21.15.86:0/1589367824 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47541007d0 msgr2=0x7f4754072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:08.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.760+0000 7f4751e00640 1 --2- 172.21.15.86:0/1589367824 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47541007d0 0x7f4754072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:08.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.760+0000 7f4751e00640 1 -- 172.21.15.86:0/1589367824 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4744009560 con 0x7f47540ffe20 2024-09-13T16:09:08.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.760+0000 7f4751e00640 1 --2- 172.21.15.86:0/1589367824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47540ffe20 0x7f47540727b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f474402aa10 tx=0x7f47440042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:08.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.760+0000 7f474aa00640 1 -- 172.21.15.86:0/1589367824 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744005410 con 0x7f47540ffe20 2024-09-13T16:09:08.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.761+0000 7f4753200640 1 -- 172.21.15.86:0/1589367824 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47541a4af0 con 0x7f47540ffe20 2024-09-13T16:09:08.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.761+0000 7f474aa00640 1 -- 172.21.15.86:0/1589367824 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f47440044e0 con 0x7f47540ffe20 2024-09-13T16:09:08.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.761+0000 7f474aa00640 1 -- 172.21.15.86:0/1589367824 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744003970 con 0x7f47540ffe20 2024-09-13T16:09:08.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.761+0000 7f4753200640 1 -- 172.21.15.86:0/1589367824 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47541a4fb0 con 0x7f47540ffe20 2024-09-13T16:09:08.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.762+0000 7f4753200640 1 -- 172.21.15.86:0/1589367824 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4754101300 con 0x7f47540ffe20 2024-09-13T16:09:08.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.764+0000 7f474aa00640 1 -- 172.21.15.86:0/1589367824 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f4744003ad0 con 0x7f47540ffe20 2024-09-13T16:09:08.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.766+0000 7f474aa00640 1 --2- 172.21.15.86:0/1589367824 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f47380a1180 0x7f47380a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:08.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.766+0000 7f474aa00640 1 -- 172.21.15.86:0/1589367824 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f47440edca0 con 0x7f47540ffe20 2024-09-13T16:09:08.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.766+0000 7f4751400640 1 --2- 172.21.15.86:0/1589367824 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f47380a1180 0x7f47380a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:08.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.767+0000 7f474aa00640 1 --2- 172.21.15.86:0/1589367824 >> [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372] conn(0x7f47380ac210 0x7f47380ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:08.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.767+0000 7f474aa00640 1 -- 172.21.15.86:0/1589367824 --> [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47380aed80 con 0x7f47380ac210 2024-09-13T16:09:08.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.767+0000 7f474aa00640 1 -- 172.21.15.86:0/1589367824 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47440ee010 con 0x7f47540ffe20 2024-09-13T16:09:08.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.767+0000 7f4752800640 1 --2- 172.21.15.86:0/1589367824 >> [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372] conn(0x7f47380ac210 0x7f47380ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:08.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.767+0000 7f4751400640 1 --2- 172.21.15.86:0/1589367824 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f47380a1180 0x7f47380a3640 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4754073f30 tx=0x7f4740005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:08.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.768+0000 7f4752800640 1 --2- 172.21.15.86:0/1589367824 >> [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372] conn(0x7f47380ac210 0x7f47380ae6b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:08.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.769+0000 7f474aa00640 1 -- 172.21.15.86:0/1589367824 <== osd.6 v2:172.21.15.86:6818/2271757372 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f47380aed80 con 0x7f47380ac210 2024-09-13T16:09:08.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.783+0000 7f4753200640 1 -- 172.21.15.86:0/1589367824 --> [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4754110040 con 0x7f47380ac210 2024-09-13T16:09:08.784 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:08 smithi086 ceph-mon[30379]: pgmap v326: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 7 op/s 2024-09-13T16:09:08.784 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.783+0000 7f474aa00640 1 -- 172.21.15.86:0/1589367824 <== osd.6 v2:172.21.15.86:6818/2271757372 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f474c004b20 con 0x7f47380ac210 2024-09-13T16:09:08.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.783+0000 7f4753200640 1 -- 172.21.15.86:0/1589367824 >> [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372] conn(0x7f47380ac210 msgr2=0x7f47380ae6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:08.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.783+0000 7f4753200640 1 --2- 172.21.15.86:0/1589367824 >> [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372] conn(0x7f47380ac210 0x7f47380ae6b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:08.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.784+0000 7f4753200640 1 -- 172.21.15.86:0/1589367824 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f47380a1180 msgr2=0x7f47380a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:08.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.784+0000 7f4753200640 1 --2- 172.21.15.86:0/1589367824 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f47380a1180 0x7f47380a3640 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4754073f30 tx=0x7f4740005f90 comp rx=0 tx=0).stop 2024-09-13T16:09:08.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.784+0000 7f4753200640 1 -- 172.21.15.86:0/1589367824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47540ffe20 msgr2=0x7f47540727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:08.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.784+0000 7f4753200640 1 --2- 172.21.15.86:0/1589367824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47540ffe20 0x7f47540727b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f474402aa10 tx=0x7f47440042f0 comp rx=0 tx=0).stop 2024-09-13T16:09:08.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.784+0000 7f4752800640 1 -- 172.21.15.86:0/1589367824 reap_dead start 2024-09-13T16:09:08.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.784+0000 7f4753200640 1 -- 172.21.15.86:0/1589367824 shutdown_connections 2024-09-13T16:09:08.785 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.784+0000 7f4753200640 1 -- 172.21.15.86:0/1589367824 >> 172.21.15.86:0/1589367824 conn(0x7f47540fb900 msgr2=0x7f47540fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:08.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.784+0000 7f4753200640 1 -- 172.21.15.86:0/1589367824 shutdown_connections 2024-09-13T16:09:08.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:08.784+0000 7f4753200640 1 -- 172.21.15.86:0/1589367824 wait complete. 2024-09-13T16:09:08.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:08 smithi139 ceph-mon[35320]: pgmap v326: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 7 op/s 2024-09-13T16:09:09.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:08 smithi194 ceph-mon[35694]: pgmap v326: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 7 op/s 2024-09-13T16:09:09.711 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:09 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:09:09.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.716+0000 7efcd8a00640 1 -- 172.21.15.86:0/1193405433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcd41007d0 msgr2=0x7efcd4104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:09.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.716+0000 7efcd8a00640 1 --2- 172.21.15.86:0/1193405433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcd41007d0 0x7efcd4104820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efcc0009930 tx=0x7efcc002a420 comp rx=0 tx=0).stop 2024-09-13T16:09:09.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.716+0000 7efcd8a00640 1 -- 172.21.15.86:0/1193405433 shutdown_connections 2024-09-13T16:09:09.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.716+0000 7efcd8a00640 1 --2- 172.21.15.86:0/1193405433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcd4104f50 0x7efcd410cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:09.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.716+0000 7efcd8a00640 1 --2- 172.21.15.86:0/1193405433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcd41007d0 0x7efcd4104820 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:09.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.716+0000 7efcd8a00640 1 --2- 172.21.15.86:0/1193405433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcd40ffe20 0x7efcd4100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:09.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.716+0000 7efcd8a00640 1 -- 172.21.15.86:0/1193405433 >> 172.21.15.86:0/1193405433 conn(0x7efcd40fb900 msgr2=0x7efcd40fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:09.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.716+0000 7efcd8a00640 1 -- 172.21.15.86:0/1193405433 shutdown_connections 2024-09-13T16:09:09.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.716+0000 7efcd8a00640 1 -- 172.21.15.86:0/1193405433 wait complete. 2024-09-13T16:09:09.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.718+0000 7efcd8a00640 1 Processor -- start 2024-09-13T16:09:09.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.718+0000 7efcd8a00640 1 -- start start 2024-09-13T16:09:09.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.718+0000 7efcd8a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcd40ffe20 0x7efcd4196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:09.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.718+0000 7efcd8a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcd41007d0 0x7efcd41967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:09.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.718+0000 7efcd8a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcd4104f50 0x7efcd419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:09.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.718+0000 7efcd8a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd419b1a0 con 0x7efcd4104f50 2024-09-13T16:09:09.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.718+0000 7efcd8a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd419b310 con 0x7efcd40ffe20 2024-09-13T16:09:09.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.718+0000 7efcd8a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd419b480 con 0x7efcd41007d0 2024-09-13T16:09:09.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.718+0000 7efcd3400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcd40ffe20 0x7efcd4196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:09.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.719+0000 7efcd2a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcd41007d0 0x7efcd41967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:09.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.719+0000 7efcd3400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcd40ffe20 0x7efcd4196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:50676/0 (socket says 172.21.15.86:50676) 2024-09-13T16:09:09.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.719+0000 7efcd3400640 1 -- 172.21.15.86:0/3005638720 learned_addr learned my addr 172.21.15.86:0/3005638720 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:09.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.719+0000 7efcd3e00640 1 --2- 172.21.15.86:0/3005638720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcd4104f50 0x7efcd419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:09.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.719+0000 7efcd2a00640 1 -- 172.21.15.86:0/3005638720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcd40ffe20 msgr2=0x7efcd4196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:09.726 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.719+0000 7efcd2a00640 1 --2- 172.21.15.86:0/3005638720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcd40ffe20 0x7efcd4196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:09.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.719+0000 7efcd2a00640 1 -- 172.21.15.86:0/3005638720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcd4104f50 msgr2=0x7efcd419aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:09.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.719+0000 7efcd2a00640 1 --2- 172.21.15.86:0/3005638720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcd4104f50 0x7efcd419aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:09.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.719+0000 7efcd2a00640 1 -- 172.21.15.86:0/3005638720 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc0009560 con 0x7efcd41007d0 2024-09-13T16:09:09.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.719+0000 7efcd3e00640 1 --2- 172.21.15.86:0/3005638720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcd4104f50 0x7efcd419aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:09:09.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.719+0000 7efcd2a00640 1 --2- 172.21.15.86:0/3005638720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcd41007d0 0x7efcd41967a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efcc002a940 tx=0x7efcc0005620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:09.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.720+0000 7efccbe00640 1 -- 172.21.15.86:0/3005638720 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0004ad0 con 0x7efcd41007d0 2024-09-13T16:09:09.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.720+0000 7efccbe00640 1 -- 172.21.15.86:0/3005638720 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efcc0004c30 con 0x7efcd41007d0 2024-09-13T16:09:09.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.720+0000 7efcd8a00640 1 -- 172.21.15.86:0/3005638720 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd419b700 con 0x7efcd41007d0 2024-09-13T16:09:09.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.720+0000 7efccbe00640 1 -- 172.21.15.86:0/3005638720 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0031950 con 0x7efcd41007d0 2024-09-13T16:09:09.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.720+0000 7efcd8a00640 1 -- 172.21.15.86:0/3005638720 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd419b9f0 con 0x7efcd41007d0 2024-09-13T16:09:09.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.721+0000 7efcd8a00640 1 -- 172.21.15.86:0/3005638720 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efcd410ffd0 con 0x7efcd41007d0 2024-09-13T16:09:09.727 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.723+0000 7efccbe00640 1 -- 172.21.15.86:0/3005638720 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7efcc0003bd0 con 0x7efcd41007d0 2024-09-13T16:09:09.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.725+0000 7efccbe00640 1 --2- 172.21.15.86:0/3005638720 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efcb80a1180 0x7efcb80a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:09.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.725+0000 7efccbe00640 1 -- 172.21.15.86:0/3005638720 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7efcc00edfe0 con 0x7efcd41007d0 2024-09-13T16:09:09.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.725+0000 7efcd3400640 1 --2- 172.21.15.86:0/3005638720 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efcb80a1180 0x7efcb80a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:09.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.725+0000 7efccbe00640 1 --2- 172.21.15.86:0/3005638720 >> [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980] conn(0x7efcb80ac210 0x7efcb80ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:09.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.725+0000 7efccbe00640 1 -- 172.21.15.86:0/3005638720 --> [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efcb80aed80 con 0x7efcb80ac210 2024-09-13T16:09:09.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.725+0000 7efccbe00640 1 -- 172.21.15.86:0/3005638720 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcc00ee350 con 0x7efcd41007d0 2024-09-13T16:09:09.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.726+0000 7efcd3e00640 1 --2- 172.21.15.86:0/3005638720 >> [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980] conn(0x7efcb80ac210 0x7efcb80ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:09.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.726+0000 7efcd3400640 1 --2- 172.21.15.86:0/3005638720 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efcb80a1180 0x7efcb80a3640 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009cd0 tx=0x7efcc4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:09.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.726+0000 7efcd3e00640 1 --2- 172.21.15.86:0/3005638720 >> [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980] conn(0x7efcb80ac210 0x7efcb80ae6b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:09.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.727+0000 7efccbe00640 1 -- 172.21.15.86:0/3005638720 <== osd.9 v2:172.21.15.86:6826/2812182980 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7efcb80aed80 con 0x7efcb80ac210 2024-09-13T16:09:09.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.742+0000 7efcd8a00640 1 -- 172.21.15.86:0/3005638720 --> [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efcd4060b30 con 0x7efcb80ac210 2024-09-13T16:09:09.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.743+0000 7efccbe00640 1 -- 172.21.15.86:0/3005638720 <== osd.9 v2:172.21.15.86:6826/2812182980 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7efcd4060b30 con 0x7efcb80ac210 2024-09-13T16:09:09.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.743+0000 7efcd8a00640 1 -- 172.21.15.86:0/3005638720 >> [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980] conn(0x7efcb80ac210 msgr2=0x7efcb80ae6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:09.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.743+0000 7efcd8a00640 1 --2- 172.21.15.86:0/3005638720 >> [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980] conn(0x7efcb80ac210 0x7efcb80ae6b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:09.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.743+0000 7efcd8a00640 1 -- 172.21.15.86:0/3005638720 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efcb80a1180 msgr2=0x7efcb80a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:09.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.743+0000 7efcd8a00640 1 --2- 172.21.15.86:0/3005638720 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efcb80a1180 0x7efcb80a3640 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009cd0 tx=0x7efcc4005f90 comp rx=0 tx=0).stop 2024-09-13T16:09:09.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.743+0000 7efcd8a00640 1 -- 172.21.15.86:0/3005638720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcd41007d0 msgr2=0x7efcd41967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:09.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.743+0000 7efcd8a00640 1 --2- 172.21.15.86:0/3005638720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcd41007d0 0x7efcd41967a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efcc002a940 tx=0x7efcc0005620 comp rx=0 tx=0).stop 2024-09-13T16:09:09.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.743+0000 7efcd3e00640 1 -- 172.21.15.86:0/3005638720 reap_dead start 2024-09-13T16:09:09.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.743+0000 7efcd8a00640 1 -- 172.21.15.86:0/3005638720 shutdown_connections 2024-09-13T16:09:09.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.743+0000 7efcd8a00640 1 -- 172.21.15.86:0/3005638720 >> 172.21.15.86:0/3005638720 conn(0x7efcd40fb900 msgr2=0x7efcd40fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:09.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.744+0000 7efcd8a00640 1 -- 172.21.15.86:0/3005638720 shutdown_connections 2024-09-13T16:09:09.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:09.744+0000 7efcd8a00640 1 -- 172.21.15.86:0/3005638720 wait complete. 2024-09-13T16:09:09.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:09 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:09:09.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:09 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:09:10.611 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:10 smithi086 ceph-mon[30379]: pgmap v327: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 312 B/s wr, 6 op/s 2024-09-13T16:09:10.611 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:10 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:10.611 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:10 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:10.611 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:10 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:10.611 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:10 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:10.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:10 smithi139 ceph-mon[35320]: pgmap v327: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 312 B/s wr, 6 op/s 2024-09-13T16:09:10.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:10 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:10.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:10 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:10.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:10 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:10.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:10 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:10 smithi194 ceph-mon[35694]: pgmap v327: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 312 B/s wr, 6 op/s 2024-09-13T16:09:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:10 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:10 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:10 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:10 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:11.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.515+0000 7f1283400640 1 -- 172.21.15.86:0/3455148619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f127c107330 msgr2=0x7f127c10eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:11.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.515+0000 7f1283400640 1 --2- 172.21.15.86:0/3455148619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f127c107330 0x7f127c10eeb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1274009cd0 tx=0x7f127402a8f0 comp rx=0 tx=0).stop 2024-09-13T16:09:11.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.516+0000 7f1283400640 1 -- 172.21.15.86:0/3455148619 shutdown_connections 2024-09-13T16:09:11.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.516+0000 7f1283400640 1 --2- 172.21.15.86:0/3455148619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f127c107330 0x7f127c10eeb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:11.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.516+0000 7f1283400640 1 --2- 172.21.15.86:0/3455148619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f127c102bb0 0x7f127c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:11.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.516+0000 7f1283400640 1 --2- 172.21.15.86:0/3455148619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f127c102200 0x7f127c1025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:11.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.516+0000 7f1283400640 1 -- 172.21.15.86:0/3455148619 >> 172.21.15.86:0/3455148619 conn(0x7f127c0fdc40 msgr2=0x7f127c100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:11.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.516+0000 7f1283400640 1 -- 172.21.15.86:0/3455148619 shutdown_connections 2024-09-13T16:09:11.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.516+0000 7f1283400640 1 -- 172.21.15.86:0/3455148619 wait complete. 2024-09-13T16:09:11.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.517+0000 7f1283400640 1 Processor -- start 2024-09-13T16:09:11.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.517+0000 7f1283400640 1 -- start start 2024-09-13T16:09:11.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.518+0000 7f1283400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f127c102200 0x7f127c198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:11.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.518+0000 7f1283400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f127c102bb0 0x7f127c198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:11.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.518+0000 7f1283400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f127c107330 0x7f127c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:11.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.518+0000 7f1283400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c19d510 con 0x7f127c102200 2024-09-13T16:09:11.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.518+0000 7f1283400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c19d680 con 0x7f127c107330 2024-09-13T16:09:11.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.518+0000 7f1283400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c19d7f0 con 0x7f127c102bb0 2024-09-13T16:09:11.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.518+0000 7f127be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f127c102bb0 0x7f127c198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:11.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.518+0000 7f127be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f127c102bb0 0x7f127c198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:39468/0 (socket says 172.21.15.86:39468) 2024-09-13T16:09:11.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.518+0000 7f127be00640 1 -- 172.21.15.86:0/3009771250 learned_addr learned my addr 172.21.15.86:0/3009771250 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:11.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.518+0000 7f1280a00640 1 --2- 172.21.15.86:0/3009771250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f127c102200 0x7f127c198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:11.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.518+0000 7f1281400640 1 --2- 172.21.15.86:0/3009771250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f127c107330 0x7f127c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:11.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.518+0000 7f127be00640 1 -- 172.21.15.86:0/3009771250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f127c107330 msgr2=0x7f127c19cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:11.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.518+0000 7f127be00640 1 --2- 172.21.15.86:0/3009771250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f127c107330 0x7f127c19cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:11.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.518+0000 7f127be00640 1 -- 172.21.15.86:0/3009771250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f127c102200 msgr2=0x7f127c198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:11.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.518+0000 7f127be00640 1 --2- 172.21.15.86:0/3009771250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f127c102200 0x7f127c198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:11.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.518+0000 7f127be00640 1 -- 172.21.15.86:0/3009771250 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1274009900 con 0x7f127c102bb0 2024-09-13T16:09:11.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.519+0000 7f127be00640 1 --2- 172.21.15.86:0/3009771250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f127c102bb0 0x7f127c198b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f126800e9f0 tx=0x7f126800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:11.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.519+0000 7f1279600640 1 -- 172.21.15.86:0/3009771250 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268009720 con 0x7f127c102bb0 2024-09-13T16:09:11.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.519+0000 7f1279600640 1 -- 172.21.15.86:0/3009771250 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f126800cd80 con 0x7f127c102bb0 2024-09-13T16:09:11.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.519+0000 7f1279600640 1 -- 172.21.15.86:0/3009771250 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268010690 con 0x7f127c102bb0 2024-09-13T16:09:11.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.519+0000 7f1283400640 1 -- 172.21.15.86:0/3009771250 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127c19dad0 con 0x7f127c102bb0 2024-09-13T16:09:11.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.519+0000 7f1283400640 1 -- 172.21.15.86:0/3009771250 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127c1a5390 con 0x7f127c102bb0 2024-09-13T16:09:11.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.520+0000 7f1283400640 1 -- 172.21.15.86:0/3009771250 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f127c112430 con 0x7f127c102bb0 2024-09-13T16:09:11.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.522+0000 7f1279600640 1 -- 172.21.15.86:0/3009771250 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f12680046c0 con 0x7f127c102bb0 2024-09-13T16:09:11.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.523+0000 7f1279600640 1 --2- 172.21.15.86:0/3009771250 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f12640a1190 0x7f12640a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:11.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.523+0000 7f1279600640 1 -- 172.21.15.86:0/3009771250 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1268014070 con 0x7f127c102bb0 2024-09-13T16:09:11.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.524+0000 7f1280a00640 1 --2- 172.21.15.86:0/3009771250 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f12640a1190 0x7f12640a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:11.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.524+0000 7f1279600640 1 --2- 172.21.15.86:0/3009771250 >> [v2:172.21.15.194:6824/886506943,v1:172.21.15.194:6825/886506943] conn(0x7f12640ac220 0x7f12640ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:11.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.524+0000 7f1279600640 1 -- 172.21.15.86:0/3009771250 --> [v2:172.21.15.194:6824/886506943,v1:172.21.15.194:6825/886506943] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f12640aed90 con 0x7f12640ac220 2024-09-13T16:09:11.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.524+0000 7f1279600640 1 -- 172.21.15.86:0/3009771250 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12680cf490 con 0x7f127c102bb0 2024-09-13T16:09:11.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.524+0000 7f1281400640 1 --2- 172.21.15.86:0/3009771250 >> [v2:172.21.15.194:6824/886506943,v1:172.21.15.194:6825/886506943] conn(0x7f12640ac220 0x7f12640ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:11.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.524+0000 7f1280a00640 1 --2- 172.21.15.86:0/3009771250 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f12640a1190 0x7f12640a3650 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1270005d00 tx=0x7f127000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:11.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.525+0000 7f1281400640 1 --2- 172.21.15.86:0/3009771250 >> [v2:172.21.15.194:6824/886506943,v1:172.21.15.194:6825/886506943] conn(0x7f12640ac220 0x7f12640ae6c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:11.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.526+0000 7f1279600640 1 -- 172.21.15.86:0/3009771250 <== osd.11 v2:172.21.15.194:6824/886506943 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f12640aed90 con 0x7f12640ac220 2024-09-13T16:09:11.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.540+0000 7f1283400640 1 -- 172.21.15.86:0/3009771250 --> [v2:172.21.15.194:6824/886506943,v1:172.21.15.194:6825/886506943] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f127c060bb0 con 0x7f12640ac220 2024-09-13T16:09:11.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.541+0000 7f1279600640 1 -- 172.21.15.86:0/3009771250 <== osd.11 v2:172.21.15.194:6824/886506943 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f127c060bb0 con 0x7f12640ac220 2024-09-13T16:09:11.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.541+0000 7f1283400640 1 -- 172.21.15.86:0/3009771250 >> [v2:172.21.15.194:6824/886506943,v1:172.21.15.194:6825/886506943] conn(0x7f12640ac220 msgr2=0x7f12640ae6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:11.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.541+0000 7f1283400640 1 --2- 172.21.15.86:0/3009771250 >> [v2:172.21.15.194:6824/886506943,v1:172.21.15.194:6825/886506943] conn(0x7f12640ac220 0x7f12640ae6c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:11.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.541+0000 7f1283400640 1 -- 172.21.15.86:0/3009771250 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f12640a1190 msgr2=0x7f12640a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:11.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.541+0000 7f1283400640 1 --2- 172.21.15.86:0/3009771250 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f12640a1190 0x7f12640a3650 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1270005d00 tx=0x7f127000b410 comp rx=0 tx=0).stop 2024-09-13T16:09:11.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.541+0000 7f1283400640 1 -- 172.21.15.86:0/3009771250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f127c102bb0 msgr2=0x7f127c198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:11.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.541+0000 7f1283400640 1 --2- 172.21.15.86:0/3009771250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f127c102bb0 0x7f127c198b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f126800e9f0 tx=0x7f126800edf0 comp rx=0 tx=0).stop 2024-09-13T16:09:11.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.541+0000 7f1281400640 1 -- 172.21.15.86:0/3009771250 reap_dead start 2024-09-13T16:09:11.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.541+0000 7f1283400640 1 -- 172.21.15.86:0/3009771250 shutdown_connections 2024-09-13T16:09:11.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.541+0000 7f1283400640 1 -- 172.21.15.86:0/3009771250 >> 172.21.15.86:0/3009771250 conn(0x7f127c0fdc40 msgr2=0x7f127c0ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:11.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.542+0000 7f1283400640 1 -- 172.21.15.86:0/3009771250 shutdown_connections 2024-09-13T16:09:11.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:10.542+0000 7f1283400640 1 -- 172.21.15.86:0/3009771250 wait complete. 2024-09-13T16:09:12.252 INFO:teuthology.orchestra.run.smithi086.stdout:313532612637 2024-09-13T16:09:12.252 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-13T16:09:12.569 INFO:teuthology.orchestra.run.smithi086.stdout:167503724599 2024-09-13T16:09:12.569 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-13T16:09:12.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:12 smithi086 ceph-mon[30379]: pgmap v328: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 283 B/s wr, 7 op/s 2024-09-13T16:09:12.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:12 smithi139 ceph-mon[35320]: pgmap v328: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 283 B/s wr, 7 op/s 2024-09-13T16:09:13.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:12 smithi194 ceph-mon[35694]: pgmap v328: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 283 B/s wr, 7 op/s 2024-09-13T16:09:13.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.627+0000 7f88e3800640 1 -- 172.21.15.86:0/1668420754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88dc072850 msgr2=0x7f88dc072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:13.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.627+0000 7f88e3800640 1 --2- 172.21.15.86:0/1668420754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88dc072850 0x7f88dc072c30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009900 tx=0x7f88d002a480 comp rx=0 tx=0).stop 2024-09-13T16:09:13.630 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.627+0000 7f88e3800640 1 -- 172.21.15.86:0/1668420754 shutdown_connections 2024-09-13T16:09:13.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.627+0000 7f88e3800640 1 --2- 172.21.15.86:0/1668420754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88dc110da0 0x7f88dc113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:13.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.627+0000 7f88e3800640 1 --2- 172.21.15.86:0/1668420754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88dc073170 0x7f88dc110860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:13.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.627+0000 7f88e3800640 1 --2- 172.21.15.86:0/1668420754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88dc072850 0x7f88dc072c30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:13.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.627+0000 7f88e3800640 1 -- 172.21.15.86:0/1668420754 >> 172.21.15.86:0/1668420754 conn(0x7f88dc0fba90 msgr2=0x7f88dc0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:13.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.627+0000 7f88e3800640 1 -- 172.21.15.86:0/1668420754 shutdown_connections 2024-09-13T16:09:13.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.628+0000 7f88e3800640 1 -- 172.21.15.86:0/1668420754 wait complete. 2024-09-13T16:09:13.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.629+0000 7f88e3800640 1 Processor -- start 2024-09-13T16:09:13.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.629+0000 7f88e3800640 1 -- start start 2024-09-13T16:09:13.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.629+0000 7f88e3800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88dc072850 0x7f88dc19ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:13.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.629+0000 7f88e3800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88dc073170 0x7f88dc19cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:13.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.629+0000 7f88e3800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88dc110da0 0x7f88dc1a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:13.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.629+0000 7f88e3800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc1a1970 con 0x7f88dc110da0 2024-09-13T16:09:13.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.629+0000 7f88e3800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc1a1ae0 con 0x7f88dc072850 2024-09-13T16:09:13.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.629+0000 7f88e3800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc1a1ca0 con 0x7f88dc073170 2024-09-13T16:09:13.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.629+0000 7f88e1800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88dc110da0 0x7f88dc1a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:13.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.629+0000 7f88e0e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88dc072850 0x7f88dc19ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:13.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.630+0000 7f88e0e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88dc072850 0x7f88dc19ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:52244/0 (socket says 172.21.15.86:52244) 2024-09-13T16:09:13.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.630+0000 7f88e1800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88dc110da0 0x7f88dc1a1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52532/0 (socket says 172.21.15.86:52532) 2024-09-13T16:09:13.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.630+0000 7f88e0e00640 1 -- 172.21.15.86:0/3446762077 learned_addr learned my addr 172.21.15.86:0/3446762077 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:13.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.630+0000 7f88dbe00640 1 --2- 172.21.15.86:0/3446762077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88dc073170 0x7f88dc19cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:13.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.630+0000 7f88e0e00640 1 -- 172.21.15.86:0/3446762077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88dc073170 msgr2=0x7f88dc19cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:13.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.630+0000 7f88e0e00640 1 --2- 172.21.15.86:0/3446762077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88dc073170 0x7f88dc19cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:13.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.630+0000 7f88e0e00640 1 -- 172.21.15.86:0/3446762077 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88dc110da0 msgr2=0x7f88dc1a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:13.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.630+0000 7f88e0e00640 1 --2- 172.21.15.86:0/3446762077 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88dc110da0 0x7f88dc1a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:13.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.630+0000 7f88e0e00640 1 -- 172.21.15.86:0/3446762077 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d0009560 con 0x7f88dc072850 2024-09-13T16:09:13.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.630+0000 7f88e1800640 1 --2- 172.21.15.86:0/3446762077 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88dc110da0 0x7f88dc1a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:09:13.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.631+0000 7f88e0e00640 1 --2- 172.21.15.86:0/3446762077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88dc072850 0x7f88dc19ca50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009230 tx=0x7f88d00042d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:13.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.631+0000 7f88d9600640 1 -- 172.21.15.86:0/3446762077 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d00044c0 con 0x7f88dc072850 2024-09-13T16:09:13.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.631+0000 7f88d9600640 1 -- 172.21.15.86:0/3446762077 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f88d0005210 con 0x7f88dc072850 2024-09-13T16:09:13.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.631+0000 7f88d9600640 1 -- 172.21.15.86:0/3446762077 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d0004dc0 con 0x7f88dc072850 2024-09-13T16:09:13.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.631+0000 7f88e3800640 1 -- 172.21.15.86:0/3446762077 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc1a1f20 con 0x7f88dc072850 2024-09-13T16:09:13.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.631+0000 7f88e3800640 1 -- 172.21.15.86:0/3446762077 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88dc1a9620 con 0x7f88dc072850 2024-09-13T16:09:13.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.632+0000 7f88e3800640 1 -- 172.21.15.86:0/3446762077 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f88dc1167a0 con 0x7f88dc072850 2024-09-13T16:09:13.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.634+0000 7f88d9600640 1 -- 172.21.15.86:0/3446762077 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f88d0005380 con 0x7f88dc072850 2024-09-13T16:09:13.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.636+0000 7f88d9600640 1 --2- 172.21.15.86:0/3446762077 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f88c40a1190 0x7f88c40a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:13.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.636+0000 7f88d9600640 1 -- 172.21.15.86:0/3446762077 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f88d00edb50 con 0x7f88dc072850 2024-09-13T16:09:13.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.636+0000 7f88dbe00640 1 --2- 172.21.15.86:0/3446762077 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f88c40a1190 0x7f88c40a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:13.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.636+0000 7f88d9600640 1 --2- 172.21.15.86:0/3446762077 >> [v2:172.21.15.194:6816/1203296705,v1:172.21.15.194:6817/1203296705] conn(0x7f88c40ac220 0x7f88c40ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:13.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.636+0000 7f88d9600640 1 -- 172.21.15.86:0/3446762077 --> [v2:172.21.15.194:6816/1203296705,v1:172.21.15.194:6817/1203296705] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88c40aed90 con 0x7f88c40ac220 2024-09-13T16:09:13.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.636+0000 7f88d9600640 1 -- 172.21.15.86:0/3446762077 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88d00edec0 con 0x7f88dc072850 2024-09-13T16:09:13.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.637+0000 7f88e1800640 1 --2- 172.21.15.86:0/3446762077 >> [v2:172.21.15.194:6816/1203296705,v1:172.21.15.194:6817/1203296705] conn(0x7f88c40ac220 0x7f88c40ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:13.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.637+0000 7f88dbe00640 1 --2- 172.21.15.86:0/3446762077 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f88c40a1190 0x7f88c40a3650 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f88dc19dfb0 tx=0x7f88c800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:13.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.637+0000 7f88e1800640 1 --2- 172.21.15.86:0/3446762077 >> [v2:172.21.15.194:6816/1203296705,v1:172.21.15.194:6817/1203296705] conn(0x7f88c40ac220 0x7f88c40ae6c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:13.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.638+0000 7f88d9600640 1 -- 172.21.15.86:0/3446762077 <== osd.8 v2:172.21.15.194:6816/1203296705 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f88c40aed90 con 0x7f88c40ac220 2024-09-13T16:09:13.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.652+0000 7f88e3800640 1 -- 172.21.15.86:0/3446762077 --> [v2:172.21.15.194:6816/1203296705,v1:172.21.15.194:6817/1203296705] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f88dc073f90 con 0x7f88c40ac220 2024-09-13T16:09:13.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.653+0000 7f88d9600640 1 -- 172.21.15.86:0/3446762077 <== osd.8 v2:172.21.15.194:6816/1203296705 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f88dc073f90 con 0x7f88c40ac220 2024-09-13T16:09:13.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.653+0000 7f88e3800640 1 -- 172.21.15.86:0/3446762077 >> [v2:172.21.15.194:6816/1203296705,v1:172.21.15.194:6817/1203296705] conn(0x7f88c40ac220 msgr2=0x7f88c40ae6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:13.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.653+0000 7f88e3800640 1 --2- 172.21.15.86:0/3446762077 >> [v2:172.21.15.194:6816/1203296705,v1:172.21.15.194:6817/1203296705] conn(0x7f88c40ac220 0x7f88c40ae6c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:13.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.653+0000 7f88e3800640 1 -- 172.21.15.86:0/3446762077 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f88c40a1190 msgr2=0x7f88c40a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:13.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.653+0000 7f88e3800640 1 --2- 172.21.15.86:0/3446762077 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f88c40a1190 0x7f88c40a3650 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f88dc19dfb0 tx=0x7f88c800b390 comp rx=0 tx=0).stop 2024-09-13T16:09:13.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.653+0000 7f88e3800640 1 -- 172.21.15.86:0/3446762077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88dc072850 msgr2=0x7f88dc19ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:13.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.653+0000 7f88e3800640 1 --2- 172.21.15.86:0/3446762077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88dc072850 0x7f88dc19ca50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009230 tx=0x7f88d00042d0 comp rx=0 tx=0).stop 2024-09-13T16:09:13.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.653+0000 7f88e1800640 1 -- 172.21.15.86:0/3446762077 reap_dead start 2024-09-13T16:09:13.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.653+0000 7f88e3800640 1 -- 172.21.15.86:0/3446762077 shutdown_connections 2024-09-13T16:09:13.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.653+0000 7f88e3800640 1 -- 172.21.15.86:0/3446762077 >> 172.21.15.86:0/3446762077 conn(0x7f88dc0fba90 msgr2=0x7f88dc0fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:13.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.654+0000 7f88e3800640 1 -- 172.21.15.86:0/3446762077 shutdown_connections 2024-09-13T16:09:13.656 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.654+0000 7f88e3800640 1 -- 172.21.15.86:0/3446762077 wait complete. 2024-09-13T16:09:14.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.851+0000 7f5fd1400640 1 -- 172.21.15.86:0/4248717440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc1021f0 msgr2=0x7f5fcc1025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:14.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.851+0000 7f5fd1400640 1 --2- 172.21.15.86:0/4248717440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc1021f0 0x7f5fcc1025d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009930 tx=0x7f5fbc02a440 comp rx=0 tx=0).stop 2024-09-13T16:09:14.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.851+0000 7f5fd1400640 1 -- 172.21.15.86:0/4248717440 shutdown_connections 2024-09-13T16:09:14.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.851+0000 7f5fd1400640 1 --2- 172.21.15.86:0/4248717440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fcc107320 0x7f5fcc10eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:14.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.851+0000 7f5fd1400640 1 --2- 172.21.15.86:0/4248717440 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5fcc102ba0 0x7f5fcc106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:14.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.851+0000 7f5fd1400640 1 --2- 172.21.15.86:0/4248717440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc1021f0 0x7f5fcc1025d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:14.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.851+0000 7f5fd1400640 1 -- 172.21.15.86:0/4248717440 >> 172.21.15.86:0/4248717440 conn(0x7f5fcc0fdc70 msgr2=0x7f5fcc100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:14.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.851+0000 7f5fd1400640 1 -- 172.21.15.86:0/4248717440 shutdown_connections 2024-09-13T16:09:14.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.852+0000 7f5fd1400640 1 -- 172.21.15.86:0/4248717440 wait complete. 2024-09-13T16:09:14.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.853+0000 7f5fd1400640 1 Processor -- start 2024-09-13T16:09:14.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.853+0000 7f5fd1400640 1 -- start start 2024-09-13T16:09:14.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.853+0000 7f5fd1400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5fcc1021f0 0x7f5fcc198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:14.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.853+0000 7f5fd1400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc102ba0 0x7f5fcc198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:14.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.853+0000 7f5fd1400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fcc107320 0x7f5fcc19cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:14.272 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.853+0000 7f5fd1400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc19d5d0 con 0x7f5fcc102ba0 2024-09-13T16:09:14.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.853+0000 7f5fd1400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc19d740 con 0x7f5fcc1021f0 2024-09-13T16:09:14.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.853+0000 7f5fd1400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc19d8b0 con 0x7f5fcc107320 2024-09-13T16:09:14.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.853+0000 7f5fc3e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc102ba0 0x7f5fcc198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:14.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.853+0000 7f5fca800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5fcc1021f0 0x7f5fcc198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:14.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.853+0000 7f5fca800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5fcc1021f0 0x7f5fcc198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:52276/0 (socket says 172.21.15.86:52276) 2024-09-13T16:09:14.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.853+0000 7f5fc3e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc102ba0 0x7f5fcc198bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52544/0 (socket says 172.21.15.86:52544) 2024-09-13T16:09:14.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.853+0000 7f5fca800640 1 -- 172.21.15.86:0/4128826988 learned_addr learned my addr 172.21.15.86:0/4128826988 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:14.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.854+0000 7f5fcb200640 1 --2- 172.21.15.86:0/4128826988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fcc107320 0x7f5fcc19cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:14.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.854+0000 7f5fca800640 1 -- 172.21.15.86:0/4128826988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fcc107320 msgr2=0x7f5fcc19cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:14.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.854+0000 7f5fca800640 1 --2- 172.21.15.86:0/4128826988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fcc107320 0x7f5fcc19cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:14.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.854+0000 7f5fca800640 1 -- 172.21.15.86:0/4128826988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc102ba0 msgr2=0x7f5fcc198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:14.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.854+0000 7f5fca800640 1 --2- 172.21.15.86:0/4128826988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc102ba0 0x7f5fcc198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:14.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.854+0000 7f5fca800640 1 -- 172.21.15.86:0/4128826988 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fbc009560 con 0x7f5fcc1021f0 2024-09-13T16:09:14.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.854+0000 7f5fcb200640 1 --2- 172.21.15.86:0/4128826988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fcc107320 0x7f5fcc19cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:09:14.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.854+0000 7f5fc3e00640 1 --2- 172.21.15.86:0/4128826988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fcc102ba0 0x7f5fcc198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:09:14.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.854+0000 7f5fca800640 1 --2- 172.21.15.86:0/4128826988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5fcc1021f0 0x7f5fcc198690 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc005ab0 tx=0x7f5fbc005620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:14.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.854+0000 7f5fc3400640 1 -- 172.21.15.86:0/4128826988 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc004b50 con 0x7f5fcc1021f0 2024-09-13T16:09:14.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.854+0000 7f5fc3400640 1 -- 172.21.15.86:0/4128826988 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5fbc004cb0 con 0x7f5fcc1021f0 2024-09-13T16:09:14.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.854+0000 7f5fd1400640 1 -- 172.21.15.86:0/4128826988 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fcc19db30 con 0x7f5fcc1021f0 2024-09-13T16:09:14.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.854+0000 7f5fc3400640 1 -- 172.21.15.86:0/4128826988 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc031a30 con 0x7f5fcc1021f0 2024-09-13T16:09:14.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.855+0000 7f5fd1400640 1 -- 172.21.15.86:0/4128826988 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fcc19de50 con 0x7f5fcc1021f0 2024-09-13T16:09:14.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.855+0000 7f5fd1400640 1 -- 172.21.15.86:0/4128826988 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5fcc1123e0 con 0x7f5fcc1021f0 2024-09-13T16:09:14.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.858+0000 7f5fc3400640 1 -- 172.21.15.86:0/4128826988 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5fbc003c40 con 0x7f5fcc1021f0 2024-09-13T16:09:14.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.859+0000 7f5fc3400640 1 --2- 172.21.15.86:0/4128826988 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f5fb00a1190 0x7f5fb00a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:14.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.859+0000 7f5fc3400640 1 -- 172.21.15.86:0/4128826988 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5fbc0ee070 con 0x7f5fcc1021f0 2024-09-13T16:09:14.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.859+0000 7f5fc3e00640 1 --2- 172.21.15.86:0/4128826988 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f5fb00a1190 0x7f5fb00a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:14.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.859+0000 7f5fc3400640 1 --2- 172.21.15.86:0/4128826988 >> [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994] conn(0x7f5fb00ac220 0x7f5fb00ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:14.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.859+0000 7f5fc3400640 1 -- 172.21.15.86:0/4128826988 --> [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5fb00aed90 con 0x7f5fb00ac220 2024-09-13T16:09:14.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.859+0000 7f5fc3400640 1 -- 172.21.15.86:0/4128826988 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fbc0ee3e0 con 0x7f5fcc1021f0 2024-09-13T16:09:14.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.860+0000 7f5fcb200640 1 --2- 172.21.15.86:0/4128826988 >> [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994] conn(0x7f5fb00ac220 0x7f5fb00ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:14.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.860+0000 7f5fc3e00640 1 --2- 172.21.15.86:0/4128826988 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f5fb00a1190 0x7f5fb00a3650 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc199c40 tx=0x7f5fb4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:14.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.860+0000 7f5fcb200640 1 --2- 172.21.15.86:0/4128826988 >> [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994] conn(0x7f5fb00ac220 0x7f5fb00ae6c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:14.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.861+0000 7f5fc3400640 1 -- 172.21.15.86:0/4128826988 <== osd.0 v2:172.21.15.86:6802/4268534994 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f5fb00aed90 con 0x7f5fb00ac220 2024-09-13T16:09:14.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.875+0000 7f5fd1400640 1 -- 172.21.15.86:0/4128826988 --> [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5fcc1036d0 con 0x7f5fb00ac220 2024-09-13T16:09:14.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.875+0000 7f5fc3400640 1 -- 172.21.15.86:0/4128826988 <== osd.0 v2:172.21.15.86:6802/4268534994 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5fcc1036d0 con 0x7f5fb00ac220 2024-09-13T16:09:14.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.875+0000 7f5fd1400640 1 -- 172.21.15.86:0/4128826988 >> [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994] conn(0x7f5fb00ac220 msgr2=0x7f5fb00ae6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:14.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.875+0000 7f5fd1400640 1 --2- 172.21.15.86:0/4128826988 >> [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994] conn(0x7f5fb00ac220 0x7f5fb00ae6c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:14.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.875+0000 7f5fd1400640 1 -- 172.21.15.86:0/4128826988 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f5fb00a1190 msgr2=0x7f5fb00a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:14.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.876+0000 7f5fd1400640 1 --2- 172.21.15.86:0/4128826988 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f5fb00a1190 0x7f5fb00a3650 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc199c40 tx=0x7f5fb4005f90 comp rx=0 tx=0).stop 2024-09-13T16:09:14.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.876+0000 7f5fd1400640 1 -- 172.21.15.86:0/4128826988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5fcc1021f0 msgr2=0x7f5fcc198690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:14.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.876+0000 7f5fd1400640 1 --2- 172.21.15.86:0/4128826988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5fcc1021f0 0x7f5fcc198690 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc005ab0 tx=0x7f5fbc005620 comp rx=0 tx=0).stop 2024-09-13T16:09:14.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.876+0000 7f5fcb200640 1 -- 172.21.15.86:0/4128826988 reap_dead start 2024-09-13T16:09:14.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.876+0000 7f5fd1400640 1 -- 172.21.15.86:0/4128826988 shutdown_connections 2024-09-13T16:09:14.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.876+0000 7f5fd1400640 1 -- 172.21.15.86:0/4128826988 >> 172.21.15.86:0/4128826988 conn(0x7f5fcc0fdc70 msgr2=0x7f5fcc0ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:14.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.876+0000 7f5fd1400640 1 -- 172.21.15.86:0/4128826988 shutdown_connections 2024-09-13T16:09:14.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:13.876+0000 7f5fd1400640 1 -- 172.21.15.86:0/4128826988 wait complete. 2024-09-13T16:09:14.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:14 smithi086 ceph-mon[30379]: pgmap v329: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:09:14.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:14 smithi139 ceph-mon[35320]: pgmap v329: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:09:15.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:14 smithi194 ceph-mon[35694]: pgmap v329: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:09:15.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.288+0000 7fbc0fe00640 1 -- 172.21.15.86:0/1126782937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc10110bd0 msgr2=0x7fbc10112fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:15.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.288+0000 7fbc0fe00640 1 --2- 172.21.15.86:0/1126782937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc10110bd0 0x7fbc10112fc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009ca0 tx=0x7fbc0802a950 comp rx=0 tx=0).stop 2024-09-13T16:09:15.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.288+0000 7fbc0fe00640 1 -- 172.21.15.86:0/1126782937 shutdown_connections 2024-09-13T16:09:15.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.288+0000 7fbc0fe00640 1 --2- 172.21.15.86:0/1126782937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc10110bd0 0x7fbc10112fc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:15.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.288+0000 7fbc0fe00640 1 --2- 172.21.15.86:0/1126782937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc10073170 0x7fbc10110690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:15.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.288+0000 7fbc0fe00640 1 --2- 172.21.15.86:0/1126782937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc10072850 0x7fbc10072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:15.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.288+0000 7fbc0fe00640 1 -- 172.21.15.86:0/1126782937 >> 172.21.15.86:0/1126782937 conn(0x7fbc100fb900 msgr2=0x7fbc100fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:15.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.288+0000 7fbc0fe00640 1 -- 172.21.15.86:0/1126782937 shutdown_connections 2024-09-13T16:09:15.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.288+0000 7fbc0fe00640 1 -- 172.21.15.86:0/1126782937 wait complete. 2024-09-13T16:09:15.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.289+0000 7fbc0fe00640 1 Processor -- start 2024-09-13T16:09:15.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.289+0000 7fbc0fe00640 1 -- start start 2024-09-13T16:09:15.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.290+0000 7fbc0fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc10072850 0x7fbc101a2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:15.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.290+0000 7fbc0fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc10073170 0x7fbc101a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:15.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.290+0000 7fbc0fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc10110bd0 0x7fbc1019c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:15.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.290+0000 7fbc0fe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1019cc70 con 0x7fbc10072850 2024-09-13T16:09:15.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.290+0000 7fbc0fe00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1019cde0 con 0x7fbc10073170 2024-09-13T16:09:15.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.290+0000 7fbc0fe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1019cfa0 con 0x7fbc10110bd0 2024-09-13T16:09:15.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.290+0000 7fbc0ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc10072850 0x7fbc101a2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:15.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.290+0000 7fbc0ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc10072850 0x7fbc101a2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52564/0 (socket says 172.21.15.86:52564) 2024-09-13T16:09:15.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.290+0000 7fbc0ea00640 1 -- 172.21.15.86:0/3960158032 learned_addr learned my addr 172.21.15.86:0/3960158032 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:15.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.290+0000 7fbc0f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc10110bd0 0x7fbc1019c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:15.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.290+0000 7fbc0e000640 1 --2- 172.21.15.86:0/3960158032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc10073170 0x7fbc101a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:15.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.290+0000 7fbc0ea00640 1 -- 172.21.15.86:0/3960158032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc10110bd0 msgr2=0x7fbc1019c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:15.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.290+0000 7fbc0ea00640 1 --2- 172.21.15.86:0/3960158032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc10110bd0 0x7fbc1019c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:15.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.290+0000 7fbc0ea00640 1 -- 172.21.15.86:0/3960158032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc10073170 msgr2=0x7fbc101a2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:15.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.290+0000 7fbc0ea00640 1 --2- 172.21.15.86:0/3960158032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc10073170 0x7fbc101a2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:15.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.291+0000 7fbc0ea00640 1 -- 172.21.15.86:0/3960158032 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc08009900 con 0x7fbc10072850 2024-09-13T16:09:15.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.291+0000 7fbc0ea00640 1 --2- 172.21.15.86:0/3960158032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc10072850 0x7fbc101a2530 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000e9f0 tx=0x7fbc0000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:15.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.291+0000 7fbc14a00640 1 -- 172.21.15.86:0/3960158032 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00009700 con 0x7fbc10072850 2024-09-13T16:09:15.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.291+0000 7fbc14a00640 1 -- 172.21.15.86:0/3960158032 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbc0000cd80 con 0x7fbc10072850 2024-09-13T16:09:15.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.291+0000 7fbc0fe00640 1 -- 172.21.15.86:0/3960158032 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc1019d280 con 0x7fbc10072850 2024-09-13T16:09:15.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.291+0000 7fbc14a00640 1 -- 172.21.15.86:0/3960158032 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00018920 con 0x7fbc10072850 2024-09-13T16:09:15.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.291+0000 7fbc0fe00640 1 -- 172.21.15.86:0/3960158032 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc101a9520 con 0x7fbc10072850 2024-09-13T16:09:15.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.292+0000 7fbc0fe00640 1 -- 172.21.15.86:0/3960158032 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc101166a0 con 0x7fbc10072850 2024-09-13T16:09:15.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.294+0000 7fbc14a00640 1 -- 172.21.15.86:0/3960158032 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fbc00018a80 con 0x7fbc10072850 2024-09-13T16:09:15.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.295+0000 7fbc14a00640 1 --2- 172.21.15.86:0/3960158032 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbbf40a1180 0x7fbbf40a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:15.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.295+0000 7fbc14a00640 1 -- 172.21.15.86:0/3960158032 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fbc00014070 con 0x7fbc10072850 2024-09-13T16:09:15.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.296+0000 7fbc0e000640 1 --2- 172.21.15.86:0/3960158032 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbbf40a1180 0x7fbbf40a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:15.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.296+0000 7fbc14a00640 1 --2- 172.21.15.86:0/3960158032 >> [v2:172.21.15.139:6800/341901766,v1:172.21.15.139:6801/341901766] conn(0x7fbbf40ac210 0x7fbbf40ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:15.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.296+0000 7fbc14a00640 1 -- 172.21.15.86:0/3960158032 --> [v2:172.21.15.139:6800/341901766,v1:172.21.15.139:6801/341901766] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbbf40aed80 con 0x7fbbf40ac210 2024-09-13T16:09:15.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.296+0000 7fbc14a00640 1 -- 172.21.15.86:0/3960158032 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc000cda50 con 0x7fbc10072850 2024-09-13T16:09:15.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.296+0000 7fbc0e000640 1 --2- 172.21.15.86:0/3960158032 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbbf40a1180 0x7fbbf40a3640 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbc1019da90 tx=0x7fbbfc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:15.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.296+0000 7fbc0f400640 1 --2- 172.21.15.86:0/3960158032 >> [v2:172.21.15.139:6800/341901766,v1:172.21.15.139:6801/341901766] conn(0x7fbbf40ac210 0x7fbbf40ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:15.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.297+0000 7fbc0f400640 1 --2- 172.21.15.86:0/3960158032 >> [v2:172.21.15.139:6800/341901766,v1:172.21.15.139:6801/341901766] conn(0x7fbbf40ac210 0x7fbbf40ae6b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:15.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.298+0000 7fbc14a00640 1 -- 172.21.15.86:0/3960158032 <== osd.1 v2:172.21.15.139:6800/341901766 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbbf40aed80 con 0x7fbbf40ac210 2024-09-13T16:09:15.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.311+0000 7fbc0fe00640 1 -- 172.21.15.86:0/3960158032 --> [v2:172.21.15.139:6800/341901766,v1:172.21.15.139:6801/341901766] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbc10073f90 con 0x7fbbf40ac210 2024-09-13T16:09:15.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.312+0000 7fbc14a00640 1 -- 172.21.15.86:0/3960158032 <== osd.1 v2:172.21.15.139:6800/341901766 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbc10073f90 con 0x7fbbf40ac210 2024-09-13T16:09:15.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.312+0000 7fbc0fe00640 1 -- 172.21.15.86:0/3960158032 >> [v2:172.21.15.139:6800/341901766,v1:172.21.15.139:6801/341901766] conn(0x7fbbf40ac210 msgr2=0x7fbbf40ae6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:15.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.312+0000 7fbc0fe00640 1 --2- 172.21.15.86:0/3960158032 >> [v2:172.21.15.139:6800/341901766,v1:172.21.15.139:6801/341901766] conn(0x7fbbf40ac210 0x7fbbf40ae6b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:15.047 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.312+0000 7fbc0fe00640 1 -- 172.21.15.86:0/3960158032 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbbf40a1180 msgr2=0x7fbbf40a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:15.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.312+0000 7fbc0fe00640 1 --2- 172.21.15.86:0/3960158032 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbbf40a1180 0x7fbbf40a3640 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbc1019da90 tx=0x7fbbfc005f90 comp rx=0 tx=0).stop 2024-09-13T16:09:15.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.312+0000 7fbc0fe00640 1 -- 172.21.15.86:0/3960158032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc10072850 msgr2=0x7fbc101a2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:15.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.312+0000 7fbc0fe00640 1 --2- 172.21.15.86:0/3960158032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc10072850 0x7fbc101a2530 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000e9f0 tx=0x7fbc0000eeb0 comp rx=0 tx=0).stop 2024-09-13T16:09:15.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.312+0000 7fbc0f400640 1 -- 172.21.15.86:0/3960158032 reap_dead start 2024-09-13T16:09:15.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.312+0000 7fbc0fe00640 1 -- 172.21.15.86:0/3960158032 shutdown_connections 2024-09-13T16:09:15.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.312+0000 7fbc0fe00640 1 -- 172.21.15.86:0/3960158032 >> 172.21.15.86:0/3960158032 conn(0x7fbc100fb900 msgr2=0x7fbc100fd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:15.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.312+0000 7fbc0fe00640 1 -- 172.21.15.86:0/3960158032 shutdown_connections 2024-09-13T16:09:15.048 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:14.312+0000 7fbc0fe00640 1 -- 172.21.15.86:0/3960158032 wait complete. 2024-09-13T16:09:15.819 INFO:teuthology.orchestra.run.smithi086.stdout:201863462962 2024-09-13T16:09:15.819 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-13T16:09:16.119 INFO:teuthology.orchestra.run.smithi086.stdout:292057776163 2024-09-13T16:09:16.120 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-13T16:09:16.432 INFO:teuthology.orchestra.run.smithi086.stdout:347892351000 2024-09-13T16:09:16.432 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-13T16:09:16.788 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:16 smithi086 ceph-mon[30379]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:09:16.819 INFO:teuthology.orchestra.run.smithi086.stdout:34359738449 2024-09-13T16:09:16.820 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-13T16:09:16.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:16 smithi139 ceph-mon[35320]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:09:17.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:16 smithi194 ceph-mon[35694]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:09:17.250 INFO:teuthology.orchestra.run.smithi086.stdout:55834574925 2024-09-13T16:09:17.250 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-13T16:09:18.167 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:09:18.170 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:09:18.203 INFO:teuthology.orchestra.run.smithi086.stdout:257698037802 2024-09-13T16:09:18.203 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-13T16:09:18.753 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:18 smithi086 ceph-mon[30379]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:09:18.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.971+0000 7f5817000640 1 -- 172.21.15.86:0/3999853438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5810102030 msgr2=0x7f5810102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:18.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.971+0000 7f5817000640 1 --2- 172.21.15.86:0/3999853438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5810102030 0x7f5810102410 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5804009930 tx=0x7f580402a440 comp rx=0 tx=0).stop 2024-09-13T16:09:18.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.973+0000 7f5817000640 1 -- 172.21.15.86:0/3999853438 shutdown_connections 2024-09-13T16:09:18.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.973+0000 7f5817000640 1 --2- 172.21.15.86:0/3999853438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5810107160 0x7f581010ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:18.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.973+0000 7f5817000640 1 --2- 172.21.15.86:0/3999853438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58101029e0 0x7f5810106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:18.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.973+0000 7f5817000640 1 --2- 172.21.15.86:0/3999853438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5810102030 0x7f5810102410 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:18.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.973+0000 7f5817000640 1 -- 172.21.15.86:0/3999853438 >> 172.21.15.86:0/3999853438 conn(0x7f58100fda90 msgr2=0x7f58100ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:18.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.975+0000 7f5817000640 1 -- 172.21.15.86:0/3999853438 shutdown_connections 2024-09-13T16:09:18.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.975+0000 7f5817000640 1 -- 172.21.15.86:0/3999853438 wait complete. 2024-09-13T16:09:18.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.976+0000 7f5817000640 1 Processor -- start 2024-09-13T16:09:18.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.976+0000 7f5817000640 1 -- start start 2024-09-13T16:09:18.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.977+0000 7f5817000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5810102030 0x7f5810198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:18.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.977+0000 7f5817000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58101029e0 0x7f58101989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:18.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.977+0000 7f5817000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5810107160 0x7f581019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:18.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.977+0000 7f5817000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581019d380 con 0x7f5810107160 2024-09-13T16:09:18.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.977+0000 7f5817000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581019d4c0 con 0x7f58101029e0 2024-09-13T16:09:18.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.977+0000 7f5817000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581019d680 con 0x7f5810102030 2024-09-13T16:09:18.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.977+0000 7f5815c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5810102030 0x7f5810198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:18.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.977+0000 7f5815c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5810102030 0x7f5810198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:49348/0 (socket says 172.21.15.86:49348) 2024-09-13T16:09:18.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.977+0000 7f5815c00640 1 -- 172.21.15.86:0/3143194738 learned_addr learned my addr 172.21.15.86:0/3143194738 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:18.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.977+0000 7f5816600640 1 --2- 172.21.15.86:0/3143194738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5810107160 0x7f581019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:18.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.978+0000 7f5815c00640 1 -- 172.21.15.86:0/3143194738 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58101029e0 msgr2=0x7f58101989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:18.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.978+0000 7f5815c00640 1 --2- 172.21.15.86:0/3143194738 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58101029e0 0x7f58101989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:18.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.978+0000 7f5815c00640 1 -- 172.21.15.86:0/3143194738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5810107160 msgr2=0x7f581019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:18.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.978+0000 7f5815c00640 1 --2- 172.21.15.86:0/3143194738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5810107160 0x7f581019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:18.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.978+0000 7f5815c00640 1 -- 172.21.15.86:0/3143194738 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5804009560 con 0x7f5810102030 2024-09-13T16:09:18.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.981+0000 7f5815c00640 1 --2- 172.21.15.86:0/3143194738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5810102030 0x7f5810198490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5804005ab0 tx=0x7f5804005620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:18.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.982+0000 7f580e000640 1 -- 172.21.15.86:0/3143194738 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5804004b50 con 0x7f5810102030 2024-09-13T16:09:18.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.982+0000 7f580e000640 1 -- 172.21.15.86:0/3143194738 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5804004cb0 con 0x7f5810102030 2024-09-13T16:09:18.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.982+0000 7f580e000640 1 -- 172.21.15.86:0/3143194738 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5804031a30 con 0x7f5810102030 2024-09-13T16:09:18.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.982+0000 7f5817000640 1 -- 172.21.15.86:0/3143194738 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581019d900 con 0x7f5810102030 2024-09-13T16:09:18.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.982+0000 7f5817000640 1 -- 172.21.15.86:0/3143194738 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5810069ed0 con 0x7f5810102030 2024-09-13T16:09:18.987 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.983+0000 7f5817000640 1 -- 172.21.15.86:0/3143194738 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f58101122c0 con 0x7f5810102030 2024-09-13T16:09:18.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.986+0000 7f580e000640 1 -- 172.21.15.86:0/3143194738 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5804031b90 con 0x7f5810102030 2024-09-13T16:09:18.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.988+0000 7f580e000640 1 --2- 172.21.15.86:0/3143194738 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f57f80a1250 0x7f57f80a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:18.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.989+0000 7f580e000640 1 -- 172.21.15.86:0/3143194738 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f58040ee110 con 0x7f5810102030 2024-09-13T16:09:18.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.989+0000 7f580e000640 1 --2- 172.21.15.86:0/3143194738 >> [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096] conn(0x7f57f80ac2e0 0x7f57f80ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:18.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.989+0000 7f580e000640 1 -- 172.21.15.86:0/3143194738 --> [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57f80aee50 con 0x7f57f80ac2e0 2024-09-13T16:09:18.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.989+0000 7f580e000640 1 -- 172.21.15.86:0/3143194738 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58040ee520 con 0x7f5810102030 2024-09-13T16:09:18.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.990+0000 7f5815200640 1 --2- 172.21.15.86:0/3143194738 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f57f80a1250 0x7f57f80a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:18.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.990+0000 7f5816600640 1 --2- 172.21.15.86:0/3143194738 >> [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096] conn(0x7f57f80ac2e0 0x7f57f80ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:18.992 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:09:18.993 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:09:18.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.992+0000 7f5815200640 1 --2- 172.21.15.86:0/3143194738 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f57f80a1250 0x7f57f80a3710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0058c0 tx=0x7f57fc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:18.994 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:09:18.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.994+0000 7f5816600640 1 --2- 172.21.15.86:0/3143194738 >> [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096] conn(0x7f57f80ac2e0 0x7f57f80ae780 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:18.997 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:09:18.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:18 smithi139 ceph-mon[35320]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:09:18.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:18.996+0000 7f580e000640 1 -- 172.21.15.86:0/3143194738 <== osd.3 v2:172.21.15.86:6810/942908096 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f57f80aee50 con 0x7f57f80ac2e0 2024-09-13T16:09:19.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:18 smithi194 ceph-mon[35694]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:09:19.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:19.024+0000 7f5817000640 1 -- 172.21.15.86:0/3143194738 --> [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5810060bb0 con 0x7f57f80ac2e0 2024-09-13T16:09:19.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:19.028+0000 7f580e000640 1 -- 172.21.15.86:0/3143194738 <== osd.3 v2:172.21.15.86:6810/942908096 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5810060bb0 con 0x7f57f80ac2e0 2024-09-13T16:09:19.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:19.028+0000 7f5817000640 1 -- 172.21.15.86:0/3143194738 >> [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096] conn(0x7f57f80ac2e0 msgr2=0x7f57f80ae780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:19.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:19.028+0000 7f5817000640 1 --2- 172.21.15.86:0/3143194738 >> [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096] conn(0x7f57f80ac2e0 0x7f57f80ae780 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:19.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:19.029+0000 7f5817000640 1 -- 172.21.15.86:0/3143194738 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f57f80a1250 msgr2=0x7f57f80a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:19.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:19.029+0000 7f5817000640 1 --2- 172.21.15.86:0/3143194738 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f57f80a1250 0x7f57f80a3710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0058c0 tx=0x7f57fc005850 comp rx=0 tx=0).stop 2024-09-13T16:09:19.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:19.029+0000 7f5817000640 1 -- 172.21.15.86:0/3143194738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5810102030 msgr2=0x7f5810198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:19.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:19.029+0000 7f5817000640 1 --2- 172.21.15.86:0/3143194738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5810102030 0x7f5810198490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5804005ab0 tx=0x7f5804005620 comp rx=0 tx=0).stop 2024-09-13T16:09:19.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:19.030+0000 7f5816600640 1 -- 172.21.15.86:0/3143194738 reap_dead start 2024-09-13T16:09:19.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:19.030+0000 7f5817000640 1 -- 172.21.15.86:0/3143194738 shutdown_connections 2024-09-13T16:09:19.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:19.030+0000 7f5817000640 1 -- 172.21.15.86:0/3143194738 >> 172.21.15.86:0/3143194738 conn(0x7f58100fda90 msgr2=0x7f58100fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:19.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:19.030+0000 7f5817000640 1 -- 172.21.15.86:0/3143194738 shutdown_connections 2024-09-13T16:09:19.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:19.030+0000 7f5817000640 1 -- 172.21.15.86:0/3143194738 wait complete. 2024-09-13T16:09:20.366 INFO:teuthology.orchestra.run.smithi086.stdout:111669149764 2024-09-13T16:09:20.367 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-13T16:09:20.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:20 smithi086 ceph-mon[30379]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:09:20.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:20 smithi139 ceph-mon[35320]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:09:21.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:20 smithi194 ceph-mon[35694]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:09:22.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:22 smithi086 ceph-mon[30379]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:09:22.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:22 smithi139 ceph-mon[35320]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:09:23.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:22 smithi194 ceph-mon[35694]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:09:23.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.649+0000 7fb133e00640 1 -- 172.21.15.86:0/287484331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb134104f40 msgr2=0x7fb13410cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:23.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.649+0000 7fb133e00640 1 --2- 172.21.15.86:0/287484331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb134104f40 0x7fb13410cac0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009cd0 tx=0x7fb12c02a8f0 comp rx=0 tx=0).stop 2024-09-13T16:09:23.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.649+0000 7fb133e00640 1 -- 172.21.15.86:0/287484331 shutdown_connections 2024-09-13T16:09:23.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.649+0000 7fb133e00640 1 --2- 172.21.15.86:0/287484331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb134104f40 0x7fb13410cac0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:23.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.649+0000 7fb133e00640 1 --2- 172.21.15.86:0/287484331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1341007c0 0x7fb134104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:23.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.649+0000 7fb133e00640 1 --2- 172.21.15.86:0/287484331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1340ffe10 0x7fb1341001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:23.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.649+0000 7fb133e00640 1 -- 172.21.15.86:0/287484331 >> 172.21.15.86:0/287484331 conn(0x7fb1340fb930 msgr2=0x7fb1340fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:23.749 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.649+0000 7fb133e00640 1 -- 172.21.15.86:0/287484331 shutdown_connections 2024-09-13T16:09:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.649+0000 7fb133e00640 1 -- 172.21.15.86:0/287484331 wait complete. 2024-09-13T16:09:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.651+0000 7fb133e00640 1 Processor -- start 2024-09-13T16:09:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.651+0000 7fb133e00640 1 -- start start 2024-09-13T16:09:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.651+0000 7fb133e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1340ffe10 0x7fb1340727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.651+0000 7fb133e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1341007c0 0x7fb134072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.651+0000 7fb133e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb134104f40 0x7fb134073230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.651+0000 7fb133e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1341a44f0 con 0x7fb1340ffe10 2024-09-13T16:09:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.651+0000 7fb133e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1341a4660 con 0x7fb1341007c0 2024-09-13T16:09:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.651+0000 7fb133e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1341a4820 con 0x7fb134104f40 2024-09-13T16:09:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.652+0000 7fb132a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1340ffe10 0x7fb1340727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.652+0000 7fb133400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb134104f40 0x7fb134073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.652+0000 7fb133400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb134104f40 0x7fb134073230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:33880/0 (socket says 172.21.15.86:33880) 2024-09-13T16:09:23.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.652+0000 7fb133400640 1 -- 172.21.15.86:0/1660545971 learned_addr learned my addr 172.21.15.86:0/1660545971 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:23.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.652+0000 7fb12a000640 1 --2- 172.21.15.86:0/1660545971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1341007c0 0x7fb134072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:23.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.652+0000 7fb133400640 1 -- 172.21.15.86:0/1660545971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1341007c0 msgr2=0x7fb134072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:23.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.652+0000 7fb133400640 1 --2- 172.21.15.86:0/1660545971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1341007c0 0x7fb134072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:23.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.652+0000 7fb133400640 1 -- 172.21.15.86:0/1660545971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1340ffe10 msgr2=0x7fb1340727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:23.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.652+0000 7fb133400640 1 --2- 172.21.15.86:0/1660545971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1340ffe10 0x7fb1340727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:23.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.652+0000 7fb133400640 1 -- 172.21.15.86:0/1660545971 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c009490 con 0x7fb134104f40 2024-09-13T16:09:23.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.653+0000 7fb133400640 1 --2- 172.21.15.86:0/1660545971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb134104f40 0x7fb134073230 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009ca0 tx=0x7fb12c009880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:23.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.653+0000 7fb12be00640 1 -- 172.21.15.86:0/1660545971 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c003e30 con 0x7fb134104f40 2024-09-13T16:09:23.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.653+0000 7fb133e00640 1 -- 172.21.15.86:0/1660545971 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb12c009900 con 0x7fb134104f40 2024-09-13T16:09:23.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.653+0000 7fb12be00640 1 -- 172.21.15.86:0/1660545971 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb12c004520 con 0x7fb134104f40 2024-09-13T16:09:23.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.653+0000 7fb12be00640 1 -- 172.21.15.86:0/1660545971 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c045ce0 con 0x7fb134104f40 2024-09-13T16:09:23.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.653+0000 7fb133e00640 1 -- 172.21.15.86:0/1660545971 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1341a4e60 con 0x7fb134104f40 2024-09-13T16:09:23.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.654+0000 7fb133e00640 1 -- 172.21.15.86:0/1660545971 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1341012f0 con 0x7fb134104f40 2024-09-13T16:09:23.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.656+0000 7fb12be00640 1 -- 172.21.15.86:0/1660545971 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb12c042070 con 0x7fb134104f40 2024-09-13T16:09:23.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.657+0000 7fb12be00640 1 --2- 172.21.15.86:0/1660545971 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb1180a1100 0x7fb1180a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:23.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.658+0000 7fb12be00640 1 -- 172.21.15.86:0/1660545971 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb12c0edea0 con 0x7fb134104f40 2024-09-13T16:09:23.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.658+0000 7fb132a00640 1 --2- 172.21.15.86:0/1660545971 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb1180a1100 0x7fb1180a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:23.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.658+0000 7fb132a00640 1 --2- 172.21.15.86:0/1660545971 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb1180a1100 0x7fb1180a35c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb124009bd0 tx=0x7fb124005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:23.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.661+0000 7fb12be00640 1 -- 172.21.15.86:0/1660545971 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb12c0b7270 con 0x7fb134104f40 2024-09-13T16:09:23.847 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.845+0000 7fb133e00640 1 -- 172.21.15.86:0/1660545971 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb134108180 con 0x7fb134104f40 2024-09-13T16:09:23.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.846+0000 7fb12be00640 1 -- 172.21.15.86:0/1660545971 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb12c0ba890 con 0x7fb134104f40 2024-09-13T16:09:23.848 INFO:teuthology.orchestra.run.smithi086.stdout:77309411401 2024-09-13T16:09:23.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.848+0000 7fb133e00640 1 -- 172.21.15.86:0/1660545971 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb1180a1100 msgr2=0x7fb1180a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:23.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.848+0000 7fb133e00640 1 --2- 172.21.15.86:0/1660545971 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb1180a1100 0x7fb1180a35c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb124009bd0 tx=0x7fb124005f90 comp rx=0 tx=0).stop 2024-09-13T16:09:23.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.848+0000 7fb133e00640 1 -- 172.21.15.86:0/1660545971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb134104f40 msgr2=0x7fb134073230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:23.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.848+0000 7fb133e00640 1 --2- 172.21.15.86:0/1660545971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb134104f40 0x7fb134073230 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009ca0 tx=0x7fb12c009880 comp rx=0 tx=0).stop 2024-09-13T16:09:23.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.849+0000 7fb133e00640 1 -- 172.21.15.86:0/1660545971 shutdown_connections 2024-09-13T16:09:23.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.849+0000 7fb133e00640 1 --2- 172.21.15.86:0/1660545971 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb1180a1100 0x7fb1180a35c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:23.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.849+0000 7fb133e00640 1 --2- 172.21.15.86:0/1660545971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb134104f40 0x7fb134073230 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:23.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.849+0000 7fb133e00640 1 --2- 172.21.15.86:0/1660545971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1341007c0 0x7fb134072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:23.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.849+0000 7fb133e00640 1 --2- 172.21.15.86:0/1660545971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1340ffe10 0x7fb1340727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:23.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.849+0000 7fb133e00640 1 -- 172.21.15.86:0/1660545971 >> 172.21.15.86:0/1660545971 conn(0x7fb1340fb930 msgr2=0x7fb1340fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:23.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.849+0000 7fb133e00640 1 -- 172.21.15.86:0/1660545971 shutdown_connections 2024-09-13T16:09:23.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:23.849+0000 7fb133e00640 1 -- 172.21.15.86:0/1660545971 wait complete. 2024-09-13T16:09:24.760 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:24 smithi086 ceph-mon[30379]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:09:24.760 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:24 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1660545971' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T16:09:24.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:24 smithi139 ceph-mon[35320]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:09:24.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:24 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1660545971' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T16:09:25.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:24 smithi194 ceph-mon[35694]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:09:25.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:24 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1660545971' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T16:09:25.743 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411397 got 77309411401 for osd.2 2024-09-13T16:09:25.743 DEBUG:teuthology.parallel:result is None 2024-09-13T16:09:26.840 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:26 smithi086 ceph-mon[30379]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:09:26.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:26 smithi139 ceph-mon[35320]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:09:27.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:26 smithi194 ceph-mon[35694]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:09:27.216 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:09:27.981 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:09:27.981 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:09:27.989 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:09:28.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.315+0000 7f81f0600640 1 -- 172.21.15.86:0/3818599547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81e8100990 msgr2=0x7f81e81049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:28.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.315+0000 7f81f0600640 1 --2- 172.21.15.86:0/3818599547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81e8100990 0x7f81e81049e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009930 tx=0x7f81d402a420 comp rx=0 tx=0).stop 2024-09-13T16:09:28.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.316+0000 7f81f0600640 1 -- 172.21.15.86:0/3818599547 shutdown_connections 2024-09-13T16:09:28.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.316+0000 7f81f0600640 1 --2- 172.21.15.86:0/3818599547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81e8105110 0x7f81e810cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:28.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.316+0000 7f81f0600640 1 --2- 172.21.15.86:0/3818599547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81e8100990 0x7f81e81049e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:28.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.316+0000 7f81f0600640 1 --2- 172.21.15.86:0/3818599547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81e80fffe0 0x7f81e81003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:28.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.316+0000 7f81f0600640 1 -- 172.21.15.86:0/3818599547 >> 172.21.15.86:0/3818599547 conn(0x7f81e80fba80 msgr2=0x7f81e80fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:28.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.316+0000 7f81f0600640 1 -- 172.21.15.86:0/3818599547 shutdown_connections 2024-09-13T16:09:28.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.316+0000 7f81f0600640 1 -- 172.21.15.86:0/3818599547 wait complete. 2024-09-13T16:09:28.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.317+0000 7f81f0600640 1 Processor -- start 2024-09-13T16:09:28.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.317+0000 7f81f0600640 1 -- start start 2024-09-13T16:09:28.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.317+0000 7f81f0600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81e80fffe0 0x7f81e80727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:28.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.317+0000 7f81f0600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81e8100990 0x7f81e8072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:28.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.317+0000 7f81f0600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81e8105110 0x7f81e8073230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:28.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.317+0000 7f81f0600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e81a4880 con 0x7f81e80fffe0 2024-09-13T16:09:28.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.317+0000 7f81f0600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e81a49f0 con 0x7f81e8100990 2024-09-13T16:09:28.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.317+0000 7f81f0600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e81a4bb0 con 0x7f81e8105110 2024-09-13T16:09:28.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.318+0000 7f81edc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81e80fffe0 0x7f81e80727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:28.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.318+0000 7f81edc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81e80fffe0 0x7f81e80727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44060/0 (socket says 172.21.15.86:44060) 2024-09-13T16:09:28.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.318+0000 7f81edc00640 1 -- 172.21.15.86:0/3673621035 learned_addr learned my addr 172.21.15.86:0/3673621035 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:28.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.318+0000 7f81ee600640 1 --2- 172.21.15.86:0/3673621035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81e8105110 0x7f81e8073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:28.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.318+0000 7f81ed200640 1 --2- 172.21.15.86:0/3673621035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81e8100990 0x7f81e8072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:28.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.318+0000 7f81edc00640 1 -- 172.21.15.86:0/3673621035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81e8105110 msgr2=0x7f81e8073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:28.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.319+0000 7f81edc00640 1 --2- 172.21.15.86:0/3673621035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81e8105110 0x7f81e8073230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:28.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.319+0000 7f81edc00640 1 -- 172.21.15.86:0/3673621035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81e8100990 msgr2=0x7f81e8072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:28.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.319+0000 7f81edc00640 1 --2- 172.21.15.86:0/3673621035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81e8100990 0x7f81e8072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:28.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.319+0000 7f81edc00640 1 -- 172.21.15.86:0/3673621035 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e0009840 con 0x7f81e80fffe0 2024-09-13T16:09:28.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.319+0000 7f81ee600640 1 --2- 172.21.15.86:0/3673621035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81e8105110 0x7f81e8073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:09:28.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.319+0000 7f81ed200640 1 --2- 172.21.15.86:0/3673621035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81e8100990 0x7f81e8072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:09:28.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.319+0000 7f81edc00640 1 --2- 172.21.15.86:0/3673621035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81e80fffe0 0x7f81e80727b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00e9f0 tx=0x7f81dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:28.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.319+0000 7f81e6000640 1 -- 172.21.15.86:0/3673621035 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc009720 con 0x7f81e80fffe0 2024-09-13T16:09:28.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.319+0000 7f81e6000640 1 -- 172.21.15.86:0/3673621035 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f81dc005500 con 0x7f81e80fffe0 2024-09-13T16:09:28.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.319+0000 7f81e6000640 1 -- 172.21.15.86:0/3673621035 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc010430 con 0x7f81e80fffe0 2024-09-13T16:09:28.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.320+0000 7f81f0600640 1 -- 172.21.15.86:0/3673621035 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d4009560 con 0x7f81e80fffe0 2024-09-13T16:09:28.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.320+0000 7f81f0600640 1 -- 172.21.15.86:0/3673621035 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e81a5180 con 0x7f81e80fffe0 2024-09-13T16:09:28.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.321+0000 7f81f0600640 1 -- 172.21.15.86:0/3673621035 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e81014c0 con 0x7f81e80fffe0 2024-09-13T16:09:28.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.323+0000 7f81e6000640 1 -- 172.21.15.86:0/3673621035 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f81dc005020 con 0x7f81e80fffe0 2024-09-13T16:09:28.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.324+0000 7f81e6000640 1 --2- 172.21.15.86:0/3673621035 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f81d00a1190 0x7f81d00a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:28.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.324+0000 7f81e6000640 1 -- 172.21.15.86:0/3673621035 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f81dc014070 con 0x7f81e80fffe0 2024-09-13T16:09:28.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.325+0000 7f81ed200640 1 --2- 172.21.15.86:0/3673621035 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f81d00a1190 0x7f81d00a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:28.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.325+0000 7f81ed200640 1 --2- 172.21.15.86:0/3673621035 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f81d00a1190 0x7f81d00a3650 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f81d4005ab0 tx=0x7f81d4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:28.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.328+0000 7f81e6000640 1 -- 172.21.15.86:0/3673621035 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f81dc096410 con 0x7f81e80fffe0 2024-09-13T16:09:28.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.501+0000 7f81f0600640 1 -- 172.21.15.86:0/3673621035 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f81e81a4d70 con 0x7f81e80fffe0 2024-09-13T16:09:28.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.502+0000 7f81e6000640 1 -- 172.21.15.86:0/3673621035 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81dc099a30 con 0x7f81e80fffe0 2024-09-13T16:09:28.504 INFO:teuthology.orchestra.run.smithi086.stdout:167503724603 2024-09-13T16:09:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.504+0000 7f81f0600640 1 -- 172.21.15.86:0/3673621035 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f81d00a1190 msgr2=0x7f81d00a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.504+0000 7f81f0600640 1 --2- 172.21.15.86:0/3673621035 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f81d00a1190 0x7f81d00a3650 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f81d4005ab0 tx=0x7f81d4005a20 comp rx=0 tx=0).stop 2024-09-13T16:09:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.504+0000 7f81f0600640 1 -- 172.21.15.86:0/3673621035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81e80fffe0 msgr2=0x7f81e80727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.504+0000 7f81f0600640 1 --2- 172.21.15.86:0/3673621035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81e80fffe0 0x7f81e80727b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00e9f0 tx=0x7f81dc00edf0 comp rx=0 tx=0).stop 2024-09-13T16:09:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.504+0000 7f81f0600640 1 -- 172.21.15.86:0/3673621035 shutdown_connections 2024-09-13T16:09:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.504+0000 7f81f0600640 1 --2- 172.21.15.86:0/3673621035 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f81d00a1190 0x7f81d00a3650 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.504+0000 7f81f0600640 1 --2- 172.21.15.86:0/3673621035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81e8105110 0x7f81e8073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.504+0000 7f81f0600640 1 --2- 172.21.15.86:0/3673621035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81e8100990 0x7f81e8072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:28.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.504+0000 7f81f0600640 1 --2- 172.21.15.86:0/3673621035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81e80fffe0 0x7f81e80727b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:28.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.504+0000 7f81f0600640 1 -- 172.21.15.86:0/3673621035 >> 172.21.15.86:0/3673621035 conn(0x7f81e80fba80 msgr2=0x7f81e80fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:28.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.504+0000 7f81f0600640 1 -- 172.21.15.86:0/3673621035 shutdown_connections 2024-09-13T16:09:28.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:28.504+0000 7f81f0600640 1 -- 172.21.15.86:0/3673621035 wait complete. 2024-09-13T16:09:28.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:28 smithi086 ceph-mon[30379]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:09:28.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:28 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3673621035' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T16:09:28.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:28 smithi139 ceph-mon[35320]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:09:28.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:28 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3673621035' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T16:09:29.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:28 smithi194 ceph-mon[35694]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:09:29.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:28 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3673621035' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T16:09:29.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.285+0000 7f3386e00640 1 -- 172.21.15.86:0/1761795870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3380102200 msgr2=0x7f33801025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:29.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.285+0000 7f3386e00640 1 --2- 172.21.15.86:0/1761795870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3380102200 0x7f33801025e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3370009930 tx=0x7f337002a420 comp rx=0 tx=0).stop 2024-09-13T16:09:29.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.285+0000 7f3386e00640 1 -- 172.21.15.86:0/1761795870 shutdown_connections 2024-09-13T16:09:29.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.285+0000 7f3386e00640 1 --2- 172.21.15.86:0/1761795870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3380107330 0x7f338010eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:29.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.285+0000 7f3386e00640 1 --2- 172.21.15.86:0/1761795870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3380102bb0 0x7f3380106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:29.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.285+0000 7f3386e00640 1 --2- 172.21.15.86:0/1761795870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3380102200 0x7f33801025e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.285+0000 7f3386e00640 1 -- 172.21.15.86:0/1761795870 >> 172.21.15.86:0/1761795870 conn(0x7f33800fdc60 msgr2=0x7f3380100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.285+0000 7f3386e00640 1 -- 172.21.15.86:0/1761795870 shutdown_connections 2024-09-13T16:09:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.285+0000 7f3386e00640 1 -- 172.21.15.86:0/1761795870 wait complete. 2024-09-13T16:09:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.286+0000 7f3386e00640 1 Processor -- start 2024-09-13T16:09:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.286+0000 7f3386e00640 1 -- start start 2024-09-13T16:09:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.287+0000 7f3386e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3380102200 0x7f3380198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.287+0000 7f3386e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3380102bb0 0x7f3380198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.287+0000 7f3386e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3380107330 0x7f338019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.287+0000 7f3386e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338019d490 con 0x7f3380107330 2024-09-13T16:09:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.287+0000 7f3386e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338019d600 con 0x7f3380102200 2024-09-13T16:09:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.287+0000 7f3386e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338019d770 con 0x7f3380102bb0 2024-09-13T16:09:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.287+0000 7f3384e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3380107330 0x7f338019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:29.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.287+0000 7f3384e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3380107330 0x7f338019ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44086/0 (socket says 172.21.15.86:44086) 2024-09-13T16:09:29.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.287+0000 7f3384e00640 1 -- 172.21.15.86:0/1415511801 learned_addr learned my addr 172.21.15.86:0/1415511801 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:29.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.287+0000 7f337fe00640 1 --2- 172.21.15.86:0/1415511801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3380102200 0x7f3380198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:29.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.287+0000 7f337f400640 1 --2- 172.21.15.86:0/1415511801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3380102bb0 0x7f3380198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:29.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.287+0000 7f3384e00640 1 -- 172.21.15.86:0/1415511801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3380102bb0 msgr2=0x7f3380198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:29.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.287+0000 7f3384e00640 1 --2- 172.21.15.86:0/1415511801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3380102bb0 0x7f3380198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:29.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.287+0000 7f3384e00640 1 -- 172.21.15.86:0/1415511801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3380102200 msgr2=0x7f3380198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:29.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.287+0000 7f3384e00640 1 --2- 172.21.15.86:0/1415511801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3380102200 0x7f3380198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:29.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.287+0000 7f3384e00640 1 -- 172.21.15.86:0/1415511801 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3370009560 con 0x7f3380107330 2024-09-13T16:09:29.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.288+0000 7f3384e00640 1 --2- 172.21.15.86:0/1415511801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3380107330 0x7f338019ce90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f337800eaa0 tx=0x7f337800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:29.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.288+0000 7f337cc00640 1 -- 172.21.15.86:0/1415511801 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337800cdb0 con 0x7f3380107330 2024-09-13T16:09:29.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.288+0000 7f337cc00640 1 -- 172.21.15.86:0/1415511801 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3378005020 con 0x7f3380107330 2024-09-13T16:09:29.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.288+0000 7f3386e00640 1 -- 172.21.15.86:0/1415511801 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338019da50 con 0x7f3380107330 2024-09-13T16:09:29.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.288+0000 7f337cc00640 1 -- 172.21.15.86:0/1415511801 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780116b0 con 0x7f3380107330 2024-09-13T16:09:29.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.288+0000 7f3386e00640 1 -- 172.21.15.86:0/1415511801 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33801a5310 con 0x7f3380107330 2024-09-13T16:09:29.295 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.289+0000 7f3386e00640 1 -- 172.21.15.86:0/1415511801 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33801036e0 con 0x7f3380107330 2024-09-13T16:09:29.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.291+0000 7f337cc00640 1 -- 172.21.15.86:0/1415511801 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f3378005520 con 0x7f3380107330 2024-09-13T16:09:29.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.293+0000 7f337cc00640 1 --2- 172.21.15.86:0/1415511801 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f33640a1190 0x7f33640a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:29.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.293+0000 7f337cc00640 1 -- 172.21.15.86:0/1415511801 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f33780cce60 con 0x7f3380107330 2024-09-13T16:09:29.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.293+0000 7f337fe00640 1 --2- 172.21.15.86:0/1415511801 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f33640a1190 0x7f33640a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:29.296 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.294+0000 7f337fe00640 1 --2- 172.21.15.86:0/1415511801 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f33640a1190 0x7f33640a3650 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3370009900 tx=0x7f33700058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:29.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.301+0000 7f337cc00640 1 -- 172.21.15.86:0/1415511801 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f33780961d0 con 0x7f3380107330 2024-09-13T16:09:29.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.481+0000 7f3386e00640 1 -- 172.21.15.86:0/1415511801 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f33801025e0 con 0x7f3380107330 2024-09-13T16:09:29.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.481+0000 7f337cc00640 1 -- 172.21.15.86:0/1415511801 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f337801f020 con 0x7f3380107330 2024-09-13T16:09:29.483 INFO:teuthology.orchestra.run.smithi086.stdout:292057776167 2024-09-13T16:09:29.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.484+0000 7f3386e00640 1 -- 172.21.15.86:0/1415511801 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f33640a1190 msgr2=0x7f33640a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:29.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.484+0000 7f3386e00640 1 --2- 172.21.15.86:0/1415511801 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f33640a1190 0x7f33640a3650 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3370009900 tx=0x7f33700058d0 comp rx=0 tx=0).stop 2024-09-13T16:09:29.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.484+0000 7f3386e00640 1 -- 172.21.15.86:0/1415511801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3380107330 msgr2=0x7f338019ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:29.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.484+0000 7f3386e00640 1 --2- 172.21.15.86:0/1415511801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3380107330 0x7f338019ce90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f337800eaa0 tx=0x7f337800ef60 comp rx=0 tx=0).stop 2024-09-13T16:09:29.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.484+0000 7f3386e00640 1 -- 172.21.15.86:0/1415511801 shutdown_connections 2024-09-13T16:09:29.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.484+0000 7f3386e00640 1 --2- 172.21.15.86:0/1415511801 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f33640a1190 0x7f33640a3650 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:29.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.484+0000 7f3386e00640 1 --2- 172.21.15.86:0/1415511801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3380107330 0x7f338019ce90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:29.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.484+0000 7f3386e00640 1 --2- 172.21.15.86:0/1415511801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3380102bb0 0x7f3380198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:29.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.484+0000 7f3386e00640 1 --2- 172.21.15.86:0/1415511801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3380102200 0x7f3380198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:29.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.484+0000 7f3386e00640 1 -- 172.21.15.86:0/1415511801 >> 172.21.15.86:0/1415511801 conn(0x7f33800fdc60 msgr2=0x7f33800ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:29.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.484+0000 7f3386e00640 1 -- 172.21.15.86:0/1415511801 shutdown_connections 2024-09-13T16:09:29.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:29.484+0000 7f3386e00640 1 -- 172.21.15.86:0/1415511801 wait complete. 2024-09-13T16:09:29.822 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:29 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1415511801' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-13T16:09:29.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:29 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1415511801' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-13T16:09:30.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:29 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1415511801' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-13T16:09:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:30 smithi086 ceph-mon[30379]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:09:30.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:30 smithi194 ceph-mon[35694]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:09:30.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:30 smithi139 ceph-mon[35320]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:09:31.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.366+0000 7f2f35e00640 1 -- 172.21.15.86:0/3869393330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f301009b0 msgr2=0x7f2f30104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:31.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.366+0000 7f2f35e00640 1 --2- 172.21.15.86:0/3869393330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f301009b0 0x7f2f30104a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009930 tx=0x7f2f1802a420 comp rx=0 tx=0).stop 2024-09-13T16:09:31.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.366+0000 7f2f35e00640 1 -- 172.21.15.86:0/3869393330 shutdown_connections 2024-09-13T16:09:31.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.366+0000 7f2f35e00640 1 --2- 172.21.15.86:0/3869393330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f30105130 0x7f2f3010ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.366+0000 7f2f35e00640 1 --2- 172.21.15.86:0/3869393330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f301009b0 0x7f2f30104a00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.366+0000 7f2f35e00640 1 --2- 172.21.15.86:0/3869393330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f30100000 0x7f2f301003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.366+0000 7f2f35e00640 1 -- 172.21.15.86:0/3869393330 >> 172.21.15.86:0/3869393330 conn(0x7f2f300fbaa0 msgr2=0x7f2f300fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:31.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.366+0000 7f2f35e00640 1 -- 172.21.15.86:0/3869393330 shutdown_connections 2024-09-13T16:09:31.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.366+0000 7f2f35e00640 1 -- 172.21.15.86:0/3869393330 wait complete. 2024-09-13T16:09:31.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.367+0000 7f2f35e00640 1 Processor -- start 2024-09-13T16:09:31.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.368+0000 7f2f35e00640 1 -- start start 2024-09-13T16:09:31.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.368+0000 7f2f35e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f30100000 0x7f2f300727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.368+0000 7f2f35e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f301009b0 0x7f2f30072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.368+0000 7f2f35e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f30105130 0x7f2f30073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.368+0000 7f2f35e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f301a4880 con 0x7f2f30100000 2024-09-13T16:09:31.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.368+0000 7f2f35e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f301a49f0 con 0x7f2f301009b0 2024-09-13T16:09:31.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.368+0000 7f2f35e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f301a4bb0 con 0x7f2f30105130 2024-09-13T16:09:31.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.368+0000 7f2f2ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f30100000 0x7f2f300727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.368+0000 7f2f2ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f30100000 0x7f2f300727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44116/0 (socket says 172.21.15.86:44116) 2024-09-13T16:09:31.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.368+0000 7f2f2ea00640 1 -- 172.21.15.86:0/1651672528 learned_addr learned my addr 172.21.15.86:0/1651672528 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:31.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.368+0000 7f2f26000640 1 --2- 172.21.15.86:0/1651672528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f301009b0 0x7f2f30072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.369+0000 7f2f2f400640 1 --2- 172.21.15.86:0/1651672528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f30105130 0x7f2f30073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.369+0000 7f2f2ea00640 1 -- 172.21.15.86:0/1651672528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f30105130 msgr2=0x7f2f30073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:31.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.369+0000 7f2f2ea00640 1 --2- 172.21.15.86:0/1651672528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f30105130 0x7f2f30073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.369+0000 7f2f2ea00640 1 -- 172.21.15.86:0/1651672528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f301009b0 msgr2=0x7f2f30072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:31.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.369+0000 7f2f2ea00640 1 --2- 172.21.15.86:0/1651672528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f301009b0 0x7f2f30072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.369+0000 7f2f2ea00640 1 -- 172.21.15.86:0/1651672528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f18009560 con 0x7f2f30100000 2024-09-13T16:09:31.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.369+0000 7f2f26000640 1 --2- 172.21.15.86:0/1651672528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f301009b0 0x7f2f30072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:09:31.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.369+0000 7f2f2ea00640 1 --2- 172.21.15.86:0/1651672528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f30100000 0x7f2f300727b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000d950 tx=0x7f2f2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:31.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.370+0000 7f2f34a00640 1 -- 172.21.15.86:0/1651672528 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f20009a30 con 0x7f2f30100000 2024-09-13T16:09:31.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.370+0000 7f2f34a00640 1 -- 172.21.15.86:0/1651672528 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2f20009b90 con 0x7f2f30100000 2024-09-13T16:09:31.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.370+0000 7f2f35e00640 1 -- 172.21.15.86:0/1651672528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f301a4e90 con 0x7f2f30100000 2024-09-13T16:09:31.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.370+0000 7f2f34a00640 1 -- 172.21.15.86:0/1651672528 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f20004a00 con 0x7f2f30100000 2024-09-13T16:09:31.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.370+0000 7f2f35e00640 1 -- 172.21.15.86:0/1651672528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f301a52b0 con 0x7f2f30100000 2024-09-13T16:09:31.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.371+0000 7f2f35e00640 1 -- 172.21.15.86:0/1651672528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f301014e0 con 0x7f2f30100000 2024-09-13T16:09:31.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.373+0000 7f2f34a00640 1 -- 172.21.15.86:0/1651672528 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2f20009d00 con 0x7f2f30100000 2024-09-13T16:09:31.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.375+0000 7f2f34a00640 1 --2- 172.21.15.86:0/1651672528 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2f140a1110 0x7f2f140a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.375+0000 7f2f34a00640 1 -- 172.21.15.86:0/1651672528 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2f200cc7d0 con 0x7f2f30100000 2024-09-13T16:09:31.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.375+0000 7f2f26000640 1 --2- 172.21.15.86:0/1651672528 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2f140a1110 0x7f2f140a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.376+0000 7f2f26000640 1 --2- 172.21.15.86:0/1651672528 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2f140a1110 0x7f2f140a35d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2f18006010 tx=0x7f2f18005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:31.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.379+0000 7f2f34a00640 1 -- 172.21.15.86:0/1651672528 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2f20095a90 con 0x7f2f30100000 2024-09-13T16:09:31.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.559+0000 7f2f35e00640 1 -- 172.21.15.86:0/1651672528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f2f301003e0 con 0x7f2f30100000 2024-09-13T16:09:31.562 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.560+0000 7f2f34a00640 1 -- 172.21.15.86:0/1651672528 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f2f200990b0 con 0x7f2f30100000 2024-09-13T16:09:31.562 INFO:teuthology.orchestra.run.smithi086.stdout:313532612642 2024-09-13T16:09:31.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.562+0000 7f2f35e00640 1 -- 172.21.15.86:0/1651672528 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2f140a1110 msgr2=0x7f2f140a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:31.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.562+0000 7f2f35e00640 1 --2- 172.21.15.86:0/1651672528 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2f140a1110 0x7f2f140a35d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2f18006010 tx=0x7f2f18005a20 comp rx=0 tx=0).stop 2024-09-13T16:09:31.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.562+0000 7f2f35e00640 1 -- 172.21.15.86:0/1651672528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f30100000 msgr2=0x7f2f300727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:31.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.562+0000 7f2f35e00640 1 --2- 172.21.15.86:0/1651672528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f30100000 0x7f2f300727b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000d950 tx=0x7f2f2000de10 comp rx=0 tx=0).stop 2024-09-13T16:09:31.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.563+0000 7f2f35e00640 1 -- 172.21.15.86:0/1651672528 shutdown_connections 2024-09-13T16:09:31.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.563+0000 7f2f35e00640 1 --2- 172.21.15.86:0/1651672528 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2f140a1110 0x7f2f140a35d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.563+0000 7f2f35e00640 1 --2- 172.21.15.86:0/1651672528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f30105130 0x7f2f30073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.563+0000 7f2f35e00640 1 --2- 172.21.15.86:0/1651672528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f301009b0 0x7f2f30072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.563+0000 7f2f35e00640 1 --2- 172.21.15.86:0/1651672528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f30100000 0x7f2f300727b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.565 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.563+0000 7f2f35e00640 1 -- 172.21.15.86:0/1651672528 >> 172.21.15.86:0/1651672528 conn(0x7f2f300fbaa0 msgr2=0x7f2f300fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:31.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.563+0000 7f2f35e00640 1 -- 172.21.15.86:0/1651672528 shutdown_connections 2024-09-13T16:09:31.566 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:31.563+0000 7f2f35e00640 1 -- 172.21.15.86:0/1651672528 wait complete. 2024-09-13T16:09:31.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:31 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1651672528' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-13T16:09:31.923 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:31 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1651672528' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-13T16:09:31.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:31 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1651672528' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-13T16:09:32.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.569+0000 7f48c5200640 1 -- 172.21.15.86:0/3921573307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48c0107330 msgr2=0x7f48c010eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:32.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.569+0000 7f48c5200640 1 --2- 172.21.15.86:0/3921573307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48c0107330 0x7f48c010eeb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f48b8009cd0 tx=0x7f48b802a8f0 comp rx=0 tx=0).stop 2024-09-13T16:09:32.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.569+0000 7f48c5200640 1 -- 172.21.15.86:0/3921573307 shutdown_connections 2024-09-13T16:09:32.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.569+0000 7f48c5200640 1 --2- 172.21.15.86:0/3921573307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48c0107330 0x7f48c010eeb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:32.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.569+0000 7f48c5200640 1 --2- 172.21.15.86:0/3921573307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f48c0102bb0 0x7f48c0106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:32.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.569+0000 7f48c5200640 1 --2- 172.21.15.86:0/3921573307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48c0102200 0x7f48c01025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:32.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.569+0000 7f48c5200640 1 -- 172.21.15.86:0/3921573307 >> 172.21.15.86:0/3921573307 conn(0x7f48c00fdc60 msgr2=0x7f48c0100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:32.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.569+0000 7f48c5200640 1 -- 172.21.15.86:0/3921573307 shutdown_connections 2024-09-13T16:09:32.572 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.569+0000 7f48c5200640 1 -- 172.21.15.86:0/3921573307 wait complete. 2024-09-13T16:09:32.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.570+0000 7f48c5200640 1 Processor -- start 2024-09-13T16:09:32.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.571+0000 7f48c5200640 1 -- start start 2024-09-13T16:09:32.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.571+0000 7f48c5200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48c0102200 0x7f48c0198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:32.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.571+0000 7f48c5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f48c0102bb0 0x7f48c0198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:32.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.571+0000 7f48c5200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48c0107330 0x7f48c019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:32.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.571+0000 7f48c5200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c019d460 con 0x7f48c0102200 2024-09-13T16:09:32.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.571+0000 7f48c5200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c019d5d0 con 0x7f48c0102bb0 2024-09-13T16:09:32.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.571+0000 7f48c5200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c019d740 con 0x7f48c0107330 2024-09-13T16:09:32.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.571+0000 7f48b7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f48c0102bb0 0x7f48c0198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:32.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.571+0000 7f48bde00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48c0102200 0x7f48c0198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:32.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.571+0000 7f48b7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f48c0102bb0 0x7f48c0198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:52542/0 (socket says 172.21.15.86:52542) 2024-09-13T16:09:32.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.571+0000 7f48b7e00640 1 -- 172.21.15.86:0/3893596420 learned_addr learned my addr 172.21.15.86:0/3893596420 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:32.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.571+0000 7f48be800640 1 --2- 172.21.15.86:0/3893596420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48c0107330 0x7f48c019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:32.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.572+0000 7f48b7e00640 1 -- 172.21.15.86:0/3893596420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48c0107330 msgr2=0x7f48c019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:32.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.572+0000 7f48b7e00640 1 --2- 172.21.15.86:0/3893596420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48c0107330 0x7f48c019ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:32.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.572+0000 7f48b7e00640 1 -- 172.21.15.86:0/3893596420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48c0102200 msgr2=0x7f48c0198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:32.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.572+0000 7f48b7e00640 1 --2- 172.21.15.86:0/3893596420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48c0102200 0x7f48c0198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:32.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.572+0000 7f48b7e00640 1 -- 172.21.15.86:0/3893596420 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b8009900 con 0x7f48c0102bb0 2024-09-13T16:09:32.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.572+0000 7f48b7e00640 1 --2- 172.21.15.86:0/3893596420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f48c0102bb0 0x7f48c0198a60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f48a800d950 tx=0x7f48a800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:32.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.572+0000 7f48b6a00640 1 -- 172.21.15.86:0/3893596420 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a8009c30 con 0x7f48c0102bb0 2024-09-13T16:09:32.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.572+0000 7f48c5200640 1 -- 172.21.15.86:0/3893596420 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c019da20 con 0x7f48c0102bb0 2024-09-13T16:09:32.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.572+0000 7f48b6a00640 1 -- 172.21.15.86:0/3893596420 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f48a8009d90 con 0x7f48c0102bb0 2024-09-13T16:09:32.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.572+0000 7f48b6a00640 1 -- 172.21.15.86:0/3893596420 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a800f7e0 con 0x7f48c0102bb0 2024-09-13T16:09:32.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.572+0000 7f48c5200640 1 -- 172.21.15.86:0/3893596420 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c01a52e0 con 0x7f48c0102bb0 2024-09-13T16:09:32.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.573+0000 7f48c5200640 1 -- 172.21.15.86:0/3893596420 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c01036e0 con 0x7f48c0102bb0 2024-09-13T16:09:32.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.575+0000 7f48b6a00640 1 -- 172.21.15.86:0/3893596420 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f48a8010ad0 con 0x7f48c0102bb0 2024-09-13T16:09:32.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.577+0000 7f48b6a00640 1 --2- 172.21.15.86:0/3893596420 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f48a40a1110 0x7f48a40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:32.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.577+0000 7f48b6a00640 1 -- 172.21.15.86:0/3893596420 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f48a80cc930 con 0x7f48c0102bb0 2024-09-13T16:09:32.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.578+0000 7f48bde00640 1 --2- 172.21.15.86:0/3893596420 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f48a40a1110 0x7f48a40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:32.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.578+0000 7f48bde00640 1 --2- 172.21.15.86:0/3893596420 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f48a40a1110 0x7f48a40a35d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009bd0 tx=0x7f48b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:32.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.579+0000 7f48b6a00640 1 -- 172.21.15.86:0/3893596420 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f48a8095ca0 con 0x7f48c0102bb0 2024-09-13T16:09:32.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.753+0000 7f48c5200640 1 -- 172.21.15.86:0/3893596420 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f48c01025e0 con 0x7f48c0102bb0 2024-09-13T16:09:32.755 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:32 smithi086 ceph-mon[30379]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T16:09:32.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.754+0000 7f48b6a00640 1 -- 172.21.15.86:0/3893596420 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f48a8017020 con 0x7f48c0102bb0 2024-09-13T16:09:32.756 INFO:teuthology.orchestra.run.smithi086.stdout:347892351004 2024-09-13T16:09:32.758 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.756+0000 7f48c5200640 1 -- 172.21.15.86:0/3893596420 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f48a40a1110 msgr2=0x7f48a40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:32.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.756+0000 7f48c5200640 1 --2- 172.21.15.86:0/3893596420 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f48a40a1110 0x7f48a40a35d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009bd0 tx=0x7f48b0005f90 comp rx=0 tx=0).stop 2024-09-13T16:09:32.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.756+0000 7f48c5200640 1 -- 172.21.15.86:0/3893596420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f48c0102bb0 msgr2=0x7f48c0198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:32.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.756+0000 7f48c5200640 1 --2- 172.21.15.86:0/3893596420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f48c0102bb0 0x7f48c0198a60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f48a800d950 tx=0x7f48a800de10 comp rx=0 tx=0).stop 2024-09-13T16:09:32.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.756+0000 7f48c5200640 1 -- 172.21.15.86:0/3893596420 shutdown_connections 2024-09-13T16:09:32.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.756+0000 7f48c5200640 1 --2- 172.21.15.86:0/3893596420 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f48a40a1110 0x7f48a40a35d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:32.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.756+0000 7f48c5200640 1 --2- 172.21.15.86:0/3893596420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48c0107330 0x7f48c019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:32.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.756+0000 7f48c5200640 1 --2- 172.21.15.86:0/3893596420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f48c0102bb0 0x7f48c0198a60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:32.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.756+0000 7f48c5200640 1 --2- 172.21.15.86:0/3893596420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48c0102200 0x7f48c0198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:32.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.757+0000 7f48c5200640 1 -- 172.21.15.86:0/3893596420 >> 172.21.15.86:0/3893596420 conn(0x7f48c00fdc60 msgr2=0x7f48c00ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:32.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.757+0000 7f48c5200640 1 -- 172.21.15.86:0/3893596420 shutdown_connections 2024-09-13T16:09:32.759 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:32.757+0000 7f48c5200640 1 -- 172.21.15.86:0/3893596420 wait complete. 2024-09-13T16:09:32.946 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724599 got 167503724603 for osd.5 2024-09-13T16:09:32.946 DEBUG:teuthology.parallel:result is None 2024-09-13T16:09:32.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:32 smithi139 ceph-mon[35320]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T16:09:33.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:32 smithi194 ceph-mon[35694]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T16:09:33.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:33 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3893596420' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-13T16:09:33.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:33 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3893596420' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-13T16:09:34.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:33 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3893596420' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-13T16:09:34.663 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:09:34.685 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776163 got 292057776167 for osd.9 2024-09-13T16:09:34.685 DEBUG:teuthology.parallel:result is None 2024-09-13T16:09:34.884 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:34 smithi086 ceph-mon[30379]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:09:34.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:34 smithi139 ceph-mon[35320]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:09:35.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:34 smithi194 ceph-mon[35694]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:09:35.311 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892351000 got 347892351004 for osd.11 2024-09-13T16:09:35.312 DEBUG:teuthology.parallel:result is None 2024-09-13T16:09:36.761 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.742+0000 7f4909400640 1 -- 172.21.15.86:0/2708323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49041007c0 msgr2=0x7f4904104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:36.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.742+0000 7f4909400640 1 --2- 172.21.15.86:0/2708323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49041007c0 0x7f4904104810 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009930 tx=0x7f48ec02a420 comp rx=0 tx=0).stop 2024-09-13T16:09:36.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.743+0000 7f4909400640 1 -- 172.21.15.86:0/2708323 shutdown_connections 2024-09-13T16:09:36.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.743+0000 7f4909400640 1 --2- 172.21.15.86:0/2708323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4904104f40 0x7f490410cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:36.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.743+0000 7f4909400640 1 --2- 172.21.15.86:0/2708323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49041007c0 0x7f4904104810 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:36.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.743+0000 7f4909400640 1 --2- 172.21.15.86:0/2708323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49040ffe10 0x7f49041001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:36.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.743+0000 7f4909400640 1 -- 172.21.15.86:0/2708323 >> 172.21.15.86:0/2708323 conn(0x7f49040fb870 msgr2=0x7f49040fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:36.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.743+0000 7f4909400640 1 -- 172.21.15.86:0/2708323 shutdown_connections 2024-09-13T16:09:36.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.743+0000 7f4909400640 1 -- 172.21.15.86:0/2708323 wait complete. 2024-09-13T16:09:36.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.744+0000 7f4909400640 1 Processor -- start 2024-09-13T16:09:36.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.744+0000 7f4909400640 1 -- start start 2024-09-13T16:09:36.762 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.744+0000 7f4909400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49040ffe10 0x7f49041961d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.744+0000 7f4909400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49041007c0 0x7f4904196710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.744+0000 7f4909400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4904104f40 0x7f490419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.744+0000 7f4909400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490419b110 con 0x7f49040ffe10 2024-09-13T16:09:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.744+0000 7f4909400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490419b280 con 0x7f4904104f40 2024-09-13T16:09:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.744+0000 7f4909400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490419b3f0 con 0x7f49041007c0 2024-09-13T16:09:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.744+0000 7f4903e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49040ffe10 0x7f49041961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.744+0000 7f4903e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49040ffe10 0x7f49041961d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42790/0 (socket says 172.21.15.86:42790) 2024-09-13T16:09:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.744+0000 7f4903e00640 1 -- 172.21.15.86:0/1635980056 learned_addr learned my addr 172.21.15.86:0/1635980056 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.744+0000 7f48fb400640 1 --2- 172.21.15.86:0/1635980056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49041007c0 0x7f4904196710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.744+0000 7f4908a00640 1 --2- 172.21.15.86:0/1635980056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4904104f40 0x7f490419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.745+0000 7f4903e00640 1 -- 172.21.15.86:0/1635980056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49041007c0 msgr2=0x7f4904196710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:36.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.745+0000 7f4903e00640 1 --2- 172.21.15.86:0/1635980056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49041007c0 0x7f4904196710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.745+0000 7f4903e00640 1 -- 172.21.15.86:0/1635980056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4904104f40 msgr2=0x7f490419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.745+0000 7f4903e00640 1 --2- 172.21.15.86:0/1635980056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4904104f40 0x7f490419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.745+0000 7f4903e00640 1 -- 172.21.15.86:0/1635980056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec009560 con 0x7f49040ffe10 2024-09-13T16:09:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.745+0000 7f48fb400640 1 --2- 172.21.15.86:0/1635980056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49041007c0 0x7f4904196710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:09:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.745+0000 7f4903e00640 1 --2- 172.21.15.86:0/1635980056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49040ffe10 0x7f49041961d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f48f400e9f0 tx=0x7f48f400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.746+0000 7f4901600640 1 -- 172.21.15.86:0/1635980056 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4009700 con 0x7f49040ffe10 2024-09-13T16:09:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.746+0000 7f4901600640 1 -- 172.21.15.86:0/1635980056 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f48f400cd80 con 0x7f49040ffe10 2024-09-13T16:09:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.746+0000 7f4901600640 1 -- 172.21.15.86:0/1635980056 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4018920 con 0x7f49040ffe10 2024-09-13T16:09:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.746+0000 7f4909400640 1 -- 172.21.15.86:0/1635980056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490419b6d0 con 0x7f49040ffe10 2024-09-13T16:09:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.746+0000 7f4909400640 1 -- 172.21.15.86:0/1635980056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49041a2f90 con 0x7f49040ffe10 2024-09-13T16:09:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.747+0000 7f4909400640 1 -- 172.21.15.86:0/1635980056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49041012f0 con 0x7f49040ffe10 2024-09-13T16:09:36.764 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.749+0000 7f4901600640 1 -- 172.21.15.86:0/1635980056 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f48f4018a80 con 0x7f49040ffe10 2024-09-13T16:09:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.750+0000 7f4901600640 1 --2- 172.21.15.86:0/1635980056 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f48e80a1180 0x7f48e80a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.750+0000 7f4901600640 1 -- 172.21.15.86:0/1635980056 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f48f4014070 con 0x7f49040ffe10 2024-09-13T16:09:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.750+0000 7f48fb400640 1 --2- 172.21.15.86:0/1635980056 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f48e80a1180 0x7f48e80a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.751+0000 7f48fb400640 1 --2- 172.21.15.86:0/1635980056 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f48e80a1180 0x7f48e80a3640 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f48ec005ab0 tx=0x7f48ec005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:36.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.754+0000 7f4901600640 1 -- 172.21.15.86:0/1635980056 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f48f4052e20 con 0x7f49040ffe10 2024-09-13T16:09:36.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:36 smithi086 ceph-mon[30379]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:09:36.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:36.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:36 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:36.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.937+0000 7f4909400640 1 -- 172.21.15.86:0/1635980056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f49041001f0 con 0x7f49040ffe10 2024-09-13T16:09:36.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.937+0000 7f4901600640 1 -- 172.21.15.86:0/1635980056 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48f4096470 con 0x7f49040ffe10 2024-09-13T16:09:36.939 INFO:teuthology.orchestra.run.smithi086.stdout:55834574930 2024-09-13T16:09:36.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.940+0000 7f4909400640 1 -- 172.21.15.86:0/1635980056 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f48e80a1180 msgr2=0x7f48e80a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:36.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.940+0000 7f4909400640 1 --2- 172.21.15.86:0/1635980056 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f48e80a1180 0x7f48e80a3640 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f48ec005ab0 tx=0x7f48ec005a20 comp rx=0 tx=0).stop 2024-09-13T16:09:36.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.940+0000 7f4909400640 1 -- 172.21.15.86:0/1635980056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49040ffe10 msgr2=0x7f49041961d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:36.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.940+0000 7f4909400640 1 --2- 172.21.15.86:0/1635980056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49040ffe10 0x7f49041961d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f48f400e9f0 tx=0x7f48f400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:09:36.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.940+0000 7f4909400640 1 -- 172.21.15.86:0/1635980056 shutdown_connections 2024-09-13T16:09:36.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.940+0000 7f4909400640 1 --2- 172.21.15.86:0/1635980056 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f48e80a1180 0x7f48e80a3640 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:36.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.940+0000 7f4909400640 1 --2- 172.21.15.86:0/1635980056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4904104f40 0x7f490419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:36.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.940+0000 7f4909400640 1 --2- 172.21.15.86:0/1635980056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49041007c0 0x7f4904196710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:36.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.940+0000 7f4909400640 1 --2- 172.21.15.86:0/1635980056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49040ffe10 0x7f49041961d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:36.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.940+0000 7f4909400640 1 -- 172.21.15.86:0/1635980056 >> 172.21.15.86:0/1635980056 conn(0x7f49040fb870 msgr2=0x7f49040fcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:36.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.940+0000 7f4909400640 1 -- 172.21.15.86:0/1635980056 shutdown_connections 2024-09-13T16:09:36.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:36.940+0000 7f4909400640 1 -- 172.21.15.86:0/1635980056 wait complete. 2024-09-13T16:09:36.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:36 smithi139 ceph-mon[35320]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:09:36.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:36 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:36.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:36 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:37.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:36 smithi194 ceph-mon[35694]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:09:37.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:36 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:37.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:36 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:37.122 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:09:37.753 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:37 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1635980056' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T16:09:37.753 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:37 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:09:37.753 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:37 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:09:37.754 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:37 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:37.787 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612637 got 313532612642 for osd.10 2024-09-13T16:09:37.787 DEBUG:teuthology.parallel:result is None 2024-09-13T16:09:37.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:37 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1635980056' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T16:09:37.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:37 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:09:37.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:37 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:09:37.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:37 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:38.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:37 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1635980056' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T16:09:38.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:37 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:09:38.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:37 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:09:38.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:37 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:09:38.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.997+0000 7f6f03e00640 1 -- 172.21.15.86:0/2168684815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f041029e0 msgr2=0x7f6f04106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:38.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.997+0000 7f6f03e00640 1 --2- 172.21.15.86:0/2168684815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f041029e0 0x7f6f04106a30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009930 tx=0x7f6ef002a420 comp rx=0 tx=0).stop 2024-09-13T16:09:38.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.997+0000 7f6f03e00640 1 -- 172.21.15.86:0/2168684815 shutdown_connections 2024-09-13T16:09:38.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.997+0000 7f6f03e00640 1 --2- 172.21.15.86:0/2168684815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f04107160 0x7f6f0410ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:38.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.997+0000 7f6f03e00640 1 --2- 172.21.15.86:0/2168684815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f041029e0 0x7f6f04106a30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:38.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.997+0000 7f6f03e00640 1 --2- 172.21.15.86:0/2168684815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f04102030 0x7f6f04102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:38.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.997+0000 7f6f03e00640 1 -- 172.21.15.86:0/2168684815 >> 172.21.15.86:0/2168684815 conn(0x7f6f040fda90 msgr2=0x7f6f040ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.997+0000 7f6f03e00640 1 -- 172.21.15.86:0/2168684815 shutdown_connections 2024-09-13T16:09:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.997+0000 7f6f03e00640 1 -- 172.21.15.86:0/2168684815 wait complete. 2024-09-13T16:09:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.998+0000 7f6f03e00640 1 Processor -- start 2024-09-13T16:09:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.998+0000 7f6f03e00640 1 -- start start 2024-09-13T16:09:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.998+0000 7f6f03e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f04102030 0x7f6f04198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.998+0000 7f6f03e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f041029e0 0x7f6f041988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.998+0000 7f6f03e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f04107160 0x7f6f0419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.998+0000 7f6f03e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0419d2c0 con 0x7f6f04102030 2024-09-13T16:09:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.998+0000 7f6f03e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0419d430 con 0x7f6f041029e0 2024-09-13T16:09:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.998+0000 7f6f03e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0419d5a0 con 0x7f6f04107160 2024-09-13T16:09:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.999+0000 7f6f02a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f04102030 0x7f6f04198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.999+0000 7f6f02a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f04102030 0x7f6f04198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42808/0 (socket says 172.21.15.86:42808) 2024-09-13T16:09:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.999+0000 7f6f02a00640 1 -- 172.21.15.86:0/141503034 learned_addr learned my addr 172.21.15.86:0/141503034 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.999+0000 7f6f03400640 1 --2- 172.21.15.86:0/141503034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f04107160 0x7f6f0419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.999+0000 7f6f02000640 1 --2- 172.21.15.86:0/141503034 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f041029e0 0x7f6f041988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.999+0000 7f6f02a00640 1 -- 172.21.15.86:0/141503034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f04107160 msgr2=0x7f6f0419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.999+0000 7f6f02a00640 1 --2- 172.21.15.86:0/141503034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f04107160 0x7f6f0419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.999+0000 7f6f02a00640 1 -- 172.21.15.86:0/141503034 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f041029e0 msgr2=0x7f6f041988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.999+0000 7f6f02a00640 1 --2- 172.21.15.86:0/141503034 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f041029e0 0x7f6f041988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.999+0000 7f6f02a00640 1 -- 172.21.15.86:0/141503034 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef4009490 con 0x7f6f04102030 2024-09-13T16:09:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:37.999+0000 7f6f03400640 1 --2- 172.21.15.86:0/141503034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f04107160 0x7f6f0419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:09:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.000+0000 7f6f02a00640 1 --2- 172.21.15.86:0/141503034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f04102030 0x7f6f04198380 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400ea60 tx=0x7f6ef400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.000+0000 7f6efb400640 1 -- 172.21.15.86:0/141503034 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef400cde0 con 0x7f6f04102030 2024-09-13T16:09:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.000+0000 7f6efb400640 1 -- 172.21.15.86:0/141503034 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6ef40035f0 con 0x7f6f04102030 2024-09-13T16:09:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.000+0000 7f6f03e00640 1 -- 172.21.15.86:0/141503034 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef0009560 con 0x7f6f04102030 2024-09-13T16:09:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.000+0000 7f6efb400640 1 -- 172.21.15.86:0/141503034 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4010690 con 0x7f6f04102030 2024-09-13T16:09:38.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.000+0000 7f6f03e00640 1 -- 172.21.15.86:0/141503034 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f041a4f70 con 0x7f6f04102030 2024-09-13T16:09:38.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.001+0000 7f6f03e00640 1 -- 172.21.15.86:0/141503034 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f04103510 con 0x7f6f04102030 2024-09-13T16:09:38.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.003+0000 7f6efb400640 1 -- 172.21.15.86:0/141503034 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f6ef4003af0 con 0x7f6f04102030 2024-09-13T16:09:38.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.004+0000 7f6efb400640 1 --2- 172.21.15.86:0/141503034 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6ee80a1180 0x7f6ee80a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:38.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.005+0000 7f6efb400640 1 -- 172.21.15.86:0/141503034 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6ef4014070 con 0x7f6f04102030 2024-09-13T16:09:38.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.005+0000 7f6f02000640 1 --2- 172.21.15.86:0/141503034 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6ee80a1180 0x7f6ee80a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:38.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.006+0000 7f6f02000640 1 --2- 172.21.15.86:0/141503034 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6ee80a1180 0x7f6ee80a3640 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009900 tx=0x7f6ef00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:38.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.009+0000 7f6efb400640 1 -- 172.21.15.86:0/141503034 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6ef4096450 con 0x7f6f04102030 2024-09-13T16:09:38.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.193+0000 7f6f03e00640 1 -- 172.21.15.86:0/141503034 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6f0410a370 con 0x7f6f04102030 2024-09-13T16:09:38.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.193+0000 7f6efb400640 1 -- 172.21.15.86:0/141503034 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ef4099a70 con 0x7f6f04102030 2024-09-13T16:09:38.195 INFO:teuthology.orchestra.run.smithi086.stdout:146028888130 2024-09-13T16:09:38.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.195+0000 7f6f03e00640 1 -- 172.21.15.86:0/141503034 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6ee80a1180 msgr2=0x7f6ee80a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:38.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.195+0000 7f6f03e00640 1 --2- 172.21.15.86:0/141503034 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6ee80a1180 0x7f6ee80a3640 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009900 tx=0x7f6ef00058d0 comp rx=0 tx=0).stop 2024-09-13T16:09:38.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.195+0000 7f6f03e00640 1 -- 172.21.15.86:0/141503034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f04102030 msgr2=0x7f6f04198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:38.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.195+0000 7f6f03e00640 1 --2- 172.21.15.86:0/141503034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f04102030 0x7f6f04198380 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400ea60 tx=0x7f6ef400ef20 comp rx=0 tx=0).stop 2024-09-13T16:09:38.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.196+0000 7f6f03e00640 1 -- 172.21.15.86:0/141503034 shutdown_connections 2024-09-13T16:09:38.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.196+0000 7f6f03e00640 1 --2- 172.21.15.86:0/141503034 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6ee80a1180 0x7f6ee80a3640 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:38.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.196+0000 7f6f03e00640 1 --2- 172.21.15.86:0/141503034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f04107160 0x7f6f0419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:38.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.196+0000 7f6f03e00640 1 --2- 172.21.15.86:0/141503034 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f041029e0 0x7f6f041988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:38.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.196+0000 7f6f03e00640 1 --2- 172.21.15.86:0/141503034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f04102030 0x7f6f04198380 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:38.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.196+0000 7f6f03e00640 1 -- 172.21.15.86:0/141503034 >> 172.21.15.86:0/141503034 conn(0x7f6f040fda90 msgr2=0x7f6f040fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:38.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.196+0000 7f6f03e00640 1 -- 172.21.15.86:0/141503034 shutdown_connections 2024-09-13T16:09:38.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:38.196+0000 7f6f03e00640 1 -- 172.21.15.86:0/141503034 wait complete. 2024-09-13T16:09:38.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:38 smithi086 ceph-mon[30379]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:09:38.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:38 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/141503034' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T16:09:38.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:38 smithi139 ceph-mon[35320]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:09:38.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:38 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/141503034' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T16:09:39.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:38 smithi194 ceph-mon[35694]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:09:39.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:38 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/141503034' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T16:09:40.226 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574925 got 55834574930 for osd.1 2024-09-13T16:09:40.227 DEBUG:teuthology.parallel:result is None 2024-09-13T16:09:40.452 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888123 got 146028888130 for osd.4 2024-09-13T16:09:40.453 DEBUG:teuthology.parallel:result is None 2024-09-13T16:09:40.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:40 smithi086 ceph-mon[30379]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:09:40.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:40 smithi139 ceph-mon[35320]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:09:41.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:40 smithi194 ceph-mon[35694]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:09:42.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.019+0000 7f32c6200640 1 -- 172.21.15.86:0/309550771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c0110a50 msgr2=0x7f32c0112e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:42.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.019+0000 7f32c6200640 1 --2- 172.21.15.86:0/309550771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c0110a50 0x7f32c0112e40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009ca0 tx=0x7f32b802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:09:42.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.019+0000 7f32c6200640 1 -- 172.21.15.86:0/309550771 shutdown_connections 2024-09-13T16:09:42.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.019+0000 7f32c6200640 1 --2- 172.21.15.86:0/309550771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c0110a50 0x7f32c0112e40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:42.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.019+0000 7f32c6200640 1 --2- 172.21.15.86:0/309550771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f32c0075300 0x7f32c0110510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:42.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.019+0000 7f32c6200640 1 --2- 172.21.15.86:0/309550771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c00749e0 0x7f32c0074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:42.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.019+0000 7f32c6200640 1 -- 172.21.15.86:0/309550771 >> 172.21.15.86:0/309550771 conn(0x7f32c00fda70 msgr2=0x7f32c00ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:42.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.019+0000 7f32c6200640 1 -- 172.21.15.86:0/309550771 shutdown_connections 2024-09-13T16:09:42.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.019+0000 7f32c6200640 1 -- 172.21.15.86:0/309550771 wait complete. 2024-09-13T16:09:42.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.020+0000 7f32c6200640 1 Processor -- start 2024-09-13T16:09:42.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.020+0000 7f32c6200640 1 -- start start 2024-09-13T16:09:42.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.021+0000 7f32c6200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c00749e0 0x7f32c019c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:42.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.021+0000 7f32c6200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f32c0075300 0x7f32c019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:42.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.021+0000 7f32c6200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c0110a50 0x7f32c019fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:42.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.021+0000 7f32c6200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c01a05f0 con 0x7f32c00749e0 2024-09-13T16:09:42.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.021+0000 7f32c6200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c01a0760 con 0x7f32c0075300 2024-09-13T16:09:42.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.021+0000 7f32c6200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c01a0920 con 0x7f32c0110a50 2024-09-13T16:09:42.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.021+0000 7f32c4e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c00749e0 0x7f32c019c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:42.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.021+0000 7f32c4e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c00749e0 0x7f32c019c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42818/0 (socket says 172.21.15.86:42818) 2024-09-13T16:09:42.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.021+0000 7f32c4e00640 1 -- 172.21.15.86:0/1386706876 learned_addr learned my addr 172.21.15.86:0/1386706876 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:42.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.021+0000 7f32c5800640 1 --2- 172.21.15.86:0/1386706876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c0110a50 0x7f32c019fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:42.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.021+0000 7f32b7e00640 1 --2- 172.21.15.86:0/1386706876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f32c0075300 0x7f32c019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:42.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.022+0000 7f32c4e00640 1 -- 172.21.15.86:0/1386706876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c0110a50 msgr2=0x7f32c019fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:42.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.022+0000 7f32c4e00640 1 --2- 172.21.15.86:0/1386706876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c0110a50 0x7f32c019fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:42.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.022+0000 7f32c4e00640 1 -- 172.21.15.86:0/1386706876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f32c0075300 msgr2=0x7f32c019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:42.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.022+0000 7f32c4e00640 1 --2- 172.21.15.86:0/1386706876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f32c0075300 0x7f32c019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:42.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.022+0000 7f32c4e00640 1 -- 172.21.15.86:0/1386706876 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b8009900 con 0x7f32c00749e0 2024-09-13T16:09:42.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.022+0000 7f32c5800640 1 --2- 172.21.15.86:0/1386706876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c0110a50 0x7f32c019fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:09:42.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.022+0000 7f32c4e00640 1 --2- 172.21.15.86:0/1386706876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c00749e0 0x7f32c019c760 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f32b000e9f0 tx=0x7f32b000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:42.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.022+0000 7f32be000640 1 -- 172.21.15.86:0/1386706876 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0009720 con 0x7f32c00749e0 2024-09-13T16:09:42.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.022+0000 7f32be000640 1 -- 172.21.15.86:0/1386706876 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f32b000cd80 con 0x7f32c00749e0 2024-09-13T16:09:42.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.022+0000 7f32c6200640 1 -- 172.21.15.86:0/1386706876 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c01a0c00 con 0x7f32c00749e0 2024-09-13T16:09:42.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.022+0000 7f32be000640 1 -- 172.21.15.86:0/1386706876 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0010690 con 0x7f32c00749e0 2024-09-13T16:09:42.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.022+0000 7f32c6200640 1 -- 172.21.15.86:0/1386706876 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c01a9550 con 0x7f32c00749e0 2024-09-13T16:09:42.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.023+0000 7f32c6200640 1 -- 172.21.15.86:0/1386706876 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c0076120 con 0x7f32c00749e0 2024-09-13T16:09:42.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.025+0000 7f32be000640 1 -- 172.21.15.86:0/1386706876 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f32b00046c0 con 0x7f32c00749e0 2024-09-13T16:09:42.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.027+0000 7f32be000640 1 --2- 172.21.15.86:0/1386706876 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f32a40a1100 0x7f32a40a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:42.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.027+0000 7f32be000640 1 -- 172.21.15.86:0/1386706876 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f32b0014070 con 0x7f32c00749e0 2024-09-13T16:09:42.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.028+0000 7f32b7e00640 1 --2- 172.21.15.86:0/1386706876 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f32a40a1100 0x7f32a40a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:42.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.028+0000 7f32b7e00640 1 --2- 172.21.15.86:0/1386706876 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f32a40a1100 0x7f32a40a35c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f32c019dd10 tx=0x7f32a800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:42.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.031+0000 7f32be000640 1 -- 172.21.15.86:0/1386706876 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f32b0096430 con 0x7f32c00749e0 2024-09-13T16:09:42.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.207+0000 7f32c6200640 1 -- 172.21.15.86:0/1386706876 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f32c0074dc0 con 0x7f32c00749e0 2024-09-13T16:09:42.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.208+0000 7f32be000640 1 -- 172.21.15.86:0/1386706876 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f32b0099a50 con 0x7f32c00749e0 2024-09-13T16:09:42.210 INFO:teuthology.orchestra.run.smithi086.stdout:201863462969 2024-09-13T16:09:42.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.210+0000 7f32c6200640 1 -- 172.21.15.86:0/1386706876 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f32a40a1100 msgr2=0x7f32a40a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:42.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.210+0000 7f32c6200640 1 --2- 172.21.15.86:0/1386706876 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f32a40a1100 0x7f32a40a35c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f32c019dd10 tx=0x7f32a800b410 comp rx=0 tx=0).stop 2024-09-13T16:09:42.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.210+0000 7f32c6200640 1 -- 172.21.15.86:0/1386706876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c00749e0 msgr2=0x7f32c019c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:42.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.210+0000 7f32c6200640 1 --2- 172.21.15.86:0/1386706876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c00749e0 0x7f32c019c760 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f32b000e9f0 tx=0x7f32b000edf0 comp rx=0 tx=0).stop 2024-09-13T16:09:42.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.210+0000 7f32c6200640 1 -- 172.21.15.86:0/1386706876 shutdown_connections 2024-09-13T16:09:42.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.210+0000 7f32c6200640 1 --2- 172.21.15.86:0/1386706876 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f32a40a1100 0x7f32a40a35c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:42.212 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.210+0000 7f32c6200640 1 --2- 172.21.15.86:0/1386706876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c0110a50 0x7f32c019fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:42.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.210+0000 7f32c6200640 1 --2- 172.21.15.86:0/1386706876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f32c0075300 0x7f32c019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:42.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.210+0000 7f32c6200640 1 --2- 172.21.15.86:0/1386706876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c00749e0 0x7f32c019c760 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:42.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.210+0000 7f32c6200640 1 -- 172.21.15.86:0/1386706876 >> 172.21.15.86:0/1386706876 conn(0x7f32c00fda70 msgr2=0x7f32c00ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:42.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.211+0000 7f32c6200640 1 -- 172.21.15.86:0/1386706876 shutdown_connections 2024-09-13T16:09:42.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:42.211+0000 7f32c6200640 1 -- 172.21.15.86:0/1386706876 wait complete. 2024-09-13T16:09:42.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:42 smithi139 ceph-mon[35320]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T16:09:42.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:42 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1386706876' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-13T16:09:43.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:42 smithi194 ceph-mon[35694]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T16:09:43.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:42 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1386706876' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-13T16:09:43.066 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:42 smithi086 ceph-mon[30379]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T16:09:43.066 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:42 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1386706876' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-13T16:09:43.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.571+0000 7fc70a800640 1 -- 172.21.15.86:0/1779738768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc704102ba0 msgr2=0x7fc704106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:43.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.571+0000 7fc70a800640 1 --2- 172.21.15.86:0/1779738768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc704102ba0 0x7fc704106bf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0009930 tx=0x7fc6f002a420 comp rx=0 tx=0).stop 2024-09-13T16:09:43.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.571+0000 7fc70a800640 1 -- 172.21.15.86:0/1779738768 shutdown_connections 2024-09-13T16:09:43.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.571+0000 7fc70a800640 1 --2- 172.21.15.86:0/1779738768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc704107320 0x7fc70410eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:43.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.571+0000 7fc70a800640 1 --2- 172.21.15.86:0/1779738768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc704102ba0 0x7fc704106bf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:43.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.571+0000 7fc70a800640 1 --2- 172.21.15.86:0/1779738768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7041021f0 0x7fc7041025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:43.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.571+0000 7fc70a800640 1 -- 172.21.15.86:0/1779738768 >> 172.21.15.86:0/1779738768 conn(0x7fc7040fdc70 msgr2=0x7fc704100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:43.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.571+0000 7fc70a800640 1 -- 172.21.15.86:0/1779738768 shutdown_connections 2024-09-13T16:09:43.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.571+0000 7fc70a800640 1 -- 172.21.15.86:0/1779738768 wait complete. 2024-09-13T16:09:43.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.572+0000 7fc70a800640 1 Processor -- start 2024-09-13T16:09:43.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.572+0000 7fc70a800640 1 -- start start 2024-09-13T16:09:43.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.573+0000 7fc70a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7041021f0 0x7fc704198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:43.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.573+0000 7fc70a800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc704102ba0 0x7fc704198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:43.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.573+0000 7fc70a800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc704107320 0x7fc70419ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:43.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.573+0000 7fc70a800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70419d4b0 con 0x7fc704107320 2024-09-13T16:09:43.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.573+0000 7fc70a800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70419d620 con 0x7fc704102ba0 2024-09-13T16:09:43.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.573+0000 7fc70a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70419d790 con 0x7fc7041021f0 2024-09-13T16:09:43.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.573+0000 7fc703e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc704107320 0x7fc70419ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:43.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.573+0000 7fc703e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc704107320 0x7fc70419ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38996/0 (socket says 172.21.15.86:38996) 2024-09-13T16:09:43.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.573+0000 7fc703e00640 1 -- 172.21.15.86:0/3568212178 learned_addr learned my addr 172.21.15.86:0/3568212178 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:43.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.573+0000 7fc702a00640 1 --2- 172.21.15.86:0/3568212178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc704102ba0 0x7fc704198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:43.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.573+0000 7fc703400640 1 --2- 172.21.15.86:0/3568212178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7041021f0 0x7fc704198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:43.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.574+0000 7fc703e00640 1 -- 172.21.15.86:0/3568212178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7041021f0 msgr2=0x7fc704198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:43.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.574+0000 7fc703e00640 1 --2- 172.21.15.86:0/3568212178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7041021f0 0x7fc704198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:43.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.574+0000 7fc703e00640 1 -- 172.21.15.86:0/3568212178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc704102ba0 msgr2=0x7fc704198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:43.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.574+0000 7fc703e00640 1 --2- 172.21.15.86:0/3568212178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc704102ba0 0x7fc704198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:43.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.574+0000 7fc703e00640 1 -- 172.21.15.86:0/3568212178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f0009560 con 0x7fc704107320 2024-09-13T16:09:43.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.574+0000 7fc702a00640 1 --2- 172.21.15.86:0/3568212178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc704102ba0 0x7fc704198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:09:43.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.574+0000 7fc703e00640 1 --2- 172.21.15.86:0/3568212178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc704107320 0x7fc70419ceb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00eaa0 tx=0x7fc6fc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:43.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.574+0000 7fc6fbe00640 1 -- 172.21.15.86:0/3568212178 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc00cdb0 con 0x7fc704107320 2024-09-13T16:09:43.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.574+0000 7fc6fbe00640 1 -- 172.21.15.86:0/3568212178 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc6fc005020 con 0x7fc704107320 2024-09-13T16:09:43.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.574+0000 7fc6fbe00640 1 -- 172.21.15.86:0/3568212178 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc0116b0 con 0x7fc704107320 2024-09-13T16:09:43.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.574+0000 7fc70a800640 1 -- 172.21.15.86:0/3568212178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70419da70 con 0x7fc704107320 2024-09-13T16:09:43.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.574+0000 7fc70a800640 1 -- 172.21.15.86:0/3568212178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70419dd20 con 0x7fc704107320 2024-09-13T16:09:43.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.575+0000 7fc70a800640 1 -- 172.21.15.86:0/3568212178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7041036d0 con 0x7fc704107320 2024-09-13T16:09:43.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.577+0000 7fc6fbe00640 1 -- 172.21.15.86:0/3568212178 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc6fc005520 con 0x7fc704107320 2024-09-13T16:09:43.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.578+0000 7fc6fbe00640 1 --2- 172.21.15.86:0/3568212178 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc6e80a1190 0x7fc6e80a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:43.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.579+0000 7fc6fbe00640 1 -- 172.21.15.86:0/3568212178 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc6fc0cc9b0 con 0x7fc704107320 2024-09-13T16:09:43.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.579+0000 7fc703400640 1 --2- 172.21.15.86:0/3568212178 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc6e80a1190 0x7fc6e80a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:43.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.579+0000 7fc703400640 1 --2- 172.21.15.86:0/3568212178 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc6e80a1190 0x7fc6e80a3650 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009bd0 tx=0x7fc6f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:43.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.583+0000 7fc6fbe00640 1 -- 172.21.15.86:0/3568212178 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc6fc095d20 con 0x7fc704107320 2024-09-13T16:09:43.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.766+0000 7fc70a800640 1 -- 172.21.15.86:0/3568212178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc7041025d0 con 0x7fc704107320 2024-09-13T16:09:43.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.767+0000 7fc6fbe00640 1 -- 172.21.15.86:0/3568212178 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc6fc01f020 con 0x7fc704107320 2024-09-13T16:09:43.769 INFO:teuthology.orchestra.run.smithi086.stdout:34359738455 2024-09-13T16:09:43.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.769+0000 7fc70a800640 1 -- 172.21.15.86:0/3568212178 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc6e80a1190 msgr2=0x7fc6e80a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:43.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.769+0000 7fc70a800640 1 --2- 172.21.15.86:0/3568212178 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc6e80a1190 0x7fc6e80a3650 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009bd0 tx=0x7fc6f4005f90 comp rx=0 tx=0).stop 2024-09-13T16:09:43.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.769+0000 7fc70a800640 1 -- 172.21.15.86:0/3568212178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc704107320 msgr2=0x7fc70419ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:43.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.769+0000 7fc70a800640 1 --2- 172.21.15.86:0/3568212178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc704107320 0x7fc70419ceb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00eaa0 tx=0x7fc6fc00ef60 comp rx=0 tx=0).stop 2024-09-13T16:09:43.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.769+0000 7fc70a800640 1 -- 172.21.15.86:0/3568212178 shutdown_connections 2024-09-13T16:09:43.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.769+0000 7fc70a800640 1 --2- 172.21.15.86:0/3568212178 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc6e80a1190 0x7fc6e80a3650 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:43.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.769+0000 7fc70a800640 1 --2- 172.21.15.86:0/3568212178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc704107320 0x7fc70419ceb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:43.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.769+0000 7fc70a800640 1 --2- 172.21.15.86:0/3568212178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc704102ba0 0x7fc704198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:43.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.769+0000 7fc70a800640 1 --2- 172.21.15.86:0/3568212178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7041021f0 0x7fc704198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:43.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.769+0000 7fc70a800640 1 -- 172.21.15.86:0/3568212178 >> 172.21.15.86:0/3568212178 conn(0x7fc7040fdc70 msgr2=0x7fc7040ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:43.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.769+0000 7fc70a800640 1 -- 172.21.15.86:0/3568212178 shutdown_connections 2024-09-13T16:09:43.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.769+0000 7fc70a800640 1 -- 172.21.15.86:0/3568212178 wait complete. 2024-09-13T16:09:43.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.831+0000 7f730a400640 1 -- 172.21.15.86:0/219868741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7304104f50 msgr2=0x7f730410cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:43.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.831+0000 7f730a400640 1 --2- 172.21.15.86:0/219868741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7304104f50 0x7f730410cad0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009cd0 tx=0x7f72fc02a8f0 comp rx=0 tx=0).stop 2024-09-13T16:09:43.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.832+0000 7f730a400640 1 -- 172.21.15.86:0/219868741 shutdown_connections 2024-09-13T16:09:43.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.832+0000 7f730a400640 1 --2- 172.21.15.86:0/219868741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7304104f50 0x7f730410cad0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:43.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.832+0000 7f730a400640 1 --2- 172.21.15.86:0/219868741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73041007d0 0x7f7304104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:43.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.832+0000 7f730a400640 1 --2- 172.21.15.86:0/219868741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73040ffe20 0x7f7304100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:43.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.832+0000 7f730a400640 1 -- 172.21.15.86:0/219868741 >> 172.21.15.86:0/219868741 conn(0x7f73040fb900 msgr2=0x7f73040fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:43.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.832+0000 7f730a400640 1 -- 172.21.15.86:0/219868741 shutdown_connections 2024-09-13T16:09:43.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.832+0000 7f730a400640 1 -- 172.21.15.86:0/219868741 wait complete. 2024-09-13T16:09:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.833+0000 7f730a400640 1 Processor -- start 2024-09-13T16:09:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.833+0000 7f730a400640 1 -- start start 2024-09-13T16:09:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.833+0000 7f730a400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73040ffe20 0x7f73041983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.834+0000 7f730a400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73041007d0 0x7f7304198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.834+0000 7f730a400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7304104f50 0x7f730419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.834+0000 7f730a400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730419d2c0 con 0x7f73040ffe20 2024-09-13T16:09:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.834+0000 7f730a400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730419d430 con 0x7f7304104f50 2024-09-13T16:09:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.834+0000 7f730a400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730419d5a0 con 0x7f73041007d0 2024-09-13T16:09:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.834+0000 7f7309000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73040ffe20 0x7f73041983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.834+0000 7f7309000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73040ffe20 0x7f73041983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39002/0 (socket says 172.21.15.86:39002) 2024-09-13T16:09:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.834+0000 7f7309000640 1 -- 172.21.15.86:0/2374890796 learned_addr learned my addr 172.21.15.86:0/2374890796 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.834+0000 7f7303e00640 1 --2- 172.21.15.86:0/2374890796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73041007d0 0x7f7304198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.834+0000 7f7309a00640 1 --2- 172.21.15.86:0/2374890796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7304104f50 0x7f730419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.834+0000 7f7309000640 1 -- 172.21.15.86:0/2374890796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73041007d0 msgr2=0x7f7304198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.834+0000 7f7309000640 1 --2- 172.21.15.86:0/2374890796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73041007d0 0x7f7304198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.834+0000 7f7309000640 1 -- 172.21.15.86:0/2374890796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7304104f50 msgr2=0x7f730419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.834+0000 7f7309000640 1 --2- 172.21.15.86:0/2374890796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7304104f50 0x7f730419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.834+0000 7f7309000640 1 -- 172.21.15.86:0/2374890796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc009900 con 0x7f73040ffe20 2024-09-13T16:09:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.835+0000 7f7309000640 1 --2- 172.21.15.86:0/2374890796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73040ffe20 0x7f73041983d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f72f800e9f0 tx=0x7f72f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.835+0000 7f7301600640 1 -- 172.21.15.86:0/2374890796 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8009700 con 0x7f73040ffe20 2024-09-13T16:09:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.835+0000 7f7301600640 1 -- 172.21.15.86:0/2374890796 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f72f800cd80 con 0x7f73040ffe20 2024-09-13T16:09:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.835+0000 7f7301600640 1 -- 172.21.15.86:0/2374890796 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8018920 con 0x7f73040ffe20 2024-09-13T16:09:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.835+0000 7f730a400640 1 -- 172.21.15.86:0/2374890796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730419d880 con 0x7f73040ffe20 2024-09-13T16:09:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.835+0000 7f730a400640 1 -- 172.21.15.86:0/2374890796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73041a5140 con 0x7f73040ffe20 2024-09-13T16:09:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.836+0000 7f730a400640 1 -- 172.21.15.86:0/2374890796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7304101300 con 0x7f73040ffe20 2024-09-13T16:09:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.838+0000 7f7301600640 1 -- 172.21.15.86:0/2374890796 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f72f8018a80 con 0x7f73040ffe20 2024-09-13T16:09:43.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.839+0000 7f7301600640 1 --2- 172.21.15.86:0/2374890796 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f72ec0a1100 0x7f72ec0a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:43.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.839+0000 7f7301600640 1 -- 172.21.15.86:0/2374890796 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f72f8014070 con 0x7f73040ffe20 2024-09-13T16:09:43.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.839+0000 7f7303e00640 1 --2- 172.21.15.86:0/2374890796 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f72ec0a1100 0x7f72ec0a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:43.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.840+0000 7f7303e00640 1 --2- 172.21.15.86:0/2374890796 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f72ec0a1100 0x7f72ec0a35c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7304199930 tx=0x7f72f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:43.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:43.843+0000 7f7301600640 1 -- 172.21.15.86:0/2374890796 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f72f8052e20 con 0x7f73040ffe20 2024-09-13T16:09:44.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:44.020+0000 7f730a400640 1 -- 172.21.15.86:0/2374890796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f730410fd40 con 0x7f73040ffe20 2024-09-13T16:09:44.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:44.020+0000 7f7301600640 1 -- 172.21.15.86:0/2374890796 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72f80964c0 con 0x7f73040ffe20 2024-09-13T16:09:44.022 INFO:teuthology.orchestra.run.smithi086.stdout:257698037808 2024-09-13T16:09:44.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:44.023+0000 7f730a400640 1 -- 172.21.15.86:0/2374890796 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f72ec0a1100 msgr2=0x7f72ec0a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:44.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:44.023+0000 7f730a400640 1 --2- 172.21.15.86:0/2374890796 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f72ec0a1100 0x7f72ec0a35c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7304199930 tx=0x7f72f0005f90 comp rx=0 tx=0).stop 2024-09-13T16:09:44.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:44.023+0000 7f730a400640 1 -- 172.21.15.86:0/2374890796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73040ffe20 msgr2=0x7f73041983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:44.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:44.023+0000 7f730a400640 1 --2- 172.21.15.86:0/2374890796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73040ffe20 0x7f73041983d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f72f800e9f0 tx=0x7f72f800eeb0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:44.023+0000 7f730a400640 1 -- 172.21.15.86:0/2374890796 shutdown_connections 2024-09-13T16:09:44.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:44.023+0000 7f730a400640 1 --2- 172.21.15.86:0/2374890796 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f72ec0a1100 0x7f72ec0a35c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:44.023+0000 7f730a400640 1 --2- 172.21.15.86:0/2374890796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7304104f50 0x7f730419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:44.023+0000 7f730a400640 1 --2- 172.21.15.86:0/2374890796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73041007d0 0x7f7304198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:44.023+0000 7f730a400640 1 --2- 172.21.15.86:0/2374890796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73040ffe20 0x7f73041983d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:44.023+0000 7f730a400640 1 -- 172.21.15.86:0/2374890796 >> 172.21.15.86:0/2374890796 conn(0x7f73040fb900 msgr2=0x7f73040fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:44.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:44.023+0000 7f730a400640 1 -- 172.21.15.86:0/2374890796 shutdown_connections 2024-09-13T16:09:44.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:44.023+0000 7f730a400640 1 -- 172.21.15.86:0/2374890796 wait complete. 2024-09-13T16:09:44.823 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:44 smithi086 ceph-mon[30379]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:09:44.823 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:44 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3568212178' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T16:09:44.823 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:44 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2374890796' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-13T16:09:44.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:44 smithi139 ceph-mon[35320]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:09:44.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:44 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3568212178' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T16:09:44.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:44 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2374890796' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-13T16:09:45.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:44 smithi194 ceph-mon[35694]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:09:45.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:44 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3568212178' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T16:09:45.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:44 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2374890796' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-13T16:09:45.692 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462962 got 201863462969 for osd.6 2024-09-13T16:09:45.692 DEBUG:teuthology.parallel:result is None 2024-09-13T16:09:46.032 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738449 got 34359738455 for osd.0 2024-09-13T16:09:46.032 DEBUG:teuthology.parallel:result is None 2024-09-13T16:09:46.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.317+0000 7efc50800640 1 -- 172.21.15.86:0/1522334652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc48106fa0 msgr2=0x7efc4810aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:46.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.317+0000 7efc50800640 1 --2- 172.21.15.86:0/1522334652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc48106fa0 0x7efc4810aff0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efc38009930 tx=0x7efc3802a420 comp rx=0 tx=0).stop 2024-09-13T16:09:46.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.317+0000 7efc50800640 1 -- 172.21.15.86:0/1522334652 shutdown_connections 2024-09-13T16:09:46.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.317+0000 7efc50800640 1 --2- 172.21.15.86:0/1522334652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc4810b720 0x7efc481132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:46.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.317+0000 7efc50800640 1 --2- 172.21.15.86:0/1522334652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc48106fa0 0x7efc4810aff0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:46.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.317+0000 7efc50800640 1 --2- 172.21.15.86:0/1522334652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc481065f0 0x7efc481069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:46.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.317+0000 7efc50800640 1 -- 172.21.15.86:0/1522334652 >> 172.21.15.86:0/1522334652 conn(0x7efc48075d10 msgr2=0x7efc48078130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:46.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.317+0000 7efc50800640 1 -- 172.21.15.86:0/1522334652 shutdown_connections 2024-09-13T16:09:46.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.318+0000 7efc50800640 1 -- 172.21.15.86:0/1522334652 wait complete. 2024-09-13T16:09:46.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.318+0000 7efc50800640 1 Processor -- start 2024-09-13T16:09:46.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.319+0000 7efc50800640 1 -- start start 2024-09-13T16:09:46.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.319+0000 7efc50800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc481065f0 0x7efc4819c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:46.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.319+0000 7efc50800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc48106fa0 0x7efc4819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:46.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.319+0000 7efc50800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc4810b720 0x7efc481a1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:46.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.319+0000 7efc50800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc481a1940 con 0x7efc4810b720 2024-09-13T16:09:46.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.319+0000 7efc50800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc481a1ab0 con 0x7efc48106fa0 2024-09-13T16:09:46.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.319+0000 7efc50800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc481a1c70 con 0x7efc481065f0 2024-09-13T16:09:46.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.319+0000 7efc4e800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc4810b720 0x7efc481a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:46.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.319+0000 7efc4de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc481065f0 0x7efc4819c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:46.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.319+0000 7efc4e800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc4810b720 0x7efc481a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39022/0 (socket says 172.21.15.86:39022) 2024-09-13T16:09:46.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.319+0000 7efc4de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc481065f0 0x7efc4819c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:34002/0 (socket says 172.21.15.86:34002) 2024-09-13T16:09:46.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.319+0000 7efc4e800640 1 -- 172.21.15.86:0/2514887178 learned_addr learned my addr 172.21.15.86:0/2514887178 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:46.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.320+0000 7efc4d400640 1 --2- 172.21.15.86:0/2514887178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc48106fa0 0x7efc4819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:46.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.320+0000 7efc4e800640 1 -- 172.21.15.86:0/2514887178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc481065f0 msgr2=0x7efc4819c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:46.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.320+0000 7efc4e800640 1 --2- 172.21.15.86:0/2514887178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc481065f0 0x7efc4819c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:46.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.320+0000 7efc4e800640 1 -- 172.21.15.86:0/2514887178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc48106fa0 msgr2=0x7efc4819cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:46.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.320+0000 7efc4e800640 1 --2- 172.21.15.86:0/2514887178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc48106fa0 0x7efc4819cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:46.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.320+0000 7efc4e800640 1 -- 172.21.15.86:0/2514887178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc38009560 con 0x7efc4810b720 2024-09-13T16:09:46.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.320+0000 7efc4de00640 1 --2- 172.21.15.86:0/2514887178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc481065f0 0x7efc4819c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:09:46.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.320+0000 7efc4e800640 1 --2- 172.21.15.86:0/2514887178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc4810b720 0x7efc481a1340 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efc4400eb10 tx=0x7efc4400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:46.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.320+0000 7efc42a00640 1 -- 172.21.15.86:0/2514887178 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44004b20 con 0x7efc4810b720 2024-09-13T16:09:46.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.320+0000 7efc42a00640 1 -- 172.21.15.86:0/2514887178 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efc44004c80 con 0x7efc4810b720 2024-09-13T16:09:46.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.320+0000 7efc50800640 1 -- 172.21.15.86:0/2514887178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc481a1f50 con 0x7efc4810b720 2024-09-13T16:09:46.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.320+0000 7efc42a00640 1 -- 172.21.15.86:0/2514887178 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44010650 con 0x7efc4810b720 2024-09-13T16:09:46.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.321+0000 7efc50800640 1 -- 172.21.15.86:0/2514887178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc481a97c0 con 0x7efc4810b720 2024-09-13T16:09:46.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.322+0000 7efc50800640 1 -- 172.21.15.86:0/2514887178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc48107ad0 con 0x7efc4810b720 2024-09-13T16:09:46.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.324+0000 7efc42a00640 1 -- 172.21.15.86:0/2514887178 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7efc440107f0 con 0x7efc4810b720 2024-09-13T16:09:46.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.325+0000 7efc42a00640 1 --2- 172.21.15.86:0/2514887178 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efc300a1110 0x7efc300a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:46.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.325+0000 7efc42a00640 1 -- 172.21.15.86:0/2514887178 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7efc44014070 con 0x7efc4810b720 2024-09-13T16:09:46.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.325+0000 7efc4de00640 1 --2- 172.21.15.86:0/2514887178 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efc300a1110 0x7efc300a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:46.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.326+0000 7efc4de00640 1 --2- 172.21.15.86:0/2514887178 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efc300a1110 0x7efc300a35d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009fc0 tx=0x7efc3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:46.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.327+0000 7efc42a00640 1 -- 172.21.15.86:0/2514887178 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efc44096790 con 0x7efc4810b720 2024-09-13T16:09:46.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.501+0000 7efc50800640 1 -- 172.21.15.86:0/2514887178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7efc4819dd30 con 0x7efc4810b720 2024-09-13T16:09:46.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.502+0000 7efc42a00640 1 -- 172.21.15.86:0/2514887178 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc44099db0 con 0x7efc4810b720 2024-09-13T16:09:46.504 INFO:teuthology.orchestra.run.smithi086.stdout:223338299445 2024-09-13T16:09:46.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.504+0000 7efc50800640 1 -- 172.21.15.86:0/2514887178 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efc300a1110 msgr2=0x7efc300a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:46.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.504+0000 7efc50800640 1 --2- 172.21.15.86:0/2514887178 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efc300a1110 0x7efc300a35d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009fc0 tx=0x7efc3c005f90 comp rx=0 tx=0).stop 2024-09-13T16:09:46.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.504+0000 7efc50800640 1 -- 172.21.15.86:0/2514887178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc4810b720 msgr2=0x7efc481a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:46.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.504+0000 7efc50800640 1 --2- 172.21.15.86:0/2514887178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc4810b720 0x7efc481a1340 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efc4400eb10 tx=0x7efc4400c2d0 comp rx=0 tx=0).stop 2024-09-13T16:09:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.504+0000 7efc50800640 1 -- 172.21.15.86:0/2514887178 shutdown_connections 2024-09-13T16:09:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.504+0000 7efc50800640 1 --2- 172.21.15.86:0/2514887178 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7efc300a1110 0x7efc300a35d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.504+0000 7efc50800640 1 --2- 172.21.15.86:0/2514887178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc4810b720 0x7efc481a1340 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.504+0000 7efc50800640 1 --2- 172.21.15.86:0/2514887178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc48106fa0 0x7efc4819cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.504+0000 7efc50800640 1 --2- 172.21.15.86:0/2514887178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc481065f0 0x7efc4819c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.504+0000 7efc50800640 1 -- 172.21.15.86:0/2514887178 >> 172.21.15.86:0/2514887178 conn(0x7efc48075d10 msgr2=0x7efc48077210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.505+0000 7efc50800640 1 -- 172.21.15.86:0/2514887178 shutdown_connections 2024-09-13T16:09:46.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:46.505+0000 7efc50800640 1 -- 172.21.15.86:0/2514887178 wait complete. 2024-09-13T16:09:46.923 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:46 smithi086 ceph-mon[30379]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:09:46.923 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:46 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2514887178' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-13T16:09:46.952 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037802 got 257698037808 for osd.8 2024-09-13T16:09:46.952 DEBUG:teuthology.parallel:result is None 2024-09-13T16:09:46.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:46 smithi139 ceph-mon[35320]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:09:46.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:46 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2514887178' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-13T16:09:47.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:46 smithi194 ceph-mon[35694]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:09:47.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:46 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2514887178' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-13T16:09:47.787 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299436 got 223338299445 for osd.7 2024-09-13T16:09:47.787 DEBUG:teuthology.parallel:result is None 2024-09-13T16:09:47.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.517+0000 7f1e24800640 1 -- 172.21.15.86:0/2682175973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e1c105110 msgr2=0x7f1e1c10cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:47.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.517+0000 7f1e24800640 1 --2- 172.21.15.86:0/2682175973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e1c105110 0x7f1e1c10cc90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009cd0 tx=0x7f1e1802a8e0 comp rx=0 tx=0).stop 2024-09-13T16:09:47.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.517+0000 7f1e24800640 1 -- 172.21.15.86:0/2682175973 shutdown_connections 2024-09-13T16:09:47.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.517+0000 7f1e24800640 1 --2- 172.21.15.86:0/2682175973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e1c105110 0x7f1e1c10cc90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:47.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.517+0000 7f1e24800640 1 --2- 172.21.15.86:0/2682175973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e1c100990 0x7f1e1c1049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:47.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.517+0000 7f1e24800640 1 --2- 172.21.15.86:0/2682175973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e1c0fffe0 0x7f1e1c1003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:47.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.518+0000 7f1e24800640 1 -- 172.21.15.86:0/2682175973 >> 172.21.15.86:0/2682175973 conn(0x7f1e1c0fba80 msgr2=0x7f1e1c0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:47.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.518+0000 7f1e24800640 1 -- 172.21.15.86:0/2682175973 shutdown_connections 2024-09-13T16:09:47.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.518+0000 7f1e24800640 1 -- 172.21.15.86:0/2682175973 wait complete. 2024-09-13T16:09:47.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.519+0000 7f1e24800640 1 Processor -- start 2024-09-13T16:09:47.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.519+0000 7f1e24800640 1 -- start start 2024-09-13T16:09:47.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.519+0000 7f1e24800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e1c0fffe0 0x7f1e1c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:47.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.519+0000 7f1e24800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e1c100990 0x7f1e1c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:47.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.519+0000 7f1e24800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e1c105110 0x7f1e1c073230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.519+0000 7f1e24800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c1a47d0 con 0x7f1e1c105110 2024-09-13T16:09:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.519+0000 7f1e24800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c1a4940 con 0x7f1e1c0fffe0 2024-09-13T16:09:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.519+0000 7f1e24800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c1a4b00 con 0x7f1e1c100990 2024-09-13T16:09:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.519+0000 7f1e21e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e1c0fffe0 0x7f1e1c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.519+0000 7f1e21e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e1c0fffe0 0x7f1e1c0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:34474/0 (socket says 172.21.15.86:34474) 2024-09-13T16:09:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.520+0000 7f1e21e00640 1 -- 172.21.15.86:0/2138090085 learned_addr learned my addr 172.21.15.86:0/2138090085 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.520+0000 7f1e21400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e1c100990 0x7f1e1c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.520+0000 7f1e22800640 1 --2- 172.21.15.86:0/2138090085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e1c105110 0x7f1e1c073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.520+0000 7f1e21e00640 1 -- 172.21.15.86:0/2138090085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e1c100990 msgr2=0x7f1e1c072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.520+0000 7f1e21e00640 1 --2- 172.21.15.86:0/2138090085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e1c100990 0x7f1e1c072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.520+0000 7f1e21e00640 1 -- 172.21.15.86:0/2138090085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e1c105110 msgr2=0x7f1e1c073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:47.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.520+0000 7f1e21e00640 1 --2- 172.21.15.86:0/2138090085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e1c105110 0x7f1e1c073230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:47.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.520+0000 7f1e21e00640 1 -- 172.21.15.86:0/2138090085 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e18009900 con 0x7f1e1c0fffe0 2024-09-13T16:09:47.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.520+0000 7f1e22800640 1 --2- 172.21.15.86:0/2138090085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e1c105110 0x7f1e1c073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:09:47.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.520+0000 7f1e21400640 1 --2- 172.21.15.86:0/2138090085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e1c100990 0x7f1e1c072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:09:47.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.520+0000 7f1e21e00640 1 --2- 172.21.15.86:0/2138090085 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e1c0fffe0 0x7f1e1c0727b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1e1000d950 tx=0x7f1e1000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:47.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.521+0000 7f1e16a00640 1 -- 172.21.15.86:0/2138090085 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10009a30 con 0x7f1e1c0fffe0 2024-09-13T16:09:47.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.521+0000 7f1e24800640 1 -- 172.21.15.86:0/2138090085 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1c1a4de0 con 0x7f1e1c0fffe0 2024-09-13T16:09:47.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.521+0000 7f1e16a00640 1 -- 172.21.15.86:0/2138090085 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1e10009b90 con 0x7f1e1c0fffe0 2024-09-13T16:09:47.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.521+0000 7f1e16a00640 1 -- 172.21.15.86:0/2138090085 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10004a00 con 0x7f1e1c0fffe0 2024-09-13T16:09:47.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.521+0000 7f1e24800640 1 -- 172.21.15.86:0/2138090085 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1c1a5260 con 0x7f1e1c0fffe0 2024-09-13T16:09:47.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.522+0000 7f1e24800640 1 -- 172.21.15.86:0/2138090085 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1c1014c0 con 0x7f1e1c0fffe0 2024-09-13T16:09:47.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.524+0000 7f1e16a00640 1 -- 172.21.15.86:0/2138090085 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1e10009d00 con 0x7f1e1c0fffe0 2024-09-13T16:09:47.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.525+0000 7f1e16a00640 1 --2- 172.21.15.86:0/2138090085 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1e040a1110 0x7f1e040a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:47.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.525+0000 7f1e16a00640 1 -- 172.21.15.86:0/2138090085 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1e100cc730 con 0x7f1e1c0fffe0 2024-09-13T16:09:47.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.525+0000 7f1e21400640 1 --2- 172.21.15.86:0/2138090085 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1e040a1110 0x7f1e040a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:47.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.526+0000 7f1e21400640 1 --2- 172.21.15.86:0/2138090085 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1e040a1110 0x7f1e040a35d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c074260 tx=0x7f1e0c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:47.950 INFO:teuthology.orchestra.run.smithi086.stdout:111669149769 2024-09-13T16:09:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.527+0000 7f1e16a00640 1 -- 172.21.15.86:0/2138090085 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1e100959f0 con 0x7f1e1c0fffe0 2024-09-13T16:09:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.701+0000 7f1e24800640 1 -- 172.21.15.86:0/2138090085 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1e1c1003c0 con 0x7f1e1c0fffe0 2024-09-13T16:09:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.702+0000 7f1e16a00640 1 -- 172.21.15.86:0/2138090085 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e10017090 con 0x7f1e1c0fffe0 2024-09-13T16:09:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.704+0000 7f1e24800640 1 -- 172.21.15.86:0/2138090085 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1e040a1110 msgr2=0x7f1e040a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.704+0000 7f1e24800640 1 --2- 172.21.15.86:0/2138090085 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1e040a1110 0x7f1e040a35d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c074260 tx=0x7f1e0c00b410 comp rx=0 tx=0).stop 2024-09-13T16:09:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.704+0000 7f1e24800640 1 -- 172.21.15.86:0/2138090085 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e1c0fffe0 msgr2=0x7f1e1c0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.704+0000 7f1e24800640 1 --2- 172.21.15.86:0/2138090085 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e1c0fffe0 0x7f1e1c0727b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1e1000d950 tx=0x7f1e1000de10 comp rx=0 tx=0).stop 2024-09-13T16:09:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.704+0000 7f1e24800640 1 -- 172.21.15.86:0/2138090085 shutdown_connections 2024-09-13T16:09:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.704+0000 7f1e24800640 1 --2- 172.21.15.86:0/2138090085 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f1e040a1110 0x7f1e040a35d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.704+0000 7f1e24800640 1 --2- 172.21.15.86:0/2138090085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e1c105110 0x7f1e1c073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.704+0000 7f1e24800640 1 --2- 172.21.15.86:0/2138090085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e1c100990 0x7f1e1c072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.704+0000 7f1e24800640 1 --2- 172.21.15.86:0/2138090085 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e1c0fffe0 0x7f1e1c0727b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:47.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.704+0000 7f1e24800640 1 -- 172.21.15.86:0/2138090085 >> 172.21.15.86:0/2138090085 conn(0x7f1e1c0fba80 msgr2=0x7f1e1c0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:47.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.704+0000 7f1e24800640 1 -- 172.21.15.86:0/2138090085 shutdown_connections 2024-09-13T16:09:47.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:47.704+0000 7f1e24800640 1 -- 172.21.15.86:0/2138090085 wait complete. 2024-09-13T16:09:48.598 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149764 got 111669149769 for osd.3 2024-09-13T16:09:48.598 DEBUG:teuthology.parallel:result is None 2024-09-13T16:09:48.599 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-13T16:09:48.599 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T16:09:48.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:48 smithi086 ceph-mon[30379]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:09:48.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:48 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2138090085' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T16:09:48.915 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:09:48.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:48 smithi139 ceph-mon[35320]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:09:48.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:48 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2138090085' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T16:09:49.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:48 smithi194 ceph-mon[35694]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:09:49.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:48 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2138090085' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T16:09:50.824 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:50 smithi086 ceph-mon[30379]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:09:50.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.933+0000 7f5096600640 1 -- 172.21.15.86:0/466455214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5090105110 msgr2=0x7f509010cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:50.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.933+0000 7f5096600640 1 --2- 172.21.15.86:0/466455214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5090105110 0x7f509010cc90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5088009cd0 tx=0x7f508802a8f0 comp rx=0 tx=0).stop 2024-09-13T16:09:50.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.933+0000 7f5096600640 1 -- 172.21.15.86:0/466455214 shutdown_connections 2024-09-13T16:09:50.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.933+0000 7f5096600640 1 --2- 172.21.15.86:0/466455214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5090105110 0x7f509010cc90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:50.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.933+0000 7f5096600640 1 --2- 172.21.15.86:0/466455214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5090100990 0x7f50901049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:50.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.933+0000 7f5096600640 1 --2- 172.21.15.86:0/466455214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50900fffe0 0x7f50901003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:50.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.933+0000 7f5096600640 1 -- 172.21.15.86:0/466455214 >> 172.21.15.86:0/466455214 conn(0x7f50900fba80 msgr2=0x7f50900fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:50.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.933+0000 7f5096600640 1 -- 172.21.15.86:0/466455214 shutdown_connections 2024-09-13T16:09:50.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.933+0000 7f5096600640 1 -- 172.21.15.86:0/466455214 wait complete. 2024-09-13T16:09:50.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.934+0000 7f5096600640 1 Processor -- start 2024-09-13T16:09:50.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.934+0000 7f5096600640 1 -- start start 2024-09-13T16:09:50.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.935+0000 7f5096600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50900fffe0 0x7f50901985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:50.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.935+0000 7f5096600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5090100990 0x7f5090198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:50.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.935+0000 7f5096600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5090105110 0x7f509019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:50.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.935+0000 7f5096600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509019d420 con 0x7f50900fffe0 2024-09-13T16:09:50.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.935+0000 7f5096600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509019d590 con 0x7f5090105110 2024-09-13T16:09:50.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.935+0000 7f5096600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509019d700 con 0x7f5090100990 2024-09-13T16:09:50.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.935+0000 7f508f400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50900fffe0 0x7f50901985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:50.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.935+0000 7f508f400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50900fffe0 0x7f50901985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39050/0 (socket says 172.21.15.86:39050) 2024-09-13T16:09:50.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.935+0000 7f5087e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5090100990 0x7f5090198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:50.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.935+0000 7f508f400640 1 -- 172.21.15.86:0/3143003974 learned_addr learned my addr 172.21.15.86:0/3143003974 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:50.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.935+0000 7f508fe00640 1 --2- 172.21.15.86:0/3143003974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5090105110 0x7f509019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:50.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.935+0000 7f5087e00640 1 -- 172.21.15.86:0/3143003974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5090105110 msgr2=0x7f509019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:50.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.935+0000 7f5087e00640 1 --2- 172.21.15.86:0/3143003974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5090105110 0x7f509019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:50.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.935+0000 7f5087e00640 1 -- 172.21.15.86:0/3143003974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50900fffe0 msgr2=0x7f50901985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:50.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.935+0000 7f5087e00640 1 --2- 172.21.15.86:0/3143003974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50900fffe0 0x7f50901985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:50.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.935+0000 7f5087e00640 1 -- 172.21.15.86:0/3143003974 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5088009900 con 0x7f5090100990 2024-09-13T16:09:50.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.935+0000 7f508f400640 1 --2- 172.21.15.86:0/3143003974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50900fffe0 0x7f50901985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:09:50.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.935+0000 7f508fe00640 1 --2- 172.21.15.86:0/3143003974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5090105110 0x7f509019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:09:50.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.936+0000 7f5087e00640 1 --2- 172.21.15.86:0/3143003974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5090100990 0x7f5090198ae0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f507800e9f0 tx=0x7f507800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:50.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.936+0000 7f508cc00640 1 -- 172.21.15.86:0/3143003974 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507800ccc0 con 0x7f5090100990 2024-09-13T16:09:50.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.936+0000 7f5096600640 1 -- 172.21.15.86:0/3143003974 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509019d9e0 con 0x7f5090100990 2024-09-13T16:09:50.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.936+0000 7f508cc00640 1 -- 172.21.15.86:0/3143003974 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f507800ce20 con 0x7f5090100990 2024-09-13T16:09:50.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.936+0000 7f508cc00640 1 -- 172.21.15.86:0/3143003974 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5078004a00 con 0x7f5090100990 2024-09-13T16:09:50.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.936+0000 7f5096600640 1 -- 172.21.15.86:0/3143003974 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50901a52a0 con 0x7f5090100990 2024-09-13T16:09:50.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.937+0000 7f5096600640 1 -- 172.21.15.86:0/3143003974 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50901014c0 con 0x7f5090100990 2024-09-13T16:09:50.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.940+0000 7f508cc00640 1 -- 172.21.15.86:0/3143003974 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5078004b60 con 0x7f5090100990 2024-09-13T16:09:50.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.941+0000 7f508cc00640 1 --2- 172.21.15.86:0/3143003974 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f50740a1110 0x7f50740a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:50.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.941+0000 7f508cc00640 1 -- 172.21.15.86:0/3143003974 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5078014070 con 0x7f5090100990 2024-09-13T16:09:50.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.941+0000 7f508f400640 1 --2- 172.21.15.86:0/3143003974 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f50740a1110 0x7f50740a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:50.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.942+0000 7f508f400640 1 --2- 172.21.15.86:0/3143003974 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f50740a1110 0x7f50740a35d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5080005fd0 tx=0x7f508000b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:50.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:50.943+0000 7f508cc00640 1 -- 172.21.15.86:0/3143003974 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f50780967d0 con 0x7f5090100990 2024-09-13T16:09:50.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:50 smithi139 ceph-mon[35320]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:09:51.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:50 smithi194 ceph-mon[35694]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:09:51.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:51.108+0000 7f5096600640 1 -- 172.21.15.86:0/3143003974 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f509010ff00 con 0x7f50740a1110 2024-09-13T16:09:51.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:51.120+0000 7f508cc00640 1 -- 172.21.15.86:0/3143003974 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+428097 (secure 0 0 0) 0x7f509010ff00 con 0x7f50740a1110 2024-09-13T16:09:51.126 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:09:51.129 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-09-13T16:09:51.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:51.126+0000 7f5096600640 1 -- 172.21.15.86:0/3143003974 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f50740a1110 msgr2=0x7f50740a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:51.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:51.126+0000 7f5096600640 1 --2- 172.21.15.86:0/3143003974 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f50740a1110 0x7f50740a35d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5080005fd0 tx=0x7f508000b480 comp rx=0 tx=0).stop 2024-09-13T16:09:51.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:51.126+0000 7f5096600640 1 -- 172.21.15.86:0/3143003974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5090100990 msgr2=0x7f5090198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:51.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:51.126+0000 7f5096600640 1 --2- 172.21.15.86:0/3143003974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5090100990 0x7f5090198ae0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f507800e9f0 tx=0x7f507800eeb0 comp rx=0 tx=0).stop 2024-09-13T16:09:51.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:51.126+0000 7f5096600640 1 -- 172.21.15.86:0/3143003974 shutdown_connections 2024-09-13T16:09:51.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:51.126+0000 7f5096600640 1 --2- 172.21.15.86:0/3143003974 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f50740a1110 0x7f50740a35d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:51.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:51.126+0000 7f5096600640 1 --2- 172.21.15.86:0/3143003974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5090105110 0x7f509019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:51.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:51.126+0000 7f5096600640 1 --2- 172.21.15.86:0/3143003974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5090100990 0x7f5090198ae0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:51.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:51.126+0000 7f5096600640 1 --2- 172.21.15.86:0/3143003974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50900fffe0 0x7f50901985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:51.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:51.126+0000 7f5096600640 1 -- 172.21.15.86:0/3143003974 >> 172.21.15.86:0/3143003974 conn(0x7f50900fba80 msgr2=0x7f50900fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:51.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:51.126+0000 7f5096600640 1 -- 172.21.15.86:0/3143003974 shutdown_connections 2024-09-13T16:09:51.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:51.126+0000 7f5096600640 1 -- 172.21.15.86:0/3143003974 wait complete. 2024-09-13T16:09:52.035 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2024-09-13T16:09:49.357393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656795,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":597,"num_read_kb":413,"num_write":342,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":383452,"kb_used_data":14120,"kb_used_omap":18,"kb_used_meta":369133,"kb_avail":1124558372,"statfs":{"total":1151940427776,"available":1151547772928,"internally_reserved":0,"allocated":14458880,"data_stored":7981393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19130,"internal_metadata":377992518},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003488"},"pg_stats":[{"pgid":"2.1f","version":"90'9","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519774+0000","last_change":"2024-09-13T16:08:08.808610+0000","last_active":"2024-09-13T16:08:59.519774+0000","last_peered":"2024-09-13T16:08:59.519774+0000","last_clean":"2024-09-13T16:08:59.519774+0000","last_became_active":"2024-09-13T16:08:08.808267+0000","last_became_peered":"2024-09-13T16:08:08.808267+0000","last_unstale":"2024-09-13T16:08:59.519774+0000","last_undegraded":"2024-09-13T16:08:59.519774+0000","last_fullsized":"2024-09-13T16:08:59.519774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:56.867501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.620979+0000","last_change":"2024-09-13T16:09:00.620135+0000","last_active":"2024-09-13T16:09:00.620979+0000","last_peered":"2024-09-13T16:09:00.620979+0000","last_clean":"2024-09-13T16:09:00.620979+0000","last_became_active":"2024-09-13T16:09:00.619755+0000","last_became_peered":"2024-09-13T16:09:00.619755+0000","last_unstale":"2024-09-13T16:09:00.620979+0000","last_undegraded":"2024-09-13T16:09:00.620979+0000","last_fullsized":"2024-09-13T16:09:00.620979+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:49.150102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.521816+0000","last_change":"2024-09-13T16:08:13.245650+0000","last_active":"2024-09-13T16:08:59.521816+0000","last_peered":"2024-09-13T16:08:59.521816+0000","last_clean":"2024-09-13T16:08:59.521816+0000","last_became_active":"2024-09-13T16:08:13.245346+0000","last_became_peered":"2024-09-13T16:08:13.245346+0000","last_unstale":"2024-09-13T16:08:59.521816+0000","last_undegraded":"2024-09-13T16:08:59.521816+0000","last_fullsized":"2024-09-13T16:08:59.521816+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:49.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523107+0000","last_change":"2024-09-13T16:08:08.820385+0000","last_active":"2024-09-13T16:08:59.523107+0000","last_peered":"2024-09-13T16:08:59.523107+0000","last_clean":"2024-09-13T16:08:59.523107+0000","last_became_active":"2024-09-13T16:08:08.819874+0000","last_became_peered":"2024-09-13T16:08:08.819874+0000","last_unstale":"2024-09-13T16:08:59.523107+0000","last_undegraded":"2024-09-13T16:08:59.523107+0000","last_fullsized":"2024-09-13T16:08:59.523107+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:02.566058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528650+0000","last_change":"2024-09-13T16:08:09.235517+0000","last_active":"2024-09-13T16:08:59.528650+0000","last_peered":"2024-09-13T16:08:59.528650+0000","last_clean":"2024-09-13T16:08:59.528650+0000","last_became_active":"2024-09-13T16:08:09.235157+0000","last_became_peered":"2024-09-13T16:08:09.235157+0000","last_unstale":"2024-09-13T16:08:59.528650+0000","last_undegraded":"2024-09-13T16:08:59.528650+0000","last_fullsized":"2024-09-13T16:08:59.528650+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:11.651025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.526924+0000","last_change":"2024-09-13T16:08:13.243422+0000","last_active":"2024-09-13T16:08:59.526924+0000","last_peered":"2024-09-13T16:08:59.526924+0000","last_clean":"2024-09-13T16:08:59.526924+0000","last_became_active":"2024-09-13T16:08:13.243075+0000","last_became_peered":"2024-09-13T16:08:13.243075+0000","last_unstale":"2024-09-13T16:08:59.526924+0000","last_undegraded":"2024-09-13T16:08:59.526924+0000","last_fullsized":"2024-09-13T16:08:59.526924+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:56.457343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.526120+0000","last_change":"2024-09-13T16:08:08.807410+0000","last_active":"2024-09-13T16:08:59.526120+0000","last_peered":"2024-09-13T16:08:59.526120+0000","last_clean":"2024-09-13T16:08:59.526120+0000","last_became_active":"2024-09-13T16:08:08.807041+0000","last_became_peered":"2024-09-13T16:08:08.807041+0000","last_unstale":"2024-09-13T16:08:59.526120+0000","last_undegraded":"2024-09-13T16:08:59.526120+0000","last_fullsized":"2024-09-13T16:08:59.526120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:58.198019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.529642+0000","last_change":"2024-09-13T16:08:09.228643+0000","last_active":"2024-09-13T16:08:59.529642+0000","last_peered":"2024-09-13T16:08:59.529642+0000","last_clean":"2024-09-13T16:08:59.529642+0000","last_became_active":"2024-09-13T16:08:09.228329+0000","last_became_peered":"2024-09-13T16:08:09.228329+0000","last_unstale":"2024-09-13T16:08:59.529642+0000","last_undegraded":"2024-09-13T16:08:59.529642+0000","last_fullsized":"2024-09-13T16:08:59.529642+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:03.306471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527999+0000","last_change":"2024-09-13T16:08:13.250671+0000","last_active":"2024-09-13T16:08:59.527999+0000","last_peered":"2024-09-13T16:08:59.527999+0000","last_clean":"2024-09-13T16:08:59.527999+0000","last_became_active":"2024-09-13T16:08:13.250267+0000","last_became_peered":"2024-09-13T16:08:13.250267+0000","last_unstale":"2024-09-13T16:08:59.527999+0000","last_undegraded":"2024-09-13T16:08:59.527999+0000","last_fullsized":"2024-09-13T16:08:59.527999+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:30.939774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.526340+0000","last_change":"2024-09-13T16:08:08.805379+0000","last_active":"2024-09-13T16:08:59.526340+0000","last_peered":"2024-09-13T16:08:59.526340+0000","last_clean":"2024-09-13T16:08:59.526340+0000","last_became_active":"2024-09-13T16:08:08.804848+0000","last_became_peered":"2024-09-13T16:08:08.804848+0000","last_unstale":"2024-09-13T16:08:59.526340+0000","last_undegraded":"2024-09-13T16:08:59.526340+0000","last_fullsized":"2024-09-13T16:08:59.526340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:46.380684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.607048+0000","last_change":"2024-09-13T16:09:00.607048+0000","last_active":"2024-09-13T16:09:00.607048+0000","last_peered":"2024-09-13T16:09:00.607048+0000","last_clean":"2024-09-13T16:09:00.607048+0000","last_became_active":"2024-09-13T16:09:00.606708+0000","last_became_peered":"2024-09-13T16:09:00.606708+0000","last_unstale":"2024-09-13T16:09:00.607048+0000","last_undegraded":"2024-09-13T16:09:00.607048+0000","last_fullsized":"2024-09-13T16:09:00.607048+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:47.971033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527090+0000","last_change":"2024-09-13T16:08:13.244886+0000","last_active":"2024-09-13T16:08:59.527090+0000","last_peered":"2024-09-13T16:08:59.527090+0000","last_clean":"2024-09-13T16:08:59.527090+0000","last_became_active":"2024-09-13T16:08:13.244476+0000","last_became_peered":"2024-09-13T16:08:13.244476+0000","last_unstale":"2024-09-13T16:08:59.527090+0000","last_undegraded":"2024-09-13T16:08:59.527090+0000","last_fullsized":"2024-09-13T16:08:59.527090+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:55.359807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519389+0000","last_change":"2024-09-13T16:08:09.234804+0000","last_active":"2024-09-13T16:08:59.519389+0000","last_peered":"2024-09-13T16:08:59.519389+0000","last_clean":"2024-09-13T16:08:59.519389+0000","last_became_active":"2024-09-13T16:08:09.234358+0000","last_became_peered":"2024-09-13T16:08:09.234358+0000","last_unstale":"2024-09-13T16:08:59.519389+0000","last_undegraded":"2024-09-13T16:08:59.519389+0000","last_fullsized":"2024-09-13T16:08:59.519389+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:48:51.454586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524866+0000","last_change":"2024-09-13T16:08:08.807412+0000","last_active":"2024-09-13T16:08:59.524866+0000","last_peered":"2024-09-13T16:08:59.524866+0000","last_clean":"2024-09-13T16:08:59.524866+0000","last_became_active":"2024-09-13T16:08:08.806940+0000","last_became_peered":"2024-09-13T16:08:08.806940+0000","last_unstale":"2024-09-13T16:08:59.524866+0000","last_undegraded":"2024-09-13T16:08:59.524866+0000","last_fullsized":"2024-09-13T16:08:59.524866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:38.678823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527222+0000","last_change":"2024-09-13T16:08:13.494327+0000","last_active":"2024-09-13T16:08:59.527222+0000","last_peered":"2024-09-13T16:08:59.527222+0000","last_clean":"2024-09-13T16:08:59.527222+0000","last_became_active":"2024-09-13T16:08:13.493850+0000","last_became_peered":"2024-09-13T16:08:13.493850+0000","last_unstale":"2024-09-13T16:08:59.527222+0000","last_undegraded":"2024-09-13T16:08:59.527222+0000","last_fullsized":"2024-09-13T16:08:59.527222+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:12.123640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523663+0000","last_change":"2024-09-13T16:08:09.233638+0000","last_active":"2024-09-13T16:08:59.523663+0000","last_peered":"2024-09-13T16:08:59.523663+0000","last_clean":"2024-09-13T16:08:59.523663+0000","last_became_active":"2024-09-13T16:08:09.233323+0000","last_became_peered":"2024-09-13T16:08:09.233323+0000","last_unstale":"2024-09-13T16:08:59.523663+0000","last_undegraded":"2024-09-13T16:08:59.523663+0000","last_fullsized":"2024-09-13T16:08:59.523663+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:47.313442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.521945+0000","last_change":"2024-09-13T16:08:08.820002+0000","last_active":"2024-09-13T16:08:59.521945+0000","last_peered":"2024-09-13T16:08:59.521945+0000","last_clean":"2024-09-13T16:08:59.521945+0000","last_became_active":"2024-09-13T16:08:08.819675+0000","last_became_peered":"2024-09-13T16:08:08.819675+0000","last_unstale":"2024-09-13T16:08:59.521945+0000","last_undegraded":"2024-09-13T16:08:59.521945+0000","last_fullsized":"2024-09-13T16:08:59.521945+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:13.691478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527206+0000","last_change":"2024-09-13T16:08:13.257847+0000","last_active":"2024-09-13T16:08:59.527206+0000","last_peered":"2024-09-13T16:08:59.527206+0000","last_clean":"2024-09-13T16:08:59.527206+0000","last_became_active":"2024-09-13T16:08:13.257472+0000","last_became_peered":"2024-09-13T16:08:13.257472+0000","last_unstale":"2024-09-13T16:08:59.527206+0000","last_undegraded":"2024-09-13T16:08:59.527206+0000","last_fullsized":"2024-09-13T16:08:59.527206+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:53.002153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528423+0000","last_change":"2024-09-13T16:08:09.221868+0000","last_active":"2024-09-13T16:08:59.528423+0000","last_peered":"2024-09-13T16:08:59.528423+0000","last_clean":"2024-09-13T16:08:59.528423+0000","last_became_active":"2024-09-13T16:08:09.221130+0000","last_became_peered":"2024-09-13T16:08:09.221130+0000","last_unstale":"2024-09-13T16:08:59.528423+0000","last_undegraded":"2024-09-13T16:08:59.528423+0000","last_fullsized":"2024-09-13T16:08:59.528423+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:12:54.102303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522928+0000","last_change":"2024-09-13T16:08:08.807413+0000","last_active":"2024-09-13T16:08:59.522928+0000","last_peered":"2024-09-13T16:08:59.522928+0000","last_clean":"2024-09-13T16:08:59.522928+0000","last_became_active":"2024-09-13T16:08:08.807040+0000","last_became_peered":"2024-09-13T16:08:08.807040+0000","last_unstale":"2024-09-13T16:08:59.522928+0000","last_undegraded":"2024-09-13T16:08:59.522928+0000","last_fullsized":"2024-09-13T16:08:59.522928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:00.580572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519503+0000","last_change":"2024-09-13T16:08:13.257060+0000","last_active":"2024-09-13T16:08:59.519503+0000","last_peered":"2024-09-13T16:08:59.519503+0000","last_clean":"2024-09-13T16:08:59.519503+0000","last_became_active":"2024-09-13T16:08:13.256665+0000","last_became_peered":"2024-09-13T16:08:13.256665+0000","last_unstale":"2024-09-13T16:08:59.519503+0000","last_undegraded":"2024-09-13T16:08:59.519503+0000","last_fullsized":"2024-09-13T16:08:59.519503+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:33.139558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524978+0000","last_change":"2024-09-13T16:08:09.231289+0000","last_active":"2024-09-13T16:08:59.524978+0000","last_peered":"2024-09-13T16:08:59.524978+0000","last_clean":"2024-09-13T16:08:59.524978+0000","last_became_active":"2024-09-13T16:08:09.230247+0000","last_became_peered":"2024-09-13T16:08:09.230247+0000","last_unstale":"2024-09-13T16:08:59.524978+0000","last_undegraded":"2024-09-13T16:08:59.524978+0000","last_fullsized":"2024-09-13T16:08:59.524978+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:34.765694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.529129+0000","last_change":"2024-09-13T16:08:08.797980+0000","last_active":"2024-09-13T16:08:59.529129+0000","last_peered":"2024-09-13T16:08:59.529129+0000","last_clean":"2024-09-13T16:08:59.529129+0000","last_became_active":"2024-09-13T16:08:08.797601+0000","last_became_peered":"2024-09-13T16:08:08.797601+0000","last_unstale":"2024-09-13T16:08:59.529129+0000","last_undegraded":"2024-09-13T16:08:59.529129+0000","last_fullsized":"2024-09-13T16:08:59.529129+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:37.985497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527489+0000","last_change":"2024-09-13T16:08:13.494332+0000","last_active":"2024-09-13T16:08:59.527489+0000","last_peered":"2024-09-13T16:08:59.527489+0000","last_clean":"2024-09-13T16:08:59.527489+0000","last_became_active":"2024-09-13T16:08:13.493846+0000","last_became_peered":"2024-09-13T16:08:13.493846+0000","last_unstale":"2024-09-13T16:08:59.527489+0000","last_undegraded":"2024-09-13T16:08:59.527489+0000","last_fullsized":"2024-09-13T16:08:59.527489+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:08:17.342575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528343+0000","last_change":"2024-09-13T16:08:09.241373+0000","last_active":"2024-09-13T16:08:59.528343+0000","last_peered":"2024-09-13T16:08:59.528343+0000","last_clean":"2024-09-13T16:08:59.528343+0000","last_became_active":"2024-09-13T16:08:09.240846+0000","last_became_peered":"2024-09-13T16:08:09.240846+0000","last_unstale":"2024-09-13T16:08:59.528343+0000","last_undegraded":"2024-09-13T16:08:59.528343+0000","last_fullsized":"2024-09-13T16:08:59.528343+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:11.315423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527799+0000","last_change":"2024-09-13T16:08:08.805428+0000","last_active":"2024-09-13T16:08:59.527799+0000","last_peered":"2024-09-13T16:08:59.527799+0000","last_clean":"2024-09-13T16:08:59.527799+0000","last_became_active":"2024-09-13T16:08:08.805109+0000","last_became_peered":"2024-09-13T16:08:08.805109+0000","last_unstale":"2024-09-13T16:08:59.527799+0000","last_undegraded":"2024-09-13T16:08:59.527799+0000","last_fullsized":"2024-09-13T16:08:59.527799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:30.335761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.521947+0000","last_change":"2024-09-13T16:08:13.240929+0000","last_active":"2024-09-13T16:08:59.521947+0000","last_peered":"2024-09-13T16:08:59.521947+0000","last_clean":"2024-09-13T16:08:59.521947+0000","last_became_active":"2024-09-13T16:08:13.240554+0000","last_became_peered":"2024-09-13T16:08:13.240554+0000","last_unstale":"2024-09-13T16:08:59.521947+0000","last_undegraded":"2024-09-13T16:08:59.521947+0000","last_fullsized":"2024-09-13T16:08:59.521947+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:20.853764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523426+0000","last_change":"2024-09-13T16:08:09.225824+0000","last_active":"2024-09-13T16:08:59.523426+0000","last_peered":"2024-09-13T16:08:59.523426+0000","last_clean":"2024-09-13T16:08:59.523426+0000","last_became_active":"2024-09-13T16:08:09.225568+0000","last_became_peered":"2024-09-13T16:08:09.225568+0000","last_unstale":"2024-09-13T16:08:59.523426+0000","last_undegraded":"2024-09-13T16:08:59.523426+0000","last_fullsized":"2024-09-13T16:08:59.523426+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:05:13.423381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'6","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.520054+0000","last_change":"2024-09-13T16:08:08.812752+0000","last_active":"2024-09-13T16:08:59.520054+0000","last_peered":"2024-09-13T16:08:59.520054+0000","last_clean":"2024-09-13T16:08:59.520054+0000","last_became_active":"2024-09-13T16:08:08.810994+0000","last_became_peered":"2024-09-13T16:08:08.810994+0000","last_unstale":"2024-09-13T16:08:59.520054+0000","last_undegraded":"2024-09-13T16:08:59.520054+0000","last_fullsized":"2024-09-13T16:08:59.520054+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:46.449871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522057+0000","last_change":"2024-09-13T16:08:13.494450+0000","last_active":"2024-09-13T16:08:59.522057+0000","last_peered":"2024-09-13T16:08:59.522057+0000","last_clean":"2024-09-13T16:08:59.522057+0000","last_became_active":"2024-09-13T16:08:13.494008+0000","last_became_peered":"2024-09-13T16:08:13.494008+0000","last_unstale":"2024-09-13T16:08:59.522057+0000","last_undegraded":"2024-09-13T16:08:59.522057+0000","last_fullsized":"2024-09-13T16:08:59.522057+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:05.427801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524524+0000","last_change":"2024-09-13T16:08:09.220790+0000","last_active":"2024-09-13T16:08:59.524524+0000","last_peered":"2024-09-13T16:08:59.524524+0000","last_clean":"2024-09-13T16:08:59.524524+0000","last_became_active":"2024-09-13T16:08:09.219420+0000","last_became_peered":"2024-09-13T16:08:09.219420+0000","last_unstale":"2024-09-13T16:08:59.524524+0000","last_undegraded":"2024-09-13T16:08:59.524524+0000","last_fullsized":"2024-09-13T16:08:59.524524+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:29.674270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.526232+0000","last_change":"2024-09-13T16:08:08.815272+0000","last_active":"2024-09-13T16:08:59.526232+0000","last_peered":"2024-09-13T16:08:59.526232+0000","last_clean":"2024-09-13T16:08:59.526232+0000","last_became_active":"2024-09-13T16:08:08.815018+0000","last_became_peered":"2024-09-13T16:08:08.815018+0000","last_unstale":"2024-09-13T16:08:59.526232+0000","last_undegraded":"2024-09-13T16:08:59.526232+0000","last_fullsized":"2024-09-13T16:08:59.526232+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:29.277253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528456+0000","last_change":"2024-09-13T16:08:13.249856+0000","last_active":"2024-09-13T16:08:59.528456+0000","last_peered":"2024-09-13T16:08:59.528456+0000","last_clean":"2024-09-13T16:08:59.528456+0000","last_became_active":"2024-09-13T16:08:13.249433+0000","last_became_peered":"2024-09-13T16:08:13.249433+0000","last_unstale":"2024-09-13T16:08:59.528456+0000","last_undegraded":"2024-09-13T16:08:59.528456+0000","last_fullsized":"2024-09-13T16:08:59.528456+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:18.805858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522019+0000","last_change":"2024-09-13T16:08:09.239244+0000","last_active":"2024-09-13T16:08:59.522019+0000","last_peered":"2024-09-13T16:08:59.522019+0000","last_clean":"2024-09-13T16:08:59.522019+0000","last_became_active":"2024-09-13T16:08:09.238966+0000","last_became_peered":"2024-09-13T16:08:09.238966+0000","last_unstale":"2024-09-13T16:08:59.522019+0000","last_undegraded":"2024-09-13T16:08:59.522019+0000","last_fullsized":"2024-09-13T16:08:59.522019+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:16:48.832090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519318+0000","last_change":"2024-09-13T16:08:08.813429+0000","last_active":"2024-09-13T16:08:59.519318+0000","last_peered":"2024-09-13T16:08:59.519318+0000","last_clean":"2024-09-13T16:08:59.519318+0000","last_became_active":"2024-09-13T16:08:08.810497+0000","last_became_peered":"2024-09-13T16:08:08.810497+0000","last_unstale":"2024-09-13T16:08:59.519318+0000","last_undegraded":"2024-09-13T16:08:59.519318+0000","last_fullsized":"2024-09-13T16:08:59.519318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:59.728094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524524+0000","last_change":"2024-09-13T16:08:13.494341+0000","last_active":"2024-09-13T16:08:59.524524+0000","last_peered":"2024-09-13T16:08:59.524524+0000","last_clean":"2024-09-13T16:08:59.524524+0000","last_became_active":"2024-09-13T16:08:13.493851+0000","last_became_peered":"2024-09-13T16:08:13.493851+0000","last_unstale":"2024-09-13T16:08:59.524524+0000","last_undegraded":"2024-09-13T16:08:59.524524+0000","last_fullsized":"2024-09-13T16:08:59.524524+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:27.389086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.521998+0000","last_change":"2024-09-13T16:08:09.241722+0000","last_active":"2024-09-13T16:08:59.521998+0000","last_peered":"2024-09-13T16:08:59.521998+0000","last_clean":"2024-09-13T16:08:59.521998+0000","last_became_active":"2024-09-13T16:08:09.241270+0000","last_became_peered":"2024-09-13T16:08:09.241270+0000","last_unstale":"2024-09-13T16:08:59.521998+0000","last_undegraded":"2024-09-13T16:08:59.521998+0000","last_fullsized":"2024-09-13T16:08:59.521998+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:38.909163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519617+0000","last_change":"2024-09-13T16:08:08.807099+0000","last_active":"2024-09-13T16:08:59.519617+0000","last_peered":"2024-09-13T16:08:59.519617+0000","last_clean":"2024-09-13T16:08:59.519617+0000","last_became_active":"2024-09-13T16:08:08.806760+0000","last_became_peered":"2024-09-13T16:08:08.806760+0000","last_unstale":"2024-09-13T16:08:59.519617+0000","last_undegraded":"2024-09-13T16:08:59.519617+0000","last_fullsized":"2024-09-13T16:08:59.519617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:31.077377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524080+0000","last_change":"2024-09-13T16:08:13.258033+0000","last_active":"2024-09-13T16:08:59.524080+0000","last_peered":"2024-09-13T16:08:59.524080+0000","last_clean":"2024-09-13T16:08:59.524080+0000","last_became_active":"2024-09-13T16:08:13.257195+0000","last_became_peered":"2024-09-13T16:08:13.257195+0000","last_unstale":"2024-09-13T16:08:59.524080+0000","last_undegraded":"2024-09-13T16:08:59.524080+0000","last_fullsized":"2024-09-13T16:08:59.524080+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:38.599985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524115+0000","last_change":"2024-09-13T16:08:09.223766+0000","last_active":"2024-09-13T16:08:59.524115+0000","last_peered":"2024-09-13T16:08:59.524115+0000","last_clean":"2024-09-13T16:08:59.524115+0000","last_became_active":"2024-09-13T16:08:09.223485+0000","last_became_peered":"2024-09-13T16:08:09.223485+0000","last_unstale":"2024-09-13T16:08:59.524115+0000","last_undegraded":"2024-09-13T16:08:59.524115+0000","last_fullsized":"2024-09-13T16:08:59.524115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:32.222545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":94,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:42.555411+0000","last_change":"2024-09-13T16:08:08.812793+0000","last_active":"2024-09-13T16:09:42.555411+0000","last_peered":"2024-09-13T16:09:42.555411+0000","last_clean":"2024-09-13T16:09:42.555411+0000","last_became_active":"2024-09-13T16:08:08.811513+0000","last_became_peered":"2024-09-13T16:08:08.811513+0000","last_unstale":"2024-09-13T16:09:42.555411+0000","last_undegraded":"2024-09-13T16:09:42.555411+0000","last_fullsized":"2024-09-13T16:09:42.555411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:42.396184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.525116+0000","last_change":"2024-09-13T16:08:13.494286+0000","last_active":"2024-09-13T16:08:59.525116+0000","last_peered":"2024-09-13T16:08:59.525116+0000","last_clean":"2024-09-13T16:08:59.525116+0000","last_became_active":"2024-09-13T16:08:13.493848+0000","last_became_peered":"2024-09-13T16:08:13.493848+0000","last_unstale":"2024-09-13T16:08:59.525116+0000","last_undegraded":"2024-09-13T16:08:59.525116+0000","last_fullsized":"2024-09-13T16:08:59.525116+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:45.466478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522804+0000","last_change":"2024-09-13T16:08:09.216137+0000","last_active":"2024-09-13T16:08:59.522804+0000","last_peered":"2024-09-13T16:08:59.522804+0000","last_clean":"2024-09-13T16:08:59.522804+0000","last_became_active":"2024-09-13T16:08:09.215801+0000","last_became_peered":"2024-09-13T16:08:09.215801+0000","last_unstale":"2024-09-13T16:08:59.522804+0000","last_undegraded":"2024-09-13T16:08:59.522804+0000","last_fullsized":"2024-09-13T16:08:59.522804+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:58.860711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519178+0000","last_change":"2024-09-13T16:08:08.804138+0000","last_active":"2024-09-13T16:08:59.519178+0000","last_peered":"2024-09-13T16:08:59.519178+0000","last_clean":"2024-09-13T16:08:59.519178+0000","last_became_active":"2024-09-13T16:08:08.803812+0000","last_became_peered":"2024-09-13T16:08:08.803812+0000","last_unstale":"2024-09-13T16:08:59.519178+0000","last_undegraded":"2024-09-13T16:08:59.519178+0000","last_fullsized":"2024-09-13T16:08:59.519178+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:39.388227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.529398+0000","last_change":"2024-09-13T16:09:00.529398+0000","last_active":"2024-09-13T16:09:00.529398+0000","last_peered":"2024-09-13T16:09:00.529398+0000","last_clean":"2024-09-13T16:09:00.529398+0000","last_became_active":"2024-09-13T16:09:00.528920+0000","last_became_peered":"2024-09-13T16:09:00.528920+0000","last_unstale":"2024-09-13T16:09:00.529398+0000","last_undegraded":"2024-09-13T16:09:00.529398+0000","last_fullsized":"2024-09-13T16:09:00.529398+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:59.689268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522463+0000","last_change":"2024-09-13T16:08:09.226177+0000","last_active":"2024-09-13T16:08:59.522463+0000","last_peered":"2024-09-13T16:08:59.522463+0000","last_clean":"2024-09-13T16:08:59.522463+0000","last_became_active":"2024-09-13T16:08:09.225334+0000","last_became_peered":"2024-09-13T16:08:09.225334+0000","last_unstale":"2024-09-13T16:08:59.522463+0000","last_undegraded":"2024-09-13T16:08:59.522463+0000","last_fullsized":"2024-09-13T16:08:59.522463+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:15.539497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527942+0000","last_change":"2024-09-13T16:08:08.807616+0000","last_active":"2024-09-13T16:08:59.527942+0000","last_peered":"2024-09-13T16:08:59.527942+0000","last_clean":"2024-09-13T16:08:59.527942+0000","last_became_active":"2024-09-13T16:08:08.807234+0000","last_became_peered":"2024-09-13T16:08:08.807234+0000","last_unstale":"2024-09-13T16:08:59.527942+0000","last_undegraded":"2024-09-13T16:08:59.527942+0000","last_fullsized":"2024-09-13T16:08:59.527942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:16.270075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":334,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.523013+0000","last_change":"2024-09-13T16:06:54.461102+0000","last_active":"2024-09-13T16:09:00.523013+0000","last_peered":"2024-09-13T16:09:00.523013+0000","last_clean":"2024-09-13T16:09:00.523013+0000","last_became_active":"2024-09-13T16:06:54.460531+0000","last_became_peered":"2024-09-13T16:06:54.460531+0000","last_unstale":"2024-09-13T16:09:00.523013+0000","last_undegraded":"2024-09-13T16:09:00.523013+0000","last_fullsized":"2024-09-13T16:09:00.523013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:03:28.200529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:03:28.200529+0000","last_clean_scrub_stamp":"2024-09-13T16:03:28.200529+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:30.260436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519500+0000","last_change":"2024-09-13T16:08:13.246406+0000","last_active":"2024-09-13T16:08:59.519500+0000","last_peered":"2024-09-13T16:08:59.519500+0000","last_clean":"2024-09-13T16:08:59.519500+0000","last_became_active":"2024-09-13T16:08:13.246026+0000","last_became_peered":"2024-09-13T16:08:13.246026+0000","last_unstale":"2024-09-13T16:08:59.519500+0000","last_undegraded":"2024-09-13T16:08:59.519500+0000","last_fullsized":"2024-09-13T16:08:59.519500+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:28.665873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519695+0000","last_change":"2024-09-13T16:08:09.233241+0000","last_active":"2024-09-13T16:08:59.519695+0000","last_peered":"2024-09-13T16:08:59.519695+0000","last_clean":"2024-09-13T16:08:59.519695+0000","last_became_active":"2024-09-13T16:08:09.232948+0000","last_became_peered":"2024-09-13T16:08:09.232948+0000","last_unstale":"2024-09-13T16:08:59.519695+0000","last_undegraded":"2024-09-13T16:08:59.519695+0000","last_fullsized":"2024-09-13T16:08:59.519695+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:09:45.475066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522390+0000","last_change":"2024-09-13T16:08:08.808529+0000","last_active":"2024-09-13T16:08:59.522390+0000","last_peered":"2024-09-13T16:08:59.522390+0000","last_clean":"2024-09-13T16:08:59.522390+0000","last_became_active":"2024-09-13T16:08:08.808147+0000","last_became_peered":"2024-09-13T16:08:08.808147+0000","last_unstale":"2024-09-13T16:08:59.522390+0000","last_undegraded":"2024-09-13T16:08:59.522390+0000","last_fullsized":"2024-09-13T16:08:59.522390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:20.003116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.529315+0000","last_change":"2024-09-13T16:08:13.254834+0000","last_active":"2024-09-13T16:08:59.529315+0000","last_peered":"2024-09-13T16:08:59.529315+0000","last_clean":"2024-09-13T16:08:59.529315+0000","last_became_active":"2024-09-13T16:08:13.254367+0000","last_became_peered":"2024-09-13T16:08:13.254367+0000","last_unstale":"2024-09-13T16:08:59.529315+0000","last_undegraded":"2024-09-13T16:08:59.529315+0000","last_fullsized":"2024-09-13T16:08:59.529315+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:41.300674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519762+0000","last_change":"2024-09-13T16:08:09.236082+0000","last_active":"2024-09-13T16:08:59.519762+0000","last_peered":"2024-09-13T16:08:59.519762+0000","last_clean":"2024-09-13T16:08:59.519762+0000","last_became_active":"2024-09-13T16:08:09.235750+0000","last_became_peered":"2024-09-13T16:08:09.235750+0000","last_unstale":"2024-09-13T16:08:59.519762+0000","last_undegraded":"2024-09-13T16:08:59.519762+0000","last_fullsized":"2024-09-13T16:08:59.519762+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:32.953680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524152+0000","last_change":"2024-09-13T16:08:08.804210+0000","last_active":"2024-09-13T16:08:59.524152+0000","last_peered":"2024-09-13T16:08:59.524152+0000","last_clean":"2024-09-13T16:08:59.524152+0000","last_became_active":"2024-09-13T16:08:08.803910+0000","last_became_peered":"2024-09-13T16:08:08.803910+0000","last_unstale":"2024-09-13T16:08:59.524152+0000","last_undegraded":"2024-09-13T16:08:59.524152+0000","last_fullsized":"2024-09-13T16:08:59.524152+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:43.572010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528155+0000","last_change":"2024-09-13T16:08:13.252873+0000","last_active":"2024-09-13T16:08:59.528155+0000","last_peered":"2024-09-13T16:08:59.528155+0000","last_clean":"2024-09-13T16:08:59.528155+0000","last_became_active":"2024-09-13T16:08:13.252051+0000","last_became_peered":"2024-09-13T16:08:13.252051+0000","last_unstale":"2024-09-13T16:08:59.528155+0000","last_undegraded":"2024-09-13T16:08:59.528155+0000","last_fullsized":"2024-09-13T16:08:59.528155+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:28.163552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519952+0000","last_change":"2024-09-13T16:08:09.228033+0000","last_active":"2024-09-13T16:08:59.519952+0000","last_peered":"2024-09-13T16:08:59.519952+0000","last_clean":"2024-09-13T16:08:59.519952+0000","last_became_active":"2024-09-13T16:08:09.227741+0000","last_became_peered":"2024-09-13T16:08:09.227741+0000","last_unstale":"2024-09-13T16:08:59.519952+0000","last_undegraded":"2024-09-13T16:08:59.519952+0000","last_fullsized":"2024-09-13T16:08:59.519952+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:49.607147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.525276+0000","last_change":"2024-09-13T16:08:08.812963+0000","last_active":"2024-09-13T16:08:59.525276+0000","last_peered":"2024-09-13T16:08:59.525276+0000","last_clean":"2024-09-13T16:08:59.525276+0000","last_became_active":"2024-09-13T16:08:08.812627+0000","last_became_peered":"2024-09-13T16:08:08.812627+0000","last_unstale":"2024-09-13T16:08:59.525276+0000","last_undegraded":"2024-09-13T16:08:59.525276+0000","last_fullsized":"2024-09-13T16:08:59.525276+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:11.237846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523980+0000","last_change":"2024-09-13T16:08:13.242146+0000","last_active":"2024-09-13T16:08:59.523980+0000","last_peered":"2024-09-13T16:08:59.523980+0000","last_clean":"2024-09-13T16:08:59.523980+0000","last_became_active":"2024-09-13T16:08:13.241794+0000","last_became_peered":"2024-09-13T16:08:13.241794+0000","last_unstale":"2024-09-13T16:08:59.523980+0000","last_undegraded":"2024-09-13T16:08:59.523980+0000","last_fullsized":"2024-09-13T16:08:59.523980+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:55.392157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.529457+0000","last_change":"2024-09-13T16:09:00.529457+0000","last_active":"2024-09-13T16:09:00.529457+0000","last_peered":"2024-09-13T16:09:00.529457+0000","last_clean":"2024-09-13T16:09:00.529457+0000","last_became_active":"2024-09-13T16:09:00.529130+0000","last_became_peered":"2024-09-13T16:09:00.529130+0000","last_unstale":"2024-09-13T16:09:00.529457+0000","last_undegraded":"2024-09-13T16:09:00.529457+0000","last_fullsized":"2024-09-13T16:09:00.529457+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:03.158466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7],"acting":[11,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.526522+0000","last_change":"2024-09-13T16:08:08.805604+0000","last_active":"2024-09-13T16:08:59.526522+0000","last_peered":"2024-09-13T16:08:59.526522+0000","last_clean":"2024-09-13T16:08:59.526522+0000","last_became_active":"2024-09-13T16:08:08.805285+0000","last_became_peered":"2024-09-13T16:08:08.805285+0000","last_unstale":"2024-09-13T16:08:59.526522+0000","last_undegraded":"2024-09-13T16:08:59.526522+0000","last_fullsized":"2024-09-13T16:08:59.526522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:53.534980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524283+0000","last_change":"2024-09-13T16:08:13.253080+0000","last_active":"2024-09-13T16:08:59.524283+0000","last_peered":"2024-09-13T16:08:59.524283+0000","last_clean":"2024-09-13T16:08:59.524283+0000","last_became_active":"2024-09-13T16:08:13.252803+0000","last_became_peered":"2024-09-13T16:08:13.252803+0000","last_unstale":"2024-09-13T16:08:59.524283+0000","last_undegraded":"2024-09-13T16:08:59.524283+0000","last_fullsized":"2024-09-13T16:08:59.524283+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:45.074295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.525305+0000","last_change":"2024-09-13T16:08:09.226784+0000","last_active":"2024-09-13T16:08:59.525305+0000","last_peered":"2024-09-13T16:08:59.525305+0000","last_clean":"2024-09-13T16:08:59.525305+0000","last_became_active":"2024-09-13T16:08:09.226464+0000","last_became_peered":"2024-09-13T16:08:09.226464+0000","last_unstale":"2024-09-13T16:08:59.525305+0000","last_undegraded":"2024-09-13T16:08:59.525305+0000","last_fullsized":"2024-09-13T16:08:59.525305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:42.808510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523298+0000","last_change":"2024-09-13T16:08:08.814647+0000","last_active":"2024-09-13T16:08:59.523298+0000","last_peered":"2024-09-13T16:08:59.523298+0000","last_clean":"2024-09-13T16:08:59.523298+0000","last_became_active":"2024-09-13T16:08:08.814325+0000","last_became_peered":"2024-09-13T16:08:08.814325+0000","last_unstale":"2024-09-13T16:08:59.523298+0000","last_undegraded":"2024-09-13T16:08:59.523298+0000","last_fullsized":"2024-09-13T16:08:59.523298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:15.358731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.525114+0000","last_change":"2024-09-13T16:08:13.259693+0000","last_active":"2024-09-13T16:08:59.525114+0000","last_peered":"2024-09-13T16:08:59.525114+0000","last_clean":"2024-09-13T16:08:59.525114+0000","last_became_active":"2024-09-13T16:08:13.254908+0000","last_became_peered":"2024-09-13T16:08:13.254908+0000","last_unstale":"2024-09-13T16:08:59.525114+0000","last_undegraded":"2024-09-13T16:08:59.525114+0000","last_fullsized":"2024-09-13T16:08:59.525114+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:57.130633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519066+0000","last_change":"2024-09-13T16:08:09.231371+0000","last_active":"2024-09-13T16:08:59.519066+0000","last_peered":"2024-09-13T16:08:59.519066+0000","last_clean":"2024-09-13T16:08:59.519066+0000","last_became_active":"2024-09-13T16:08:09.231054+0000","last_became_peered":"2024-09-13T16:08:09.231054+0000","last_unstale":"2024-09-13T16:08:59.519066+0000","last_undegraded":"2024-09-13T16:08:59.519066+0000","last_fullsized":"2024-09-13T16:08:59.519066+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:59.921297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'4","reported_seq":101,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:46.561840+0000","last_change":"2024-09-13T16:08:08.803541+0000","last_active":"2024-09-13T16:09:46.561840+0000","last_peered":"2024-09-13T16:09:46.561840+0000","last_clean":"2024-09-13T16:09:46.561840+0000","last_became_active":"2024-09-13T16:08:08.803183+0000","last_became_peered":"2024-09-13T16:08:08.803183+0000","last_unstale":"2024-09-13T16:09:46.561840+0000","last_undegraded":"2024-09-13T16:09:46.561840+0000","last_fullsized":"2024-09-13T16:09:46.561840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:09.210442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":932,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519584+0000","last_change":"2024-09-13T16:08:13.259229+0000","last_active":"2024-09-13T16:08:59.519584+0000","last_peered":"2024-09-13T16:08:59.519584+0000","last_clean":"2024-09-13T16:08:59.519584+0000","last_became_active":"2024-09-13T16:08:13.258625+0000","last_became_peered":"2024-09-13T16:08:13.258625+0000","last_unstale":"2024-09-13T16:08:59.519584+0000","last_undegraded":"2024-09-13T16:08:59.519584+0000","last_fullsized":"2024-09-13T16:08:59.519584+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:09.660175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519495+0000","last_change":"2024-09-13T16:08:09.229192+0000","last_active":"2024-09-13T16:08:59.519495+0000","last_peered":"2024-09-13T16:08:59.519495+0000","last_clean":"2024-09-13T16:08:59.519495+0000","last_became_active":"2024-09-13T16:08:09.227639+0000","last_became_peered":"2024-09-13T16:08:09.227639+0000","last_unstale":"2024-09-13T16:08:59.519495+0000","last_undegraded":"2024-09-13T16:08:59.519495+0000","last_fullsized":"2024-09-13T16:08:59.519495+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:59.646494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524882+0000","last_change":"2024-09-13T16:08:08.803645+0000","last_active":"2024-09-13T16:08:59.524882+0000","last_peered":"2024-09-13T16:08:59.524882+0000","last_clean":"2024-09-13T16:08:59.524882+0000","last_became_active":"2024-09-13T16:08:08.803248+0000","last_became_peered":"2024-09-13T16:08:08.803248+0000","last_unstale":"2024-09-13T16:08:59.524882+0000","last_undegraded":"2024-09-13T16:08:59.524882+0000","last_fullsized":"2024-09-13T16:08:59.524882+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:34.875141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528675+0000","last_change":"2024-09-13T16:08:13.256058+0000","last_active":"2024-09-13T16:08:59.528675+0000","last_peered":"2024-09-13T16:08:59.528675+0000","last_clean":"2024-09-13T16:08:59.528675+0000","last_became_active":"2024-09-13T16:08:13.255760+0000","last_became_peered":"2024-09-13T16:08:13.255760+0000","last_unstale":"2024-09-13T16:08:59.528675+0000","last_undegraded":"2024-09-13T16:08:59.528675+0000","last_fullsized":"2024-09-13T16:08:59.528675+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:58.830340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523578+0000","last_change":"2024-09-13T16:08:09.222978+0000","last_active":"2024-09-13T16:08:59.523578+0000","last_peered":"2024-09-13T16:08:59.523578+0000","last_clean":"2024-09-13T16:08:59.523578+0000","last_became_active":"2024-09-13T16:08:09.222646+0000","last_became_peered":"2024-09-13T16:08:09.222646+0000","last_unstale":"2024-09-13T16:08:59.523578+0000","last_undegraded":"2024-09-13T16:08:59.523578+0000","last_fullsized":"2024-09-13T16:08:59.523578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:05.335298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522200+0000","last_change":"2024-09-13T16:08:08.820187+0000","last_active":"2024-09-13T16:08:59.522200+0000","last_peered":"2024-09-13T16:08:59.522200+0000","last_clean":"2024-09-13T16:08:59.522200+0000","last_became_active":"2024-09-13T16:08:08.819825+0000","last_became_peered":"2024-09-13T16:08:08.819825+0000","last_unstale":"2024-09-13T16:08:59.522200+0000","last_undegraded":"2024-09-13T16:08:59.522200+0000","last_fullsized":"2024-09-13T16:08:59.522200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:13.175211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523780+0000","last_change":"2024-09-13T16:08:13.247359+0000","last_active":"2024-09-13T16:08:59.523780+0000","last_peered":"2024-09-13T16:08:59.523780+0000","last_clean":"2024-09-13T16:08:59.523780+0000","last_became_active":"2024-09-13T16:08:13.247000+0000","last_became_peered":"2024-09-13T16:08:13.247000+0000","last_unstale":"2024-09-13T16:08:59.523780+0000","last_undegraded":"2024-09-13T16:08:59.523780+0000","last_fullsized":"2024-09-13T16:08:59.523780+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:24.447814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.525939+0000","last_change":"2024-09-13T16:08:09.235838+0000","last_active":"2024-09-13T16:08:59.525939+0000","last_peered":"2024-09-13T16:08:59.525939+0000","last_clean":"2024-09-13T16:08:59.525939+0000","last_became_active":"2024-09-13T16:08:09.235545+0000","last_became_peered":"2024-09-13T16:08:09.235545+0000","last_unstale":"2024-09-13T16:08:59.525939+0000","last_undegraded":"2024-09-13T16:08:59.525939+0000","last_fullsized":"2024-09-13T16:08:59.525939+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.842273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'34","reported_seq":208,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:45.560322+0000","last_change":"2024-09-13T16:08:08.798172+0000","last_active":"2024-09-13T16:09:45.560322+0000","last_peered":"2024-09-13T16:09:45.560322+0000","last_clean":"2024-09-13T16:09:45.560322+0000","last_became_active":"2024-09-13T16:08:08.797852+0000","last_became_peered":"2024-09-13T16:08:08.797852+0000","last_unstale":"2024-09-13T16:09:45.560322+0000","last_undegraded":"2024-09-13T16:09:45.560322+0000","last_fullsized":"2024-09-13T16:09:45.560322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:19.455595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62287,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":156,"num_read_kb":139,"num_write":35,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.518819+0000","last_change":"2024-09-13T16:08:13.246905+0000","last_active":"2024-09-13T16:08:59.518819+0000","last_peered":"2024-09-13T16:08:59.518819+0000","last_clean":"2024-09-13T16:08:59.518819+0000","last_became_active":"2024-09-13T16:08:13.246446+0000","last_became_peered":"2024-09-13T16:08:13.246446+0000","last_unstale":"2024-09-13T16:08:59.518819+0000","last_undegraded":"2024-09-13T16:08:59.518819+0000","last_fullsized":"2024-09-13T16:08:59.518819+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:10.282057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.529592+0000","last_change":"2024-09-13T16:08:09.223545+0000","last_active":"2024-09-13T16:08:59.529592+0000","last_peered":"2024-09-13T16:08:59.529592+0000","last_clean":"2024-09-13T16:08:59.529592+0000","last_became_active":"2024-09-13T16:08:09.223224+0000","last_became_peered":"2024-09-13T16:08:09.223224+0000","last_unstale":"2024-09-13T16:08:59.529592+0000","last_undegraded":"2024-09-13T16:08:59.529592+0000","last_fullsized":"2024-09-13T16:08:59.529592+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:43.886882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524002+0000","last_change":"2024-09-13T16:08:08.811078+0000","last_active":"2024-09-13T16:08:59.524002+0000","last_peered":"2024-09-13T16:08:59.524002+0000","last_clean":"2024-09-13T16:08:59.524002+0000","last_became_active":"2024-09-13T16:08:08.810743+0000","last_became_peered":"2024-09-13T16:08:08.810743+0000","last_unstale":"2024-09-13T16:08:59.524002+0000","last_undegraded":"2024-09-13T16:08:59.524002+0000","last_fullsized":"2024-09-13T16:08:59.524002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:48.355869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527334+0000","last_change":"2024-09-13T16:08:13.243634+0000","last_active":"2024-09-13T16:08:59.527334+0000","last_peered":"2024-09-13T16:08:59.527334+0000","last_clean":"2024-09-13T16:08:59.527334+0000","last_became_active":"2024-09-13T16:08:13.243283+0000","last_became_peered":"2024-09-13T16:08:13.243283+0000","last_unstale":"2024-09-13T16:08:59.527334+0000","last_undegraded":"2024-09-13T16:08:59.527334+0000","last_fullsized":"2024-09-13T16:08:59.527334+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:50.226378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528723+0000","last_change":"2024-09-13T16:08:09.236851+0000","last_active":"2024-09-13T16:08:59.528723+0000","last_peered":"2024-09-13T16:08:59.528723+0000","last_clean":"2024-09-13T16:08:59.528723+0000","last_became_active":"2024-09-13T16:08:09.233841+0000","last_became_peered":"2024-09-13T16:08:09.233841+0000","last_unstale":"2024-09-13T16:08:59.528723+0000","last_undegraded":"2024-09-13T16:08:59.528723+0000","last_fullsized":"2024-09-13T16:08:59.528723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.543328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519638+0000","last_change":"2024-09-13T16:08:08.804942+0000","last_active":"2024-09-13T16:08:59.519638+0000","last_peered":"2024-09-13T16:08:59.519638+0000","last_clean":"2024-09-13T16:08:59.519638+0000","last_became_active":"2024-09-13T16:08:08.804618+0000","last_became_peered":"2024-09-13T16:08:08.804618+0000","last_unstale":"2024-09-13T16:08:59.519638+0000","last_undegraded":"2024-09-13T16:08:59.519638+0000","last_fullsized":"2024-09-13T16:08:59.519638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:54.798241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.518504+0000","last_change":"2024-09-13T16:08:13.255246+0000","last_active":"2024-09-13T16:08:59.518504+0000","last_peered":"2024-09-13T16:08:59.518504+0000","last_clean":"2024-09-13T16:08:59.518504+0000","last_became_active":"2024-09-13T16:08:13.249738+0000","last_became_peered":"2024-09-13T16:08:13.249738+0000","last_unstale":"2024-09-13T16:08:59.518504+0000","last_undegraded":"2024-09-13T16:08:59.518504+0000","last_fullsized":"2024-09-13T16:08:59.518504+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:59.917028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.529949+0000","last_change":"2024-09-13T16:08:09.232237+0000","last_active":"2024-09-13T16:08:59.529949+0000","last_peered":"2024-09-13T16:08:59.529949+0000","last_clean":"2024-09-13T16:08:59.529949+0000","last_became_active":"2024-09-13T16:08:09.231936+0000","last_became_peered":"2024-09-13T16:08:09.231936+0000","last_unstale":"2024-09-13T16:08:59.529949+0000","last_undegraded":"2024-09-13T16:08:59.529949+0000","last_fullsized":"2024-09-13T16:08:59.529949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:14.154719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'3","reported_seq":95,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:44.558956+0000","last_change":"2024-09-13T16:08:08.807354+0000","last_active":"2024-09-13T16:09:44.558956+0000","last_peered":"2024-09-13T16:09:44.558956+0000","last_clean":"2024-09-13T16:09:44.558956+0000","last_became_active":"2024-09-13T16:08:08.807040+0000","last_became_peered":"2024-09-13T16:08:08.807040+0000","last_unstale":"2024-09-13T16:09:44.558956+0000","last_undegraded":"2024-09-13T16:09:44.558956+0000","last_fullsized":"2024-09-13T16:09:44.558956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:38.861647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":74,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522150+0000","last_change":"2024-09-13T16:08:13.243743+0000","last_active":"2024-09-13T16:08:59.522150+0000","last_peered":"2024-09-13T16:08:59.522150+0000","last_clean":"2024-09-13T16:08:59.522150+0000","last_became_active":"2024-09-13T16:08:13.243197+0000","last_became_peered":"2024-09-13T16:08:13.243197+0000","last_unstale":"2024-09-13T16:08:59.522150+0000","last_undegraded":"2024-09-13T16:08:59.522150+0000","last_fullsized":"2024-09-13T16:08:59.522150+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:53.731019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528222+0000","last_change":"2024-09-13T16:08:13.255518+0000","last_active":"2024-09-13T16:08:59.528222+0000","last_peered":"2024-09-13T16:08:59.528222+0000","last_clean":"2024-09-13T16:08:59.528222+0000","last_became_active":"2024-09-13T16:08:13.255082+0000","last_became_peered":"2024-09-13T16:08:13.255082+0000","last_unstale":"2024-09-13T16:08:59.528222+0000","last_undegraded":"2024-09-13T16:08:59.528222+0000","last_fullsized":"2024-09-13T16:08:59.528222+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:09.010691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.525844+0000","last_change":"2024-09-13T16:09:00.525844+0000","last_active":"2024-09-13T16:09:00.525844+0000","last_peered":"2024-09-13T16:09:00.525844+0000","last_clean":"2024-09-13T16:09:00.525844+0000","last_became_active":"2024-09-13T16:09:00.525419+0000","last_became_peered":"2024-09-13T16:09:00.525419+0000","last_unstale":"2024-09-13T16:09:00.525844+0000","last_undegraded":"2024-09-13T16:09:00.525844+0000","last_fullsized":"2024-09-13T16:09:00.525844+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:13:50.642374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,10],"acting":[9,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524232+0000","last_change":"2024-09-13T16:08:08.803903+0000","last_active":"2024-09-13T16:08:59.524232+0000","last_peered":"2024-09-13T16:08:59.524232+0000","last_clean":"2024-09-13T16:08:59.524232+0000","last_became_active":"2024-09-13T16:08:08.803412+0000","last_became_peered":"2024-09-13T16:08:08.803412+0000","last_unstale":"2024-09-13T16:08:59.524232+0000","last_undegraded":"2024-09-13T16:08:59.524232+0000","last_fullsized":"2024-09-13T16:08:59.524232+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:20.472012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528506+0000","last_change":"2024-09-13T16:08:13.258590+0000","last_active":"2024-09-13T16:08:59.528506+0000","last_peered":"2024-09-13T16:08:59.528506+0000","last_clean":"2024-09-13T16:08:59.528506+0000","last_became_active":"2024-09-13T16:08:13.258181+0000","last_became_peered":"2024-09-13T16:08:13.258181+0000","last_unstale":"2024-09-13T16:08:59.528506+0000","last_undegraded":"2024-09-13T16:08:59.528506+0000","last_fullsized":"2024-09-13T16:08:59.528506+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:36.631501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522283+0000","last_change":"2024-09-13T16:08:09.228506+0000","last_active":"2024-09-13T16:08:59.522283+0000","last_peered":"2024-09-13T16:08:59.522283+0000","last_clean":"2024-09-13T16:08:59.522283+0000","last_became_active":"2024-09-13T16:08:09.226565+0000","last_became_peered":"2024-09-13T16:08:09.226565+0000","last_unstale":"2024-09-13T16:08:59.522283+0000","last_undegraded":"2024-09-13T16:08:59.522283+0000","last_fullsized":"2024-09-13T16:08:59.522283+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:46.333106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522891+0000","last_change":"2024-09-13T16:08:08.807615+0000","last_active":"2024-09-13T16:08:59.522891+0000","last_peered":"2024-09-13T16:08:59.522891+0000","last_clean":"2024-09-13T16:08:59.522891+0000","last_became_active":"2024-09-13T16:08:08.807318+0000","last_became_peered":"2024-09-13T16:08:08.807318+0000","last_unstale":"2024-09-13T16:08:59.522891+0000","last_undegraded":"2024-09-13T16:08:59.522891+0000","last_fullsized":"2024-09-13T16:08:59.522891+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:36.901859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.521763+0000","last_change":"2024-09-13T16:08:08.806438+0000","last_active":"2024-09-13T16:08:59.521763+0000","last_peered":"2024-09-13T16:08:59.521763+0000","last_clean":"2024-09-13T16:08:59.521763+0000","last_became_active":"2024-09-13T16:08:08.806109+0000","last_became_peered":"2024-09-13T16:08:08.806109+0000","last_unstale":"2024-09-13T16:08:59.521763+0000","last_undegraded":"2024-09-13T16:08:59.521763+0000","last_fullsized":"2024-09-13T16:08:59.521763+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:31.862771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.589501+0000","last_change":"2024-09-13T16:09:00.589501+0000","last_active":"2024-09-13T16:09:00.589501+0000","last_peered":"2024-09-13T16:09:00.589501+0000","last_clean":"2024-09-13T16:09:00.589501+0000","last_became_active":"2024-09-13T16:09:00.589122+0000","last_became_peered":"2024-09-13T16:09:00.589122+0000","last_unstale":"2024-09-13T16:09:00.589501+0000","last_undegraded":"2024-09-13T16:09:00.589501+0000","last_fullsized":"2024-09-13T16:09:00.589501+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:23.415740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522174+0000","last_change":"2024-09-13T16:08:13.244314+0000","last_active":"2024-09-13T16:08:59.522174+0000","last_peered":"2024-09-13T16:08:59.522174+0000","last_clean":"2024-09-13T16:08:59.522174+0000","last_became_active":"2024-09-13T16:08:13.243895+0000","last_became_peered":"2024-09-13T16:08:13.243895+0000","last_unstale":"2024-09-13T16:08:59.522174+0000","last_undegraded":"2024-09-13T16:08:59.522174+0000","last_fullsized":"2024-09-13T16:08:59.522174+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:54.639780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":99,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:44.559415+0000","last_change":"2024-09-13T16:08:08.803669+0000","last_active":"2024-09-13T16:09:44.559415+0000","last_peered":"2024-09-13T16:09:44.559415+0000","last_clean":"2024-09-13T16:09:44.559415+0000","last_became_active":"2024-09-13T16:08:08.803319+0000","last_became_peered":"2024-09-13T16:08:08.803319+0000","last_unstale":"2024-09-13T16:09:44.559415+0000","last_undegraded":"2024-09-13T16:09:44.559415+0000","last_fullsized":"2024-09-13T16:09:44.559415+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:05.791715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.526511+0000","last_change":"2024-09-13T16:09:00.526511+0000","last_active":"2024-09-13T16:09:00.526511+0000","last_peered":"2024-09-13T16:09:00.526511+0000","last_clean":"2024-09-13T16:09:00.526511+0000","last_became_active":"2024-09-13T16:09:00.526155+0000","last_became_peered":"2024-09-13T16:09:00.526155+0000","last_unstale":"2024-09-13T16:09:00.526511+0000","last_undegraded":"2024-09-13T16:09:00.526511+0000","last_fullsized":"2024-09-13T16:09:00.526511+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:12.069491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522300+0000","last_change":"2024-09-13T16:08:13.240680+0000","last_active":"2024-09-13T16:08:59.522300+0000","last_peered":"2024-09-13T16:08:59.522300+0000","last_clean":"2024-09-13T16:08:59.522300+0000","last_became_active":"2024-09-13T16:08:13.240296+0000","last_became_peered":"2024-09-13T16:08:13.240296+0000","last_unstale":"2024-09-13T16:08:59.522300+0000","last_undegraded":"2024-09-13T16:08:59.522300+0000","last_fullsized":"2024-09-13T16:08:59.522300+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:32.990479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528289+0000","last_change":"2024-09-13T16:08:09.221827+0000","last_active":"2024-09-13T16:08:59.528289+0000","last_peered":"2024-09-13T16:08:59.528289+0000","last_clean":"2024-09-13T16:08:59.528289+0000","last_became_active":"2024-09-13T16:08:09.220698+0000","last_became_peered":"2024-09-13T16:08:09.220698+0000","last_unstale":"2024-09-13T16:08:59.528289+0000","last_undegraded":"2024-09-13T16:08:59.528289+0000","last_fullsized":"2024-09-13T16:08:59.528289+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:17.721497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522132+0000","last_change":"2024-09-13T16:08:09.217094+0000","last_active":"2024-09-13T16:08:59.522132+0000","last_peered":"2024-09-13T16:08:59.522132+0000","last_clean":"2024-09-13T16:08:59.522132+0000","last_became_active":"2024-09-13T16:08:09.216775+0000","last_became_peered":"2024-09-13T16:08:09.216775+0000","last_unstale":"2024-09-13T16:08:59.522132+0000","last_undegraded":"2024-09-13T16:08:59.522132+0000","last_fullsized":"2024-09-13T16:08:59.522132+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:32.350130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522001+0000","last_change":"2024-09-13T16:08:09.227411+0000","last_active":"2024-09-13T16:08:59.522001+0000","last_peered":"2024-09-13T16:08:59.522001+0000","last_clean":"2024-09-13T16:08:59.522001+0000","last_became_active":"2024-09-13T16:08:09.227142+0000","last_became_peered":"2024-09-13T16:08:09.227142+0000","last_unstale":"2024-09-13T16:08:59.522001+0000","last_undegraded":"2024-09-13T16:08:59.522001+0000","last_fullsized":"2024-09-13T16:08:59.522001+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:46.883864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528083+0000","last_change":"2024-09-13T16:08:09.229160+0000","last_active":"2024-09-13T16:08:59.528083+0000","last_peered":"2024-09-13T16:08:59.528083+0000","last_clean":"2024-09-13T16:08:59.528083+0000","last_became_active":"2024-09-13T16:08:09.228843+0000","last_became_peered":"2024-09-13T16:08:09.228843+0000","last_unstale":"2024-09-13T16:08:59.528083+0000","last_undegraded":"2024-09-13T16:08:59.528083+0000","last_fullsized":"2024-09-13T16:08:59.528083+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:11.667437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.620625+0000","last_change":"2024-09-13T16:09:00.620625+0000","last_active":"2024-09-13T16:09:00.620625+0000","last_peered":"2024-09-13T16:09:00.620625+0000","last_clean":"2024-09-13T16:09:00.620625+0000","last_became_active":"2024-09-13T16:09:00.620153+0000","last_became_peered":"2024-09-13T16:09:00.620153+0000","last_unstale":"2024-09-13T16:09:00.620625+0000","last_undegraded":"2024-09-13T16:09:00.620625+0000","last_fullsized":"2024-09-13T16:09:00.620625+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:02.088656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528596+0000","last_change":"2024-09-13T16:08:09.218650+0000","last_active":"2024-09-13T16:08:59.528596+0000","last_peered":"2024-09-13T16:08:59.528596+0000","last_clean":"2024-09-13T16:08:59.528596+0000","last_became_active":"2024-09-13T16:08:09.218347+0000","last_became_peered":"2024-09-13T16:08:09.218347+0000","last_unstale":"2024-09-13T16:08:59.528596+0000","last_undegraded":"2024-09-13T16:08:59.528596+0000","last_fullsized":"2024-09-13T16:08:59.528596+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:31.331274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522638+0000","last_change":"2024-09-13T16:08:09.217256+0000","last_active":"2024-09-13T16:08:59.522638+0000","last_peered":"2024-09-13T16:08:59.522638+0000","last_clean":"2024-09-13T16:08:59.522638+0000","last_became_active":"2024-09-13T16:08:09.216960+0000","last_became_peered":"2024-09-13T16:08:09.216960+0000","last_unstale":"2024-09-13T16:08:59.522638+0000","last_undegraded":"2024-09-13T16:08:59.522638+0000","last_fullsized":"2024-09-13T16:08:59.522638+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:44.473317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523350+0000","last_change":"2024-09-13T16:08:09.225677+0000","last_active":"2024-09-13T16:08:59.523350+0000","last_peered":"2024-09-13T16:08:59.523350+0000","last_clean":"2024-09-13T16:08:59.523350+0000","last_became_active":"2024-09-13T16:08:09.224474+0000","last_became_peered":"2024-09-13T16:08:09.224474+0000","last_unstale":"2024-09-13T16:08:59.523350+0000","last_undegraded":"2024-09-13T16:08:59.523350+0000","last_fullsized":"2024-09-13T16:08:59.523350+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:01.474204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524111+0000","last_change":"2024-09-13T16:08:09.229125+0000","last_active":"2024-09-13T16:08:59.524111+0000","last_peered":"2024-09-13T16:08:59.524111+0000","last_clean":"2024-09-13T16:08:59.524111+0000","last_became_active":"2024-09-13T16:08:09.228611+0000","last_became_peered":"2024-09-13T16:08:09.228611+0000","last_unstale":"2024-09-13T16:08:59.524111+0000","last_undegraded":"2024-09-13T16:08:59.524111+0000","last_fullsized":"2024-09-13T16:08:59.524111+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:51.910316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522770+0000","last_change":"2024-09-13T16:08:09.226355+0000","last_active":"2024-09-13T16:08:59.522770+0000","last_peered":"2024-09-13T16:08:59.522770+0000","last_clean":"2024-09-13T16:08:59.522770+0000","last_became_active":"2024-09-13T16:08:09.225304+0000","last_became_peered":"2024-09-13T16:08:09.225304+0000","last_unstale":"2024-09-13T16:08:59.522770+0000","last_undegraded":"2024-09-13T16:08:59.522770+0000","last_fullsized":"2024-09-13T16:08:59.522770+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:01.714833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.529333+0000","last_change":"2024-09-13T16:08:09.223744+0000","last_active":"2024-09-13T16:08:59.529333+0000","last_peered":"2024-09-13T16:08:59.529333+0000","last_clean":"2024-09-13T16:08:59.529333+0000","last_became_active":"2024-09-13T16:08:09.223433+0000","last_became_peered":"2024-09-13T16:08:09.223433+0000","last_unstale":"2024-09-13T16:08:59.529333+0000","last_undegraded":"2024-09-13T16:08:59.529333+0000","last_fullsized":"2024-09-13T16:08:59.529333+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:32.406142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523757+0000","last_change":"2024-09-13T16:08:09.227752+0000","last_active":"2024-09-13T16:08:59.523757+0000","last_peered":"2024-09-13T16:08:59.523757+0000","last_clean":"2024-09-13T16:08:59.523757+0000","last_became_active":"2024-09-13T16:08:09.227459+0000","last_became_peered":"2024-09-13T16:08:09.227459+0000","last_unstale":"2024-09-13T16:08:59.523757+0000","last_undegraded":"2024-09-13T16:08:59.523757+0000","last_fullsized":"2024-09-13T16:08:59.523757+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:57.357214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528571+0000","last_change":"2024-09-13T16:08:09.221624+0000","last_active":"2024-09-13T16:08:59.528571+0000","last_peered":"2024-09-13T16:08:59.528571+0000","last_clean":"2024-09-13T16:08:59.528571+0000","last_became_active":"2024-09-13T16:08:09.220573+0000","last_became_peered":"2024-09-13T16:08:09.220573+0000","last_unstale":"2024-09-13T16:08:59.528571+0000","last_undegraded":"2024-09-13T16:08:59.528571+0000","last_fullsized":"2024-09-13T16:08:59.528571+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:29.862958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522399+0000","last_change":"2024-09-13T16:08:09.223575+0000","last_active":"2024-09-13T16:08:59.522399+0000","last_peered":"2024-09-13T16:08:59.522399+0000","last_clean":"2024-09-13T16:08:59.522399+0000","last_became_active":"2024-09-13T16:08:09.223312+0000","last_became_peered":"2024-09-13T16:08:09.223312+0000","last_unstale":"2024-09-13T16:08:59.522399+0000","last_undegraded":"2024-09-13T16:08:59.522399+0000","last_fullsized":"2024-09-13T16:08:59.522399+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:32.926562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519977+0000","last_change":"2024-09-13T16:08:09.236371+0000","last_active":"2024-09-13T16:08:59.519977+0000","last_peered":"2024-09-13T16:08:59.519977+0000","last_clean":"2024-09-13T16:08:59.519977+0000","last_became_active":"2024-09-13T16:08:09.234906+0000","last_became_peered":"2024-09-13T16:08:09.234906+0000","last_unstale":"2024-09-13T16:08:59.519977+0000","last_undegraded":"2024-09-13T16:08:59.519977+0000","last_fullsized":"2024-09-13T16:08:59.519977+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:45.305622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.620946+0000","last_change":"2024-09-13T16:09:00.620946+0000","last_active":"2024-09-13T16:09:00.620946+0000","last_peered":"2024-09-13T16:09:00.620946+0000","last_clean":"2024-09-13T16:09:00.620946+0000","last_became_active":"2024-09-13T16:09:00.620640+0000","last_became_peered":"2024-09-13T16:09:00.620640+0000","last_unstale":"2024-09-13T16:09:00.620946+0000","last_undegraded":"2024-09-13T16:09:00.620946+0000","last_fullsized":"2024-09-13T16:09:00.620946+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:25.071507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,0],"acting":[11,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.529014+0000","last_change":"2024-09-13T16:08:09.226472+0000","last_active":"2024-09-13T16:08:59.529014+0000","last_peered":"2024-09-13T16:08:59.529014+0000","last_clean":"2024-09-13T16:08:59.529014+0000","last_became_active":"2024-09-13T16:08:09.225988+0000","last_became_peered":"2024-09-13T16:08:09.225988+0000","last_unstale":"2024-09-13T16:08:59.529014+0000","last_undegraded":"2024-09-13T16:08:59.529014+0000","last_fullsized":"2024-09-13T16:08:59.529014+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:41.785752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527977+0000","last_change":"2024-09-13T16:08:09.219313+0000","last_active":"2024-09-13T16:08:59.527977+0000","last_peered":"2024-09-13T16:08:59.527977+0000","last_clean":"2024-09-13T16:08:59.527977+0000","last_became_active":"2024-09-13T16:08:09.219030+0000","last_became_peered":"2024-09-13T16:08:09.219030+0000","last_unstale":"2024-09-13T16:08:59.527977+0000","last_undegraded":"2024-09-13T16:08:59.527977+0000","last_fullsized":"2024-09-13T16:08:59.527977+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:26.561305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527880+0000","last_change":"2024-09-13T16:08:09.240585+0000","last_active":"2024-09-13T16:08:59.527880+0000","last_peered":"2024-09-13T16:08:59.527880+0000","last_clean":"2024-09-13T16:08:59.527880+0000","last_became_active":"2024-09-13T16:08:09.238960+0000","last_became_peered":"2024-09-13T16:08:09.238960+0000","last_unstale":"2024-09-13T16:08:59.527880+0000","last_undegraded":"2024-09-13T16:08:59.527880+0000","last_fullsized":"2024-09-13T16:08:59.527880+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:24.086723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523677+0000","last_change":"2024-09-13T16:08:09.234963+0000","last_active":"2024-09-13T16:08:59.523677+0000","last_peered":"2024-09-13T16:08:59.523677+0000","last_clean":"2024-09-13T16:08:59.523677+0000","last_became_active":"2024-09-13T16:08:09.234649+0000","last_became_peered":"2024-09-13T16:08:09.234649+0000","last_unstale":"2024-09-13T16:08:59.523677+0000","last_undegraded":"2024-09-13T16:08:59.523677+0000","last_fullsized":"2024-09-13T16:08:59.523677+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:38.972344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527786+0000","last_change":"2024-09-13T16:08:09.226425+0000","last_active":"2024-09-13T16:08:59.527786+0000","last_peered":"2024-09-13T16:08:59.527786+0000","last_clean":"2024-09-13T16:08:59.527786+0000","last_became_active":"2024-09-13T16:08:09.226121+0000","last_became_peered":"2024-09-13T16:08:09.226121+0000","last_unstale":"2024-09-13T16:08:59.527786+0000","last_undegraded":"2024-09-13T16:08:59.527786+0000","last_fullsized":"2024-09-13T16:08:59.527786+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:10.035414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519699+0000","last_change":"2024-09-13T16:08:09.234592+0000","last_active":"2024-09-13T16:08:59.519699+0000","last_peered":"2024-09-13T16:08:59.519699+0000","last_clean":"2024-09-13T16:08:59.519699+0000","last_became_active":"2024-09-13T16:08:09.234293+0000","last_became_peered":"2024-09-13T16:08:09.234293+0000","last_unstale":"2024-09-13T16:08:59.519699+0000","last_undegraded":"2024-09-13T16:08:59.519699+0000","last_fullsized":"2024-09-13T16:08:59.519699+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:44.196400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522371+0000","last_change":"2024-09-13T16:08:09.231974+0000","last_active":"2024-09-13T16:08:59.522371+0000","last_peered":"2024-09-13T16:08:59.522371+0000","last_clean":"2024-09-13T16:08:59.522371+0000","last_became_active":"2024-09-13T16:08:09.231667+0000","last_became_peered":"2024-09-13T16:08:09.231667+0000","last_unstale":"2024-09-13T16:08:59.522371+0000","last_undegraded":"2024-09-13T16:08:59.522371+0000","last_fullsized":"2024-09-13T16:08:59.522371+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:05.595837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.530378+0000","last_change":"2024-09-13T16:08:09.225322+0000","last_active":"2024-09-13T16:08:59.530378+0000","last_peered":"2024-09-13T16:08:59.530378+0000","last_clean":"2024-09-13T16:08:59.530378+0000","last_became_active":"2024-09-13T16:08:09.224969+0000","last_became_peered":"2024-09-13T16:08:09.224969+0000","last_unstale":"2024-09-13T16:08:59.530378+0000","last_undegraded":"2024-09-13T16:08:59.530378+0000","last_fullsized":"2024-09-13T16:08:59.530378+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:36.797080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522209+0000","last_change":"2024-09-13T16:08:09.231870+0000","last_active":"2024-09-13T16:08:59.522209+0000","last_peered":"2024-09-13T16:08:59.522209+0000","last_clean":"2024-09-13T16:08:59.522209+0000","last_became_active":"2024-09-13T16:08:09.231606+0000","last_became_peered":"2024-09-13T16:08:09.231606+0000","last_unstale":"2024-09-13T16:08:59.522209+0000","last_undegraded":"2024-09-13T16:08:59.522209+0000","last_fullsized":"2024-09-13T16:08:59.522209+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:49.235264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.525142+0000","last_change":"2024-09-13T16:09:00.525142+0000","last_active":"2024-09-13T16:09:00.525142+0000","last_peered":"2024-09-13T16:09:00.525142+0000","last_clean":"2024-09-13T16:09:00.525142+0000","last_became_active":"2024-09-13T16:09:00.524728+0000","last_became_peered":"2024-09-13T16:09:00.524728+0000","last_unstale":"2024-09-13T16:09:00.525142+0000","last_undegraded":"2024-09-13T16:09:00.525142+0000","last_fullsized":"2024-09-13T16:09:00.525142+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:28.609694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.521732+0000","last_change":"2024-09-13T16:08:09.230428+0000","last_active":"2024-09-13T16:08:59.521732+0000","last_peered":"2024-09-13T16:08:59.521732+0000","last_clean":"2024-09-13T16:08:59.521732+0000","last_became_active":"2024-09-13T16:08:09.230139+0000","last_became_peered":"2024-09-13T16:08:09.230139+0000","last_unstale":"2024-09-13T16:08:59.521732+0000","last_undegraded":"2024-09-13T16:08:59.521732+0000","last_fullsized":"2024-09-13T16:08:59.521732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:56.475566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524737+0000","last_change":"2024-09-13T16:08:09.223142+0000","last_active":"2024-09-13T16:08:59.524737+0000","last_peered":"2024-09-13T16:08:59.524737+0000","last_clean":"2024-09-13T16:08:59.524737+0000","last_became_active":"2024-09-13T16:08:09.222718+0000","last_became_peered":"2024-09-13T16:08:09.222718+0000","last_unstale":"2024-09-13T16:08:59.524737+0000","last_undegraded":"2024-09-13T16:08:59.524737+0000","last_fullsized":"2024-09-13T16:08:59.524737+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:00.737875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527888+0000","last_change":"2024-09-13T16:08:09.220060+0000","last_active":"2024-09-13T16:08:59.527888+0000","last_peered":"2024-09-13T16:08:59.527888+0000","last_clean":"2024-09-13T16:08:59.527888+0000","last_became_active":"2024-09-13T16:08:09.219751+0000","last_became_peered":"2024-09-13T16:08:09.219751+0000","last_unstale":"2024-09-13T16:08:59.527888+0000","last_undegraded":"2024-09-13T16:08:59.527888+0000","last_fullsized":"2024-09-13T16:08:59.527888+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:47.103762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528343+0000","last_change":"2024-09-13T16:08:09.230914+0000","last_active":"2024-09-13T16:08:59.528343+0000","last_peered":"2024-09-13T16:08:59.528343+0000","last_clean":"2024-09-13T16:08:59.528343+0000","last_became_active":"2024-09-13T16:08:09.230500+0000","last_became_peered":"2024-09-13T16:08:09.230500+0000","last_unstale":"2024-09-13T16:08:59.528343+0000","last_undegraded":"2024-09-13T16:08:59.528343+0000","last_fullsized":"2024-09-13T16:08:59.528343+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:02.096851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528313+0000","last_change":"2024-09-13T16:08:09.239818+0000","last_active":"2024-09-13T16:08:59.528313+0000","last_peered":"2024-09-13T16:08:59.528313+0000","last_clean":"2024-09-13T16:08:59.528313+0000","last_became_active":"2024-09-13T16:08:09.238707+0000","last_became_peered":"2024-09-13T16:08:09.238707+0000","last_unstale":"2024-09-13T16:08:59.528313+0000","last_undegraded":"2024-09-13T16:08:59.528313+0000","last_fullsized":"2024-09-13T16:08:59.528313+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:46.937934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528826+0000","last_change":"2024-09-13T16:08:09.238796+0000","last_active":"2024-09-13T16:08:59.528826+0000","last_peered":"2024-09-13T16:08:59.528826+0000","last_clean":"2024-09-13T16:08:59.528826+0000","last_became_active":"2024-09-13T16:08:09.238510+0000","last_became_peered":"2024-09-13T16:08:09.238510+0000","last_unstale":"2024-09-13T16:08:59.528826+0000","last_undegraded":"2024-09-13T16:08:59.528826+0000","last_fullsized":"2024-09-13T16:08:59.528826+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:18.691940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66193,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":471,"num_read_kb":304,"num_write":159,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":198579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351008,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":1028096,"data_stored":503070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.36299999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77200000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.624,"15min":0.63500000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.745,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.496}]},{"osd":1,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.622,"15min":0.629},"min":{"1min":0.40799999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.44700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77000000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.68899999999999995}]},{"osd":2,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.46800000000000003,"15min":0.47599999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.60599999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.44900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.78900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.67100000000000004,"15min":0.68500000000000005},"min":{"1min":0.375,"5min":0.373,"15min":0.373},"max":{"1min":0.80700000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72599999999999998}]},{"osd":5,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.50700000000000001,"15min":0.50600000000000001},"min":{"1min":0.38800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.32500000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.81399999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.40200000000000002}]},{"osd":6,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80000000000000004,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.68999999999999995,"15min":0.70999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78700000000000003,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.61399999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70399999999999996,"15min":0.71099999999999997},"min":{"1min":0.48599999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.79600000000000004,"5min":1.081,"15min":1.081},"last":0.627},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71599999999999997,"15min":0.72599999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.77800000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.75900000000000001}]},{"osd":8,"last update":"Fri Sep 13 16:09:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.65800000000000003}]},{"osd":9,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73599999999999999,"15min":0.745},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.90200000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.89600000000000002,"5min":1.127,"15min":1.127},"last":0.60499999999999998}]},{"osd":10,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.84999999999999998,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.53000000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.88,"5min":1.381,"15min":1.381},"last":0.74299999999999999}]}]},{"osd":10,"up_from":73,"seq":313532612646,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28704,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716448,"statfs":{"total":95995035648,"available":95965642752,"internally_reserved":0,"allocated":1720320,"data_stored":1152969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:09:08 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67400000000000004}]},{"osd":1,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.434,"15min":0.441},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.59399999999999997,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.435,"15min":0.439},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60699999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72899999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.755,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.66100000000000003}]},{"osd":3,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.63100000000000001,"15min":0.64100000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78800000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70099999999999996,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45500000000000002,"15min":0.46000000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66900000000000004,"5min":0.754,"15min":0.754},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.60699999999999998}]},{"osd":5,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.623,"15min":0.63100000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.76200000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.82099999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91100000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.70799999999999996,"15min":0.72099999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92400000000000004,"5min":1.385,"15min":1.385},"last":0.78900000000000003}]},{"osd":7,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.377},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.39900000000000002}]},{"osd":8,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68799999999999994,"15min":0.69299999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86099999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.748},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.74199999999999999,"15min":0.752},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86899999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.73899999999999999}]},{"osd":9,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.73399999999999999,"15min":0.745},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93300000000000005,"5min":1.054,"15min":1.054},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83299999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.85499999999999998}]},{"osd":11,"last update":"Fri Sep 13 16:09:18 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.56799999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.84699999999999998,"5min":1.026,"15min":1.026},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71099999999999997,"15min":0.70599999999999996},"min":{"1min":0.65200000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89600000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.82599999999999996}]}]},{"osd":9,"up_from":68,"seq":292057776171,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":507402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.49399999999999999,"15min":0.51200000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73599999999999999,"5min":0.745,"15min":0.745},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.48499999999999999,"15min":0.51500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.53800000000000003,"5min":0.746,"15min":0.746},"last":0.38200000000000001}]},{"osd":1,"last update":"Fri Sep 13 16:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65800000000000003,"15min":0.68999999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83199999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.70099999999999996,"15min":0.73099999999999998},"min":{"1min":0.45100000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81899999999999995,"5min":1.028,"15min":1.028},"last":0.504}]},{"osd":2,"last update":"Fri Sep 13 16:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.71699999999999997,"15min":0.753},"min":{"1min":0.49299999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72599999999999998,"5min":1.113,"15min":1.113},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82899999999999996,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Sep 13 16:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.58999999999999997,"15min":0.63400000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.66900000000000004,"15min":0.71799999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.66300000000000003,"5min":1.151,"15min":1.151},"last":0.48099999999999998}]},{"osd":4,"last update":"Fri Sep 13 16:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.70899999999999996,"15min":0.746},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81699999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.77500000000000002,"15min":0.81699999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.78600000000000003,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Sep 13 16:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.749,"15min":0.79100000000000004},"min":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.79600000000000004,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.79200000000000004,"15min":0.83699999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84999999999999998,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.54700000000000004}]},{"osd":7,"last update":"Fri Sep 13 16:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.82999999999999996,"15min":0.88},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.85499999999999998,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.78200000000000003,"15min":0.83199999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90600000000000003,"5min":1.089,"15min":1.089},"last":0.54800000000000004}]},{"osd":8,"last update":"Fri Sep 13 16:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.82899999999999996,"15min":0.88300000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.84599999999999997,"5min":1.175,"15min":1.175},"last":0.747},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.81999999999999995,"15min":0.87},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.84999999999999998,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.68300000000000005}]},{"osd":10,"last update":"Fri Sep 13 16:08:58 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.83399999999999996,"15min":0.85399999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.88700000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.86499999999999999,"15min":0.88800000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.93300000000000005,"5min":1.242,"15min":1.242},"last":0.68799999999999994}]},{"osd":11,"last update":"Fri Sep 13 16:09:18 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.72699999999999998}]}]},{"osd":8,"up_from":60,"seq":257698037809,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":1040384,"data_stored":502895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.59899999999999998,"15min":0.62},"min":{"1min":0.33300000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.747,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77800000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.42299999999999999}]},{"osd":1,"last update":"Fri Sep 13 16:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79100000000000004,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.71199999999999997}]},{"osd":2,"last update":"Fri Sep 13 16:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.27900000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.58999999999999997,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.40200000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71299999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61399999999999999,"15min":0.63500000000000001},"min":{"1min":0.43099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.92600000000000005,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Sep 13 16:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Sep 13 16:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.495,"15min":0.495},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48799999999999999,"15min":0.48399999999999999},"min":{"1min":0.32900000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.49299999999999999}]},{"osd":6,"last update":"Fri Sep 13 16:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61799999999999999,"15min":0.63100000000000001},"min":{"1min":0.41799999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68000000000000005,"15min":0.68799999999999994},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86499999999999999,"5min":1.371,"15min":1.371},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Sep 13 16:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85499999999999998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.87,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.60299999999999998}]},{"osd":9,"last update":"Fri Sep 13 16:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.48799999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.89200000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.54700000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90700000000000003,"5min":1.401,"15min":1.401},"last":0.68700000000000006}]},{"osd":10,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.622,"15min":0.60999999999999999},"min":{"1min":0.45300000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.65700000000000003,"15min":0.64600000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.61299999999999999}]},{"osd":11,"last update":"Fri Sep 13 16:09:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.50900000000000001}]}]},{"osd":7,"up_from":52,"seq":223338299446,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36808,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708344,"statfs":{"total":95995035648,"available":95957344256,"internally_reserved":0,"allocated":1634304,"data_stored":1098759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.432,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.38200000000000001,"15min":0.373},"min":{"1min":0.28299999999999997,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.376},"min":{"1min":0.32200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59199999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55000000000000004,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82299999999999995,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.502},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55300000000000005,"15min":0.54100000000000004},"min":{"1min":0.441,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71399999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.58099999999999996}]},{"osd":3,"last update":"Fri Sep 13 16:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.46400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.42699999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.77600000000000002,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.45000000000000001,"15min":0.44400000000000001},"min":{"1min":0.30199999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70299999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.379},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45400000000000001,"15min":0.46200000000000002},"min":{"1min":0.29999999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71199999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.41999999999999998}]},{"osd":5,"last update":"Fri Sep 13 16:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77500000000000002,"5min":1.022,"15min":1.022},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59999999999999998,"15min":0.58199999999999996},"min":{"1min":0.48899999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89600000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.51800000000000002}]},{"osd":6,"last update":"Fri Sep 13 16:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.46500000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.45800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.71699999999999997}]},{"osd":8,"last update":"Fri Sep 13 16:09:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60899999999999999,"15min":0.60099999999999998},"min":{"1min":0.45800000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64300000000000002,"15min":0.63100000000000001},"min":{"1min":0.52300000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.73199999999999998}]},{"osd":9,"last update":"Fri Sep 13 16:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71999999999999997,"15min":0.73399999999999999},"min":{"1min":0.52800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.752},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72299999999999998,"15min":0.72899999999999998},"min":{"1min":0.56499999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.67900000000000005}]},{"osd":10,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.45500000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.627,"15min":0.628},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.626}]},{"osd":11,"last update":"Fri Sep 13 16:09:13 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.65800000000000003}]}]},{"osd":6,"up_from":47,"seq":201863462970,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":498209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.495,"15min":0.46600000000000003},"min":{"1min":0.34999999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3,"5min":3,"15min":3},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.48599999999999999,"15min":0.46100000000000002},"min":{"1min":0.35299999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Sep 13 16:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.69999999999999996,"15min":0.67700000000000005},"min":{"1min":0.47799999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.66500000000000004,"15min":0.623},"min":{"1min":0.46100000000000002,"5min":0.442,"15min":0.442},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.66800000000000004,"15min":0.63400000000000001},"min":{"1min":0.497,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.71799999999999997,"15min":0.69299999999999995},"min":{"1min":0.497,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0089999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.82799999999999996}]},{"osd":3,"last update":"Fri Sep 13 16:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.64500000000000002,"15min":0.61199999999999999},"min":{"1min":0.42399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":3.1709999999999998,"5min":3.1709999999999998,"15min":3.1709999999999998},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.58299999999999996,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.6320000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":0.629}]},{"osd":4,"last update":"Fri Sep 13 16:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.66600000000000004,"15min":0.65200000000000002},"min":{"1min":0.46700000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.754,"15min":0.73399999999999999},"min":{"1min":0.57599999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.878}]},{"osd":5,"last update":"Fri Sep 13 16:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.70299999999999996,"15min":0.67500000000000004},"min":{"1min":0.58499999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.6600000000000001,"5min":2.6600000000000001,"15min":2.6600000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.71399999999999997,"15min":0.69899999999999995},"min":{"1min":0.53500000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.3250000000000002,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.76700000000000002}]},{"osd":7,"last update":"Fri Sep 13 16:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.72199999999999998,"15min":0.70999999999999996},"min":{"1min":0.52900000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.77300000000000002,"15min":0.749},"min":{"1min":0.55500000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.90100000000000002}]},{"osd":8,"last update":"Fri Sep 13 16:09:08 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.78400000000000003,"15min":0.77000000000000002},"min":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.752,"15min":0.73699999999999999},"min":{"1min":0.53200000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":0.72799999999999998}]},{"osd":9,"last update":"Fri Sep 13 16:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.86299999999999999,"15min":0.85499999999999998},"min":{"1min":0.54500000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":3.363,"5min":3.363,"15min":3.363},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.50600000000000001,"5min":0.505,"15min":0.505},"max":{"1min":2.714,"5min":2.714,"15min":2.714},"last":0.68899999999999995}]},{"osd":10,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.80700000000000005,"15min":0.80600000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.89600000000000002,"15min":0.90200000000000002},"min":{"1min":0.67100000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.95899999999999996}]},{"osd":11,"last update":"Fri Sep 13 16:09:14 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.97899999999999998}]}]},{"osd":5,"up_from":39,"seq":167503724607,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36824,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708328,"statfs":{"total":95995035648,"available":95957327872,"internally_reserved":0,"allocated":1646592,"data_stored":1094284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:08:46 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.38200000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68600000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.54900000000000004,"15min":0.56100000000000005},"min":{"1min":0.33300000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68100000000000005,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.47899999999999998}]},{"osd":1,"last update":"Fri Sep 13 16:08:46 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69199999999999995,"5min":0.748,"15min":0.748},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51800000000000002,"15min":0.50900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76100000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.623}]},{"osd":2,"last update":"Fri Sep 13 16:08:46 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.379,"15min":0.36899999999999999},"min":{"1min":0.28000000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.377},"min":{"1min":0.28399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Sep 13 16:08:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67200000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79300000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Sep 13 16:08:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.39300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77900000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Sep 13 16:09:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.623},"min":{"1min":0.44500000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78500000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.61699999999999999,"15min":0.60799999999999998},"min":{"1min":0.51300000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84899999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.498}]},{"osd":7,"last update":"Fri Sep 13 16:08:46 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.433,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88600000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.63500000000000001}]},{"osd":8,"last update":"Fri Sep 13 16:09:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.39100000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.42399999999999999}]},{"osd":9,"last update":"Fri Sep 13 16:09:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.70999999999999996,"15min":0.72099999999999997},"min":{"1min":0.54300000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.92600000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.60399999999999998}]},{"osd":10,"last update":"Fri Sep 13 16:08:56 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65300000000000002,"15min":0.65600000000000003},"min":{"1min":0.48499999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.874,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64900000000000002,"15min":0.65000000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.73299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888133,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":1036288,"data_stored":503476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:07:28 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.51800000000000002,"15min":0.49099999999999999},"min":{"1min":0.438,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.48199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.436}]},{"osd":1,"last update":"Fri Sep 13 16:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36399999999999999,"15min":0.33600000000000002},"min":{"1min":0.27800000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.54900000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.376,"15min":0.34599999999999997},"min":{"1min":0.32000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.56799999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53500000000000003,"15min":0.52200000000000002},"min":{"1min":0.42899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78000000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52000000000000002,"15min":0.50800000000000001},"min":{"1min":0.40400000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68600000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.71699999999999997}]},{"osd":3,"last update":"Fri Sep 13 16:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.53100000000000003},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75900000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59699999999999998,"15min":0.54700000000000004},"min":{"1min":0.47799999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79300000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:08:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55300000000000005,"15min":0.54100000000000004},"min":{"1min":0.318,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.33600000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68400000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.621,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63500000000000001,"15min":0.61099999999999999},"min":{"1min":0.44600000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86599999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Sep 13 16:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.57299999999999995,"15min":0.65200000000000002},"min":{"1min":0.32900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69399999999999995,"5min":3.4660000000000002,"15min":3.4660000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.56499999999999995,"15min":0.61399999999999999},"min":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72099999999999997,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.63100000000000001}]},{"osd":8,"last update":"Fri Sep 13 16:09:02 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.621,"15min":0.60399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82199999999999995,"5min":0.879,"15min":0.879},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.626,"15min":0.61699999999999999},"min":{"1min":0.438,"5min":0.433,"15min":0.433},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.746}]},{"osd":9,"last update":"Fri Sep 13 16:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.89500000000000002,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.58599999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.80100000000000005}]},{"osd":10,"last update":"Fri Sep 13 16:08:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.81699999999999995}]},{"osd":11,"last update":"Fri Sep 13 16:09:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.85499999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149770,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":498345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:09:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.46000000000000002,"15min":0.39800000000000002},"min":{"1min":0.34000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.45500000000000002,"15min":0.41299999999999998},"min":{"1min":0.34300000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.39100000000000001}]},{"osd":1,"last update":"Fri Sep 13 16:09:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61899999999999999,"15min":0.58699999999999997},"min":{"1min":0.47199999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78800000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.66700000000000004,"15min":0.59699999999999998},"min":{"1min":0.54900000000000004,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.873,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:09:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.68899999999999995,"15min":0.61499999999999999},"min":{"1min":0.50600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91800000000000004,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.70099999999999996,"15min":0.60899999999999999},"min":{"1min":0.61199999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94799999999999995,"5min":1.179,"15min":1.179},"last":0.75900000000000001}]},{"osd":4,"last update":"Fri Sep 13 16:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.66600000000000004,"15min":0.62},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69199999999999995,"15min":0.63400000000000001},"min":{"1min":0.48299999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.70199999999999996}]},{"osd":5,"last update":"Fri Sep 13 16:08:49 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68999999999999995,"15min":0.67300000000000004},"min":{"1min":0.54900000000000004,"5min":0.437,"15min":0.437},"max":{"1min":0.97199999999999998,"5min":1.155,"15min":1.155},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.67400000000000004,"15min":0.65900000000000003},"min":{"1min":0.51400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.85899999999999999}]},{"osd":6,"last update":"Fri Sep 13 16:09:13 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.46200000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0620000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90400000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Sep 13 16:09:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.75,"15min":0.75},"min":{"1min":0.51400000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.747},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.53400000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.73899999999999999}]},{"osd":8,"last update":"Fri Sep 13 16:07:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82099999999999995,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.0069999999999999,"5min":1.2,"15min":1.2},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78000000000000003,"15min":0.78600000000000003},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.86399999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.623}]},{"osd":9,"last update":"Fri Sep 13 16:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.84599999999999997,"15min":0.86299999999999999},"min":{"1min":0.57399999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.77700000000000002}]},{"osd":10,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83399999999999996,"15min":0.83499999999999996},"min":{"1min":0.71099999999999997,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.874,"5min":0.90900000000000003,"15min":0.91500000000000004},"min":{"1min":0.68200000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1160000000000001,"5min":1.145,"15min":1.145},"last":0.875}]},{"osd":11,"last update":"Fri Sep 13 16:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.86899999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1118208,"data_stored":561981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.39100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.56000000000000005,"15min":0.53300000000000003},"min":{"1min":0.45500000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78800000000000003,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60399999999999998}]},{"osd":1,"last update":"Fri Sep 13 16:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59499999999999997,"15min":0.52300000000000002},"min":{"1min":0.45800000000000002,"5min":0.32000000000000001,"15min":0.28299999999999997},"max":{"1min":0.82799999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54200000000000004,"15min":0.48499999999999999},"min":{"1min":0.42399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.621}]},{"osd":3,"last update":"Fri Sep 13 16:09:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.42299999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77400000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.436,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.52600000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:09:13 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.73999999999999999}]},{"osd":5,"last update":"Fri Sep 13 16:08:51 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.434,"15min":0.41299999999999998},"min":{"1min":0.30399999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.73599999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.496,"15min":0.46800000000000003},"min":{"1min":0.36499999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.57099999999999995}]},{"osd":6,"last update":"Fri Sep 13 16:09:21 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66500000000000004,"15min":0.65300000000000002},"min":{"1min":0.51900000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83699999999999997,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.437,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90400000000000003,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.498}]},{"osd":7,"last update":"Fri Sep 13 16:09:13 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.70599999999999996}]},{"osd":8,"last update":"Fri Sep 13 16:09:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.33600000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59999999999999998,"15min":0.60299999999999998},"min":{"1min":0.39600000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.44}]},{"osd":9,"last update":"Fri Sep 13 16:09:27 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.74299999999999999,"15min":0.73399999999999999},"min":{"1min":0.55700000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94099999999999995,"5min":1.038,"15min":1.038},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.56100000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93400000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.54600000000000004}]},{"osd":10,"last update":"Fri Sep 13 16:08:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.70499999999999996,"15min":0.69399999999999995},"min":{"1min":0.54900000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.90200000000000002,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.64900000000000002}]},{"osd":11,"last update":"Fri Sep 13 16:09:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.63400000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":1089536,"data_stored":560406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:09:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.44,"5min":0.32200000000000001,"15min":0.309},"max":{"1min":0.88100000000000001,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56000000000000005,"15min":0.55100000000000005},"min":{"1min":0.42099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Sep 13 16:09:43 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.53600000000000003,"15min":0.504},"min":{"1min":0.436,"5min":0.30399999999999999,"15min":0.23799999999999999},"max":{"1min":0.70199999999999996,"5min":0.80400000000000005,"15min":0.82399999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.55300000000000005,"15min":0.51800000000000002},"min":{"1min":0.50900000000000001,"5min":0.32100000000000001,"15min":0.28799999999999998},"max":{"1min":0.76400000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.52600000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:09:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57999999999999996,"15min":0.54200000000000004},"min":{"1min":0.437,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84899999999999998,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56899999999999995,"15min":0.54400000000000004},"min":{"1min":0.38200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79600000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.53600000000000003}]},{"osd":4,"last update":"Fri Sep 13 16:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.42299999999999999,"15min":0.41499999999999998},"min":{"1min":0.307,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.66100000000000003,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.47499999999999998,"15min":0.44500000000000001},"min":{"1min":0.40899999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.48799999999999999}]},{"osd":5,"last update":"Fri Sep 13 16:08:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.55800000000000005,"15min":0.53900000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.55500000000000005,"15min":0.53200000000000003},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.80400000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.62}]},{"osd":6,"last update":"Fri Sep 13 16:09:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61899999999999999,"15min":0.59599999999999997},"min":{"1min":0.40100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89800000000000002,"5min":1.048,"15min":1.048},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.63800000000000001,"15min":0.59999999999999998},"min":{"1min":0.51400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.90900000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri Sep 13 16:09:43 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.46700000000000003,"15min":0.44500000000000001},"min":{"1min":0.35599999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.75600000000000001,"5min":0.875,"15min":0.875},"last":0.63},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.503,"15min":0.47699999999999998},"min":{"1min":0.40999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71099999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.68100000000000005}]},{"osd":8,"last update":"Fri Sep 13 16:09:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89200000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.66500000000000004}]},{"osd":9,"last update":"Fri Sep 13 16:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.63600000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.95799999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.53100000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.873,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69999999999999996}]},{"osd":10,"last update":"Fri Sep 13 16:08:56 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65200000000000002,"15min":0.64900000000000002},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86899999999999999,"5min":1.004,"15min":1.004},"last":0.82999999999999996}]},{"osd":11,"last update":"Fri Sep 13 16:09:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.84099999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":1044480,"data_stored":499597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59499999999999997,"15min":0.55900000000000005},"min":{"1min":0.45900000000000002,"5min":0.36799999999999999,"15min":0.36699999999999999},"max":{"1min":0.86699999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.62},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59499999999999997,"15min":0.56200000000000006},"min":{"1min":0.44400000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67700000000000005,"15min":0.629},"min":{"1min":0.46899999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.95699999999999996,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.67800000000000005,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90100000000000002,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.74199999999999999}]},{"osd":3,"last update":"Fri Sep 13 16:09:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.495},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.46600000000000003}]},{"osd":4,"last update":"Fri Sep 13 16:09:24 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.62,"15min":0.58499999999999996},"min":{"1min":0.47099999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83299999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.60099999999999998},"min":{"1min":0.47099999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89500000000000002,"5min":1.006,"15min":1.006},"last":0.751}]},{"osd":5,"last update":"Fri Sep 13 16:08:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.41599999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94899999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.63100000000000001,"15min":0.623},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.89600000000000002,"5min":1.004,"15min":1.004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66200000000000003,"15min":0.64000000000000001},"min":{"1min":0.45500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.92700000000000005,"5min":1.141,"15min":1.141},"last":0.79700000000000004}]},{"osd":7,"last update":"Fri Sep 13 16:09:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.89900000000000002}]},{"osd":8,"last update":"Fri Sep 13 16:08:58 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77900000000000003,"15min":0.79800000000000004},"min":{"1min":0.56599999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.99299999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.90300000000000002,"15min":0.85099999999999998},"min":{"1min":0.55300000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.024,"5min":13.347,"15min":13.347},"last":0.78400000000000003}]},{"osd":9,"last update":"Fri Sep 13 16:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.83199999999999996,"15min":0.88600000000000001},"min":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97599999999999998,"5min":1.224,"15min":1.224},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.81399999999999995,"15min":0.85199999999999998},"min":{"1min":0.61499999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.97199999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.88200000000000001}]},{"osd":10,"last update":"Fri Sep 13 16:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.84799999999999998,"15min":0.84999999999999998},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.05,"5min":1.204,"15min":1.204},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.82699999999999996,"15min":0.82499999999999996},"min":{"1min":0.625,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.048,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.93999999999999995}]},{"osd":11,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.78600000000000003,"15min":0.77200000000000002},"min":{"1min":0.69599999999999995,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.747,"15min":0.74099999999999999},"min":{"1min":0.57099999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.86799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":63589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:09:52.043 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T16:09:52.358 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:09:52.794 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:52 smithi086 ceph-mon[30379]: from='client.25045 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:09:52.794 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:52 smithi086 ceph-mon[30379]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T16:09:52.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:52 smithi139 ceph-mon[35320]: from='client.25045 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:09:53.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:52 smithi139 ceph-mon[35320]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T16:09:53.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:52 smithi194 ceph-mon[35694]: from='client.25045 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:09:53.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:52 smithi194 ceph-mon[35694]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T16:09:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.451+0000 7f24a5200640 1 -- 172.21.15.86:0/1590242086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24a0072850 msgr2=0x7f24a0072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.451+0000 7f24a5200640 1 --2- 172.21.15.86:0/1590242086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24a0072850 0x7f24a0072c30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2490009900 tx=0x7f249002a480 comp rx=0 tx=0).stop 2024-09-13T16:09:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.451+0000 7f24a5200640 1 -- 172.21.15.86:0/1590242086 shutdown_connections 2024-09-13T16:09:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.451+0000 7f24a5200640 1 --2- 172.21.15.86:0/1590242086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24a0110db0 0x7f24a01131a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.451+0000 7f24a5200640 1 --2- 172.21.15.86:0/1590242086 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24a0073170 0x7f24a0110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.451+0000 7f24a5200640 1 --2- 172.21.15.86:0/1590242086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24a0072850 0x7f24a0072c30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.451+0000 7f24a5200640 1 -- 172.21.15.86:0/1590242086 >> 172.21.15.86:0/1590242086 conn(0x7f24a00fbaa0 msgr2=0x7f24a00fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.451+0000 7f24a5200640 1 -- 172.21.15.86:0/1590242086 shutdown_connections 2024-09-13T16:09:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.451+0000 7f24a5200640 1 -- 172.21.15.86:0/1590242086 wait complete. 2024-09-13T16:09:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.452+0000 7f24a5200640 1 Processor -- start 2024-09-13T16:09:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.452+0000 7f24a5200640 1 -- start start 2024-09-13T16:09:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.453+0000 7f24a5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24a0072850 0x7f24a019ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.453+0000 7f24a5200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24a0073170 0x7f24a019cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.453+0000 7f24a5200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24a0110db0 0x7f24a01a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.453+0000 7f24a5200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a01a1980 con 0x7f24a0073170 2024-09-13T16:09:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.453+0000 7f24a5200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a01a1af0 con 0x7f24a0072850 2024-09-13T16:09:54.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.453+0000 7f24a5200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a01a1cb0 con 0x7f24a0110db0 2024-09-13T16:09:54.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.453+0000 7f249d400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24a0073170 0x7f24a019cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:54.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.453+0000 7f249de00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24a0072850 0x7f24a019ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:54.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.453+0000 7f249de00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24a0072850 0x7f24a019ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:42310/0 (socket says 172.21.15.86:42310) 2024-09-13T16:09:54.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.453+0000 7f249de00640 1 -- 172.21.15.86:0/534553983 learned_addr learned my addr 172.21.15.86:0/534553983 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:54.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.453+0000 7f249e800640 1 --2- 172.21.15.86:0/534553983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24a0110db0 0x7f24a01a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:54.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.453+0000 7f249d400640 1 -- 172.21.15.86:0/534553983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24a0110db0 msgr2=0x7f24a01a1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:54.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.453+0000 7f249d400640 1 --2- 172.21.15.86:0/534553983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24a0110db0 0x7f24a01a1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:54.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.453+0000 7f249d400640 1 -- 172.21.15.86:0/534553983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24a0072850 msgr2=0x7f24a019ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:54.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.453+0000 7f249d400640 1 --2- 172.21.15.86:0/534553983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24a0072850 0x7f24a019ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:54.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.453+0000 7f249d400640 1 -- 172.21.15.86:0/534553983 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2490009560 con 0x7f24a0073170 2024-09-13T16:09:54.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.454+0000 7f249d400640 1 --2- 172.21.15.86:0/534553983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24a0073170 0x7f24a019cf50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f248c00e9f0 tx=0x7f248c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:54.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.454+0000 7f2496a00640 1 -- 172.21.15.86:0/534553983 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c00ccc0 con 0x7f24a0073170 2024-09-13T16:09:54.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.454+0000 7f2496a00640 1 -- 172.21.15.86:0/534553983 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f248c00ce20 con 0x7f24a0073170 2024-09-13T16:09:54.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.454+0000 7f24a5200640 1 -- 172.21.15.86:0/534553983 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a01a1f90 con 0x7f24a0073170 2024-09-13T16:09:54.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.454+0000 7f2496a00640 1 -- 172.21.15.86:0/534553983 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c018920 con 0x7f24a0073170 2024-09-13T16:09:54.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.454+0000 7f24a5200640 1 -- 172.21.15.86:0/534553983 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a01a9800 con 0x7f24a0073170 2024-09-13T16:09:54.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.455+0000 7f24a5200640 1 -- 172.21.15.86:0/534553983 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a0073f90 con 0x7f24a0073170 2024-09-13T16:09:54.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.457+0000 7f2496a00640 1 -- 172.21.15.86:0/534553983 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f248c018a80 con 0x7f24a0073170 2024-09-13T16:09:54.460 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.459+0000 7f2496a00640 1 --2- 172.21.15.86:0/534553983 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f24840a1110 0x7f24840a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:54.460 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.459+0000 7f2496a00640 1 -- 172.21.15.86:0/534553983 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f248c014070 con 0x7f24a0073170 2024-09-13T16:09:54.460 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.459+0000 7f249de00640 1 --2- 172.21.15.86:0/534553983 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f24840a1110 0x7f24840a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:54.460 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.460+0000 7f249de00640 1 --2- 172.21.15.86:0/534553983 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f24840a1110 0x7f24840a35d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2490000c00 tx=0x7f2490005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:54.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.463+0000 7f2496a00640 1 -- 172.21.15.86:0/534553983 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f248c052e20 con 0x7f24a0073170 2024-09-13T16:09:54.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.630+0000 7f24a5200640 1 -- 172.21.15.86:0/534553983 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24a0116580 con 0x7f24840a1110 2024-09-13T16:09:54.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.641+0000 7f2496a00640 1 -- 172.21.15.86:0/534553983 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+428091 (secure 0 0 0) 0x7f24a0116580 con 0x7f24840a1110 2024-09-13T16:09:54.651 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:09:54.655 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-09-13T16:09:54.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.648+0000 7f24a5200640 1 -- 172.21.15.86:0/534553983 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f24840a1110 msgr2=0x7f24840a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:54.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.648+0000 7f24a5200640 1 --2- 172.21.15.86:0/534553983 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f24840a1110 0x7f24840a35d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2490000c00 tx=0x7f2490005a20 comp rx=0 tx=0).stop 2024-09-13T16:09:54.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.648+0000 7f24a5200640 1 -- 172.21.15.86:0/534553983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24a0073170 msgr2=0x7f24a019cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:54.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.648+0000 7f24a5200640 1 --2- 172.21.15.86:0/534553983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24a0073170 0x7f24a019cf50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f248c00e9f0 tx=0x7f248c00eeb0 comp rx=0 tx=0).stop 2024-09-13T16:09:54.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.648+0000 7f24a5200640 1 -- 172.21.15.86:0/534553983 shutdown_connections 2024-09-13T16:09:54.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.648+0000 7f24a5200640 1 --2- 172.21.15.86:0/534553983 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f24840a1110 0x7f24840a35d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:54.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.648+0000 7f24a5200640 1 --2- 172.21.15.86:0/534553983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24a0110db0 0x7f24a01a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:54.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.648+0000 7f24a5200640 1 --2- 172.21.15.86:0/534553983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24a0073170 0x7f24a019cf50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:54.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.648+0000 7f24a5200640 1 --2- 172.21.15.86:0/534553983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24a0072850 0x7f24a019ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:54.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.648+0000 7f24a5200640 1 -- 172.21.15.86:0/534553983 >> 172.21.15.86:0/534553983 conn(0x7f24a00fbaa0 msgr2=0x7f24a00fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:54.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.648+0000 7f24a5200640 1 -- 172.21.15.86:0/534553983 shutdown_connections 2024-09-13T16:09:54.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:54.648+0000 7f24a5200640 1 -- 172.21.15.86:0/534553983 wait complete. 2024-09-13T16:09:54.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:54 smithi139 ceph-mon[35320]: pgmap v349: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:09:55.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:54 smithi194 ceph-mon[35694]: pgmap v349: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:09:55.022 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:54 smithi086 ceph-mon[30379]: pgmap v349: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:09:55.548 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2024-09-13T16:09:53.358358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656795,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":622,"num_read_kb":428,"num_write":342,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":383452,"kb_used_data":14120,"kb_used_omap":18,"kb_used_meta":369133,"kb_avail":1124558372,"statfs":{"total":1151940427776,"available":1151547772928,"internally_reserved":0,"allocated":14458880,"data_stored":7981393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19130,"internal_metadata":377992518},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003197"},"pg_stats":[{"pgid":"2.1f","version":"90'9","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519774+0000","last_change":"2024-09-13T16:08:08.808610+0000","last_active":"2024-09-13T16:08:59.519774+0000","last_peered":"2024-09-13T16:08:59.519774+0000","last_clean":"2024-09-13T16:08:59.519774+0000","last_became_active":"2024-09-13T16:08:08.808267+0000","last_became_peered":"2024-09-13T16:08:08.808267+0000","last_unstale":"2024-09-13T16:08:59.519774+0000","last_undegraded":"2024-09-13T16:08:59.519774+0000","last_fullsized":"2024-09-13T16:08:59.519774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:56.867501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.620979+0000","last_change":"2024-09-13T16:09:00.620135+0000","last_active":"2024-09-13T16:09:00.620979+0000","last_peered":"2024-09-13T16:09:00.620979+0000","last_clean":"2024-09-13T16:09:00.620979+0000","last_became_active":"2024-09-13T16:09:00.619755+0000","last_became_peered":"2024-09-13T16:09:00.619755+0000","last_unstale":"2024-09-13T16:09:00.620979+0000","last_undegraded":"2024-09-13T16:09:00.620979+0000","last_fullsized":"2024-09-13T16:09:00.620979+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:49.150102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.521816+0000","last_change":"2024-09-13T16:08:13.245650+0000","last_active":"2024-09-13T16:08:59.521816+0000","last_peered":"2024-09-13T16:08:59.521816+0000","last_clean":"2024-09-13T16:08:59.521816+0000","last_became_active":"2024-09-13T16:08:13.245346+0000","last_became_peered":"2024-09-13T16:08:13.245346+0000","last_unstale":"2024-09-13T16:08:59.521816+0000","last_undegraded":"2024-09-13T16:08:59.521816+0000","last_fullsized":"2024-09-13T16:08:59.521816+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:49.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523107+0000","last_change":"2024-09-13T16:08:08.820385+0000","last_active":"2024-09-13T16:08:59.523107+0000","last_peered":"2024-09-13T16:08:59.523107+0000","last_clean":"2024-09-13T16:08:59.523107+0000","last_became_active":"2024-09-13T16:08:08.819874+0000","last_became_peered":"2024-09-13T16:08:08.819874+0000","last_unstale":"2024-09-13T16:08:59.523107+0000","last_undegraded":"2024-09-13T16:08:59.523107+0000","last_fullsized":"2024-09-13T16:08:59.523107+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:02.566058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528650+0000","last_change":"2024-09-13T16:08:09.235517+0000","last_active":"2024-09-13T16:08:59.528650+0000","last_peered":"2024-09-13T16:08:59.528650+0000","last_clean":"2024-09-13T16:08:59.528650+0000","last_became_active":"2024-09-13T16:08:09.235157+0000","last_became_peered":"2024-09-13T16:08:09.235157+0000","last_unstale":"2024-09-13T16:08:59.528650+0000","last_undegraded":"2024-09-13T16:08:59.528650+0000","last_fullsized":"2024-09-13T16:08:59.528650+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:11.651025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.526924+0000","last_change":"2024-09-13T16:08:13.243422+0000","last_active":"2024-09-13T16:08:59.526924+0000","last_peered":"2024-09-13T16:08:59.526924+0000","last_clean":"2024-09-13T16:08:59.526924+0000","last_became_active":"2024-09-13T16:08:13.243075+0000","last_became_peered":"2024-09-13T16:08:13.243075+0000","last_unstale":"2024-09-13T16:08:59.526924+0000","last_undegraded":"2024-09-13T16:08:59.526924+0000","last_fullsized":"2024-09-13T16:08:59.526924+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:56.457343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.526120+0000","last_change":"2024-09-13T16:08:08.807410+0000","last_active":"2024-09-13T16:08:59.526120+0000","last_peered":"2024-09-13T16:08:59.526120+0000","last_clean":"2024-09-13T16:08:59.526120+0000","last_became_active":"2024-09-13T16:08:08.807041+0000","last_became_peered":"2024-09-13T16:08:08.807041+0000","last_unstale":"2024-09-13T16:08:59.526120+0000","last_undegraded":"2024-09-13T16:08:59.526120+0000","last_fullsized":"2024-09-13T16:08:59.526120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:58.198019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.529642+0000","last_change":"2024-09-13T16:08:09.228643+0000","last_active":"2024-09-13T16:08:59.529642+0000","last_peered":"2024-09-13T16:08:59.529642+0000","last_clean":"2024-09-13T16:08:59.529642+0000","last_became_active":"2024-09-13T16:08:09.228329+0000","last_became_peered":"2024-09-13T16:08:09.228329+0000","last_unstale":"2024-09-13T16:08:59.529642+0000","last_undegraded":"2024-09-13T16:08:59.529642+0000","last_fullsized":"2024-09-13T16:08:59.529642+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:03.306471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527999+0000","last_change":"2024-09-13T16:08:13.250671+0000","last_active":"2024-09-13T16:08:59.527999+0000","last_peered":"2024-09-13T16:08:59.527999+0000","last_clean":"2024-09-13T16:08:59.527999+0000","last_became_active":"2024-09-13T16:08:13.250267+0000","last_became_peered":"2024-09-13T16:08:13.250267+0000","last_unstale":"2024-09-13T16:08:59.527999+0000","last_undegraded":"2024-09-13T16:08:59.527999+0000","last_fullsized":"2024-09-13T16:08:59.527999+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:30.939774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.526340+0000","last_change":"2024-09-13T16:08:08.805379+0000","last_active":"2024-09-13T16:08:59.526340+0000","last_peered":"2024-09-13T16:08:59.526340+0000","last_clean":"2024-09-13T16:08:59.526340+0000","last_became_active":"2024-09-13T16:08:08.804848+0000","last_became_peered":"2024-09-13T16:08:08.804848+0000","last_unstale":"2024-09-13T16:08:59.526340+0000","last_undegraded":"2024-09-13T16:08:59.526340+0000","last_fullsized":"2024-09-13T16:08:59.526340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:46.380684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.607048+0000","last_change":"2024-09-13T16:09:00.607048+0000","last_active":"2024-09-13T16:09:00.607048+0000","last_peered":"2024-09-13T16:09:00.607048+0000","last_clean":"2024-09-13T16:09:00.607048+0000","last_became_active":"2024-09-13T16:09:00.606708+0000","last_became_peered":"2024-09-13T16:09:00.606708+0000","last_unstale":"2024-09-13T16:09:00.607048+0000","last_undegraded":"2024-09-13T16:09:00.607048+0000","last_fullsized":"2024-09-13T16:09:00.607048+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:47.971033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527090+0000","last_change":"2024-09-13T16:08:13.244886+0000","last_active":"2024-09-13T16:08:59.527090+0000","last_peered":"2024-09-13T16:08:59.527090+0000","last_clean":"2024-09-13T16:08:59.527090+0000","last_became_active":"2024-09-13T16:08:13.244476+0000","last_became_peered":"2024-09-13T16:08:13.244476+0000","last_unstale":"2024-09-13T16:08:59.527090+0000","last_undegraded":"2024-09-13T16:08:59.527090+0000","last_fullsized":"2024-09-13T16:08:59.527090+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:55.359807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519389+0000","last_change":"2024-09-13T16:08:09.234804+0000","last_active":"2024-09-13T16:08:59.519389+0000","last_peered":"2024-09-13T16:08:59.519389+0000","last_clean":"2024-09-13T16:08:59.519389+0000","last_became_active":"2024-09-13T16:08:09.234358+0000","last_became_peered":"2024-09-13T16:08:09.234358+0000","last_unstale":"2024-09-13T16:08:59.519389+0000","last_undegraded":"2024-09-13T16:08:59.519389+0000","last_fullsized":"2024-09-13T16:08:59.519389+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:48:51.454586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524866+0000","last_change":"2024-09-13T16:08:08.807412+0000","last_active":"2024-09-13T16:08:59.524866+0000","last_peered":"2024-09-13T16:08:59.524866+0000","last_clean":"2024-09-13T16:08:59.524866+0000","last_became_active":"2024-09-13T16:08:08.806940+0000","last_became_peered":"2024-09-13T16:08:08.806940+0000","last_unstale":"2024-09-13T16:08:59.524866+0000","last_undegraded":"2024-09-13T16:08:59.524866+0000","last_fullsized":"2024-09-13T16:08:59.524866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:38.678823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527222+0000","last_change":"2024-09-13T16:08:13.494327+0000","last_active":"2024-09-13T16:08:59.527222+0000","last_peered":"2024-09-13T16:08:59.527222+0000","last_clean":"2024-09-13T16:08:59.527222+0000","last_became_active":"2024-09-13T16:08:13.493850+0000","last_became_peered":"2024-09-13T16:08:13.493850+0000","last_unstale":"2024-09-13T16:08:59.527222+0000","last_undegraded":"2024-09-13T16:08:59.527222+0000","last_fullsized":"2024-09-13T16:08:59.527222+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:12.123640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523663+0000","last_change":"2024-09-13T16:08:09.233638+0000","last_active":"2024-09-13T16:08:59.523663+0000","last_peered":"2024-09-13T16:08:59.523663+0000","last_clean":"2024-09-13T16:08:59.523663+0000","last_became_active":"2024-09-13T16:08:09.233323+0000","last_became_peered":"2024-09-13T16:08:09.233323+0000","last_unstale":"2024-09-13T16:08:59.523663+0000","last_undegraded":"2024-09-13T16:08:59.523663+0000","last_fullsized":"2024-09-13T16:08:59.523663+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:47.313442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.521945+0000","last_change":"2024-09-13T16:08:08.820002+0000","last_active":"2024-09-13T16:08:59.521945+0000","last_peered":"2024-09-13T16:08:59.521945+0000","last_clean":"2024-09-13T16:08:59.521945+0000","last_became_active":"2024-09-13T16:08:08.819675+0000","last_became_peered":"2024-09-13T16:08:08.819675+0000","last_unstale":"2024-09-13T16:08:59.521945+0000","last_undegraded":"2024-09-13T16:08:59.521945+0000","last_fullsized":"2024-09-13T16:08:59.521945+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:13.691478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527206+0000","last_change":"2024-09-13T16:08:13.257847+0000","last_active":"2024-09-13T16:08:59.527206+0000","last_peered":"2024-09-13T16:08:59.527206+0000","last_clean":"2024-09-13T16:08:59.527206+0000","last_became_active":"2024-09-13T16:08:13.257472+0000","last_became_peered":"2024-09-13T16:08:13.257472+0000","last_unstale":"2024-09-13T16:08:59.527206+0000","last_undegraded":"2024-09-13T16:08:59.527206+0000","last_fullsized":"2024-09-13T16:08:59.527206+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:53.002153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528423+0000","last_change":"2024-09-13T16:08:09.221868+0000","last_active":"2024-09-13T16:08:59.528423+0000","last_peered":"2024-09-13T16:08:59.528423+0000","last_clean":"2024-09-13T16:08:59.528423+0000","last_became_active":"2024-09-13T16:08:09.221130+0000","last_became_peered":"2024-09-13T16:08:09.221130+0000","last_unstale":"2024-09-13T16:08:59.528423+0000","last_undegraded":"2024-09-13T16:08:59.528423+0000","last_fullsized":"2024-09-13T16:08:59.528423+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:12:54.102303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522928+0000","last_change":"2024-09-13T16:08:08.807413+0000","last_active":"2024-09-13T16:08:59.522928+0000","last_peered":"2024-09-13T16:08:59.522928+0000","last_clean":"2024-09-13T16:08:59.522928+0000","last_became_active":"2024-09-13T16:08:08.807040+0000","last_became_peered":"2024-09-13T16:08:08.807040+0000","last_unstale":"2024-09-13T16:08:59.522928+0000","last_undegraded":"2024-09-13T16:08:59.522928+0000","last_fullsized":"2024-09-13T16:08:59.522928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:00.580572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519503+0000","last_change":"2024-09-13T16:08:13.257060+0000","last_active":"2024-09-13T16:08:59.519503+0000","last_peered":"2024-09-13T16:08:59.519503+0000","last_clean":"2024-09-13T16:08:59.519503+0000","last_became_active":"2024-09-13T16:08:13.256665+0000","last_became_peered":"2024-09-13T16:08:13.256665+0000","last_unstale":"2024-09-13T16:08:59.519503+0000","last_undegraded":"2024-09-13T16:08:59.519503+0000","last_fullsized":"2024-09-13T16:08:59.519503+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:33.139558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524978+0000","last_change":"2024-09-13T16:08:09.231289+0000","last_active":"2024-09-13T16:08:59.524978+0000","last_peered":"2024-09-13T16:08:59.524978+0000","last_clean":"2024-09-13T16:08:59.524978+0000","last_became_active":"2024-09-13T16:08:09.230247+0000","last_became_peered":"2024-09-13T16:08:09.230247+0000","last_unstale":"2024-09-13T16:08:59.524978+0000","last_undegraded":"2024-09-13T16:08:59.524978+0000","last_fullsized":"2024-09-13T16:08:59.524978+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:34.765694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.529129+0000","last_change":"2024-09-13T16:08:08.797980+0000","last_active":"2024-09-13T16:08:59.529129+0000","last_peered":"2024-09-13T16:08:59.529129+0000","last_clean":"2024-09-13T16:08:59.529129+0000","last_became_active":"2024-09-13T16:08:08.797601+0000","last_became_peered":"2024-09-13T16:08:08.797601+0000","last_unstale":"2024-09-13T16:08:59.529129+0000","last_undegraded":"2024-09-13T16:08:59.529129+0000","last_fullsized":"2024-09-13T16:08:59.529129+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:37.985497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527489+0000","last_change":"2024-09-13T16:08:13.494332+0000","last_active":"2024-09-13T16:08:59.527489+0000","last_peered":"2024-09-13T16:08:59.527489+0000","last_clean":"2024-09-13T16:08:59.527489+0000","last_became_active":"2024-09-13T16:08:13.493846+0000","last_became_peered":"2024-09-13T16:08:13.493846+0000","last_unstale":"2024-09-13T16:08:59.527489+0000","last_undegraded":"2024-09-13T16:08:59.527489+0000","last_fullsized":"2024-09-13T16:08:59.527489+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:08:17.342575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528343+0000","last_change":"2024-09-13T16:08:09.241373+0000","last_active":"2024-09-13T16:08:59.528343+0000","last_peered":"2024-09-13T16:08:59.528343+0000","last_clean":"2024-09-13T16:08:59.528343+0000","last_became_active":"2024-09-13T16:08:09.240846+0000","last_became_peered":"2024-09-13T16:08:09.240846+0000","last_unstale":"2024-09-13T16:08:59.528343+0000","last_undegraded":"2024-09-13T16:08:59.528343+0000","last_fullsized":"2024-09-13T16:08:59.528343+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:11.315423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527799+0000","last_change":"2024-09-13T16:08:08.805428+0000","last_active":"2024-09-13T16:08:59.527799+0000","last_peered":"2024-09-13T16:08:59.527799+0000","last_clean":"2024-09-13T16:08:59.527799+0000","last_became_active":"2024-09-13T16:08:08.805109+0000","last_became_peered":"2024-09-13T16:08:08.805109+0000","last_unstale":"2024-09-13T16:08:59.527799+0000","last_undegraded":"2024-09-13T16:08:59.527799+0000","last_fullsized":"2024-09-13T16:08:59.527799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:30.335761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.521947+0000","last_change":"2024-09-13T16:08:13.240929+0000","last_active":"2024-09-13T16:08:59.521947+0000","last_peered":"2024-09-13T16:08:59.521947+0000","last_clean":"2024-09-13T16:08:59.521947+0000","last_became_active":"2024-09-13T16:08:13.240554+0000","last_became_peered":"2024-09-13T16:08:13.240554+0000","last_unstale":"2024-09-13T16:08:59.521947+0000","last_undegraded":"2024-09-13T16:08:59.521947+0000","last_fullsized":"2024-09-13T16:08:59.521947+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:20.853764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523426+0000","last_change":"2024-09-13T16:08:09.225824+0000","last_active":"2024-09-13T16:08:59.523426+0000","last_peered":"2024-09-13T16:08:59.523426+0000","last_clean":"2024-09-13T16:08:59.523426+0000","last_became_active":"2024-09-13T16:08:09.225568+0000","last_became_peered":"2024-09-13T16:08:09.225568+0000","last_unstale":"2024-09-13T16:08:59.523426+0000","last_undegraded":"2024-09-13T16:08:59.523426+0000","last_fullsized":"2024-09-13T16:08:59.523426+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:05:13.423381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'6","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.520054+0000","last_change":"2024-09-13T16:08:08.812752+0000","last_active":"2024-09-13T16:08:59.520054+0000","last_peered":"2024-09-13T16:08:59.520054+0000","last_clean":"2024-09-13T16:08:59.520054+0000","last_became_active":"2024-09-13T16:08:08.810994+0000","last_became_peered":"2024-09-13T16:08:08.810994+0000","last_unstale":"2024-09-13T16:08:59.520054+0000","last_undegraded":"2024-09-13T16:08:59.520054+0000","last_fullsized":"2024-09-13T16:08:59.520054+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:46.449871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522057+0000","last_change":"2024-09-13T16:08:13.494450+0000","last_active":"2024-09-13T16:08:59.522057+0000","last_peered":"2024-09-13T16:08:59.522057+0000","last_clean":"2024-09-13T16:08:59.522057+0000","last_became_active":"2024-09-13T16:08:13.494008+0000","last_became_peered":"2024-09-13T16:08:13.494008+0000","last_unstale":"2024-09-13T16:08:59.522057+0000","last_undegraded":"2024-09-13T16:08:59.522057+0000","last_fullsized":"2024-09-13T16:08:59.522057+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:05.427801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524524+0000","last_change":"2024-09-13T16:08:09.220790+0000","last_active":"2024-09-13T16:08:59.524524+0000","last_peered":"2024-09-13T16:08:59.524524+0000","last_clean":"2024-09-13T16:08:59.524524+0000","last_became_active":"2024-09-13T16:08:09.219420+0000","last_became_peered":"2024-09-13T16:08:09.219420+0000","last_unstale":"2024-09-13T16:08:59.524524+0000","last_undegraded":"2024-09-13T16:08:59.524524+0000","last_fullsized":"2024-09-13T16:08:59.524524+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:29.674270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.526232+0000","last_change":"2024-09-13T16:08:08.815272+0000","last_active":"2024-09-13T16:08:59.526232+0000","last_peered":"2024-09-13T16:08:59.526232+0000","last_clean":"2024-09-13T16:08:59.526232+0000","last_became_active":"2024-09-13T16:08:08.815018+0000","last_became_peered":"2024-09-13T16:08:08.815018+0000","last_unstale":"2024-09-13T16:08:59.526232+0000","last_undegraded":"2024-09-13T16:08:59.526232+0000","last_fullsized":"2024-09-13T16:08:59.526232+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:29.277253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528456+0000","last_change":"2024-09-13T16:08:13.249856+0000","last_active":"2024-09-13T16:08:59.528456+0000","last_peered":"2024-09-13T16:08:59.528456+0000","last_clean":"2024-09-13T16:08:59.528456+0000","last_became_active":"2024-09-13T16:08:13.249433+0000","last_became_peered":"2024-09-13T16:08:13.249433+0000","last_unstale":"2024-09-13T16:08:59.528456+0000","last_undegraded":"2024-09-13T16:08:59.528456+0000","last_fullsized":"2024-09-13T16:08:59.528456+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:18.805858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522019+0000","last_change":"2024-09-13T16:08:09.239244+0000","last_active":"2024-09-13T16:08:59.522019+0000","last_peered":"2024-09-13T16:08:59.522019+0000","last_clean":"2024-09-13T16:08:59.522019+0000","last_became_active":"2024-09-13T16:08:09.238966+0000","last_became_peered":"2024-09-13T16:08:09.238966+0000","last_unstale":"2024-09-13T16:08:59.522019+0000","last_undegraded":"2024-09-13T16:08:59.522019+0000","last_fullsized":"2024-09-13T16:08:59.522019+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:16:48.832090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519318+0000","last_change":"2024-09-13T16:08:08.813429+0000","last_active":"2024-09-13T16:08:59.519318+0000","last_peered":"2024-09-13T16:08:59.519318+0000","last_clean":"2024-09-13T16:08:59.519318+0000","last_became_active":"2024-09-13T16:08:08.810497+0000","last_became_peered":"2024-09-13T16:08:08.810497+0000","last_unstale":"2024-09-13T16:08:59.519318+0000","last_undegraded":"2024-09-13T16:08:59.519318+0000","last_fullsized":"2024-09-13T16:08:59.519318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:59.728094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524524+0000","last_change":"2024-09-13T16:08:13.494341+0000","last_active":"2024-09-13T16:08:59.524524+0000","last_peered":"2024-09-13T16:08:59.524524+0000","last_clean":"2024-09-13T16:08:59.524524+0000","last_became_active":"2024-09-13T16:08:13.493851+0000","last_became_peered":"2024-09-13T16:08:13.493851+0000","last_unstale":"2024-09-13T16:08:59.524524+0000","last_undegraded":"2024-09-13T16:08:59.524524+0000","last_fullsized":"2024-09-13T16:08:59.524524+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:27.389086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.521998+0000","last_change":"2024-09-13T16:08:09.241722+0000","last_active":"2024-09-13T16:08:59.521998+0000","last_peered":"2024-09-13T16:08:59.521998+0000","last_clean":"2024-09-13T16:08:59.521998+0000","last_became_active":"2024-09-13T16:08:09.241270+0000","last_became_peered":"2024-09-13T16:08:09.241270+0000","last_unstale":"2024-09-13T16:08:59.521998+0000","last_undegraded":"2024-09-13T16:08:59.521998+0000","last_fullsized":"2024-09-13T16:08:59.521998+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:38.909163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519617+0000","last_change":"2024-09-13T16:08:08.807099+0000","last_active":"2024-09-13T16:08:59.519617+0000","last_peered":"2024-09-13T16:08:59.519617+0000","last_clean":"2024-09-13T16:08:59.519617+0000","last_became_active":"2024-09-13T16:08:08.806760+0000","last_became_peered":"2024-09-13T16:08:08.806760+0000","last_unstale":"2024-09-13T16:08:59.519617+0000","last_undegraded":"2024-09-13T16:08:59.519617+0000","last_fullsized":"2024-09-13T16:08:59.519617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:31.077377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524080+0000","last_change":"2024-09-13T16:08:13.258033+0000","last_active":"2024-09-13T16:08:59.524080+0000","last_peered":"2024-09-13T16:08:59.524080+0000","last_clean":"2024-09-13T16:08:59.524080+0000","last_became_active":"2024-09-13T16:08:13.257195+0000","last_became_peered":"2024-09-13T16:08:13.257195+0000","last_unstale":"2024-09-13T16:08:59.524080+0000","last_undegraded":"2024-09-13T16:08:59.524080+0000","last_fullsized":"2024-09-13T16:08:59.524080+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:38.599985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524115+0000","last_change":"2024-09-13T16:08:09.223766+0000","last_active":"2024-09-13T16:08:59.524115+0000","last_peered":"2024-09-13T16:08:59.524115+0000","last_clean":"2024-09-13T16:08:59.524115+0000","last_became_active":"2024-09-13T16:08:09.223485+0000","last_became_peered":"2024-09-13T16:08:09.223485+0000","last_unstale":"2024-09-13T16:08:59.524115+0000","last_undegraded":"2024-09-13T16:08:59.524115+0000","last_fullsized":"2024-09-13T16:08:59.524115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:32.222545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":99,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:47.562568+0000","last_change":"2024-09-13T16:08:08.812793+0000","last_active":"2024-09-13T16:09:47.562568+0000","last_peered":"2024-09-13T16:09:47.562568+0000","last_clean":"2024-09-13T16:09:47.562568+0000","last_became_active":"2024-09-13T16:08:08.811513+0000","last_became_peered":"2024-09-13T16:08:08.811513+0000","last_unstale":"2024-09-13T16:09:47.562568+0000","last_undegraded":"2024-09-13T16:09:47.562568+0000","last_fullsized":"2024-09-13T16:09:47.562568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:42.396184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.525116+0000","last_change":"2024-09-13T16:08:13.494286+0000","last_active":"2024-09-13T16:08:59.525116+0000","last_peered":"2024-09-13T16:08:59.525116+0000","last_clean":"2024-09-13T16:08:59.525116+0000","last_became_active":"2024-09-13T16:08:13.493848+0000","last_became_peered":"2024-09-13T16:08:13.493848+0000","last_unstale":"2024-09-13T16:08:59.525116+0000","last_undegraded":"2024-09-13T16:08:59.525116+0000","last_fullsized":"2024-09-13T16:08:59.525116+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:45.466478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522804+0000","last_change":"2024-09-13T16:08:09.216137+0000","last_active":"2024-09-13T16:08:59.522804+0000","last_peered":"2024-09-13T16:08:59.522804+0000","last_clean":"2024-09-13T16:08:59.522804+0000","last_became_active":"2024-09-13T16:08:09.215801+0000","last_became_peered":"2024-09-13T16:08:09.215801+0000","last_unstale":"2024-09-13T16:08:59.522804+0000","last_undegraded":"2024-09-13T16:08:59.522804+0000","last_fullsized":"2024-09-13T16:08:59.522804+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:58.860711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519178+0000","last_change":"2024-09-13T16:08:08.804138+0000","last_active":"2024-09-13T16:08:59.519178+0000","last_peered":"2024-09-13T16:08:59.519178+0000","last_clean":"2024-09-13T16:08:59.519178+0000","last_became_active":"2024-09-13T16:08:08.803812+0000","last_became_peered":"2024-09-13T16:08:08.803812+0000","last_unstale":"2024-09-13T16:08:59.519178+0000","last_undegraded":"2024-09-13T16:08:59.519178+0000","last_fullsized":"2024-09-13T16:08:59.519178+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:39.388227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.529398+0000","last_change":"2024-09-13T16:09:00.529398+0000","last_active":"2024-09-13T16:09:00.529398+0000","last_peered":"2024-09-13T16:09:00.529398+0000","last_clean":"2024-09-13T16:09:00.529398+0000","last_became_active":"2024-09-13T16:09:00.528920+0000","last_became_peered":"2024-09-13T16:09:00.528920+0000","last_unstale":"2024-09-13T16:09:00.529398+0000","last_undegraded":"2024-09-13T16:09:00.529398+0000","last_fullsized":"2024-09-13T16:09:00.529398+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:59.689268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522463+0000","last_change":"2024-09-13T16:08:09.226177+0000","last_active":"2024-09-13T16:08:59.522463+0000","last_peered":"2024-09-13T16:08:59.522463+0000","last_clean":"2024-09-13T16:08:59.522463+0000","last_became_active":"2024-09-13T16:08:09.225334+0000","last_became_peered":"2024-09-13T16:08:09.225334+0000","last_unstale":"2024-09-13T16:08:59.522463+0000","last_undegraded":"2024-09-13T16:08:59.522463+0000","last_fullsized":"2024-09-13T16:08:59.522463+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:15.539497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527942+0000","last_change":"2024-09-13T16:08:08.807616+0000","last_active":"2024-09-13T16:08:59.527942+0000","last_peered":"2024-09-13T16:08:59.527942+0000","last_clean":"2024-09-13T16:08:59.527942+0000","last_became_active":"2024-09-13T16:08:08.807234+0000","last_became_peered":"2024-09-13T16:08:08.807234+0000","last_unstale":"2024-09-13T16:08:59.527942+0000","last_undegraded":"2024-09-13T16:08:59.527942+0000","last_fullsized":"2024-09-13T16:08:59.527942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:16.270075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":334,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.523013+0000","last_change":"2024-09-13T16:06:54.461102+0000","last_active":"2024-09-13T16:09:00.523013+0000","last_peered":"2024-09-13T16:09:00.523013+0000","last_clean":"2024-09-13T16:09:00.523013+0000","last_became_active":"2024-09-13T16:06:54.460531+0000","last_became_peered":"2024-09-13T16:06:54.460531+0000","last_unstale":"2024-09-13T16:09:00.523013+0000","last_undegraded":"2024-09-13T16:09:00.523013+0000","last_fullsized":"2024-09-13T16:09:00.523013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:03:28.200529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:03:28.200529+0000","last_clean_scrub_stamp":"2024-09-13T16:03:28.200529+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:30.260436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519500+0000","last_change":"2024-09-13T16:08:13.246406+0000","last_active":"2024-09-13T16:08:59.519500+0000","last_peered":"2024-09-13T16:08:59.519500+0000","last_clean":"2024-09-13T16:08:59.519500+0000","last_became_active":"2024-09-13T16:08:13.246026+0000","last_became_peered":"2024-09-13T16:08:13.246026+0000","last_unstale":"2024-09-13T16:08:59.519500+0000","last_undegraded":"2024-09-13T16:08:59.519500+0000","last_fullsized":"2024-09-13T16:08:59.519500+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:28.665873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519695+0000","last_change":"2024-09-13T16:08:09.233241+0000","last_active":"2024-09-13T16:08:59.519695+0000","last_peered":"2024-09-13T16:08:59.519695+0000","last_clean":"2024-09-13T16:08:59.519695+0000","last_became_active":"2024-09-13T16:08:09.232948+0000","last_became_peered":"2024-09-13T16:08:09.232948+0000","last_unstale":"2024-09-13T16:08:59.519695+0000","last_undegraded":"2024-09-13T16:08:59.519695+0000","last_fullsized":"2024-09-13T16:08:59.519695+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:09:45.475066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522390+0000","last_change":"2024-09-13T16:08:08.808529+0000","last_active":"2024-09-13T16:08:59.522390+0000","last_peered":"2024-09-13T16:08:59.522390+0000","last_clean":"2024-09-13T16:08:59.522390+0000","last_became_active":"2024-09-13T16:08:08.808147+0000","last_became_peered":"2024-09-13T16:08:08.808147+0000","last_unstale":"2024-09-13T16:08:59.522390+0000","last_undegraded":"2024-09-13T16:08:59.522390+0000","last_fullsized":"2024-09-13T16:08:59.522390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:20.003116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.529315+0000","last_change":"2024-09-13T16:08:13.254834+0000","last_active":"2024-09-13T16:08:59.529315+0000","last_peered":"2024-09-13T16:08:59.529315+0000","last_clean":"2024-09-13T16:08:59.529315+0000","last_became_active":"2024-09-13T16:08:13.254367+0000","last_became_peered":"2024-09-13T16:08:13.254367+0000","last_unstale":"2024-09-13T16:08:59.529315+0000","last_undegraded":"2024-09-13T16:08:59.529315+0000","last_fullsized":"2024-09-13T16:08:59.529315+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:41.300674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519762+0000","last_change":"2024-09-13T16:08:09.236082+0000","last_active":"2024-09-13T16:08:59.519762+0000","last_peered":"2024-09-13T16:08:59.519762+0000","last_clean":"2024-09-13T16:08:59.519762+0000","last_became_active":"2024-09-13T16:08:09.235750+0000","last_became_peered":"2024-09-13T16:08:09.235750+0000","last_unstale":"2024-09-13T16:08:59.519762+0000","last_undegraded":"2024-09-13T16:08:59.519762+0000","last_fullsized":"2024-09-13T16:08:59.519762+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:32.953680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524152+0000","last_change":"2024-09-13T16:08:08.804210+0000","last_active":"2024-09-13T16:08:59.524152+0000","last_peered":"2024-09-13T16:08:59.524152+0000","last_clean":"2024-09-13T16:08:59.524152+0000","last_became_active":"2024-09-13T16:08:08.803910+0000","last_became_peered":"2024-09-13T16:08:08.803910+0000","last_unstale":"2024-09-13T16:08:59.524152+0000","last_undegraded":"2024-09-13T16:08:59.524152+0000","last_fullsized":"2024-09-13T16:08:59.524152+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:43.572010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528155+0000","last_change":"2024-09-13T16:08:13.252873+0000","last_active":"2024-09-13T16:08:59.528155+0000","last_peered":"2024-09-13T16:08:59.528155+0000","last_clean":"2024-09-13T16:08:59.528155+0000","last_became_active":"2024-09-13T16:08:13.252051+0000","last_became_peered":"2024-09-13T16:08:13.252051+0000","last_unstale":"2024-09-13T16:08:59.528155+0000","last_undegraded":"2024-09-13T16:08:59.528155+0000","last_fullsized":"2024-09-13T16:08:59.528155+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:28.163552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519952+0000","last_change":"2024-09-13T16:08:09.228033+0000","last_active":"2024-09-13T16:08:59.519952+0000","last_peered":"2024-09-13T16:08:59.519952+0000","last_clean":"2024-09-13T16:08:59.519952+0000","last_became_active":"2024-09-13T16:08:09.227741+0000","last_became_peered":"2024-09-13T16:08:09.227741+0000","last_unstale":"2024-09-13T16:08:59.519952+0000","last_undegraded":"2024-09-13T16:08:59.519952+0000","last_fullsized":"2024-09-13T16:08:59.519952+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:49.607147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.525276+0000","last_change":"2024-09-13T16:08:08.812963+0000","last_active":"2024-09-13T16:08:59.525276+0000","last_peered":"2024-09-13T16:08:59.525276+0000","last_clean":"2024-09-13T16:08:59.525276+0000","last_became_active":"2024-09-13T16:08:08.812627+0000","last_became_peered":"2024-09-13T16:08:08.812627+0000","last_unstale":"2024-09-13T16:08:59.525276+0000","last_undegraded":"2024-09-13T16:08:59.525276+0000","last_fullsized":"2024-09-13T16:08:59.525276+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:11.237846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523980+0000","last_change":"2024-09-13T16:08:13.242146+0000","last_active":"2024-09-13T16:08:59.523980+0000","last_peered":"2024-09-13T16:08:59.523980+0000","last_clean":"2024-09-13T16:08:59.523980+0000","last_became_active":"2024-09-13T16:08:13.241794+0000","last_became_peered":"2024-09-13T16:08:13.241794+0000","last_unstale":"2024-09-13T16:08:59.523980+0000","last_undegraded":"2024-09-13T16:08:59.523980+0000","last_fullsized":"2024-09-13T16:08:59.523980+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:55.392157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.529457+0000","last_change":"2024-09-13T16:09:00.529457+0000","last_active":"2024-09-13T16:09:00.529457+0000","last_peered":"2024-09-13T16:09:00.529457+0000","last_clean":"2024-09-13T16:09:00.529457+0000","last_became_active":"2024-09-13T16:09:00.529130+0000","last_became_peered":"2024-09-13T16:09:00.529130+0000","last_unstale":"2024-09-13T16:09:00.529457+0000","last_undegraded":"2024-09-13T16:09:00.529457+0000","last_fullsized":"2024-09-13T16:09:00.529457+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:03.158466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7],"acting":[11,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.526522+0000","last_change":"2024-09-13T16:08:08.805604+0000","last_active":"2024-09-13T16:08:59.526522+0000","last_peered":"2024-09-13T16:08:59.526522+0000","last_clean":"2024-09-13T16:08:59.526522+0000","last_became_active":"2024-09-13T16:08:08.805285+0000","last_became_peered":"2024-09-13T16:08:08.805285+0000","last_unstale":"2024-09-13T16:08:59.526522+0000","last_undegraded":"2024-09-13T16:08:59.526522+0000","last_fullsized":"2024-09-13T16:08:59.526522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:53.534980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524283+0000","last_change":"2024-09-13T16:08:13.253080+0000","last_active":"2024-09-13T16:08:59.524283+0000","last_peered":"2024-09-13T16:08:59.524283+0000","last_clean":"2024-09-13T16:08:59.524283+0000","last_became_active":"2024-09-13T16:08:13.252803+0000","last_became_peered":"2024-09-13T16:08:13.252803+0000","last_unstale":"2024-09-13T16:08:59.524283+0000","last_undegraded":"2024-09-13T16:08:59.524283+0000","last_fullsized":"2024-09-13T16:08:59.524283+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:45.074295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.525305+0000","last_change":"2024-09-13T16:08:09.226784+0000","last_active":"2024-09-13T16:08:59.525305+0000","last_peered":"2024-09-13T16:08:59.525305+0000","last_clean":"2024-09-13T16:08:59.525305+0000","last_became_active":"2024-09-13T16:08:09.226464+0000","last_became_peered":"2024-09-13T16:08:09.226464+0000","last_unstale":"2024-09-13T16:08:59.525305+0000","last_undegraded":"2024-09-13T16:08:59.525305+0000","last_fullsized":"2024-09-13T16:08:59.525305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:42.808510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523298+0000","last_change":"2024-09-13T16:08:08.814647+0000","last_active":"2024-09-13T16:08:59.523298+0000","last_peered":"2024-09-13T16:08:59.523298+0000","last_clean":"2024-09-13T16:08:59.523298+0000","last_became_active":"2024-09-13T16:08:08.814325+0000","last_became_peered":"2024-09-13T16:08:08.814325+0000","last_unstale":"2024-09-13T16:08:59.523298+0000","last_undegraded":"2024-09-13T16:08:59.523298+0000","last_fullsized":"2024-09-13T16:08:59.523298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:15.358731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.525114+0000","last_change":"2024-09-13T16:08:13.259693+0000","last_active":"2024-09-13T16:08:59.525114+0000","last_peered":"2024-09-13T16:08:59.525114+0000","last_clean":"2024-09-13T16:08:59.525114+0000","last_became_active":"2024-09-13T16:08:13.254908+0000","last_became_peered":"2024-09-13T16:08:13.254908+0000","last_unstale":"2024-09-13T16:08:59.525114+0000","last_undegraded":"2024-09-13T16:08:59.525114+0000","last_fullsized":"2024-09-13T16:08:59.525114+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:57.130633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519066+0000","last_change":"2024-09-13T16:08:09.231371+0000","last_active":"2024-09-13T16:08:59.519066+0000","last_peered":"2024-09-13T16:08:59.519066+0000","last_clean":"2024-09-13T16:08:59.519066+0000","last_became_active":"2024-09-13T16:08:09.231054+0000","last_became_peered":"2024-09-13T16:08:09.231054+0000","last_unstale":"2024-09-13T16:08:59.519066+0000","last_undegraded":"2024-09-13T16:08:59.519066+0000","last_fullsized":"2024-09-13T16:08:59.519066+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:59.921297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'4","reported_seq":101,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:46.561840+0000","last_change":"2024-09-13T16:08:08.803541+0000","last_active":"2024-09-13T16:09:46.561840+0000","last_peered":"2024-09-13T16:09:46.561840+0000","last_clean":"2024-09-13T16:09:46.561840+0000","last_became_active":"2024-09-13T16:08:08.803183+0000","last_became_peered":"2024-09-13T16:08:08.803183+0000","last_unstale":"2024-09-13T16:09:46.561840+0000","last_undegraded":"2024-09-13T16:09:46.561840+0000","last_fullsized":"2024-09-13T16:09:46.561840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:09.210442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":932,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519584+0000","last_change":"2024-09-13T16:08:13.259229+0000","last_active":"2024-09-13T16:08:59.519584+0000","last_peered":"2024-09-13T16:08:59.519584+0000","last_clean":"2024-09-13T16:08:59.519584+0000","last_became_active":"2024-09-13T16:08:13.258625+0000","last_became_peered":"2024-09-13T16:08:13.258625+0000","last_unstale":"2024-09-13T16:08:59.519584+0000","last_undegraded":"2024-09-13T16:08:59.519584+0000","last_fullsized":"2024-09-13T16:08:59.519584+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:09.660175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519495+0000","last_change":"2024-09-13T16:08:09.229192+0000","last_active":"2024-09-13T16:08:59.519495+0000","last_peered":"2024-09-13T16:08:59.519495+0000","last_clean":"2024-09-13T16:08:59.519495+0000","last_became_active":"2024-09-13T16:08:09.227639+0000","last_became_peered":"2024-09-13T16:08:09.227639+0000","last_unstale":"2024-09-13T16:08:59.519495+0000","last_undegraded":"2024-09-13T16:08:59.519495+0000","last_fullsized":"2024-09-13T16:08:59.519495+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:59.646494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524882+0000","last_change":"2024-09-13T16:08:08.803645+0000","last_active":"2024-09-13T16:08:59.524882+0000","last_peered":"2024-09-13T16:08:59.524882+0000","last_clean":"2024-09-13T16:08:59.524882+0000","last_became_active":"2024-09-13T16:08:08.803248+0000","last_became_peered":"2024-09-13T16:08:08.803248+0000","last_unstale":"2024-09-13T16:08:59.524882+0000","last_undegraded":"2024-09-13T16:08:59.524882+0000","last_fullsized":"2024-09-13T16:08:59.524882+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:34.875141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528675+0000","last_change":"2024-09-13T16:08:13.256058+0000","last_active":"2024-09-13T16:08:59.528675+0000","last_peered":"2024-09-13T16:08:59.528675+0000","last_clean":"2024-09-13T16:08:59.528675+0000","last_became_active":"2024-09-13T16:08:13.255760+0000","last_became_peered":"2024-09-13T16:08:13.255760+0000","last_unstale":"2024-09-13T16:08:59.528675+0000","last_undegraded":"2024-09-13T16:08:59.528675+0000","last_fullsized":"2024-09-13T16:08:59.528675+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:58.830340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523578+0000","last_change":"2024-09-13T16:08:09.222978+0000","last_active":"2024-09-13T16:08:59.523578+0000","last_peered":"2024-09-13T16:08:59.523578+0000","last_clean":"2024-09-13T16:08:59.523578+0000","last_became_active":"2024-09-13T16:08:09.222646+0000","last_became_peered":"2024-09-13T16:08:09.222646+0000","last_unstale":"2024-09-13T16:08:59.523578+0000","last_undegraded":"2024-09-13T16:08:59.523578+0000","last_fullsized":"2024-09-13T16:08:59.523578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:05.335298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522200+0000","last_change":"2024-09-13T16:08:08.820187+0000","last_active":"2024-09-13T16:08:59.522200+0000","last_peered":"2024-09-13T16:08:59.522200+0000","last_clean":"2024-09-13T16:08:59.522200+0000","last_became_active":"2024-09-13T16:08:08.819825+0000","last_became_peered":"2024-09-13T16:08:08.819825+0000","last_unstale":"2024-09-13T16:08:59.522200+0000","last_undegraded":"2024-09-13T16:08:59.522200+0000","last_fullsized":"2024-09-13T16:08:59.522200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:13.175211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523780+0000","last_change":"2024-09-13T16:08:13.247359+0000","last_active":"2024-09-13T16:08:59.523780+0000","last_peered":"2024-09-13T16:08:59.523780+0000","last_clean":"2024-09-13T16:08:59.523780+0000","last_became_active":"2024-09-13T16:08:13.247000+0000","last_became_peered":"2024-09-13T16:08:13.247000+0000","last_unstale":"2024-09-13T16:08:59.523780+0000","last_undegraded":"2024-09-13T16:08:59.523780+0000","last_fullsized":"2024-09-13T16:08:59.523780+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:24.447814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.525939+0000","last_change":"2024-09-13T16:08:09.235838+0000","last_active":"2024-09-13T16:08:59.525939+0000","last_peered":"2024-09-13T16:08:59.525939+0000","last_clean":"2024-09-13T16:08:59.525939+0000","last_became_active":"2024-09-13T16:08:09.235545+0000","last_became_peered":"2024-09-13T16:08:09.235545+0000","last_unstale":"2024-09-13T16:08:59.525939+0000","last_undegraded":"2024-09-13T16:08:59.525939+0000","last_fullsized":"2024-09-13T16:08:59.525939+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.842273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'34","reported_seq":218,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:50.567720+0000","last_change":"2024-09-13T16:08:08.798172+0000","last_active":"2024-09-13T16:09:50.567720+0000","last_peered":"2024-09-13T16:09:50.567720+0000","last_clean":"2024-09-13T16:09:50.567720+0000","last_became_active":"2024-09-13T16:08:08.797852+0000","last_became_peered":"2024-09-13T16:08:08.797852+0000","last_unstale":"2024-09-13T16:09:50.567720+0000","last_undegraded":"2024-09-13T16:09:50.567720+0000","last_fullsized":"2024-09-13T16:09:50.567720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:19.455595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62287,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":144,"num_write":35,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.518819+0000","last_change":"2024-09-13T16:08:13.246905+0000","last_active":"2024-09-13T16:08:59.518819+0000","last_peered":"2024-09-13T16:08:59.518819+0000","last_clean":"2024-09-13T16:08:59.518819+0000","last_became_active":"2024-09-13T16:08:13.246446+0000","last_became_peered":"2024-09-13T16:08:13.246446+0000","last_unstale":"2024-09-13T16:08:59.518819+0000","last_undegraded":"2024-09-13T16:08:59.518819+0000","last_fullsized":"2024-09-13T16:08:59.518819+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:10.282057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.529592+0000","last_change":"2024-09-13T16:08:09.223545+0000","last_active":"2024-09-13T16:08:59.529592+0000","last_peered":"2024-09-13T16:08:59.529592+0000","last_clean":"2024-09-13T16:08:59.529592+0000","last_became_active":"2024-09-13T16:08:09.223224+0000","last_became_peered":"2024-09-13T16:08:09.223224+0000","last_unstale":"2024-09-13T16:08:59.529592+0000","last_undegraded":"2024-09-13T16:08:59.529592+0000","last_fullsized":"2024-09-13T16:08:59.529592+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:43.886882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524002+0000","last_change":"2024-09-13T16:08:08.811078+0000","last_active":"2024-09-13T16:08:59.524002+0000","last_peered":"2024-09-13T16:08:59.524002+0000","last_clean":"2024-09-13T16:08:59.524002+0000","last_became_active":"2024-09-13T16:08:08.810743+0000","last_became_peered":"2024-09-13T16:08:08.810743+0000","last_unstale":"2024-09-13T16:08:59.524002+0000","last_undegraded":"2024-09-13T16:08:59.524002+0000","last_fullsized":"2024-09-13T16:08:59.524002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:48.355869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527334+0000","last_change":"2024-09-13T16:08:13.243634+0000","last_active":"2024-09-13T16:08:59.527334+0000","last_peered":"2024-09-13T16:08:59.527334+0000","last_clean":"2024-09-13T16:08:59.527334+0000","last_became_active":"2024-09-13T16:08:13.243283+0000","last_became_peered":"2024-09-13T16:08:13.243283+0000","last_unstale":"2024-09-13T16:08:59.527334+0000","last_undegraded":"2024-09-13T16:08:59.527334+0000","last_fullsized":"2024-09-13T16:08:59.527334+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:50.226378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528723+0000","last_change":"2024-09-13T16:08:09.236851+0000","last_active":"2024-09-13T16:08:59.528723+0000","last_peered":"2024-09-13T16:08:59.528723+0000","last_clean":"2024-09-13T16:08:59.528723+0000","last_became_active":"2024-09-13T16:08:09.233841+0000","last_became_peered":"2024-09-13T16:08:09.233841+0000","last_unstale":"2024-09-13T16:08:59.528723+0000","last_undegraded":"2024-09-13T16:08:59.528723+0000","last_fullsized":"2024-09-13T16:08:59.528723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.543328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519638+0000","last_change":"2024-09-13T16:08:08.804942+0000","last_active":"2024-09-13T16:08:59.519638+0000","last_peered":"2024-09-13T16:08:59.519638+0000","last_clean":"2024-09-13T16:08:59.519638+0000","last_became_active":"2024-09-13T16:08:08.804618+0000","last_became_peered":"2024-09-13T16:08:08.804618+0000","last_unstale":"2024-09-13T16:08:59.519638+0000","last_undegraded":"2024-09-13T16:08:59.519638+0000","last_fullsized":"2024-09-13T16:08:59.519638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:54.798241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.518504+0000","last_change":"2024-09-13T16:08:13.255246+0000","last_active":"2024-09-13T16:08:59.518504+0000","last_peered":"2024-09-13T16:08:59.518504+0000","last_clean":"2024-09-13T16:08:59.518504+0000","last_became_active":"2024-09-13T16:08:13.249738+0000","last_became_peered":"2024-09-13T16:08:13.249738+0000","last_unstale":"2024-09-13T16:08:59.518504+0000","last_undegraded":"2024-09-13T16:08:59.518504+0000","last_fullsized":"2024-09-13T16:08:59.518504+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:59.917028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.529949+0000","last_change":"2024-09-13T16:08:09.232237+0000","last_active":"2024-09-13T16:08:59.529949+0000","last_peered":"2024-09-13T16:08:59.529949+0000","last_clean":"2024-09-13T16:08:59.529949+0000","last_became_active":"2024-09-13T16:08:09.231936+0000","last_became_peered":"2024-09-13T16:08:09.231936+0000","last_unstale":"2024-09-13T16:08:59.529949+0000","last_undegraded":"2024-09-13T16:08:59.529949+0000","last_fullsized":"2024-09-13T16:08:59.529949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:14.154719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'3","reported_seq":100,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:49.566170+0000","last_change":"2024-09-13T16:08:08.807354+0000","last_active":"2024-09-13T16:09:49.566170+0000","last_peered":"2024-09-13T16:09:49.566170+0000","last_clean":"2024-09-13T16:09:49.566170+0000","last_became_active":"2024-09-13T16:08:08.807040+0000","last_became_peered":"2024-09-13T16:08:08.807040+0000","last_unstale":"2024-09-13T16:09:49.566170+0000","last_undegraded":"2024-09-13T16:09:49.566170+0000","last_fullsized":"2024-09-13T16:09:49.566170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:38.861647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":79,"num_read_kb":79,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522150+0000","last_change":"2024-09-13T16:08:13.243743+0000","last_active":"2024-09-13T16:08:59.522150+0000","last_peered":"2024-09-13T16:08:59.522150+0000","last_clean":"2024-09-13T16:08:59.522150+0000","last_became_active":"2024-09-13T16:08:13.243197+0000","last_became_peered":"2024-09-13T16:08:13.243197+0000","last_unstale":"2024-09-13T16:08:59.522150+0000","last_undegraded":"2024-09-13T16:08:59.522150+0000","last_fullsized":"2024-09-13T16:08:59.522150+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:53.731019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528222+0000","last_change":"2024-09-13T16:08:13.255518+0000","last_active":"2024-09-13T16:08:59.528222+0000","last_peered":"2024-09-13T16:08:59.528222+0000","last_clean":"2024-09-13T16:08:59.528222+0000","last_became_active":"2024-09-13T16:08:13.255082+0000","last_became_peered":"2024-09-13T16:08:13.255082+0000","last_unstale":"2024-09-13T16:08:59.528222+0000","last_undegraded":"2024-09-13T16:08:59.528222+0000","last_fullsized":"2024-09-13T16:08:59.528222+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:09.010691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.525844+0000","last_change":"2024-09-13T16:09:00.525844+0000","last_active":"2024-09-13T16:09:00.525844+0000","last_peered":"2024-09-13T16:09:00.525844+0000","last_clean":"2024-09-13T16:09:00.525844+0000","last_became_active":"2024-09-13T16:09:00.525419+0000","last_became_peered":"2024-09-13T16:09:00.525419+0000","last_unstale":"2024-09-13T16:09:00.525844+0000","last_undegraded":"2024-09-13T16:09:00.525844+0000","last_fullsized":"2024-09-13T16:09:00.525844+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:13:50.642374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,10],"acting":[9,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524232+0000","last_change":"2024-09-13T16:08:08.803903+0000","last_active":"2024-09-13T16:08:59.524232+0000","last_peered":"2024-09-13T16:08:59.524232+0000","last_clean":"2024-09-13T16:08:59.524232+0000","last_became_active":"2024-09-13T16:08:08.803412+0000","last_became_peered":"2024-09-13T16:08:08.803412+0000","last_unstale":"2024-09-13T16:08:59.524232+0000","last_undegraded":"2024-09-13T16:08:59.524232+0000","last_fullsized":"2024-09-13T16:08:59.524232+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:20.472012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528506+0000","last_change":"2024-09-13T16:08:13.258590+0000","last_active":"2024-09-13T16:08:59.528506+0000","last_peered":"2024-09-13T16:08:59.528506+0000","last_clean":"2024-09-13T16:08:59.528506+0000","last_became_active":"2024-09-13T16:08:13.258181+0000","last_became_peered":"2024-09-13T16:08:13.258181+0000","last_unstale":"2024-09-13T16:08:59.528506+0000","last_undegraded":"2024-09-13T16:08:59.528506+0000","last_fullsized":"2024-09-13T16:08:59.528506+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:36.631501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522283+0000","last_change":"2024-09-13T16:08:09.228506+0000","last_active":"2024-09-13T16:08:59.522283+0000","last_peered":"2024-09-13T16:08:59.522283+0000","last_clean":"2024-09-13T16:08:59.522283+0000","last_became_active":"2024-09-13T16:08:09.226565+0000","last_became_peered":"2024-09-13T16:08:09.226565+0000","last_unstale":"2024-09-13T16:08:59.522283+0000","last_undegraded":"2024-09-13T16:08:59.522283+0000","last_fullsized":"2024-09-13T16:08:59.522283+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:46.333106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522891+0000","last_change":"2024-09-13T16:08:08.807615+0000","last_active":"2024-09-13T16:08:59.522891+0000","last_peered":"2024-09-13T16:08:59.522891+0000","last_clean":"2024-09-13T16:08:59.522891+0000","last_became_active":"2024-09-13T16:08:08.807318+0000","last_became_peered":"2024-09-13T16:08:08.807318+0000","last_unstale":"2024-09-13T16:08:59.522891+0000","last_undegraded":"2024-09-13T16:08:59.522891+0000","last_fullsized":"2024-09-13T16:08:59.522891+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:36.901859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.521763+0000","last_change":"2024-09-13T16:08:08.806438+0000","last_active":"2024-09-13T16:08:59.521763+0000","last_peered":"2024-09-13T16:08:59.521763+0000","last_clean":"2024-09-13T16:08:59.521763+0000","last_became_active":"2024-09-13T16:08:08.806109+0000","last_became_peered":"2024-09-13T16:08:08.806109+0000","last_unstale":"2024-09-13T16:08:59.521763+0000","last_undegraded":"2024-09-13T16:08:59.521763+0000","last_fullsized":"2024-09-13T16:08:59.521763+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:31.862771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.589501+0000","last_change":"2024-09-13T16:09:00.589501+0000","last_active":"2024-09-13T16:09:00.589501+0000","last_peered":"2024-09-13T16:09:00.589501+0000","last_clean":"2024-09-13T16:09:00.589501+0000","last_became_active":"2024-09-13T16:09:00.589122+0000","last_became_peered":"2024-09-13T16:09:00.589122+0000","last_unstale":"2024-09-13T16:09:00.589501+0000","last_undegraded":"2024-09-13T16:09:00.589501+0000","last_fullsized":"2024-09-13T16:09:00.589501+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:23.415740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522174+0000","last_change":"2024-09-13T16:08:13.244314+0000","last_active":"2024-09-13T16:08:59.522174+0000","last_peered":"2024-09-13T16:08:59.522174+0000","last_clean":"2024-09-13T16:08:59.522174+0000","last_became_active":"2024-09-13T16:08:13.243895+0000","last_became_peered":"2024-09-13T16:08:13.243895+0000","last_unstale":"2024-09-13T16:08:59.522174+0000","last_undegraded":"2024-09-13T16:08:59.522174+0000","last_fullsized":"2024-09-13T16:08:59.522174+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:54.639780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":104,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:49.566654+0000","last_change":"2024-09-13T16:08:08.803669+0000","last_active":"2024-09-13T16:09:49.566654+0000","last_peered":"2024-09-13T16:09:49.566654+0000","last_clean":"2024-09-13T16:09:49.566654+0000","last_became_active":"2024-09-13T16:08:08.803319+0000","last_became_peered":"2024-09-13T16:08:08.803319+0000","last_unstale":"2024-09-13T16:09:49.566654+0000","last_undegraded":"2024-09-13T16:09:49.566654+0000","last_fullsized":"2024-09-13T16:09:49.566654+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:07.782702+0000","last_clean_scrub_stamp":"2024-09-13T16:08:07.782702+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:05.791715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.526511+0000","last_change":"2024-09-13T16:09:00.526511+0000","last_active":"2024-09-13T16:09:00.526511+0000","last_peered":"2024-09-13T16:09:00.526511+0000","last_clean":"2024-09-13T16:09:00.526511+0000","last_became_active":"2024-09-13T16:09:00.526155+0000","last_became_peered":"2024-09-13T16:09:00.526155+0000","last_unstale":"2024-09-13T16:09:00.526511+0000","last_undegraded":"2024-09-13T16:09:00.526511+0000","last_fullsized":"2024-09-13T16:09:00.526511+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:12.069491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522300+0000","last_change":"2024-09-13T16:08:13.240680+0000","last_active":"2024-09-13T16:08:59.522300+0000","last_peered":"2024-09-13T16:08:59.522300+0000","last_clean":"2024-09-13T16:08:59.522300+0000","last_became_active":"2024-09-13T16:08:13.240296+0000","last_became_peered":"2024-09-13T16:08:13.240296+0000","last_unstale":"2024-09-13T16:08:59.522300+0000","last_undegraded":"2024-09-13T16:08:59.522300+0000","last_fullsized":"2024-09-13T16:08:59.522300+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:12.217943+0000","last_clean_scrub_stamp":"2024-09-13T16:08:12.217943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:32.990479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528289+0000","last_change":"2024-09-13T16:08:09.221827+0000","last_active":"2024-09-13T16:08:59.528289+0000","last_peered":"2024-09-13T16:08:59.528289+0000","last_clean":"2024-09-13T16:08:59.528289+0000","last_became_active":"2024-09-13T16:08:09.220698+0000","last_became_peered":"2024-09-13T16:08:09.220698+0000","last_unstale":"2024-09-13T16:08:59.528289+0000","last_undegraded":"2024-09-13T16:08:59.528289+0000","last_fullsized":"2024-09-13T16:08:59.528289+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:17.721497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522132+0000","last_change":"2024-09-13T16:08:09.217094+0000","last_active":"2024-09-13T16:08:59.522132+0000","last_peered":"2024-09-13T16:08:59.522132+0000","last_clean":"2024-09-13T16:08:59.522132+0000","last_became_active":"2024-09-13T16:08:09.216775+0000","last_became_peered":"2024-09-13T16:08:09.216775+0000","last_unstale":"2024-09-13T16:08:59.522132+0000","last_undegraded":"2024-09-13T16:08:59.522132+0000","last_fullsized":"2024-09-13T16:08:59.522132+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:32.350130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522001+0000","last_change":"2024-09-13T16:08:09.227411+0000","last_active":"2024-09-13T16:08:59.522001+0000","last_peered":"2024-09-13T16:08:59.522001+0000","last_clean":"2024-09-13T16:08:59.522001+0000","last_became_active":"2024-09-13T16:08:09.227142+0000","last_became_peered":"2024-09-13T16:08:09.227142+0000","last_unstale":"2024-09-13T16:08:59.522001+0000","last_undegraded":"2024-09-13T16:08:59.522001+0000","last_fullsized":"2024-09-13T16:08:59.522001+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:46.883864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528083+0000","last_change":"2024-09-13T16:08:09.229160+0000","last_active":"2024-09-13T16:08:59.528083+0000","last_peered":"2024-09-13T16:08:59.528083+0000","last_clean":"2024-09-13T16:08:59.528083+0000","last_became_active":"2024-09-13T16:08:09.228843+0000","last_became_peered":"2024-09-13T16:08:09.228843+0000","last_unstale":"2024-09-13T16:08:59.528083+0000","last_undegraded":"2024-09-13T16:08:59.528083+0000","last_fullsized":"2024-09-13T16:08:59.528083+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:11.667437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.620625+0000","last_change":"2024-09-13T16:09:00.620625+0000","last_active":"2024-09-13T16:09:00.620625+0000","last_peered":"2024-09-13T16:09:00.620625+0000","last_clean":"2024-09-13T16:09:00.620625+0000","last_became_active":"2024-09-13T16:09:00.620153+0000","last_became_peered":"2024-09-13T16:09:00.620153+0000","last_unstale":"2024-09-13T16:09:00.620625+0000","last_undegraded":"2024-09-13T16:09:00.620625+0000","last_fullsized":"2024-09-13T16:09:00.620625+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:02.088656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528596+0000","last_change":"2024-09-13T16:08:09.218650+0000","last_active":"2024-09-13T16:08:59.528596+0000","last_peered":"2024-09-13T16:08:59.528596+0000","last_clean":"2024-09-13T16:08:59.528596+0000","last_became_active":"2024-09-13T16:08:09.218347+0000","last_became_peered":"2024-09-13T16:08:09.218347+0000","last_unstale":"2024-09-13T16:08:59.528596+0000","last_undegraded":"2024-09-13T16:08:59.528596+0000","last_fullsized":"2024-09-13T16:08:59.528596+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:31.331274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522638+0000","last_change":"2024-09-13T16:08:09.217256+0000","last_active":"2024-09-13T16:08:59.522638+0000","last_peered":"2024-09-13T16:08:59.522638+0000","last_clean":"2024-09-13T16:08:59.522638+0000","last_became_active":"2024-09-13T16:08:09.216960+0000","last_became_peered":"2024-09-13T16:08:09.216960+0000","last_unstale":"2024-09-13T16:08:59.522638+0000","last_undegraded":"2024-09-13T16:08:59.522638+0000","last_fullsized":"2024-09-13T16:08:59.522638+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:44.473317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523350+0000","last_change":"2024-09-13T16:08:09.225677+0000","last_active":"2024-09-13T16:08:59.523350+0000","last_peered":"2024-09-13T16:08:59.523350+0000","last_clean":"2024-09-13T16:08:59.523350+0000","last_became_active":"2024-09-13T16:08:09.224474+0000","last_became_peered":"2024-09-13T16:08:09.224474+0000","last_unstale":"2024-09-13T16:08:59.523350+0000","last_undegraded":"2024-09-13T16:08:59.523350+0000","last_fullsized":"2024-09-13T16:08:59.523350+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:01.474204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524111+0000","last_change":"2024-09-13T16:08:09.229125+0000","last_active":"2024-09-13T16:08:59.524111+0000","last_peered":"2024-09-13T16:08:59.524111+0000","last_clean":"2024-09-13T16:08:59.524111+0000","last_became_active":"2024-09-13T16:08:09.228611+0000","last_became_peered":"2024-09-13T16:08:09.228611+0000","last_unstale":"2024-09-13T16:08:59.524111+0000","last_undegraded":"2024-09-13T16:08:59.524111+0000","last_fullsized":"2024-09-13T16:08:59.524111+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:51.910316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522770+0000","last_change":"2024-09-13T16:08:09.226355+0000","last_active":"2024-09-13T16:08:59.522770+0000","last_peered":"2024-09-13T16:08:59.522770+0000","last_clean":"2024-09-13T16:08:59.522770+0000","last_became_active":"2024-09-13T16:08:09.225304+0000","last_became_peered":"2024-09-13T16:08:09.225304+0000","last_unstale":"2024-09-13T16:08:59.522770+0000","last_undegraded":"2024-09-13T16:08:59.522770+0000","last_fullsized":"2024-09-13T16:08:59.522770+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:01.714833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.529333+0000","last_change":"2024-09-13T16:08:09.223744+0000","last_active":"2024-09-13T16:08:59.529333+0000","last_peered":"2024-09-13T16:08:59.529333+0000","last_clean":"2024-09-13T16:08:59.529333+0000","last_became_active":"2024-09-13T16:08:09.223433+0000","last_became_peered":"2024-09-13T16:08:09.223433+0000","last_unstale":"2024-09-13T16:08:59.529333+0000","last_undegraded":"2024-09-13T16:08:59.529333+0000","last_fullsized":"2024-09-13T16:08:59.529333+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:32.406142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523757+0000","last_change":"2024-09-13T16:08:09.227752+0000","last_active":"2024-09-13T16:08:59.523757+0000","last_peered":"2024-09-13T16:08:59.523757+0000","last_clean":"2024-09-13T16:08:59.523757+0000","last_became_active":"2024-09-13T16:08:09.227459+0000","last_became_peered":"2024-09-13T16:08:09.227459+0000","last_unstale":"2024-09-13T16:08:59.523757+0000","last_undegraded":"2024-09-13T16:08:59.523757+0000","last_fullsized":"2024-09-13T16:08:59.523757+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:57.357214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528571+0000","last_change":"2024-09-13T16:08:09.221624+0000","last_active":"2024-09-13T16:08:59.528571+0000","last_peered":"2024-09-13T16:08:59.528571+0000","last_clean":"2024-09-13T16:08:59.528571+0000","last_became_active":"2024-09-13T16:08:09.220573+0000","last_became_peered":"2024-09-13T16:08:09.220573+0000","last_unstale":"2024-09-13T16:08:59.528571+0000","last_undegraded":"2024-09-13T16:08:59.528571+0000","last_fullsized":"2024-09-13T16:08:59.528571+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:29.862958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522399+0000","last_change":"2024-09-13T16:08:09.223575+0000","last_active":"2024-09-13T16:08:59.522399+0000","last_peered":"2024-09-13T16:08:59.522399+0000","last_clean":"2024-09-13T16:08:59.522399+0000","last_became_active":"2024-09-13T16:08:09.223312+0000","last_became_peered":"2024-09-13T16:08:09.223312+0000","last_unstale":"2024-09-13T16:08:59.522399+0000","last_undegraded":"2024-09-13T16:08:59.522399+0000","last_fullsized":"2024-09-13T16:08:59.522399+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:32.926562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519977+0000","last_change":"2024-09-13T16:08:09.236371+0000","last_active":"2024-09-13T16:08:59.519977+0000","last_peered":"2024-09-13T16:08:59.519977+0000","last_clean":"2024-09-13T16:08:59.519977+0000","last_became_active":"2024-09-13T16:08:09.234906+0000","last_became_peered":"2024-09-13T16:08:09.234906+0000","last_unstale":"2024-09-13T16:08:59.519977+0000","last_undegraded":"2024-09-13T16:08:59.519977+0000","last_fullsized":"2024-09-13T16:08:59.519977+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:45.305622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.620946+0000","last_change":"2024-09-13T16:09:00.620946+0000","last_active":"2024-09-13T16:09:00.620946+0000","last_peered":"2024-09-13T16:09:00.620946+0000","last_clean":"2024-09-13T16:09:00.620946+0000","last_became_active":"2024-09-13T16:09:00.620640+0000","last_became_peered":"2024-09-13T16:09:00.620640+0000","last_unstale":"2024-09-13T16:09:00.620946+0000","last_undegraded":"2024-09-13T16:09:00.620946+0000","last_fullsized":"2024-09-13T16:09:00.620946+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:25.071507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,0],"acting":[11,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.529014+0000","last_change":"2024-09-13T16:08:09.226472+0000","last_active":"2024-09-13T16:08:59.529014+0000","last_peered":"2024-09-13T16:08:59.529014+0000","last_clean":"2024-09-13T16:08:59.529014+0000","last_became_active":"2024-09-13T16:08:09.225988+0000","last_became_peered":"2024-09-13T16:08:09.225988+0000","last_unstale":"2024-09-13T16:08:59.529014+0000","last_undegraded":"2024-09-13T16:08:59.529014+0000","last_fullsized":"2024-09-13T16:08:59.529014+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:41.785752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527977+0000","last_change":"2024-09-13T16:08:09.219313+0000","last_active":"2024-09-13T16:08:59.527977+0000","last_peered":"2024-09-13T16:08:59.527977+0000","last_clean":"2024-09-13T16:08:59.527977+0000","last_became_active":"2024-09-13T16:08:09.219030+0000","last_became_peered":"2024-09-13T16:08:09.219030+0000","last_unstale":"2024-09-13T16:08:59.527977+0000","last_undegraded":"2024-09-13T16:08:59.527977+0000","last_fullsized":"2024-09-13T16:08:59.527977+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:26.561305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527880+0000","last_change":"2024-09-13T16:08:09.240585+0000","last_active":"2024-09-13T16:08:59.527880+0000","last_peered":"2024-09-13T16:08:59.527880+0000","last_clean":"2024-09-13T16:08:59.527880+0000","last_became_active":"2024-09-13T16:08:09.238960+0000","last_became_peered":"2024-09-13T16:08:09.238960+0000","last_unstale":"2024-09-13T16:08:59.527880+0000","last_undegraded":"2024-09-13T16:08:59.527880+0000","last_fullsized":"2024-09-13T16:08:59.527880+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:24.086723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.523677+0000","last_change":"2024-09-13T16:08:09.234963+0000","last_active":"2024-09-13T16:08:59.523677+0000","last_peered":"2024-09-13T16:08:59.523677+0000","last_clean":"2024-09-13T16:08:59.523677+0000","last_became_active":"2024-09-13T16:08:09.234649+0000","last_became_peered":"2024-09-13T16:08:09.234649+0000","last_unstale":"2024-09-13T16:08:59.523677+0000","last_undegraded":"2024-09-13T16:08:59.523677+0000","last_fullsized":"2024-09-13T16:08:59.523677+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:38.972344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527786+0000","last_change":"2024-09-13T16:08:09.226425+0000","last_active":"2024-09-13T16:08:59.527786+0000","last_peered":"2024-09-13T16:08:59.527786+0000","last_clean":"2024-09-13T16:08:59.527786+0000","last_became_active":"2024-09-13T16:08:09.226121+0000","last_became_peered":"2024-09-13T16:08:09.226121+0000","last_unstale":"2024-09-13T16:08:59.527786+0000","last_undegraded":"2024-09-13T16:08:59.527786+0000","last_fullsized":"2024-09-13T16:08:59.527786+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:10.035414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.519699+0000","last_change":"2024-09-13T16:08:09.234592+0000","last_active":"2024-09-13T16:08:59.519699+0000","last_peered":"2024-09-13T16:08:59.519699+0000","last_clean":"2024-09-13T16:08:59.519699+0000","last_became_active":"2024-09-13T16:08:09.234293+0000","last_became_peered":"2024-09-13T16:08:09.234293+0000","last_unstale":"2024-09-13T16:08:59.519699+0000","last_undegraded":"2024-09-13T16:08:59.519699+0000","last_fullsized":"2024-09-13T16:08:59.519699+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:44.196400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522371+0000","last_change":"2024-09-13T16:08:09.231974+0000","last_active":"2024-09-13T16:08:59.522371+0000","last_peered":"2024-09-13T16:08:59.522371+0000","last_clean":"2024-09-13T16:08:59.522371+0000","last_became_active":"2024-09-13T16:08:09.231667+0000","last_became_peered":"2024-09-13T16:08:09.231667+0000","last_unstale":"2024-09-13T16:08:59.522371+0000","last_undegraded":"2024-09-13T16:08:59.522371+0000","last_fullsized":"2024-09-13T16:08:59.522371+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:05.595837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.530378+0000","last_change":"2024-09-13T16:08:09.225322+0000","last_active":"2024-09-13T16:08:59.530378+0000","last_peered":"2024-09-13T16:08:59.530378+0000","last_clean":"2024-09-13T16:08:59.530378+0000","last_became_active":"2024-09-13T16:08:09.224969+0000","last_became_peered":"2024-09-13T16:08:09.224969+0000","last_unstale":"2024-09-13T16:08:59.530378+0000","last_undegraded":"2024-09-13T16:08:59.530378+0000","last_fullsized":"2024-09-13T16:08:59.530378+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:36.797080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.522209+0000","last_change":"2024-09-13T16:08:09.231870+0000","last_active":"2024-09-13T16:08:59.522209+0000","last_peered":"2024-09-13T16:08:59.522209+0000","last_clean":"2024-09-13T16:08:59.522209+0000","last_became_active":"2024-09-13T16:08:09.231606+0000","last_became_peered":"2024-09-13T16:08:09.231606+0000","last_unstale":"2024-09-13T16:08:59.522209+0000","last_undegraded":"2024-09-13T16:08:59.522209+0000","last_fullsized":"2024-09-13T16:08:59.522209+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:49.235264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:09:00.525142+0000","last_change":"2024-09-13T16:09:00.525142+0000","last_active":"2024-09-13T16:09:00.525142+0000","last_peered":"2024-09-13T16:09:00.525142+0000","last_clean":"2024-09-13T16:09:00.525142+0000","last_became_active":"2024-09-13T16:09:00.524728+0000","last_became_peered":"2024-09-13T16:09:00.524728+0000","last_unstale":"2024-09-13T16:09:00.525142+0000","last_undegraded":"2024-09-13T16:09:00.525142+0000","last_fullsized":"2024-09-13T16:09:00.525142+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:28.609694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.521732+0000","last_change":"2024-09-13T16:08:09.230428+0000","last_active":"2024-09-13T16:08:59.521732+0000","last_peered":"2024-09-13T16:08:59.521732+0000","last_clean":"2024-09-13T16:08:59.521732+0000","last_became_active":"2024-09-13T16:08:09.230139+0000","last_became_peered":"2024-09-13T16:08:09.230139+0000","last_unstale":"2024-09-13T16:08:59.521732+0000","last_undegraded":"2024-09-13T16:08:59.521732+0000","last_fullsized":"2024-09-13T16:08:59.521732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:56.475566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.524737+0000","last_change":"2024-09-13T16:08:09.223142+0000","last_active":"2024-09-13T16:08:59.524737+0000","last_peered":"2024-09-13T16:08:59.524737+0000","last_clean":"2024-09-13T16:08:59.524737+0000","last_became_active":"2024-09-13T16:08:09.222718+0000","last_became_peered":"2024-09-13T16:08:09.222718+0000","last_unstale":"2024-09-13T16:08:59.524737+0000","last_undegraded":"2024-09-13T16:08:59.524737+0000","last_fullsized":"2024-09-13T16:08:59.524737+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:00.737875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.527888+0000","last_change":"2024-09-13T16:08:09.220060+0000","last_active":"2024-09-13T16:08:59.527888+0000","last_peered":"2024-09-13T16:08:59.527888+0000","last_clean":"2024-09-13T16:08:59.527888+0000","last_became_active":"2024-09-13T16:08:09.219751+0000","last_became_peered":"2024-09-13T16:08:09.219751+0000","last_unstale":"2024-09-13T16:08:59.527888+0000","last_undegraded":"2024-09-13T16:08:59.527888+0000","last_fullsized":"2024-09-13T16:08:59.527888+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:47.103762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528343+0000","last_change":"2024-09-13T16:08:09.230914+0000","last_active":"2024-09-13T16:08:59.528343+0000","last_peered":"2024-09-13T16:08:59.528343+0000","last_clean":"2024-09-13T16:08:59.528343+0000","last_became_active":"2024-09-13T16:08:09.230500+0000","last_became_peered":"2024-09-13T16:08:09.230500+0000","last_unstale":"2024-09-13T16:08:59.528343+0000","last_undegraded":"2024-09-13T16:08:59.528343+0000","last_fullsized":"2024-09-13T16:08:59.528343+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:02.096851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528313+0000","last_change":"2024-09-13T16:08:09.239818+0000","last_active":"2024-09-13T16:08:59.528313+0000","last_peered":"2024-09-13T16:08:59.528313+0000","last_clean":"2024-09-13T16:08:59.528313+0000","last_became_active":"2024-09-13T16:08:09.238707+0000","last_became_peered":"2024-09-13T16:08:09.238707+0000","last_unstale":"2024-09-13T16:08:59.528313+0000","last_undegraded":"2024-09-13T16:08:59.528313+0000","last_fullsized":"2024-09-13T16:08:59.528313+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:46.937934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T16:08:59.528826+0000","last_change":"2024-09-13T16:08:09.238796+0000","last_active":"2024-09-13T16:08:59.528826+0000","last_peered":"2024-09-13T16:08:59.528826+0000","last_clean":"2024-09-13T16:08:59.528826+0000","last_became_active":"2024-09-13T16:08:09.238510+0000","last_became_peered":"2024-09-13T16:08:09.238510+0000","last_unstale":"2024-09-13T16:08:59.528826+0000","last_undegraded":"2024-09-13T16:08:59.528826+0000","last_fullsized":"2024-09-13T16:08:59.528826+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:08:08.784985+0000","last_clean_scrub_stamp":"2024-09-13T16:08:08.784985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:18.691940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66193,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":496,"num_read_kb":319,"num_write":159,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":198579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351009,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":1028096,"data_stored":503070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.36299999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77200000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.63},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.624,"15min":0.63500000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.745,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.45900000000000002}]},{"osd":1,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.622,"15min":0.629},"min":{"1min":0.40799999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.44700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77000000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.46800000000000003,"15min":0.47599999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.60599999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.44900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.78900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.67100000000000004,"15min":0.68500000000000005},"min":{"1min":0.375,"5min":0.373,"15min":0.373},"max":{"1min":0.80700000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.64800000000000002}]},{"osd":5,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.50700000000000001,"15min":0.50600000000000001},"min":{"1min":0.38800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.32500000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.81399999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.56899999999999995}]},{"osd":6,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80000000000000004,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.68999999999999995,"15min":0.70999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78700000000000003,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70399999999999996,"15min":0.71099999999999997},"min":{"1min":0.48599999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.79600000000000004,"5min":1.081,"15min":1.081},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71599999999999997,"15min":0.72599999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.77800000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.76600000000000001}]},{"osd":8,"last update":"Fri Sep 13 16:09:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.754}]},{"osd":9,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73599999999999999,"15min":0.745},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.90200000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.89600000000000002,"5min":1.127,"15min":1.127},"last":0.81699999999999995}]},{"osd":10,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.84999999999999998,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.53000000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.88,"5min":1.381,"15min":1.381},"last":0.83099999999999996}]}]},{"osd":10,"up_from":73,"seq":313532612647,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28704,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716448,"statfs":{"total":95995035648,"available":95965642752,"internally_reserved":0,"allocated":1720320,"data_stored":1152969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:09:08 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.626}]},{"osd":1,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.434,"15min":0.441},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.59399999999999997,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.435,"15min":0.439},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60699999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.52600000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72899999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.755,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.68799999999999994}]},{"osd":3,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.63100000000000001,"15min":0.64100000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78800000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70099999999999996,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.65900000000000003}]},{"osd":4,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45500000000000002,"15min":0.46000000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66900000000000004,"5min":0.754,"15min":0.754},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.623,"15min":0.63100000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.76200000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.82099999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91100000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.70799999999999996,"15min":0.72099999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92400000000000004,"5min":1.385,"15min":1.385},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Sep 13 16:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.377},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.39900000000000002}]},{"osd":8,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68799999999999994,"15min":0.69299999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86099999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.74199999999999999,"15min":0.752},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86899999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.75700000000000001}]},{"osd":9,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.73399999999999999,"15min":0.745},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93300000000000005,"5min":1.054,"15min":1.054},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83299999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.871}]},{"osd":11,"last update":"Fri Sep 13 16:09:18 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.56799999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.84699999999999998,"5min":1.026,"15min":1.026},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71099999999999997,"15min":0.70599999999999996},"min":{"1min":0.65200000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89600000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.90300000000000002}]}]},{"osd":9,"up_from":68,"seq":292057776172,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":507402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.49399999999999999,"15min":0.51200000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73599999999999999,"5min":0.745,"15min":0.745},"last":0.372},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.48499999999999999,"15min":0.51500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.53800000000000003,"5min":0.746,"15min":0.746},"last":0.33100000000000002}]},{"osd":1,"last update":"Fri Sep 13 16:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65800000000000003,"15min":0.68999999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83199999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.70099999999999996,"15min":0.73099999999999998},"min":{"1min":0.45100000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81899999999999995,"5min":1.028,"15min":1.028},"last":0.71899999999999997}]},{"osd":2,"last update":"Fri Sep 13 16:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.71699999999999997,"15min":0.753},"min":{"1min":0.49299999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72599999999999998,"5min":1.113,"15min":1.113},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82899999999999996,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.48699999999999999}]},{"osd":3,"last update":"Fri Sep 13 16:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.58999999999999997,"15min":0.63400000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.66900000000000004,"15min":0.71799999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.66300000000000003,"5min":1.151,"15min":1.151},"last":0.38900000000000001}]},{"osd":4,"last update":"Fri Sep 13 16:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.70899999999999996,"15min":0.746},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81699999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.77500000000000002,"15min":0.81699999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.78600000000000003,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.68000000000000005}]},{"osd":5,"last update":"Fri Sep 13 16:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.749,"15min":0.79100000000000004},"min":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.79600000000000004,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.79200000000000004,"15min":0.83699999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84999999999999998,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.50700000000000001}]},{"osd":6,"last update":"Fri Sep 13 16:07:30 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.54700000000000004}]},{"osd":7,"last update":"Fri Sep 13 16:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.82999999999999996,"15min":0.88},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.85499999999999998,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.78200000000000003,"15min":0.83199999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90600000000000003,"5min":1.089,"15min":1.089},"last":0.59199999999999997}]},{"osd":8,"last update":"Fri Sep 13 16:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.82899999999999996,"15min":0.88300000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.84599999999999997,"5min":1.175,"15min":1.175},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.81999999999999995,"15min":0.87},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.84999999999999998,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.53300000000000003}]},{"osd":10,"last update":"Fri Sep 13 16:08:58 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.83399999999999996,"15min":0.85399999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.88700000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.86499999999999999,"15min":0.88800000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.93300000000000005,"5min":1.242,"15min":1.242},"last":0.75600000000000001}]},{"osd":11,"last update":"Fri Sep 13 16:09:18 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.77400000000000002}]}]},{"osd":8,"up_from":60,"seq":257698037810,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":1040384,"data_stored":502895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.59899999999999998,"15min":0.62},"min":{"1min":0.33300000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.747,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77800000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.47899999999999998}]},{"osd":1,"last update":"Fri Sep 13 16:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79100000000000004,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.27900000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.58999999999999997,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.34499999999999997}]},{"osd":3,"last update":"Fri Sep 13 16:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71299999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.443},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61399999999999999,"15min":0.63500000000000001},"min":{"1min":0.43099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.92600000000000005,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.58799999999999997}]},{"osd":4,"last update":"Fri Sep 13 16:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.55600000000000005}]},{"osd":5,"last update":"Fri Sep 13 16:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.495,"15min":0.495},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48799999999999999,"15min":0.48399999999999999},"min":{"1min":0.32900000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.36699999999999999}]},{"osd":6,"last update":"Fri Sep 13 16:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61799999999999999,"15min":0.63100000000000001},"min":{"1min":0.41799999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68000000000000005,"15min":0.68799999999999994},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86499999999999999,"5min":1.371,"15min":1.371},"last":0.54000000000000004}]},{"osd":7,"last update":"Fri Sep 13 16:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85499999999999998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.497},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.87,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.56999999999999995}]},{"osd":9,"last update":"Fri Sep 13 16:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.48799999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.89200000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.54700000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90700000000000003,"5min":1.401,"15min":1.401},"last":0.73499999999999999}]},{"osd":10,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.622,"15min":0.60999999999999999},"min":{"1min":0.45300000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.629},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.65700000000000003,"15min":0.64600000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.69399999999999995}]},{"osd":11,"last update":"Fri Sep 13 16:09:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.71499999999999997}]}]},{"osd":7,"up_from":52,"seq":223338299446,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36808,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708344,"statfs":{"total":95995035648,"available":95957344256,"internally_reserved":0,"allocated":1634304,"data_stored":1098759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.432,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.38200000000000001,"15min":0.373},"min":{"1min":0.28299999999999997,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.376},"min":{"1min":0.32200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59199999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55000000000000004,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82299999999999995,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.502},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55300000000000005,"15min":0.54100000000000004},"min":{"1min":0.441,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71399999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.58099999999999996}]},{"osd":3,"last update":"Fri Sep 13 16:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.46400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.42699999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.77600000000000002,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.45000000000000001,"15min":0.44400000000000001},"min":{"1min":0.30199999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70299999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.379},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45400000000000001,"15min":0.46200000000000002},"min":{"1min":0.29999999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71199999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.41999999999999998}]},{"osd":5,"last update":"Fri Sep 13 16:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77500000000000002,"5min":1.022,"15min":1.022},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59999999999999998,"15min":0.58199999999999996},"min":{"1min":0.48899999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89600000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.51800000000000002}]},{"osd":6,"last update":"Fri Sep 13 16:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.46500000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.45800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.71699999999999997}]},{"osd":8,"last update":"Fri Sep 13 16:09:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60899999999999999,"15min":0.60099999999999998},"min":{"1min":0.45800000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64300000000000002,"15min":0.63100000000000001},"min":{"1min":0.52300000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.73199999999999998}]},{"osd":9,"last update":"Fri Sep 13 16:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71999999999999997,"15min":0.73399999999999999},"min":{"1min":0.52800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.752},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72299999999999998,"15min":0.72899999999999998},"min":{"1min":0.56499999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.67900000000000005}]},{"osd":10,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.45500000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.627,"15min":0.628},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.626}]},{"osd":11,"last update":"Fri Sep 13 16:09:13 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.65800000000000003}]}]},{"osd":6,"up_from":47,"seq":201863462971,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":498209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.495,"15min":0.46600000000000003},"min":{"1min":0.34999999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3,"5min":3,"15min":3},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.48599999999999999,"15min":0.46100000000000002},"min":{"1min":0.35299999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Sep 13 16:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.69999999999999996,"15min":0.67700000000000005},"min":{"1min":0.47799999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.622},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.66500000000000004,"15min":0.623},"min":{"1min":0.46100000000000002,"5min":0.442,"15min":0.442},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.73599999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.66800000000000004,"15min":0.63400000000000001},"min":{"1min":0.497,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.71799999999999997,"15min":0.69299999999999995},"min":{"1min":0.497,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0089999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.81299999999999994}]},{"osd":3,"last update":"Fri Sep 13 16:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.64500000000000002,"15min":0.61199999999999999},"min":{"1min":0.42399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":3.1709999999999998,"5min":3.1709999999999998,"15min":3.1709999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.58299999999999996,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.6320000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":0.59799999999999998}]},{"osd":4,"last update":"Fri Sep 13 16:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.66600000000000004,"15min":0.65200000000000002},"min":{"1min":0.46700000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.754,"15min":0.73399999999999999},"min":{"1min":0.57599999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.746}]},{"osd":5,"last update":"Fri Sep 13 16:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.70299999999999996,"15min":0.67500000000000004},"min":{"1min":0.58499999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.6600000000000001,"5min":2.6600000000000001,"15min":2.6600000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.71399999999999997,"15min":0.69899999999999995},"min":{"1min":0.53500000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.3250000000000002,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.76400000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.72199999999999998,"15min":0.70999999999999996},"min":{"1min":0.52900000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.77300000000000002,"15min":0.749},"min":{"1min":0.55500000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.65900000000000003}]},{"osd":8,"last update":"Fri Sep 13 16:09:08 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.78400000000000003,"15min":0.77000000000000002},"min":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.752,"15min":0.73699999999999999},"min":{"1min":0.53200000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":0.69999999999999996}]},{"osd":9,"last update":"Fri Sep 13 16:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.86299999999999999,"15min":0.85499999999999998},"min":{"1min":0.54500000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":3.363,"5min":3.363,"15min":3.363},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.50600000000000001,"5min":0.505,"15min":0.505},"max":{"1min":2.714,"5min":2.714,"15min":2.714},"last":0.67300000000000004}]},{"osd":10,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.80700000000000005,"15min":0.80600000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.89600000000000002,"15min":0.90200000000000002},"min":{"1min":0.67100000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.78400000000000003}]},{"osd":11,"last update":"Fri Sep 13 16:09:14 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.72799999999999998}]}]},{"osd":5,"up_from":39,"seq":167503724608,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36824,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708328,"statfs":{"total":95995035648,"available":95957327872,"internally_reserved":0,"allocated":1646592,"data_stored":1094284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:08:46 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.38200000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68600000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.54900000000000004,"15min":0.56100000000000005},"min":{"1min":0.33300000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68100000000000005,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.47899999999999998}]},{"osd":1,"last update":"Fri Sep 13 16:08:46 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69199999999999995,"5min":0.748,"15min":0.748},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51800000000000002,"15min":0.50900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76100000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.623}]},{"osd":2,"last update":"Fri Sep 13 16:08:46 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.379,"15min":0.36899999999999999},"min":{"1min":0.28000000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.377},"min":{"1min":0.28399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Sep 13 16:08:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67200000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79300000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Sep 13 16:08:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.39300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77900000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Sep 13 16:09:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.623},"min":{"1min":0.44500000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78500000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.61699999999999999,"15min":0.60799999999999998},"min":{"1min":0.51300000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84899999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.498}]},{"osd":7,"last update":"Fri Sep 13 16:08:46 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.433,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88600000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.63500000000000001}]},{"osd":8,"last update":"Fri Sep 13 16:09:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.39100000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.42399999999999999}]},{"osd":9,"last update":"Fri Sep 13 16:09:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.70999999999999996,"15min":0.72099999999999997},"min":{"1min":0.54300000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.92600000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.60399999999999998}]},{"osd":10,"last update":"Fri Sep 13 16:08:56 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65300000000000002,"15min":0.65600000000000003},"min":{"1min":0.48499999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.874,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64900000000000002,"15min":0.65000000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.73299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888133,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":1036288,"data_stored":503476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:07:28 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.51800000000000002,"15min":0.49099999999999999},"min":{"1min":0.438,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.48199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.436}]},{"osd":1,"last update":"Fri Sep 13 16:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36399999999999999,"15min":0.33600000000000002},"min":{"1min":0.27800000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.54900000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.376,"15min":0.34599999999999997},"min":{"1min":0.32000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.56799999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53500000000000003,"15min":0.52200000000000002},"min":{"1min":0.42899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78000000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52000000000000002,"15min":0.50800000000000001},"min":{"1min":0.40400000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68600000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.71699999999999997}]},{"osd":3,"last update":"Fri Sep 13 16:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.53100000000000003},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75900000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59699999999999998,"15min":0.54700000000000004},"min":{"1min":0.47799999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79300000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:08:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55300000000000005,"15min":0.54100000000000004},"min":{"1min":0.318,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.33600000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68400000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.621,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63500000000000001,"15min":0.61099999999999999},"min":{"1min":0.44600000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86599999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Sep 13 16:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.57299999999999995,"15min":0.65200000000000002},"min":{"1min":0.32900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69399999999999995,"5min":3.4660000000000002,"15min":3.4660000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.56499999999999995,"15min":0.61399999999999999},"min":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72099999999999997,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.63100000000000001}]},{"osd":8,"last update":"Fri Sep 13 16:09:02 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.621,"15min":0.60399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82199999999999995,"5min":0.879,"15min":0.879},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.626,"15min":0.61699999999999999},"min":{"1min":0.438,"5min":0.433,"15min":0.433},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.746}]},{"osd":9,"last update":"Fri Sep 13 16:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.89500000000000002,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.58599999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.80100000000000005}]},{"osd":10,"last update":"Fri Sep 13 16:08:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.81699999999999995}]},{"osd":11,"last update":"Fri Sep 13 16:09:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.85499999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149770,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":498345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:09:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.46000000000000002,"15min":0.39800000000000002},"min":{"1min":0.34000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.45500000000000002,"15min":0.41299999999999998},"min":{"1min":0.34300000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.39100000000000001}]},{"osd":1,"last update":"Fri Sep 13 16:09:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61899999999999999,"15min":0.58699999999999997},"min":{"1min":0.47199999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78800000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.66700000000000004,"15min":0.59699999999999998},"min":{"1min":0.54900000000000004,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.873,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:09:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.68899999999999995,"15min":0.61499999999999999},"min":{"1min":0.50600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91800000000000004,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.70099999999999996,"15min":0.60899999999999999},"min":{"1min":0.61199999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94799999999999995,"5min":1.179,"15min":1.179},"last":0.75900000000000001}]},{"osd":4,"last update":"Fri Sep 13 16:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.66600000000000004,"15min":0.62},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69199999999999995,"15min":0.63400000000000001},"min":{"1min":0.48299999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.70199999999999996}]},{"osd":5,"last update":"Fri Sep 13 16:08:49 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68999999999999995,"15min":0.67300000000000004},"min":{"1min":0.54900000000000004,"5min":0.437,"15min":0.437},"max":{"1min":0.97199999999999998,"5min":1.155,"15min":1.155},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.67400000000000004,"15min":0.65900000000000003},"min":{"1min":0.51400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.85899999999999999}]},{"osd":6,"last update":"Fri Sep 13 16:09:13 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.46200000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0620000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90400000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Sep 13 16:09:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.75,"15min":0.75},"min":{"1min":0.51400000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.747},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.53400000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.73899999999999999}]},{"osd":8,"last update":"Fri Sep 13 16:07:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82099999999999995,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.0069999999999999,"5min":1.2,"15min":1.2},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78000000000000003,"15min":0.78600000000000003},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.86399999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.623}]},{"osd":9,"last update":"Fri Sep 13 16:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.84599999999999997,"15min":0.86299999999999999},"min":{"1min":0.57399999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.77700000000000002}]},{"osd":10,"last update":"Fri Sep 13 16:08:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83399999999999996,"15min":0.83499999999999996},"min":{"1min":0.71099999999999997,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.874,"5min":0.90900000000000003,"15min":0.91500000000000004},"min":{"1min":0.68200000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1160000000000001,"5min":1.145,"15min":1.145},"last":0.875}]},{"osd":11,"last update":"Fri Sep 13 16:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.86899999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1118208,"data_stored":561981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.39100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.56000000000000005,"15min":0.53300000000000003},"min":{"1min":0.45500000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78800000000000003,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.505}]},{"osd":1,"last update":"Fri Sep 13 16:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59499999999999997,"15min":0.52300000000000002},"min":{"1min":0.45800000000000002,"5min":0.32000000000000001,"15min":0.28299999999999997},"max":{"1min":0.82799999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54200000000000004,"15min":0.48499999999999999},"min":{"1min":0.42399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.65300000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:09:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.42299999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77400000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.436,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.61199999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:09:13 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Sep 13 16:08:51 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.434,"15min":0.41299999999999998},"min":{"1min":0.30399999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.73599999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.496,"15min":0.46800000000000003},"min":{"1min":0.36499999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.55300000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:09:21 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66500000000000004,"15min":0.65300000000000002},"min":{"1min":0.51900000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83699999999999997,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.437,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90400000000000003,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.623}]},{"osd":7,"last update":"Fri Sep 13 16:09:13 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.73899999999999999}]},{"osd":8,"last update":"Fri Sep 13 16:09:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.33600000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59999999999999998,"15min":0.60299999999999998},"min":{"1min":0.39600000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.46899999999999997}]},{"osd":9,"last update":"Fri Sep 13 16:09:27 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.74299999999999999,"15min":0.73399999999999999},"min":{"1min":0.55700000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94099999999999995,"5min":1.038,"15min":1.038},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.56100000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93400000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.53900000000000003}]},{"osd":10,"last update":"Fri Sep 13 16:08:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.70499999999999996,"15min":0.69399999999999995},"min":{"1min":0.54900000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.90200000000000002,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.69299999999999995}]},{"osd":11,"last update":"Fri Sep 13 16:09:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.71699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":1089536,"data_stored":560406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:09:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.44,"5min":0.32200000000000001,"15min":0.309},"max":{"1min":0.88100000000000001,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56000000000000005,"15min":0.55100000000000005},"min":{"1min":0.42099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.70199999999999996}]},{"osd":2,"last update":"Fri Sep 13 16:09:43 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.53600000000000003,"15min":0.504},"min":{"1min":0.436,"5min":0.30399999999999999,"15min":0.23799999999999999},"max":{"1min":0.70199999999999996,"5min":0.80400000000000005,"15min":0.82399999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.55300000000000005,"15min":0.51800000000000002},"min":{"1min":0.50900000000000001,"5min":0.32100000000000001,"15min":0.28799999999999998},"max":{"1min":0.76400000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Sep 13 16:09:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57999999999999996,"15min":0.54200000000000004},"min":{"1min":0.437,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84899999999999998,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56899999999999995,"15min":0.54400000000000004},"min":{"1min":0.38200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79600000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Sep 13 16:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.42299999999999999,"15min":0.41499999999999998},"min":{"1min":0.307,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.66100000000000003,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.47499999999999998,"15min":0.44500000000000001},"min":{"1min":0.40899999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.85499999999999998}]},{"osd":5,"last update":"Fri Sep 13 16:08:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.55800000000000005,"15min":0.53900000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.55500000000000005,"15min":0.53200000000000003},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.80400000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.65900000000000003}]},{"osd":6,"last update":"Fri Sep 13 16:09:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61899999999999999,"15min":0.59599999999999997},"min":{"1min":0.40100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89800000000000002,"5min":1.048,"15min":1.048},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.63800000000000001,"15min":0.59999999999999998},"min":{"1min":0.51400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.90900000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Sep 13 16:09:43 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.46700000000000003,"15min":0.44500000000000001},"min":{"1min":0.35599999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.75600000000000001,"5min":0.875,"15min":0.875},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.503,"15min":0.47699999999999998},"min":{"1min":0.40999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71099999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.58199999999999996}]},{"osd":8,"last update":"Fri Sep 13 16:09:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89200000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.754}]},{"osd":9,"last update":"Fri Sep 13 16:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.63600000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.95799999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.53100000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.873,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.79200000000000004}]},{"osd":10,"last update":"Fri Sep 13 16:08:56 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65200000000000002,"15min":0.64900000000000002},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86899999999999999,"5min":1.004,"15min":1.004},"last":0.88}]},{"osd":11,"last update":"Fri Sep 13 16:09:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.86699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":1044480,"data_stored":499597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59499999999999997,"15min":0.55900000000000005},"min":{"1min":0.45900000000000002,"5min":0.36799999999999999,"15min":0.36699999999999999},"max":{"1min":0.86699999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59499999999999997,"15min":0.56200000000000006},"min":{"1min":0.44400000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.628}]},{"osd":2,"last update":"Fri Sep 13 16:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67700000000000005,"15min":0.629},"min":{"1min":0.46899999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.95699999999999996,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.67800000000000005,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90100000000000002,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.74399999999999999}]},{"osd":3,"last update":"Fri Sep 13 16:09:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Sep 13 16:09:24 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.62,"15min":0.58499999999999996},"min":{"1min":0.47099999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83299999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.60099999999999998},"min":{"1min":0.47099999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89500000000000002,"5min":1.006,"15min":1.006},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Sep 13 16:09:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66300000000000003,"15min":0.65200000000000002},"min":{"1min":0.45900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83299999999999996,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.52500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95899999999999996,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.63100000000000001,"15min":0.623},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.89600000000000002,"5min":1.004,"15min":1.004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66200000000000003,"15min":0.64000000000000001},"min":{"1min":0.45500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.92700000000000005,"5min":1.141,"15min":1.141},"last":0.56799999999999995}]},{"osd":7,"last update":"Fri Sep 13 16:09:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.439},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.60799999999999998}]},{"osd":8,"last update":"Fri Sep 13 16:08:58 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77900000000000003,"15min":0.79800000000000004},"min":{"1min":0.56599999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.99299999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.90300000000000002,"15min":0.85099999999999998},"min":{"1min":0.55300000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.024,"5min":13.347,"15min":13.347},"last":0.76100000000000001}]},{"osd":9,"last update":"Fri Sep 13 16:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.83199999999999996,"15min":0.88600000000000001},"min":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97599999999999998,"5min":1.224,"15min":1.224},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.81399999999999995,"15min":0.85199999999999998},"min":{"1min":0.61499999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.97199999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.79800000000000004}]},{"osd":10,"last update":"Fri Sep 13 16:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.84799999999999998,"15min":0.84999999999999998},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.05,"5min":1.204,"15min":1.204},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.82699999999999996,"15min":0.82499999999999996},"min":{"1min":0.625,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.048,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.69099999999999995}]},{"osd":11,"last update":"Fri Sep 13 16:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.78600000000000003,"15min":0.77200000000000002},"min":{"1min":0.69599999999999995,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.747,"15min":0.74099999999999999},"min":{"1min":0.57099999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.72099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":63589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:09:55.555 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-13T16:09:55.556 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T16:09:55.556 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-13T16:09:55.556 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-13T16:09:55.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:55 smithi086 ceph-mon[30379]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:09:55.881 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:09:55.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:55 smithi139 ceph-mon[35320]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:09:56.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:55 smithi194 ceph-mon[35694]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:09:56.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:56 smithi139 ceph-mon[35320]: pgmap v350: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:09:57.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:56 smithi194 ceph-mon[35694]: pgmap v350: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:09:57.054 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:56 smithi086 ceph-mon[30379]: pgmap v350: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:09:57.844 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:57 smithi086 ceph-mon[30379]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:09:57.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.950+0000 7fb2ee200640 1 -- 172.21.15.86:0/214406055 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8106fa0 msgr2=0x7fb2e810aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:57.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.950+0000 7fb2ee200640 1 --2- 172.21.15.86:0/214406055 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8106fa0 0x7fb2e810aff0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009930 tx=0x7fb2d402a440 comp rx=0 tx=0).stop 2024-09-13T16:09:57.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.950+0000 7fb2ee200640 1 -- 172.21.15.86:0/214406055 shutdown_connections 2024-09-13T16:09:57.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.950+0000 7fb2ee200640 1 --2- 172.21.15.86:0/214406055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2e810b720 0x7fb2e81132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.950+0000 7fb2ee200640 1 --2- 172.21.15.86:0/214406055 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8106fa0 0x7fb2e810aff0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.950+0000 7fb2ee200640 1 --2- 172.21.15.86:0/214406055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2e81065f0 0x7fb2e81069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.950+0000 7fb2ee200640 1 -- 172.21.15.86:0/214406055 >> 172.21.15.86:0/214406055 conn(0x7fb2e8075d10 msgr2=0x7fb2e8078130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:57.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.950+0000 7fb2ee200640 1 -- 172.21.15.86:0/214406055 shutdown_connections 2024-09-13T16:09:57.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.950+0000 7fb2ee200640 1 -- 172.21.15.86:0/214406055 wait complete. 2024-09-13T16:09:57.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.951+0000 7fb2ee200640 1 Processor -- start 2024-09-13T16:09:57.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.952+0000 7fb2ee200640 1 -- start start 2024-09-13T16:09:57.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.952+0000 7fb2ee200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2e81065f0 0x7fb2e819c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.952+0000 7fb2ee200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8106fa0 0x7fb2e819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.952+0000 7fb2ee200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2e810b720 0x7fb2e81a1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.952+0000 7fb2ee200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e81a1940 con 0x7fb2e8106fa0 2024-09-13T16:09:57.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.952+0000 7fb2ee200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e81a1ab0 con 0x7fb2e81065f0 2024-09-13T16:09:57.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.952+0000 7fb2ee200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e81a1c70 con 0x7fb2e810b720 2024-09-13T16:09:57.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.952+0000 7fb2e6a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8106fa0 0x7fb2e819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.952+0000 7fb2e7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2e81065f0 0x7fb2e819c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.952+0000 7fb2e6a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8106fa0 0x7fb2e819cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57458/0 (socket says 172.21.15.86:57458) 2024-09-13T16:09:57.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.952+0000 7fb2e7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2e81065f0 0x7fb2e819c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:42334/0 (socket says 172.21.15.86:42334) 2024-09-13T16:09:57.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.952+0000 7fb2e6a00640 1 -- 172.21.15.86:0/2306449787 learned_addr learned my addr 172.21.15.86:0/2306449787 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:57.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.952+0000 7fb2e7e00640 1 --2- 172.21.15.86:0/2306449787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2e810b720 0x7fb2e81a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.953+0000 7fb2e7400640 1 -- 172.21.15.86:0/2306449787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2e810b720 msgr2=0x7fb2e81a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:57.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.953+0000 7fb2e7400640 1 --2- 172.21.15.86:0/2306449787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2e810b720 0x7fb2e81a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.953+0000 7fb2e7400640 1 -- 172.21.15.86:0/2306449787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8106fa0 msgr2=0x7fb2e819cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:57.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.953+0000 7fb2e7400640 1 --2- 172.21.15.86:0/2306449787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8106fa0 0x7fb2e819cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.953+0000 7fb2e7400640 1 -- 172.21.15.86:0/2306449787 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d4009560 con 0x7fb2e81065f0 2024-09-13T16:09:57.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.953+0000 7fb2e7400640 1 --2- 172.21.15.86:0/2306449787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2e81065f0 0x7fb2e819c9d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8005fd0 tx=0x7fb2d800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:57.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.953+0000 7fb2dfe00640 1 -- 172.21.15.86:0/2306449787 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800cd80 con 0x7fb2e81065f0 2024-09-13T16:09:57.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.953+0000 7fb2dfe00640 1 -- 172.21.15.86:0/2306449787 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb2d8005020 con 0x7fb2e81065f0 2024-09-13T16:09:57.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.953+0000 7fb2dfe00640 1 -- 172.21.15.86:0/2306449787 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d80116d0 con 0x7fb2e81065f0 2024-09-13T16:09:57.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.954+0000 7fb2ee200640 1 -- 172.21.15.86:0/2306449787 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e81a1f50 con 0x7fb2e81065f0 2024-09-13T16:09:57.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.954+0000 7fb2ee200640 1 -- 172.21.15.86:0/2306449787 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e81a97c0 con 0x7fb2e81065f0 2024-09-13T16:09:57.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.955+0000 7fb2ee200640 1 -- 172.21.15.86:0/2306449787 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e8107ad0 con 0x7fb2e81065f0 2024-09-13T16:09:57.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.957+0000 7fb2dfe00640 1 -- 172.21.15.86:0/2306449787 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb2d8005500 con 0x7fb2e81065f0 2024-09-13T16:09:57.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.958+0000 7fb2dfe00640 1 --2- 172.21.15.86:0/2306449787 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb2cc0a1110 0x7fb2cc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.958+0000 7fb2dfe00640 1 -- 172.21.15.86:0/2306449787 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb2d80ccf10 con 0x7fb2e81065f0 2024-09-13T16:09:57.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.958+0000 7fb2e6a00640 1 --2- 172.21.15.86:0/2306449787 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb2cc0a1110 0x7fb2cc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.959+0000 7fb2e6a00640 1 --2- 172.21.15.86:0/2306449787 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb2cc0a1110 0x7fb2cc0a35d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4000c00 tx=0x7fb2d4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:57.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:57.960+0000 7fb2dfe00640 1 -- 172.21.15.86:0/2306449787 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb2d8096280 con 0x7fb2e81065f0 2024-09-13T16:09:57.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:57 smithi139 ceph-mon[35320]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:09:58.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:57 smithi194 ceph-mon[35694]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:09:58.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:58.168+0000 7fb2ee200640 1 -- 172.21.15.86:0/2306449787 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb2e81069d0 con 0x7fb2e81065f0 2024-09-13T16:09:58.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:58.169+0000 7fb2dfe00640 1 -- 172.21.15.86:0/2306449787 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb2d801f080 con 0x7fb2e81065f0 2024-09-13T16:09:58.170 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:09:58.171 INFO:teuthology.orchestra.run.smithi086.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T16:09:58.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:58.171+0000 7fb2ee200640 1 -- 172.21.15.86:0/2306449787 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb2cc0a1110 msgr2=0x7fb2cc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:58.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:58.171+0000 7fb2ee200640 1 --2- 172.21.15.86:0/2306449787 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb2cc0a1110 0x7fb2cc0a35d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4000c00 tx=0x7fb2d4005a20 comp rx=0 tx=0).stop 2024-09-13T16:09:58.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:58.171+0000 7fb2ee200640 1 -- 172.21.15.86:0/2306449787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2e81065f0 msgr2=0x7fb2e819c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:58.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:58.171+0000 7fb2ee200640 1 --2- 172.21.15.86:0/2306449787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2e81065f0 0x7fb2e819c9d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8005fd0 tx=0x7fb2d800ee80 comp rx=0 tx=0).stop 2024-09-13T16:09:58.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:58.171+0000 7fb2ee200640 1 -- 172.21.15.86:0/2306449787 shutdown_connections 2024-09-13T16:09:58.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:58.171+0000 7fb2ee200640 1 --2- 172.21.15.86:0/2306449787 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb2cc0a1110 0x7fb2cc0a35d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:58.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:58.171+0000 7fb2ee200640 1 --2- 172.21.15.86:0/2306449787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2e810b720 0x7fb2e81a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:58.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:58.171+0000 7fb2ee200640 1 --2- 172.21.15.86:0/2306449787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2e8106fa0 0x7fb2e819cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:58.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:58.171+0000 7fb2ee200640 1 --2- 172.21.15.86:0/2306449787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2e81065f0 0x7fb2e819c9d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:58.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:58.171+0000 7fb2ee200640 1 -- 172.21.15.86:0/2306449787 >> 172.21.15.86:0/2306449787 conn(0x7fb2e8075d10 msgr2=0x7fb2e8077210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:58.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:58.171+0000 7fb2ee200640 1 -- 172.21.15.86:0/2306449787 shutdown_connections 2024-09-13T16:09:58.174 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:58.171+0000 7fb2ee200640 1 -- 172.21.15.86:0/2306449787 wait complete. 2024-09-13T16:09:58.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:58 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2306449787' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T16:09:58.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:58 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2306449787' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T16:09:59.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:58 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2306449787' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T16:09:59.070 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-13T16:09:59.071 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:09:59.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.224+0000 7fd10a400640 1 -- 172.21.15.86:0/1543112131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd104100610 msgr2=0x7fd104102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:59.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.224+0000 7fd10a400640 1 --2- 172.21.15.86:0/1543112131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd104100610 0x7fd104102a00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009900 tx=0x7fd0f402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.224+0000 7fd10a400640 1 -- 172.21.15.86:0/1543112131 shutdown_connections 2024-09-13T16:09:59.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.224+0000 7fd10a400640 1 --2- 172.21.15.86:0/1543112131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd104105870 0x7fd104107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.224+0000 7fd10a400640 1 --2- 172.21.15.86:0/1543112131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd104102f40 0x7fd104105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.224+0000 7fd10a400640 1 --2- 172.21.15.86:0/1543112131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd104100610 0x7fd104102a00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.224+0000 7fd10a400640 1 -- 172.21.15.86:0/1543112131 >> 172.21.15.86:0/1543112131 conn(0x7fd1040fa1f0 msgr2=0x7fd1040fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:59.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.224+0000 7fd10a400640 1 -- 172.21.15.86:0/1543112131 shutdown_connections 2024-09-13T16:09:59.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.224+0000 7fd10a400640 1 -- 172.21.15.86:0/1543112131 wait complete. 2024-09-13T16:09:59.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.225+0000 7fd10a400640 1 Processor -- start 2024-09-13T16:09:59.228 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.225+0000 7fd10a400640 1 -- start start 2024-09-13T16:09:59.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.225+0000 7fd10a400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd104100610 0x7fd1040fff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:59.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.225+0000 7fd10a400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd104102f40 0x7fd1040fe5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:59.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.225+0000 7fd10a400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd104105870 0x7fd1040feb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:59.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.225+0000 7fd10a400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040ff260 con 0x7fd104100610 2024-09-13T16:09:59.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.225+0000 7fd10a400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040ff3d0 con 0x7fd104102f40 2024-09-13T16:09:59.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.225+0000 7fd10a400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10419fd30 con 0x7fd104105870 2024-09-13T16:09:59.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.226+0000 7fd109000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd104100610 0x7fd1040fff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:59.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.226+0000 7fd109a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd104105870 0x7fd1040feb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:59.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.226+0000 7fd109000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd104100610 0x7fd1040fff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57482/0 (socket says 172.21.15.86:57482) 2024-09-13T16:09:59.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.226+0000 7fd109000640 1 -- 172.21.15.86:0/1370270804 learned_addr learned my addr 172.21.15.86:0/1370270804 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:59.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.226+0000 7fd0fbe00640 1 --2- 172.21.15.86:0/1370270804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd104102f40 0x7fd1040fe5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:59.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.226+0000 7fd109a00640 1 -- 172.21.15.86:0/1370270804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd104102f40 msgr2=0x7fd1040fe5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:59.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.226+0000 7fd109a00640 1 --2- 172.21.15.86:0/1370270804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd104102f40 0x7fd1040fe5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.226+0000 7fd109a00640 1 -- 172.21.15.86:0/1370270804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd104100610 msgr2=0x7fd1040fff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:59.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.226+0000 7fd109a00640 1 --2- 172.21.15.86:0/1370270804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd104100610 0x7fd1040fff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.226+0000 7fd109a00640 1 -- 172.21.15.86:0/1370270804 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec009490 con 0x7fd104105870 2024-09-13T16:09:59.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.226+0000 7fd109a00640 1 --2- 172.21.15.86:0/1370270804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd104105870 0x7fd1040feb00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc005fd0 tx=0x7fd0fc00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:59.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.227+0000 7fd102000640 1 -- 172.21.15.86:0/1370270804 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc00cdf0 con 0x7fd104105870 2024-09-13T16:09:59.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.227+0000 7fd10a400640 1 -- 172.21.15.86:0/1370270804 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f4009560 con 0x7fd104105870 2024-09-13T16:09:59.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.227+0000 7fd102000640 1 -- 172.21.15.86:0/1370270804 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd0fc005020 con 0x7fd104105870 2024-09-13T16:09:59.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.227+0000 7fd102000640 1 -- 172.21.15.86:0/1370270804 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc010670 con 0x7fd104105870 2024-09-13T16:09:59.230 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.227+0000 7fd10a400640 1 -- 172.21.15.86:0/1370270804 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1041a02d0 con 0x7fd104105870 2024-09-13T16:09:59.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.228+0000 7fd10a400640 1 -- 172.21.15.86:0/1370270804 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1040fbce0 con 0x7fd104105870 2024-09-13T16:09:59.231 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.230+0000 7fd102000640 1 -- 172.21.15.86:0/1370270804 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fd0fc005500 con 0x7fd104105870 2024-09-13T16:09:59.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.231+0000 7fd102000640 1 --2- 172.21.15.86:0/1370270804 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd0e80a1120 0x7fd0e80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:59.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.231+0000 7fd102000640 1 -- 172.21.15.86:0/1370270804 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fd0fc014070 con 0x7fd104105870 2024-09-13T16:09:59.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.231+0000 7fd109000640 1 --2- 172.21.15.86:0/1370270804 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd0e80a1120 0x7fd0e80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:59.233 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.232+0000 7fd109000640 1 --2- 172.21.15.86:0/1370270804 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd0e80a1120 0x7fd0e80a35e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4005ec0 tx=0x7fd0f40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:59.235 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.233+0000 7fd102000640 1 -- 172.21.15.86:0/1370270804 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd0fc0966d0 con 0x7fd104105870 2024-09-13T16:09:59.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.436+0000 7fd10a400640 1 -- 172.21.15.86:0/1370270804 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd10410b5e0 con 0x7fd104105870 2024-09-13T16:09:59.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.438+0000 7fd102000640 1 -- 172.21.15.86:0/1370270804 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+24420 (secure 0 0 0) 0x7fd0fc099cf0 con 0x7fd104105870 2024-09-13T16:09:59.441 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:09:59.441 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":92,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:09:00.516198+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":4,"to":7}]},{"pgid":"3.19","mappings":[{"from":3,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2f","mappings":[{"from":1,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:09:59.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.440+0000 7fd10a400640 1 -- 172.21.15.86:0/1370270804 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd0e80a1120 msgr2=0x7fd0e80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:59.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.440+0000 7fd10a400640 1 --2- 172.21.15.86:0/1370270804 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd0e80a1120 0x7fd0e80a35e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4005ec0 tx=0x7fd0f40058d0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.440+0000 7fd10a400640 1 -- 172.21.15.86:0/1370270804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd104105870 msgr2=0x7fd1040feb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:59.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.440+0000 7fd10a400640 1 --2- 172.21.15.86:0/1370270804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd104105870 0x7fd1040feb00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc005fd0 tx=0x7fd0fc00ef10 comp rx=0 tx=0).stop 2024-09-13T16:09:59.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.440+0000 7fd10a400640 1 -- 172.21.15.86:0/1370270804 shutdown_connections 2024-09-13T16:09:59.442 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.440+0000 7fd10a400640 1 --2- 172.21.15.86:0/1370270804 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fd0e80a1120 0x7fd0e80a35e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.440+0000 7fd10a400640 1 --2- 172.21.15.86:0/1370270804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd104105870 0x7fd1040feb00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.440+0000 7fd10a400640 1 --2- 172.21.15.86:0/1370270804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd104102f40 0x7fd1040fe5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.440+0000 7fd10a400640 1 --2- 172.21.15.86:0/1370270804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd104100610 0x7fd1040fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.440+0000 7fd10a400640 1 -- 172.21.15.86:0/1370270804 >> 172.21.15.86:0/1370270804 conn(0x7fd1040fa1f0 msgr2=0x7fd1041010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:59.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.441+0000 7fd10a400640 1 -- 172.21.15.86:0/1370270804 shutdown_connections 2024-09-13T16:09:59.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.441+0000 7fd10a400640 1 -- 172.21.15.86:0/1370270804 wait complete. 2024-09-13T16:09:59.459 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:03:27.830423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:08:07.732536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:08:08.742145+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T16:08:11.721740+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T16:09:59.460 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:09:59.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.617+0000 7fef18000640 1 -- 172.21.15.86:0/1871650451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef10103ab0 msgr2=0x7fef1010a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:59.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.617+0000 7fef18000640 1 --2- 172.21.15.86:0/1871650451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef10103ab0 0x7fef1010a3d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fef08009ca0 tx=0x7fef0802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.617+0000 7fef18000640 1 -- 172.21.15.86:0/1871650451 shutdown_connections 2024-09-13T16:09:59.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.617+0000 7fef18000640 1 --2- 172.21.15.86:0/1871650451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef10103ab0 0x7fef1010a3d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.617+0000 7fef18000640 1 --2- 172.21.15.86:0/1871650451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef101030f0 0x7fef10103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.617+0000 7fef18000640 1 --2- 172.21.15.86:0/1871650451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef10101f20 0x7fef10102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.617+0000 7fef18000640 1 -- 172.21.15.86:0/1871650451 >> 172.21.15.86:0/1871650451 conn(0x7fef100fd6f0 msgr2=0x7fef100ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:59.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.617+0000 7fef18000640 1 -- 172.21.15.86:0/1871650451 shutdown_connections 2024-09-13T16:09:59.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.617+0000 7fef18000640 1 -- 172.21.15.86:0/1871650451 wait complete. 2024-09-13T16:09:59.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.618+0000 7fef18000640 1 Processor -- start 2024-09-13T16:09:59.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.618+0000 7fef18000640 1 -- start start 2024-09-13T16:09:59.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.618+0000 7fef18000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef10101f20 0x7fef10198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:59.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.618+0000 7fef18000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef101030f0 0x7fef101985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:59.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.618+0000 7fef18000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef10103ab0 0x7fef1019f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:59.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.619+0000 7fef18000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1019fb00 con 0x7fef101030f0 2024-09-13T16:09:59.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.619+0000 7fef18000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1019fc70 con 0x7fef10101f20 2024-09-13T16:09:59.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.619+0000 7fef18000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1019fe30 con 0x7fef10103ab0 2024-09-13T16:09:59.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.619+0000 7fef14c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef101030f0 0x7fef101985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:59.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.619+0000 7fef14c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef101030f0 0x7fef101985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57506/0 (socket says 172.21.15.86:57506) 2024-09-13T16:09:59.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.619+0000 7fef14c00640 1 -- 172.21.15.86:0/2278213087 learned_addr learned my addr 172.21.15.86:0/2278213087 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:59.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.619+0000 7fef16000640 1 --2- 172.21.15.86:0/2278213087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef10103ab0 0x7fef1019f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:59.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.619+0000 7fef15600640 1 --2- 172.21.15.86:0/2278213087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef10101f20 0x7fef10198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:59.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.619+0000 7fef14c00640 1 -- 172.21.15.86:0/2278213087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef10103ab0 msgr2=0x7fef1019f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:59.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.619+0000 7fef14c00640 1 --2- 172.21.15.86:0/2278213087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef10103ab0 0x7fef1019f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.619+0000 7fef14c00640 1 -- 172.21.15.86:0/2278213087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef10101f20 msgr2=0x7fef10198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:59.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.619+0000 7fef14c00640 1 --2- 172.21.15.86:0/2278213087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef10101f20 0x7fef10198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.619+0000 7fef14c00640 1 -- 172.21.15.86:0/2278213087 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef08009900 con 0x7fef101030f0 2024-09-13T16:09:59.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.619+0000 7fef16000640 1 --2- 172.21.15.86:0/2278213087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef10103ab0 0x7fef1019f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:09:59.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.619+0000 7fef14c00640 1 --2- 172.21.15.86:0/2278213087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef101030f0 0x7fef101985a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7feefc00e9f0 tx=0x7feefc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:59.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.620+0000 7fef0e000640 1 -- 172.21.15.86:0/2278213087 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc009720 con 0x7fef101030f0 2024-09-13T16:09:59.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.620+0000 7fef18000640 1 -- 172.21.15.86:0/2278213087 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef101a0110 con 0x7fef101030f0 2024-09-13T16:09:59.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.620+0000 7fef0e000640 1 -- 172.21.15.86:0/2278213087 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7feefc00cd80 con 0x7fef101030f0 2024-09-13T16:09:59.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.620+0000 7fef0e000640 1 -- 172.21.15.86:0/2278213087 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc018630 con 0x7fef101030f0 2024-09-13T16:09:59.624 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.620+0000 7fef18000640 1 -- 172.21.15.86:0/2278213087 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef101a05d0 con 0x7fef101030f0 2024-09-13T16:09:59.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.621+0000 7fef18000640 1 -- 172.21.15.86:0/2278213087 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef10109320 con 0x7fef101030f0 2024-09-13T16:09:59.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.623+0000 7fef0e000640 1 -- 172.21.15.86:0/2278213087 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7feefc0046c0 con 0x7fef101030f0 2024-09-13T16:09:59.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.624+0000 7fef0e000640 1 --2- 172.21.15.86:0/2278213087 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7feef80a1120 0x7feef80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:59.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.624+0000 7fef0e000640 1 -- 172.21.15.86:0/2278213087 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7feefc014070 con 0x7fef101030f0 2024-09-13T16:09:59.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.624+0000 7fef15600640 1 --2- 172.21.15.86:0/2278213087 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7feef80a1120 0x7feef80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:59.626 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.625+0000 7fef15600640 1 --2- 172.21.15.86:0/2278213087 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7feef80a1120 0x7feef80a35e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fef10101c40 tx=0x7fef04005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:59.629 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.628+0000 7fef0e000640 1 -- 172.21.15.86:0/2278213087 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feefc096660 con 0x7fef101030f0 2024-09-13T16:09:59.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.694+0000 7fef0e000640 1 -- 172.21.15.86:0/2278213087 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7feefc096a30 con 0x7fef101030f0 2024-09-13T16:09:59.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.809+0000 7fef18000640 1 -- 172.21.15.86:0/2278213087 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef1002c3e0 con 0x7fef101030f0 2024-09-13T16:09:59.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.809+0000 7fef0e000640 1 -- 172.21.15.86:0/2278213087 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7feefc09a0f0 con 0x7fef101030f0 2024-09-13T16:09:59.811 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-09-13T16:09:59.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.812+0000 7fef18000640 1 -- 172.21.15.86:0/2278213087 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7feef80a1120 msgr2=0x7feef80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:59.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.812+0000 7fef18000640 1 --2- 172.21.15.86:0/2278213087 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7feef80a1120 0x7feef80a35e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fef10101c40 tx=0x7fef04005f90 comp rx=0 tx=0).stop 2024-09-13T16:09:59.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.812+0000 7fef18000640 1 -- 172.21.15.86:0/2278213087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef101030f0 msgr2=0x7fef101985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:59.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.812+0000 7fef18000640 1 --2- 172.21.15.86:0/2278213087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef101030f0 0x7fef101985a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7feefc00e9f0 tx=0x7feefc00edf0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.812+0000 7fef18000640 1 -- 172.21.15.86:0/2278213087 shutdown_connections 2024-09-13T16:09:59.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.812+0000 7fef18000640 1 --2- 172.21.15.86:0/2278213087 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7feef80a1120 0x7feef80a35e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.812+0000 7fef18000640 1 --2- 172.21.15.86:0/2278213087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef10103ab0 0x7fef1019f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.812+0000 7fef18000640 1 --2- 172.21.15.86:0/2278213087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef101030f0 0x7fef101985a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.812+0000 7fef18000640 1 --2- 172.21.15.86:0/2278213087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef10101f20 0x7fef10198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.812+0000 7fef18000640 1 -- 172.21.15.86:0/2278213087 >> 172.21.15.86:0/2278213087 conn(0x7fef100fd6f0 msgr2=0x7fef101064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:59.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.812+0000 7fef18000640 1 -- 172.21.15.86:0/2278213087 shutdown_connections 2024-09-13T16:09:59.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.812+0000 7fef18000640 1 -- 172.21.15.86:0/2278213087 wait complete. 2024-09-13T16:09:59.828 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:59 smithi086 ceph-mon[30379]: pgmap v352: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:09:59.828 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:59 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1370270804' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:09:59.828 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]: dispatch 2024-09-13T16:09:59.828 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-13T16:09:59.828 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-13T16:09:59.829 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-09-13T16:09:59.829 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.15", "id": [5, 10]}]: dispatch 2024-09-13T16:09:59.829 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:09:59 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-13T16:09:59.830 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:09:59.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.986+0000 7f225b600640 1 -- 172.21.15.86:0/1864311185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254103170 msgr2=0x7f22541035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:59.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.986+0000 7f225b600640 1 --2- 172.21.15.86:0/1864311185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254103170 0x7f22541035f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f223c009900 tx=0x7f223c02a3f0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.986+0000 7f225b600640 1 -- 172.21.15.86:0/1864311185 shutdown_connections 2024-09-13T16:09:59.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.986+0000 7f225b600640 1 --2- 172.21.15.86:0/1864311185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2254103b30 0x7f225410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.988 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.986+0000 7f225b600640 1 --2- 172.21.15.86:0/1864311185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254103170 0x7f22541035f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.986+0000 7f225b600640 1 --2- 172.21.15.86:0/1864311185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2254101f80 0x7f2254102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.986+0000 7f225b600640 1 -- 172.21.15.86:0/1864311185 >> 172.21.15.86:0/1864311185 conn(0x7f22540fd700 msgr2=0x7f22540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:59.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.986+0000 7f225b600640 1 -- 172.21.15.86:0/1864311185 shutdown_connections 2024-09-13T16:09:59.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.986+0000 7f225b600640 1 -- 172.21.15.86:0/1864311185 wait complete. 2024-09-13T16:09:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.987+0000 7f225b600640 1 Processor -- start 2024-09-13T16:09:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.987+0000 7f225b600640 1 -- start start 2024-09-13T16:09:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.987+0000 7f225b600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2254101f80 0x7f2254198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.987+0000 7f225b600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2254103170 0x7f22541985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.987+0000 7f225b600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254103b30 0x7f225419f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:59.991 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.987+0000 7f225b600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225419fb70 con 0x7f2254103b30 2024-09-13T16:09:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.987+0000 7f225b600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225419fce0 con 0x7f2254103170 2024-09-13T16:09:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.987+0000 7f225b600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225419fea0 con 0x7f2254101f80 2024-09-13T16:09:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.988+0000 7f2258c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2254101f80 0x7f2254198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.988+0000 7f2259600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254103b30 0x7f225419f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.988+0000 7f2258c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2254101f80 0x7f2254198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:47586/0 (socket says 172.21.15.86:47586) 2024-09-13T16:09:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.988+0000 7f2259600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254103b30 0x7f225419f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57534/0 (socket says 172.21.15.86:57534) 2024-09-13T16:09:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.988+0000 7f2258c00640 1 -- 172.21.15.86:0/2892474143 learned_addr learned my addr 172.21.15.86:0/2892474143 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:09:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.988+0000 7f224be00640 1 --2- 172.21.15.86:0/2892474143 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2254103170 0x7f22541985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.988+0000 7f2258c00640 1 -- 172.21.15.86:0/2892474143 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2254103170 msgr2=0x7f22541985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.988+0000 7f2258c00640 1 --2- 172.21.15.86:0/2892474143 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2254103170 0x7f22541985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.988+0000 7f2258c00640 1 -- 172.21.15.86:0/2892474143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254103b30 msgr2=0x7f225419f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:59.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.988+0000 7f2258c00640 1 --2- 172.21.15.86:0/2892474143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254103b30 0x7f225419f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:59.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.988+0000 7f2258c00640 1 -- 172.21.15.86:0/2892474143 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c009560 con 0x7f2254101f80 2024-09-13T16:09:59.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.988+0000 7f2259600640 1 --2- 172.21.15.86:0/2892474143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254103b30 0x7f225419f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:09:59.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.989+0000 7f2258c00640 1 --2- 172.21.15.86:0/2892474143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2254101f80 0x7f2254198080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f224400e9c0 tx=0x7f224400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:59.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.989+0000 7f2252000640 1 -- 172.21.15.86:0/2892474143 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22440096e0 con 0x7f2254101f80 2024-09-13T16:09:59.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.989+0000 7f225b600640 1 -- 172.21.15.86:0/2892474143 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22541a0180 con 0x7f2254101f80 2024-09-13T16:09:59.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.989+0000 7f2252000640 1 -- 172.21.15.86:0/2892474143 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f224400cd80 con 0x7f2254101f80 2024-09-13T16:09:59.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.989+0000 7f2252000640 1 -- 172.21.15.86:0/2892474143 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244010430 con 0x7f2254101f80 2024-09-13T16:09:59.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.989+0000 7f225b600640 1 -- 172.21.15.86:0/2892474143 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22541a0660 con 0x7f2254101f80 2024-09-13T16:09:59.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.990+0000 7f225b600640 1 -- 172.21.15.86:0/2892474143 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2254109390 con 0x7f2254101f80 2024-09-13T16:09:59.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.992+0000 7f2252000640 1 -- 172.21.15.86:0/2892474143 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2244003680 con 0x7f2254101f80 2024-09-13T16:09:59.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.993+0000 7f2252000640 1 --2- 172.21.15.86:0/2892474143 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f22380a1090 0x7f22380a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:59.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.993+0000 7f2252000640 1 -- 172.21.15.86:0/2892474143 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f2244014070 con 0x7f2254101f80 2024-09-13T16:09:59.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.993+0000 7f224be00640 1 --2- 172.21.15.86:0/2892474143 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f22380a1090 0x7f22380a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:59.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.994+0000 7f224be00640 1 --2- 172.21.15.86:0/2892474143 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f22380a1090 0x7f22380a3550 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f223c005ab0 tx=0x7f223c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:59.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:09:59.995+0000 7f2252000640 1 -- 172.21.15.86:0/2892474143 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f22440964b0 con 0x7f2254101f80 2024-09-13T16:09:59.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:59 smithi139 ceph-mon[35320]: pgmap v352: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:09:59.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:59 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1370270804' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:09:59.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:59 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]: dispatch 2024-09-13T16:09:59.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:59 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-13T16:09:59.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:59 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-13T16:09:59.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:59 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-09-13T16:09:59.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:59 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.15", "id": [5, 10]}]: dispatch 2024-09-13T16:09:59.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:09:59 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-13T16:10:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:59 smithi194 ceph-mon[35694]: pgmap v352: 129 pgs: 129 active+clean; 641 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:10:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:59 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1370270804' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:10:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]: dispatch 2024-09-13T16:10:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-13T16:10:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-13T16:10:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-09-13T16:10:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.15", "id": [5, 10]}]: dispatch 2024-09-13T16:10:00.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:09:59 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-13T16:10:00.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.164+0000 7f225b600640 1 -- 172.21.15.86:0/2892474143 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f225410d9d0 con 0x7f2254101f80 2024-09-13T16:10:00.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.165+0000 7f2252000640 1 -- 172.21.15.86:0/2892474143 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2244099ad0 con 0x7f2254101f80 2024-09-13T16:10:00.166 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-09-13T16:10:00.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.167+0000 7f225b600640 1 -- 172.21.15.86:0/2892474143 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f22380a1090 msgr2=0x7f22380a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:00.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.167+0000 7f225b600640 1 --2- 172.21.15.86:0/2892474143 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f22380a1090 0x7f22380a3550 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f223c005ab0 tx=0x7f223c005a20 comp rx=0 tx=0).stop 2024-09-13T16:10:00.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.167+0000 7f225b600640 1 -- 172.21.15.86:0/2892474143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2254101f80 msgr2=0x7f2254198080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:00.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.167+0000 7f225b600640 1 --2- 172.21.15.86:0/2892474143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2254101f80 0x7f2254198080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f224400e9c0 tx=0x7f224400ee80 comp rx=0 tx=0).stop 2024-09-13T16:10:00.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.167+0000 7f225b600640 1 -- 172.21.15.86:0/2892474143 shutdown_connections 2024-09-13T16:10:00.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.167+0000 7f225b600640 1 --2- 172.21.15.86:0/2892474143 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f22380a1090 0x7f22380a3550 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.167+0000 7f225b600640 1 --2- 172.21.15.86:0/2892474143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2254103b30 0x7f225419f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.167+0000 7f225b600640 1 --2- 172.21.15.86:0/2892474143 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2254103170 0x7f22541985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.167+0000 7f225b600640 1 --2- 172.21.15.86:0/2892474143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2254101f80 0x7f2254198080 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.167+0000 7f225b600640 1 -- 172.21.15.86:0/2892474143 >> 172.21.15.86:0/2892474143 conn(0x7f22540fd700 msgr2=0x7f2254106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:00.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.167+0000 7f225b600640 1 -- 172.21.15.86:0/2892474143 shutdown_connections 2024-09-13T16:10:00.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.167+0000 7f225b600640 1 -- 172.21.15.86:0/2892474143 wait complete. 2024-09-13T16:10:00.185 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:10:00.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.343+0000 7fb97e800640 1 -- 172.21.15.86:0/1685125466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9780760b0 msgr2=0x7fb978076510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:00.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.343+0000 7fb97e800640 1 --2- 172.21.15.86:0/1685125466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9780760b0 0x7fb978076510 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb964009900 tx=0x7fb96402a410 comp rx=0 tx=0).stop 2024-09-13T16:10:00.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.343+0000 7fb97e800640 1 -- 172.21.15.86:0/1685125466 shutdown_connections 2024-09-13T16:10:00.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.343+0000 7fb97e800640 1 --2- 172.21.15.86:0/1685125466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb978076a50 0x7fb9780772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.343+0000 7fb97e800640 1 --2- 172.21.15.86:0/1685125466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9780760b0 0x7fb978076510 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.343+0000 7fb97e800640 1 --2- 172.21.15.86:0/1685125466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb978074e70 0x7fb978075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.343+0000 7fb97e800640 1 -- 172.21.15.86:0/1685125466 >> 172.21.15.86:0/1685125466 conn(0x7fb9780fd720 msgr2=0x7fb9780ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:00.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.343+0000 7fb97e800640 1 -- 172.21.15.86:0/1685125466 shutdown_connections 2024-09-13T16:10:00.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.344+0000 7fb97e800640 1 -- 172.21.15.86:0/1685125466 wait complete. 2024-09-13T16:10:00.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.344+0000 7fb97e800640 1 Processor -- start 2024-09-13T16:10:00.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.344+0000 7fb97e800640 1 -- start start 2024-09-13T16:10:00.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.345+0000 7fb97e800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb978074e70 0x7fb97819c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:00.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.345+0000 7fb97e800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9780760b0 0x7fb97819ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:00.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.345+0000 7fb97e800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb978076a50 0x7fb9781a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:00.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.345+0000 7fb97e800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9781a4000 con 0x7fb9780760b0 2024-09-13T16:10:00.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.345+0000 7fb97e800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9781a4170 con 0x7fb978076a50 2024-09-13T16:10:00.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.345+0000 7fb97e800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9781a4330 con 0x7fb978074e70 2024-09-13T16:10:00.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.345+0000 7fb976a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9780760b0 0x7fb97819ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:00.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.345+0000 7fb976a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9780760b0 0x7fb97819ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57554/0 (socket says 172.21.15.86:57554) 2024-09-13T16:10:00.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.345+0000 7fb976a00640 1 -- 172.21.15.86:0/1040120027 learned_addr learned my addr 172.21.15.86:0/1040120027 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:00.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.345+0000 7fb977400640 1 --2- 172.21.15.86:0/1040120027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb978074e70 0x7fb97819c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:00.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.345+0000 7fb977e00640 1 --2- 172.21.15.86:0/1040120027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb978076a50 0x7fb9781a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:00.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.345+0000 7fb976a00640 1 -- 172.21.15.86:0/1040120027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb978074e70 msgr2=0x7fb97819c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:00.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.345+0000 7fb976a00640 1 --2- 172.21.15.86:0/1040120027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb978074e70 0x7fb97819c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.345+0000 7fb976a00640 1 -- 172.21.15.86:0/1040120027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb978076a50 msgr2=0x7fb9781a3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:00.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.345+0000 7fb976a00640 1 --2- 172.21.15.86:0/1040120027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb978076a50 0x7fb9781a3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.345+0000 7fb976a00640 1 -- 172.21.15.86:0/1040120027 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb964009560 con 0x7fb9780760b0 2024-09-13T16:10:00.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.345+0000 7fb977400640 1 --2- 172.21.15.86:0/1040120027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb978074e70 0x7fb97819c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:10:00.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.346+0000 7fb976a00640 1 --2- 172.21.15.86:0/1040120027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9780760b0 0x7fb97819ca50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb964031510 tx=0x7fb9640055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:00.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.346+0000 7fb96fe00640 1 -- 172.21.15.86:0/1040120027 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964004b50 con 0x7fb9780760b0 2024-09-13T16:10:00.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.346+0000 7fb96fe00640 1 -- 172.21.15.86:0/1040120027 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb964004cb0 con 0x7fb9780760b0 2024-09-13T16:10:00.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.346+0000 7fb97e800640 1 -- 172.21.15.86:0/1040120027 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9781a45b0 con 0x7fb9780760b0 2024-09-13T16:10:00.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.346+0000 7fb96fe00640 1 -- 172.21.15.86:0/1040120027 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964031ba0 con 0x7fb9780760b0 2024-09-13T16:10:00.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.346+0000 7fb97e800640 1 -- 172.21.15.86:0/1040120027 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9781a4a10 con 0x7fb9780760b0 2024-09-13T16:10:00.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.347+0000 7fb97e800640 1 -- 172.21.15.86:0/1040120027 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97810e910 con 0x7fb9780760b0 2024-09-13T16:10:00.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.349+0000 7fb96fe00640 1 -- 172.21.15.86:0/1040120027 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb964031d00 con 0x7fb9780760b0 2024-09-13T16:10:00.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.350+0000 7fb96fe00640 1 --2- 172.21.15.86:0/1040120027 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb95c0a1090 0x7fb95c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:00.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.350+0000 7fb96fe00640 1 -- 172.21.15.86:0/1040120027 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fb9640ede40 con 0x7fb9780760b0 2024-09-13T16:10:00.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.350+0000 7fb977400640 1 --2- 172.21.15.86:0/1040120027 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb95c0a1090 0x7fb95c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:00.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.351+0000 7fb977400640 1 --2- 172.21.15.86:0/1040120027 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb95c0a1090 0x7fb95c0a3550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb968005fd0 tx=0x7fb968009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:00.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.353+0000 7fb96fe00640 1 -- 172.21.15.86:0/1040120027 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb9640b72d0 con 0x7fb9780760b0 2024-09-13T16:10:00.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.521+0000 7fb97e800640 1 -- 172.21.15.86:0/1040120027 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb978112070 con 0x7fb9780760b0 2024-09-13T16:10:00.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.522+0000 7fb96fe00640 1 -- 172.21.15.86:0/1040120027 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb964035020 con 0x7fb9780760b0 2024-09-13T16:10:00.524 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2024-09-13T16:10:00.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.524+0000 7fb97e800640 1 -- 172.21.15.86:0/1040120027 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb95c0a1090 msgr2=0x7fb95c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:00.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.524+0000 7fb97e800640 1 --2- 172.21.15.86:0/1040120027 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb95c0a1090 0x7fb95c0a3550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb968005fd0 tx=0x7fb968009500 comp rx=0 tx=0).stop 2024-09-13T16:10:00.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.524+0000 7fb97e800640 1 -- 172.21.15.86:0/1040120027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9780760b0 msgr2=0x7fb97819ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:00.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.524+0000 7fb97e800640 1 --2- 172.21.15.86:0/1040120027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9780760b0 0x7fb97819ca50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb964031510 tx=0x7fb9640055a0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.524+0000 7fb97e800640 1 -- 172.21.15.86:0/1040120027 shutdown_connections 2024-09-13T16:10:00.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.524+0000 7fb97e800640 1 --2- 172.21.15.86:0/1040120027 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb95c0a1090 0x7fb95c0a3550 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.524+0000 7fb97e800640 1 --2- 172.21.15.86:0/1040120027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb978076a50 0x7fb9781a3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.524+0000 7fb97e800640 1 --2- 172.21.15.86:0/1040120027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9780760b0 0x7fb97819ca50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.524+0000 7fb97e800640 1 --2- 172.21.15.86:0/1040120027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb978074e70 0x7fb97819c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.524+0000 7fb97e800640 1 -- 172.21.15.86:0/1040120027 >> 172.21.15.86:0/1040120027 conn(0x7fb9780fd720 msgr2=0x7fb9780ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:00.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.524+0000 7fb97e800640 1 -- 172.21.15.86:0/1040120027 shutdown_connections 2024-09-13T16:10:00.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.524+0000 7fb97e800640 1 -- 172.21.15.86:0/1040120027 wait complete. 2024-09-13T16:10:00.543 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T16:10:00.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.704+0000 7f37b7400640 1 -- 172.21.15.86:0/3573934905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37b0103190 msgr2=0x7f37b0103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:00.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.704+0000 7f37b7400640 1 --2- 172.21.15.86:0/3573934905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37b0103190 0x7f37b0103610 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f379c009900 tx=0x7f379c02a3f0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.704+0000 7f37b7400640 1 -- 172.21.15.86:0/3573934905 shutdown_connections 2024-09-13T16:10:00.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.704+0000 7f37b7400640 1 --2- 172.21.15.86:0/3573934905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37b0103b50 0x7f37b010a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.704+0000 7f37b7400640 1 --2- 172.21.15.86:0/3573934905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37b0103190 0x7f37b0103610 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.705+0000 7f37b7400640 1 --2- 172.21.15.86:0/3573934905 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37b0101fa0 0x7f37b01023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.705+0000 7f37b7400640 1 -- 172.21.15.86:0/3573934905 >> 172.21.15.86:0/3573934905 conn(0x7f37b00fd700 msgr2=0x7f37b00ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:00.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.705+0000 7f37b7400640 1 -- 172.21.15.86:0/3573934905 shutdown_connections 2024-09-13T16:10:00.707 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.705+0000 7f37b7400640 1 -- 172.21.15.86:0/3573934905 wait complete. 2024-09-13T16:10:00.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.705+0000 7f37b7400640 1 Processor -- start 2024-09-13T16:10:00.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.706+0000 7f37b7400640 1 -- start start 2024-09-13T16:10:00.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.706+0000 7f37b7400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37b0101fa0 0x7f37b0198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:00.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.706+0000 7f37b7400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37b0103190 0x7f37b01985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:00.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.706+0000 7f37b7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37b0103b50 0x7f37b019f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:00.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.706+0000 7f37b7400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b019fb70 con 0x7f37b0101fa0 2024-09-13T16:10:00.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.706+0000 7f37b7400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b019fce0 con 0x7f37b0103b50 2024-09-13T16:10:00.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.706+0000 7f37b7400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b019fea0 con 0x7f37b0103190 2024-09-13T16:10:00.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.706+0000 7f37b4a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37b0101fa0 0x7f37b0198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:00.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.706+0000 7f37b4a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37b0101fa0 0x7f37b0198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57582/0 (socket says 172.21.15.86:57582) 2024-09-13T16:10:00.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.706+0000 7f37b4a00640 1 -- 172.21.15.86:0/2281745704 learned_addr learned my addr 172.21.15.86:0/2281745704 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:00.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.706+0000 7f37afe00640 1 --2- 172.21.15.86:0/2281745704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37b0103190 0x7f37b01985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:00.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.706+0000 7f37b5400640 1 --2- 172.21.15.86:0/2281745704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37b0103b50 0x7f37b019f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:00.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.706+0000 7f37b4a00640 1 -- 172.21.15.86:0/2281745704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37b0103190 msgr2=0x7f37b01985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:00.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.707+0000 7f37b4a00640 1 --2- 172.21.15.86:0/2281745704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37b0103190 0x7f37b01985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.707+0000 7f37b4a00640 1 -- 172.21.15.86:0/2281745704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37b0103b50 msgr2=0x7f37b019f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:00.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.707+0000 7f37b4a00640 1 --2- 172.21.15.86:0/2281745704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37b0103b50 0x7f37b019f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.707+0000 7f37b4a00640 1 -- 172.21.15.86:0/2281745704 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379c009560 con 0x7f37b0101fa0 2024-09-13T16:10:00.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.707+0000 7f37b4a00640 1 --2- 172.21.15.86:0/2281745704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37b0101fa0 0x7f37b0198080 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f37a400e9c0 tx=0x7f37a400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:00.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.707+0000 7f37ad600640 1 -- 172.21.15.86:0/2281745704 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a4009700 con 0x7f37b0101fa0 2024-09-13T16:10:00.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.707+0000 7f37ad600640 1 -- 172.21.15.86:0/2281745704 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f37a400cd80 con 0x7f37b0101fa0 2024-09-13T16:10:00.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.707+0000 7f37b7400640 1 -- 172.21.15.86:0/2281745704 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b01a0180 con 0x7f37b0101fa0 2024-09-13T16:10:00.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.707+0000 7f37ad600640 1 -- 172.21.15.86:0/2281745704 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a4010430 con 0x7f37b0101fa0 2024-09-13T16:10:00.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.707+0000 7f37b7400640 1 -- 172.21.15.86:0/2281745704 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b01a0660 con 0x7f37b0101fa0 2024-09-13T16:10:00.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.708+0000 7f37b7400640 1 -- 172.21.15.86:0/2281745704 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b0109430 con 0x7f37b0101fa0 2024-09-13T16:10:00.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.710+0000 7f37ad600640 1 -- 172.21.15.86:0/2281745704 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f37a4003680 con 0x7f37b0101fa0 2024-09-13T16:10:00.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.711+0000 7f37ad600640 1 --2- 172.21.15.86:0/2281745704 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f37980a1090 0x7f37980a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:00.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.711+0000 7f37ad600640 1 -- 172.21.15.86:0/2281745704 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f37a4014070 con 0x7f37b0101fa0 2024-09-13T16:10:00.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.711+0000 7f37afe00640 1 --2- 172.21.15.86:0/2281745704 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f37980a1090 0x7f37980a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:00.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.712+0000 7f37afe00640 1 --2- 172.21.15.86:0/2281745704 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f37980a1090 0x7f37980a3550 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f379c005ab0 tx=0x7f379c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:00.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.715+0000 7f37ad600640 1 -- 172.21.15.86:0/2281745704 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f37a40964e0 con 0x7f37b0101fa0 2024-09-13T16:10:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]': finished 2024-09-13T16:10:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-13T16:10:00.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-13T16:10:00.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-13T16:10:00.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.15", "id": [5, 10]}]': finished 2024-09-13T16:10:00.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:00 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-13T16:10:00.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:00 smithi086 ceph-mon[30379]: osdmap e93: 12 total, 12 up, 12 in 2024-09-13T16:10:00.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:00 smithi086 ceph-mon[30379]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-13T16:10:00.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:00 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2278213087' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:10:00.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:00 smithi086 ceph-mon[30379]: overall HEALTH_OK 2024-09-13T16:10:00.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:00 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2892474143' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:10:00.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:00 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1040120027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:10:00.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.893+0000 7f37b7400640 1 -- 172.21.15.86:0/2281745704 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f37b002c3e0 con 0x7f37b0101fa0 2024-09-13T16:10:00.895 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.894+0000 7f37ad600640 1 -- 172.21.15.86:0/2281745704 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f37a4099b00 con 0x7f37b0101fa0 2024-09-13T16:10:00.896 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-09-13T16:10:00.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.896+0000 7f37b7400640 1 -- 172.21.15.86:0/2281745704 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f37980a1090 msgr2=0x7f37980a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:00.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.896+0000 7f37b7400640 1 --2- 172.21.15.86:0/2281745704 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f37980a1090 0x7f37980a3550 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f379c005ab0 tx=0x7f379c005a20 comp rx=0 tx=0).stop 2024-09-13T16:10:00.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.896+0000 7f37b7400640 1 -- 172.21.15.86:0/2281745704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37b0101fa0 msgr2=0x7f37b0198080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:00.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.896+0000 7f37b7400640 1 --2- 172.21.15.86:0/2281745704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37b0101fa0 0x7f37b0198080 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f37a400e9c0 tx=0x7f37a400ee80 comp rx=0 tx=0).stop 2024-09-13T16:10:00.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.896+0000 7f37b7400640 1 -- 172.21.15.86:0/2281745704 shutdown_connections 2024-09-13T16:10:00.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.896+0000 7f37b7400640 1 --2- 172.21.15.86:0/2281745704 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f37980a1090 0x7f37980a3550 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.896+0000 7f37b7400640 1 --2- 172.21.15.86:0/2281745704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37b0103b50 0x7f37b019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.896+0000 7f37b7400640 1 --2- 172.21.15.86:0/2281745704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37b0103190 0x7f37b01985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.896+0000 7f37b7400640 1 --2- 172.21.15.86:0/2281745704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37b0101fa0 0x7f37b0198080 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:00.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.896+0000 7f37b7400640 1 -- 172.21.15.86:0/2281745704 >> 172.21.15.86:0/2281745704 conn(0x7f37b00fd700 msgr2=0x7f37b0106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:00.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.896+0000 7f37b7400640 1 -- 172.21.15.86:0/2281745704 shutdown_connections 2024-09-13T16:10:00.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:00.896+0000 7f37b7400640 1 -- 172.21.15.86:0/2281745704 wait complete. 2024-09-13T16:10:00.914 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:10:01.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]': finished 2024-09-13T16:10:01.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-13T16:10:01.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-13T16:10:01.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-13T16:10:01.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.15", "id": [5, 10]}]': finished 2024-09-13T16:10:01.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:00 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-13T16:10:01.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:00 smithi139 ceph-mon[35320]: osdmap e93: 12 total, 12 up, 12 in 2024-09-13T16:10:01.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:00 smithi139 ceph-mon[35320]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-13T16:10:01.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:00 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2278213087' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:10:01.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:00 smithi139 ceph-mon[35320]: overall HEALTH_OK 2024-09-13T16:10:01.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:00 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2892474143' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:10:01.001 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:00 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1040120027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:10:01.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]': finished 2024-09-13T16:10:01.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-13T16:10:01.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-13T16:10:01.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-13T16:10:01.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.15", "id": [5, 10]}]': finished 2024-09-13T16:10:01.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:00 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-13T16:10:01.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:00 smithi194 ceph-mon[35694]: osdmap e93: 12 total, 12 up, 12 in 2024-09-13T16:10:01.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:00 smithi194 ceph-mon[35694]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-13T16:10:01.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:00 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2278213087' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:10:01.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:00 smithi194 ceph-mon[35694]: overall HEALTH_OK 2024-09-13T16:10:01.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:00 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2892474143' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:10:01.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:00 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1040120027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:10:01.067 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.065+0000 7fedeae00640 1 -- 172.21.15.86:0/2374992428 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede4102f90 msgr2=0x7fede4103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:01.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.065+0000 7fedeae00640 1 --2- 172.21.15.86:0/2374992428 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede4102f90 0x7fede4103410 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009900 tx=0x7fedd002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.065+0000 7fedeae00640 1 -- 172.21.15.86:0/2374992428 shutdown_connections 2024-09-13T16:10:01.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.065+0000 7fedeae00640 1 --2- 172.21.15.86:0/2374992428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede4103950 0x7fede410a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.065+0000 7fedeae00640 1 --2- 172.21.15.86:0/2374992428 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede4102f90 0x7fede4103410 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.065+0000 7fedeae00640 1 --2- 172.21.15.86:0/2374992428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fede4101da0 0x7fede41021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.066+0000 7fedeae00640 1 -- 172.21.15.86:0/2374992428 >> 172.21.15.86:0/2374992428 conn(0x7fede40fd540 msgr2=0x7fede40ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:01.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.066+0000 7fedeae00640 1 -- 172.21.15.86:0/2374992428 shutdown_connections 2024-09-13T16:10:01.068 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.066+0000 7fedeae00640 1 -- 172.21.15.86:0/2374992428 wait complete. 2024-09-13T16:10:01.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.066+0000 7fedeae00640 1 Processor -- start 2024-09-13T16:10:01.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.067+0000 7fedeae00640 1 -- start start 2024-09-13T16:10:01.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.067+0000 7fedeae00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fede4101da0 0x7fede4197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:01.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.067+0000 7fedeae00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede4102f90 0x7fede41983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:01.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.067+0000 7fedeae00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede4103950 0x7fede419f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:01.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.067+0000 7fedeae00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede419f950 con 0x7fede4102f90 2024-09-13T16:10:01.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.067+0000 7fedeae00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede419fac0 con 0x7fede4103950 2024-09-13T16:10:01.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.067+0000 7fedeae00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede419fc80 con 0x7fede4101da0 2024-09-13T16:10:01.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.067+0000 7fede9000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede4102f90 0x7fede41983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:01.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.067+0000 7fede9000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede4102f90 0x7fede41983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57590/0 (socket says 172.21.15.86:57590) 2024-09-13T16:10:01.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.067+0000 7fede9000640 1 -- 172.21.15.86:0/1079944380 learned_addr learned my addr 172.21.15.86:0/1079944380 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:01.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.067+0000 7fedea400640 1 --2- 172.21.15.86:0/1079944380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede4103950 0x7fede419f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:01.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.067+0000 7fede9a00640 1 --2- 172.21.15.86:0/1079944380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fede4101da0 0x7fede4197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:01.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.068+0000 7fede9000640 1 -- 172.21.15.86:0/1079944380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fede4101da0 msgr2=0x7fede4197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:01.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.068+0000 7fede9000640 1 --2- 172.21.15.86:0/1079944380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fede4101da0 0x7fede4197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.068+0000 7fede9000640 1 -- 172.21.15.86:0/1079944380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede4103950 msgr2=0x7fede419f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:01.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.068+0000 7fede9000640 1 --2- 172.21.15.86:0/1079944380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede4103950 0x7fede419f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.068+0000 7fede9000640 1 -- 172.21.15.86:0/1079944380 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd0009560 con 0x7fede4102f90 2024-09-13T16:10:01.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.068+0000 7fede9000640 1 --2- 172.21.15.86:0/1079944380 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede4102f90 0x7fede41983a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fedd0031510 tx=0x7fedd0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:01.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.068+0000 7fede2000640 1 -- 172.21.15.86:0/1079944380 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0005000 con 0x7fede4102f90 2024-09-13T16:10:01.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.068+0000 7fede2000640 1 -- 172.21.15.86:0/1079944380 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fedd00046c0 con 0x7fede4102f90 2024-09-13T16:10:01.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.068+0000 7fedeae00640 1 -- 172.21.15.86:0/1079944380 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede419ff00 con 0x7fede4102f90 2024-09-13T16:10:01.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.068+0000 7fede2000640 1 -- 172.21.15.86:0/1079944380 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0003a10 con 0x7fede4102f90 2024-09-13T16:10:01.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.068+0000 7fedeae00640 1 -- 172.21.15.86:0/1079944380 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede41a0330 con 0x7fede4102f90 2024-09-13T16:10:01.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.069+0000 7fedeae00640 1 -- 172.21.15.86:0/1079944380 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede4109200 con 0x7fede4102f90 2024-09-13T16:10:01.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.071+0000 7fede2000640 1 -- 172.21.15.86:0/1079944380 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fedd0004bc0 con 0x7fede4102f90 2024-09-13T16:10:01.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.072+0000 7fede2000640 1 --2- 172.21.15.86:0/1079944380 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fedcc0a1110 0x7fedcc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:01.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.072+0000 7fede2000640 1 -- 172.21.15.86:0/1079944380 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fedd00edb00 con 0x7fede4102f90 2024-09-13T16:10:01.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.072+0000 7fede9a00640 1 --2- 172.21.15.86:0/1079944380 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fedcc0a1110 0x7fedcc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:01.074 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.073+0000 7fede9a00640 1 --2- 172.21.15.86:0/1079944380 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fedcc0a1110 0x7fedcc0a35d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fede4102df0 tx=0x7fedd8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:01.077 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.076+0000 7fede2000640 1 -- 172.21.15.86:0/1079944380 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fedd00efe60 con 0x7fede4102f90 2024-09-13T16:10:01.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.284+0000 7fedeae00640 1 -- 172.21.15.86:0/1079944380 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fede410d7e0 con 0x7fede4102f90 2024-09-13T16:10:01.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.285+0000 7fede2000640 1 -- 172.21.15.86:0/1079944380 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10877 (secure 0 0 0) 0x7fedd004a090 con 0x7fede4102f90 2024-09-13T16:10:01.287 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:10:01.287 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14508,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1509120923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1509120923},{"type":"v1","addr":"172.21.15.86:6839","nonce":1509120923}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6841/1971775519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":1971775519},{"type":"v1","addr":"172.21.15.86:6841","nonce":1971775519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T16:08:09.202262+0000","modified":"2024-09-13T16:08:32.444959+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24544,"mds_2":24530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/1370900762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1370900762},{"type":"v1","addr":"172.21.15.194:6835","nonce":1370900762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/2460451799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":2460451799},{"type":"v1","addr":"172.21.15.194:6837","nonce":2460451799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24530":{"gid":24530,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.139:6837/2399531832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2399531832},{"type":"v1","addr":"172.21.15.139:6837","nonce":2399531832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6839/3799859182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3799859182},{"type":"v1","addr":"172.21.15.194:6839","nonce":3799859182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.139:6839/3370280063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3370280063},{"type":"v1","addr":"172.21.15.139:6839","nonce":3370280063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:10:01.287 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 24 2024-09-13T16:10:01.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.287+0000 7fedeae00640 1 -- 172.21.15.86:0/1079944380 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fedcc0a1110 msgr2=0x7fedcc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:01.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.287+0000 7fedeae00640 1 --2- 172.21.15.86:0/1079944380 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fedcc0a1110 0x7fedcc0a35d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fede4102df0 tx=0x7fedd8005f90 comp rx=0 tx=0).stop 2024-09-13T16:10:01.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.287+0000 7fedeae00640 1 -- 172.21.15.86:0/1079944380 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede4102f90 msgr2=0x7fede41983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:01.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.287+0000 7fedeae00640 1 --2- 172.21.15.86:0/1079944380 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede4102f90 0x7fede41983a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fedd0031510 tx=0x7fedd0004270 comp rx=0 tx=0).stop 2024-09-13T16:10:01.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.287+0000 7fedeae00640 1 -- 172.21.15.86:0/1079944380 shutdown_connections 2024-09-13T16:10:01.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.287+0000 7fedeae00640 1 --2- 172.21.15.86:0/1079944380 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fedcc0a1110 0x7fedcc0a35d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.287+0000 7fedeae00640 1 --2- 172.21.15.86:0/1079944380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede4103950 0x7fede419f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.287+0000 7fedeae00640 1 --2- 172.21.15.86:0/1079944380 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fede4102f90 0x7fede41983a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.287+0000 7fedeae00640 1 --2- 172.21.15.86:0/1079944380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fede4101da0 0x7fede4197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.287+0000 7fedeae00640 1 -- 172.21.15.86:0/1079944380 >> 172.21.15.86:0/1079944380 conn(0x7fede40fd540 msgr2=0x7fede41063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:01.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.287+0000 7fedeae00640 1 -- 172.21.15.86:0/1079944380 shutdown_connections 2024-09-13T16:10:01.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.287+0000 7fedeae00640 1 -- 172.21.15.86:0/1079944380 wait complete. 2024-09-13T16:10:01.306 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:10:01.460 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.458+0000 7f9565600640 1 -- 172.21.15.86:0/2112034295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95600fedd0 msgr2=0x7f95600ff250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:01.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.458+0000 7f9565600640 1 --2- 172.21.15.86:0/2112034295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95600fedd0 0x7f95600ff250 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f954c009900 tx=0x7f954c02a410 comp rx=0 tx=0).stop 2024-09-13T16:10:01.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.458+0000 7f9565600640 1 -- 172.21.15.86:0/2112034295 shutdown_connections 2024-09-13T16:10:01.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.458+0000 7f9565600640 1 --2- 172.21.15.86:0/2112034295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95600ff790 0x7f9560100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.458+0000 7f9565600640 1 --2- 172.21.15.86:0/2112034295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95600fedd0 0x7f95600ff250 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.458+0000 7f9565600640 1 --2- 172.21.15.86:0/2112034295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95600fe070 0x7f95600fe470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.458+0000 7f9565600640 1 -- 172.21.15.86:0/2112034295 >> 172.21.15.86:0/2112034295 conn(0x7f95600f9bb0 msgr2=0x7f95600fbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:01.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.458+0000 7f9565600640 1 -- 172.21.15.86:0/2112034295 shutdown_connections 2024-09-13T16:10:01.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.458+0000 7f9565600640 1 -- 172.21.15.86:0/2112034295 wait complete. 2024-09-13T16:10:01.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.459+0000 7f9565600640 1 Processor -- start 2024-09-13T16:10:01.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.459+0000 7f9565600640 1 -- start start 2024-09-13T16:10:01.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.460+0000 7f9565600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95600fe070 0x7f95601980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:01.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.460+0000 7f9565600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95600fedd0 0x7f9560198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:01.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.460+0000 7f9565600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95600ff790 0x7f956019f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:01.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.460+0000 7f9565600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956019fbc0 con 0x7f95600fedd0 2024-09-13T16:10:01.464 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.460+0000 7f9565600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956019fd30 con 0x7f95600fe070 2024-09-13T16:10:01.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.460+0000 7f9565600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956019fef0 con 0x7f95600ff790 2024-09-13T16:10:01.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.460+0000 7f955e000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95600fedd0 0x7f9560198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:01.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.460+0000 7f955e000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95600fedd0 0x7f9560198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57608/0 (socket says 172.21.15.86:57608) 2024-09-13T16:10:01.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.460+0000 7f955e000640 1 -- 172.21.15.86:0/3015886593 learned_addr learned my addr 172.21.15.86:0/3015886593 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:01.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.460+0000 7f955f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95600ff790 0x7f956019f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:01.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.460+0000 7f955ea00640 1 --2- 172.21.15.86:0/3015886593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95600fe070 0x7f95601980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:01.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.460+0000 7f955e000640 1 -- 172.21.15.86:0/3015886593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95600ff790 msgr2=0x7f956019f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:01.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.460+0000 7f955e000640 1 --2- 172.21.15.86:0/3015886593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95600ff790 0x7f956019f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.460+0000 7f955e000640 1 -- 172.21.15.86:0/3015886593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95600fe070 msgr2=0x7f95601980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:01.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.460+0000 7f955e000640 1 --2- 172.21.15.86:0/3015886593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95600fe070 0x7f95601980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.460+0000 7f955e000640 1 -- 172.21.15.86:0/3015886593 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c009560 con 0x7f95600fedd0 2024-09-13T16:10:01.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.460+0000 7f955f400640 1 --2- 172.21.15.86:0/3015886593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95600ff790 0x7f956019f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:01.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.461+0000 7f955e000640 1 --2- 172.21.15.86:0/3015886593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95600fedd0 0x7f9560198610 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f954c031510 tx=0x7f954c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:01.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.461+0000 7f9557400640 1 -- 172.21.15.86:0/3015886593 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c005000 con 0x7f95600fedd0 2024-09-13T16:10:01.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.461+0000 7f9557400640 1 -- 172.21.15.86:0/3015886593 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f954c005640 con 0x7f95600fedd0 2024-09-13T16:10:01.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.461+0000 7f9557400640 1 -- 172.21.15.86:0/3015886593 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c003970 con 0x7f95600fedd0 2024-09-13T16:10:01.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.461+0000 7f9565600640 1 -- 172.21.15.86:0/3015886593 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95601a0170 con 0x7f95600fedd0 2024-09-13T16:10:01.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.461+0000 7f9565600640 1 -- 172.21.15.86:0/3015886593 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95601a05d0 con 0x7f95600fedd0 2024-09-13T16:10:01.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.462+0000 7f9565600640 1 -- 172.21.15.86:0/3015886593 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9560109d90 con 0x7f95600fedd0 2024-09-13T16:10:01.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.464+0000 7f9557400640 1 -- 172.21.15.86:0/3015886593 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f954c0046c0 con 0x7f95600fedd0 2024-09-13T16:10:01.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.465+0000 7f9557400640 1 --2- 172.21.15.86:0/3015886593 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f95440a1110 0x7f95440a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:01.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.465+0000 7f9557400640 1 -- 172.21.15.86:0/3015886593 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f954c0ed730 con 0x7f95600fedd0 2024-09-13T16:10:01.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.465+0000 7f955ea00640 1 --2- 172.21.15.86:0/3015886593 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f95440a1110 0x7f95440a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:01.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.466+0000 7f955ea00640 1 --2- 172.21.15.86:0/3015886593 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f95440a1110 0x7f95440a35d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9550005fd0 tx=0x7f9550009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:01.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.469+0000 7f9557400640 1 -- 172.21.15.86:0/3015886593 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f954c0b6b50 con 0x7f95600fedd0 2024-09-13T16:10:01.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.643+0000 7f9565600640 1 -- 172.21.15.86:0/3015886593 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f956010da20 con 0x7f95600fedd0 2024-09-13T16:10:01.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.645+0000 7f9557400640 1 -- 172.21.15.86:0/3015886593 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24703 (secure 0 0 0) 0x7f954c0ba170 con 0x7f95600fedd0 2024-09-13T16:10:01.647 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:10:01.647 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":94,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:10:00.680229+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":7}]},{"pgid":"3.19","mappings":[{"from":3,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2f","mappings":[{"from":1,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:10:01.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.647+0000 7f9565600640 1 -- 172.21.15.86:0/3015886593 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f95440a1110 msgr2=0x7f95440a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:01.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.647+0000 7f9565600640 1 --2- 172.21.15.86:0/3015886593 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f95440a1110 0x7f95440a35d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9550005fd0 tx=0x7f9550009500 comp rx=0 tx=0).stop 2024-09-13T16:10:01.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.647+0000 7f9565600640 1 -- 172.21.15.86:0/3015886593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95600fedd0 msgr2=0x7f9560198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:01.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.647+0000 7f9565600640 1 --2- 172.21.15.86:0/3015886593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95600fedd0 0x7f9560198610 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f954c031510 tx=0x7f954c004270 comp rx=0 tx=0).stop 2024-09-13T16:10:01.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.647+0000 7f9565600640 1 -- 172.21.15.86:0/3015886593 shutdown_connections 2024-09-13T16:10:01.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.647+0000 7f9565600640 1 --2- 172.21.15.86:0/3015886593 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f95440a1110 0x7f95440a35d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.647+0000 7f9565600640 1 --2- 172.21.15.86:0/3015886593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95600ff790 0x7f956019f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.647+0000 7f9565600640 1 --2- 172.21.15.86:0/3015886593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95600fedd0 0x7f9560198610 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.647+0000 7f9565600640 1 --2- 172.21.15.86:0/3015886593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95600fe070 0x7f95601980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.647+0000 7f9565600640 1 -- 172.21.15.86:0/3015886593 >> 172.21.15.86:0/3015886593 conn(0x7f95600f9bb0 msgr2=0x7f95600fb360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:01.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.647+0000 7f9565600640 1 -- 172.21.15.86:0/3015886593 shutdown_connections 2024-09-13T16:10:01.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.647+0000 7f9565600640 1 -- 172.21.15.86:0/3015886593 wait complete. 2024-09-13T16:10:01.665 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:03:27.830423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:08:07.732536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:08:08.742145+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T16:08:11.721740+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T16:10:01.665 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:10:01.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.820+0000 7fa2bbe00640 1 -- 172.21.15.86:0/3863137962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc101e30 msgr2=0x7fa2bc102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:01.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.820+0000 7fa2bbe00640 1 --2- 172.21.15.86:0/3863137962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc101e30 0x7fa2bc102230 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009900 tx=0x7fa2ac02a400 comp rx=0 tx=0).stop 2024-09-13T16:10:01.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.820+0000 7fa2bbe00640 1 -- 172.21.15.86:0/3863137962 shutdown_connections 2024-09-13T16:10:01.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.820+0000 7fa2bbe00640 1 --2- 172.21.15.86:0/3863137962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2bc103940 0x7fa2bc10a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.820+0000 7fa2bbe00640 1 --2- 172.21.15.86:0/3863137962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2bc102f80 0x7fa2bc103400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.820+0000 7fa2bbe00640 1 --2- 172.21.15.86:0/3863137962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc101e30 0x7fa2bc102230 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.820+0000 7fa2bbe00640 1 -- 172.21.15.86:0/3863137962 >> 172.21.15.86:0/3863137962 conn(0x7fa2bc0fd5b0 msgr2=0x7fa2bc0ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:01.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.820+0000 7fa2bbe00640 1 -- 172.21.15.86:0/3863137962 shutdown_connections 2024-09-13T16:10:01.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.820+0000 7fa2bbe00640 1 -- 172.21.15.86:0/3863137962 wait complete. 2024-09-13T16:10:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.821+0000 7fa2bbe00640 1 Processor -- start 2024-09-13T16:10:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.821+0000 7fa2bbe00640 1 -- start start 2024-09-13T16:10:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.821+0000 7fa2bbe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc101e30 0x7fa2bc197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.821+0000 7fa2bbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2bc102f80 0x7fa2bc1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.821+0000 7fa2bbe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2bc103940 0x7fa2bc19f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.821+0000 7fa2bbe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc19f960 con 0x7fa2bc101e30 2024-09-13T16:10:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.821+0000 7fa2bbe00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc19fad0 con 0x7fa2bc103940 2024-09-13T16:10:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.821+0000 7fa2bbe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc19fc90 con 0x7fa2bc102f80 2024-09-13T16:10:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.822+0000 7fa2ba000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2bc102f80 0x7fa2bc1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.822+0000 7fa2baa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc101e30 0x7fa2bc197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.822+0000 7fa2ba000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2bc102f80 0x7fa2bc1983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:47690/0 (socket says 172.21.15.86:47690) 2024-09-13T16:10:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.822+0000 7fa2ba000640 1 -- 172.21.15.86:0/941570096 learned_addr learned my addr 172.21.15.86:0/941570096 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.822+0000 7fa2bb400640 1 --2- 172.21.15.86:0/941570096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2bc103940 0x7fa2bc19f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.822+0000 7fa2ba000640 1 -- 172.21.15.86:0/941570096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2bc103940 msgr2=0x7fa2bc19f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.822+0000 7fa2ba000640 1 --2- 172.21.15.86:0/941570096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2bc103940 0x7fa2bc19f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.822+0000 7fa2ba000640 1 -- 172.21.15.86:0/941570096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc101e30 msgr2=0x7fa2bc197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.822+0000 7fa2ba000640 1 --2- 172.21.15.86:0/941570096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc101e30 0x7fa2bc197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:01.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.822+0000 7fa2ba000640 1 -- 172.21.15.86:0/941570096 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a8009490 con 0x7fa2bc102f80 2024-09-13T16:10:01.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.822+0000 7fa2baa00640 1 --2- 172.21.15.86:0/941570096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc101e30 0x7fa2bc197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:01.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.823+0000 7fa2ba000640 1 --2- 172.21.15.86:0/941570096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2bc102f80 0x7fa2bc1983b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800e9c0 tx=0x7fa2a800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:01.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.823+0000 7fa2b3400640 1 -- 172.21.15.86:0/941570096 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a800cde0 con 0x7fa2bc102f80 2024-09-13T16:10:01.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.823+0000 7fa2bbe00640 1 -- 172.21.15.86:0/941570096 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ac009560 con 0x7fa2bc102f80 2024-09-13T16:10:01.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.823+0000 7fa2b3400640 1 -- 172.21.15.86:0/941570096 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa2a8010910 con 0x7fa2bc102f80 2024-09-13T16:10:01.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.823+0000 7fa2b3400640 1 -- 172.21.15.86:0/941570096 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8018960 con 0x7fa2bc102f80 2024-09-13T16:10:01.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.823+0000 7fa2bbe00640 1 -- 172.21.15.86:0/941570096 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2bc1a0270 con 0x7fa2bc102f80 2024-09-13T16:10:01.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.824+0000 7fa2bbe00640 1 -- 172.21.15.86:0/941570096 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2bc109140 con 0x7fa2bc102f80 2024-09-13T16:10:01.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.826+0000 7fa2b3400640 1 -- 172.21.15.86:0/941570096 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa2a8010a80 con 0x7fa2bc102f80 2024-09-13T16:10:01.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.827+0000 7fa2b3400640 1 --2- 172.21.15.86:0/941570096 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa2a00a1090 0x7fa2a00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:01.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.827+0000 7fa2b3400640 1 -- 172.21.15.86:0/941570096 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fa2a8014070 con 0x7fa2bc102f80 2024-09-13T16:10:01.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.827+0000 7fa2baa00640 1 --2- 172.21.15.86:0/941570096 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa2a00a1090 0x7fa2a00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:01.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.828+0000 7fa2baa00640 1 --2- 172.21.15.86:0/941570096 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa2a00a1090 0x7fa2a00a3550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac031510 tx=0x7fa2ac0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:01.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.831+0000 7fa2b3400640 1 -- 172.21.15.86:0/941570096 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa2a8096630 con 0x7fa2bc102f80 2024-09-13T16:10:01.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:01 smithi139 ceph-mon[35320]: osdmap e94: 12 total, 12 up, 12 in 2024-09-13T16:10:01.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:01 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2281745704' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:10:01.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:01 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1079944380' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:10:01.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:01 smithi139 ceph-mon[35320]: pgmap v355: 129 pgs: 1 peering, 128 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-13T16:10:01.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:01 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3015886593' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:10:01.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.998+0000 7fa2bbe00640 1 -- 172.21.15.86:0/941570096 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2bc108bb0 con 0x7fa2bc102f80 2024-09-13T16:10:02.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:01.998+0000 7fa2b3400640 1 -- 172.21.15.86:0/941570096 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2a8099c50 con 0x7fa2bc102f80 2024-09-13T16:10:02.000 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-09-13T16:10:02.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.001+0000 7fa2bbe00640 1 -- 172.21.15.86:0/941570096 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa2a00a1090 msgr2=0x7fa2a00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:02.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.001+0000 7fa2bbe00640 1 --2- 172.21.15.86:0/941570096 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa2a00a1090 0x7fa2a00a3550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac031510 tx=0x7fa2ac0058d0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.001+0000 7fa2bbe00640 1 -- 172.21.15.86:0/941570096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2bc102f80 msgr2=0x7fa2bc1983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:02.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.001+0000 7fa2bbe00640 1 --2- 172.21.15.86:0/941570096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2bc102f80 0x7fa2bc1983b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800e9c0 tx=0x7fa2a800ee80 comp rx=0 tx=0).stop 2024-09-13T16:10:02.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.001+0000 7fa2bbe00640 1 -- 172.21.15.86:0/941570096 shutdown_connections 2024-09-13T16:10:02.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.001+0000 7fa2bbe00640 1 --2- 172.21.15.86:0/941570096 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fa2a00a1090 0x7fa2a00a3550 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.001+0000 7fa2bbe00640 1 --2- 172.21.15.86:0/941570096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2bc103940 0x7fa2bc19f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.001+0000 7fa2bbe00640 1 --2- 172.21.15.86:0/941570096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2bc102f80 0x7fa2bc1983b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.001+0000 7fa2bbe00640 1 --2- 172.21.15.86:0/941570096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc101e30 0x7fa2bc197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.001+0000 7fa2bbe00640 1 -- 172.21.15.86:0/941570096 >> 172.21.15.86:0/941570096 conn(0x7fa2bc0fd5b0 msgr2=0x7fa2bc106310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:02.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.001+0000 7fa2bbe00640 1 -- 172.21.15.86:0/941570096 shutdown_connections 2024-09-13T16:10:02.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.001+0000 7fa2bbe00640 1 -- 172.21.15.86:0/941570096 wait complete. 2024-09-13T16:10:02.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:01 smithi194 ceph-mon[35694]: osdmap e94: 12 total, 12 up, 12 in 2024-09-13T16:10:02.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:01 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2281745704' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:10:02.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:01 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1079944380' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:10:02.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:01 smithi194 ceph-mon[35694]: pgmap v355: 129 pgs: 1 peering, 128 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-13T16:10:02.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:01 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3015886593' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:10:02.016 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:01 smithi086 ceph-mon[30379]: osdmap e94: 12 total, 12 up, 12 in 2024-09-13T16:10:02.016 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:01 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2281745704' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:10:02.016 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:01 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1079944380' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:10:02.017 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:01 smithi086 ceph-mon[30379]: pgmap v355: 129 pgs: 1 peering, 128 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-13T16:10:02.017 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:01 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3015886593' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:10:02.018 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:10:02.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.174+0000 7fac25600640 1 -- 172.21.15.86:0/832364046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20100f60 msgr2=0x7fac201013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:02.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.174+0000 7fac25600640 1 --2- 172.21.15.86:0/832364046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20100f60 0x7fac201013e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fac08009860 tx=0x7fac0802a340 comp rx=0 tx=0).stop 2024-09-13T16:10:02.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.174+0000 7fac25600640 1 -- 172.21.15.86:0/832364046 shutdown_connections 2024-09-13T16:10:02.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.174+0000 7fac25600640 1 --2- 172.21.15.86:0/832364046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac20101920 0x7fac201081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.174+0000 7fac25600640 1 --2- 172.21.15.86:0/832364046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20100f60 0x7fac201013e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.174+0000 7fac25600640 1 --2- 172.21.15.86:0/832364046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac200ffd70 0x7fac20100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.174+0000 7fac25600640 1 -- 172.21.15.86:0/832364046 >> 172.21.15.86:0/832364046 conn(0x7fac200fb4d0 msgr2=0x7fac200fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:02.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.174+0000 7fac25600640 1 -- 172.21.15.86:0/832364046 shutdown_connections 2024-09-13T16:10:02.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.174+0000 7fac25600640 1 -- 172.21.15.86:0/832364046 wait complete. 2024-09-13T16:10:02.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.175+0000 7fac25600640 1 Processor -- start 2024-09-13T16:10:02.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.175+0000 7fac25600640 1 -- start start 2024-09-13T16:10:02.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.175+0000 7fac25600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac200ffd70 0x7fac20074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:02.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.175+0000 7fac25600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20100f60 0x7fac200728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:02.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.175+0000 7fac25600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac20101920 0x7fac20072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:02.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.175+0000 7fac25600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac20073540 con 0x7fac200ffd70 2024-09-13T16:10:02.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.175+0000 7fac25600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac200736b0 con 0x7fac20100f60 2024-09-13T16:10:02.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.175+0000 7fac25600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2019ff10 con 0x7fac20101920 2024-09-13T16:10:02.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.176+0000 7fac1ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac200ffd70 0x7fac20074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:02.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.176+0000 7fac1ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac200ffd70 0x7fac20074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57634/0 (socket says 172.21.15.86:57634) 2024-09-13T16:10:02.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.176+0000 7fac1ea00640 1 -- 172.21.15.86:0/1348103325 learned_addr learned my addr 172.21.15.86:0/1348103325 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:02.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.176+0000 7fac1f400640 1 --2- 172.21.15.86:0/1348103325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac20101920 0x7fac20072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:02.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.176+0000 7fac17e00640 1 --2- 172.21.15.86:0/1348103325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20100f60 0x7fac200728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:02.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.176+0000 7fac1ea00640 1 -- 172.21.15.86:0/1348103325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac20101920 msgr2=0x7fac20072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:02.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.176+0000 7fac1ea00640 1 --2- 172.21.15.86:0/1348103325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac20101920 0x7fac20072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.176+0000 7fac1ea00640 1 -- 172.21.15.86:0/1348103325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20100f60 msgr2=0x7fac200728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:02.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.176+0000 7fac1ea00640 1 --2- 172.21.15.86:0/1348103325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20100f60 0x7fac200728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.176+0000 7fac1ea00640 1 -- 172.21.15.86:0/1348103325 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac18009900 con 0x7fac200ffd70 2024-09-13T16:10:02.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.176+0000 7fac17e00640 1 --2- 172.21.15.86:0/1348103325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20100f60 0x7fac200728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:10:02.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.176+0000 7fac1ea00640 1 --2- 172.21.15.86:0/1348103325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac200ffd70 0x7fac20074260 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fac1000e9f0 tx=0x7fac1000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:02.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.176+0000 7fac17400640 1 -- 172.21.15.86:0/1348103325 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac100096e0 con 0x7fac200ffd70 2024-09-13T16:10:02.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.177+0000 7fac17400640 1 -- 172.21.15.86:0/1348103325 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fac1000cd80 con 0x7fac200ffd70 2024-09-13T16:10:02.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.177+0000 7fac25600640 1 -- 172.21.15.86:0/1348103325 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac08009490 con 0x7fac200ffd70 2024-09-13T16:10:02.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.177+0000 7fac17400640 1 -- 172.21.15.86:0/1348103325 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10010430 con 0x7fac200ffd70 2024-09-13T16:10:02.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.177+0000 7fac25600640 1 -- 172.21.15.86:0/1348103325 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac201a04f0 con 0x7fac200ffd70 2024-09-13T16:10:02.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.178+0000 7fac25600640 1 -- 172.21.15.86:0/1348103325 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac20107220 con 0x7fac200ffd70 2024-09-13T16:10:02.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.179+0000 7fac17400640 1 -- 172.21.15.86:0/1348103325 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fac10003680 con 0x7fac200ffd70 2024-09-13T16:10:02.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.181+0000 7fac17400640 1 --2- 172.21.15.86:0/1348103325 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fac040a1090 0x7fac040a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:02.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.181+0000 7fac17400640 1 -- 172.21.15.86:0/1348103325 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fac10014070 con 0x7fac200ffd70 2024-09-13T16:10:02.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.181+0000 7fac17e00640 1 --2- 172.21.15.86:0/1348103325 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fac040a1090 0x7fac040a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:02.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.182+0000 7fac17e00640 1 --2- 172.21.15.86:0/1348103325 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fac040a1090 0x7fac040a3550 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fac08005940 tx=0x7fac080058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:02.184 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.183+0000 7fac17400640 1 -- 172.21.15.86:0/1348103325 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fac10096830 con 0x7fac200ffd70 2024-09-13T16:10:02.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.356+0000 7fac25600640 1 -- 172.21.15.86:0/1348103325 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fac20106c90 con 0x7fac200ffd70 2024-09-13T16:10:02.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.357+0000 7fac17400640 1 -- 172.21.15.86:0/1348103325 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7fac10099e50 con 0x7fac200ffd70 2024-09-13T16:10:02.359 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-09-13T16:10:02.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.359+0000 7fac25600640 1 -- 172.21.15.86:0/1348103325 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fac040a1090 msgr2=0x7fac040a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:02.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.359+0000 7fac25600640 1 --2- 172.21.15.86:0/1348103325 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fac040a1090 0x7fac040a3550 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fac08005940 tx=0x7fac080058b0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.359+0000 7fac25600640 1 -- 172.21.15.86:0/1348103325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac200ffd70 msgr2=0x7fac20074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:02.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.359+0000 7fac25600640 1 --2- 172.21.15.86:0/1348103325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac200ffd70 0x7fac20074260 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fac1000e9f0 tx=0x7fac1000eeb0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.359+0000 7fac25600640 1 -- 172.21.15.86:0/1348103325 shutdown_connections 2024-09-13T16:10:02.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.359+0000 7fac25600640 1 --2- 172.21.15.86:0/1348103325 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fac040a1090 0x7fac040a3550 secure :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fac08005940 tx=0x7fac080058b0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.361 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.359+0000 7fac25600640 1 --2- 172.21.15.86:0/1348103325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac20101920 0x7fac20072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.359+0000 7fac25600640 1 --2- 172.21.15.86:0/1348103325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac20100f60 0x7fac200728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.359+0000 7fac25600640 1 --2- 172.21.15.86:0/1348103325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac200ffd70 0x7fac20074260 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.359+0000 7fac25600640 1 -- 172.21.15.86:0/1348103325 >> 172.21.15.86:0/1348103325 conn(0x7fac200fb4d0 msgr2=0x7fac201043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:02.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.359+0000 7fac25600640 1 -- 172.21.15.86:0/1348103325 shutdown_connections 2024-09-13T16:10:02.362 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.360+0000 7fac25600640 1 -- 172.21.15.86:0/1348103325 wait complete. 2024-09-13T16:10:02.378 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:10:02.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.535+0000 7f630b200640 1 -- 172.21.15.86:0/1305482729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6304103170 msgr2=0x7f63041035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:02.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.535+0000 7f630b200640 1 --2- 172.21.15.86:0/1305482729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6304103170 0x7f63041035f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009900 tx=0x7f62ec02a3f0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.535+0000 7f630b200640 1 -- 172.21.15.86:0/1305482729 shutdown_connections 2024-09-13T16:10:02.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.535+0000 7f630b200640 1 --2- 172.21.15.86:0/1305482729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6304103b30 0x7f630410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.535+0000 7f630b200640 1 --2- 172.21.15.86:0/1305482729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6304103170 0x7f63041035f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.535+0000 7f630b200640 1 --2- 172.21.15.86:0/1305482729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6304101f80 0x7f6304102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.535+0000 7f630b200640 1 -- 172.21.15.86:0/1305482729 >> 172.21.15.86:0/1305482729 conn(0x7f63040fd700 msgr2=0x7f63040ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:02.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.535+0000 7f630b200640 1 -- 172.21.15.86:0/1305482729 shutdown_connections 2024-09-13T16:10:02.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.535+0000 7f630b200640 1 -- 172.21.15.86:0/1305482729 wait complete. 2024-09-13T16:10:02.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.536+0000 7f630b200640 1 Processor -- start 2024-09-13T16:10:02.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.536+0000 7f630b200640 1 -- start start 2024-09-13T16:10:02.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.536+0000 7f630b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6304101f80 0x7f63041980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:02.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.536+0000 7f630b200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6304103170 0x7f6304198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:02.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.536+0000 7f630b200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6304103b30 0x7f630419f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:02.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.536+0000 7f630b200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630419fb60 con 0x7f6304103b30 2024-09-13T16:10:02.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.536+0000 7f630b200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630419fcd0 con 0x7f6304103170 2024-09-13T16:10:02.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.536+0000 7f630b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630419fe90 con 0x7f6304101f80 2024-09-13T16:10:02.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.537+0000 7f6303e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6304101f80 0x7f63041980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:02.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.537+0000 7f6309200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6304103b30 0x7f630419f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:02.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.537+0000 7f6303e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6304101f80 0x7f63041980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:47722/0 (socket says 172.21.15.86:47722) 2024-09-13T16:10:02.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.537+0000 7f6303e00640 1 -- 172.21.15.86:0/1095309059 learned_addr learned my addr 172.21.15.86:0/1095309059 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:02.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.537+0000 7f62fb400640 1 --2- 172.21.15.86:0/1095309059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6304103170 0x7f6304198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:02.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.537+0000 7f6303e00640 1 -- 172.21.15.86:0/1095309059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6304103170 msgr2=0x7f6304198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:02.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.537+0000 7f6303e00640 1 --2- 172.21.15.86:0/1095309059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6304103170 0x7f6304198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.537+0000 7f6303e00640 1 -- 172.21.15.86:0/1095309059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6304103b30 msgr2=0x7f630419f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:02.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.537+0000 7f6303e00640 1 --2- 172.21.15.86:0/1095309059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6304103b30 0x7f630419f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.537+0000 7f6303e00640 1 -- 172.21.15.86:0/1095309059 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec009560 con 0x7f6304101f80 2024-09-13T16:10:02.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.537+0000 7f6303e00640 1 --2- 172.21.15.86:0/1095309059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6304101f80 0x7f63041980c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f62f400e9c0 tx=0x7f62f400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:02.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.538+0000 7f6301600640 1 -- 172.21.15.86:0/1095309059 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f4009700 con 0x7f6304101f80 2024-09-13T16:10:02.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.538+0000 7f630b200640 1 -- 172.21.15.86:0/1095309059 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63041a0170 con 0x7f6304101f80 2024-09-13T16:10:02.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.538+0000 7f630b200640 1 -- 172.21.15.86:0/1095309059 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63041a06a0 con 0x7f6304101f80 2024-09-13T16:10:02.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.538+0000 7f6301600640 1 -- 172.21.15.86:0/1095309059 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f62f400cd80 con 0x7f6304101f80 2024-09-13T16:10:02.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.538+0000 7f6301600640 1 -- 172.21.15.86:0/1095309059 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f4010430 con 0x7f6304101f80 2024-09-13T16:10:02.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.539+0000 7f630b200640 1 -- 172.21.15.86:0/1095309059 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e0005280 con 0x7f6304101f80 2024-09-13T16:10:02.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.541+0000 7f6301600640 1 -- 172.21.15.86:0/1095309059 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f62f40035f0 con 0x7f6304101f80 2024-09-13T16:10:02.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.542+0000 7f6301600640 1 --2- 172.21.15.86:0/1095309059 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f62e80a1090 0x7f62e80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:02.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.542+0000 7f6301600640 1 -- 172.21.15.86:0/1095309059 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f62f4014070 con 0x7f6304101f80 2024-09-13T16:10:02.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.542+0000 7f62fb400640 1 --2- 172.21.15.86:0/1095309059 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f62e80a1090 0x7f62e80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:02.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.543+0000 7f62fb400640 1 --2- 172.21.15.86:0/1095309059 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f62e80a1090 0x7f62e80a3550 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f62ec005ab0 tx=0x7f62ec005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:02.545 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.544+0000 7f6301600640 1 -- 172.21.15.86:0/1095309059 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f62f4096600 con 0x7f6304101f80 2024-09-13T16:10:02.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.715+0000 7f630b200640 1 -- 172.21.15.86:0/1095309059 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f62e0005ab0 con 0x7f6304101f80 2024-09-13T16:10:02.717 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.716+0000 7f6301600640 1 -- 172.21.15.86:0/1095309059 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f62f4099c20 con 0x7f6304101f80 2024-09-13T16:10:02.718 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2024-09-13T16:10:02.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.718+0000 7f630b200640 1 -- 172.21.15.86:0/1095309059 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f62e80a1090 msgr2=0x7f62e80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:02.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.718+0000 7f630b200640 1 --2- 172.21.15.86:0/1095309059 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f62e80a1090 0x7f62e80a3550 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f62ec005ab0 tx=0x7f62ec005a20 comp rx=0 tx=0).stop 2024-09-13T16:10:02.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.718+0000 7f630b200640 1 -- 172.21.15.86:0/1095309059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6304101f80 msgr2=0x7f63041980c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:02.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.718+0000 7f630b200640 1 --2- 172.21.15.86:0/1095309059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6304101f80 0x7f63041980c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f62f400e9c0 tx=0x7f62f400ee80 comp rx=0 tx=0).stop 2024-09-13T16:10:02.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.718+0000 7f630b200640 1 -- 172.21.15.86:0/1095309059 shutdown_connections 2024-09-13T16:10:02.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.718+0000 7f630b200640 1 --2- 172.21.15.86:0/1095309059 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f62e80a1090 0x7f62e80a3550 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.718+0000 7f630b200640 1 --2- 172.21.15.86:0/1095309059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6304103b30 0x7f630419f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.718+0000 7f630b200640 1 --2- 172.21.15.86:0/1095309059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6304103170 0x7f6304198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.718+0000 7f630b200640 1 --2- 172.21.15.86:0/1095309059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6304101f80 0x7f63041980c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.718+0000 7f630b200640 1 -- 172.21.15.86:0/1095309059 >> 172.21.15.86:0/1095309059 conn(0x7f63040fd700 msgr2=0x7f6304106540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:02.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.718+0000 7f630b200640 1 -- 172.21.15.86:0/1095309059 shutdown_connections 2024-09-13T16:10:02.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.718+0000 7f630b200640 1 -- 172.21.15.86:0/1095309059 wait complete. 2024-09-13T16:10:02.735 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T16:10:02.893 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.891+0000 7ff2b8200640 1 -- 172.21.15.86:0/3301732559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2b0103b30 msgr2=0x7ff2b010a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:02.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.891+0000 7ff2b8200640 1 --2- 172.21.15.86:0/3301732559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2b0103b30 0x7ff2b010a3c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8009ca0 tx=0x7ff2a802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.891+0000 7ff2b8200640 1 -- 172.21.15.86:0/3301732559 shutdown_connections 2024-09-13T16:10:02.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.891+0000 7ff2b8200640 1 --2- 172.21.15.86:0/3301732559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2b0103b30 0x7ff2b010a3c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.891+0000 7ff2b8200640 1 --2- 172.21.15.86:0/3301732559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2b0103170 0x7ff2b01035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.891+0000 7ff2b8200640 1 --2- 172.21.15.86:0/3301732559 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2b0101f80 0x7ff2b0102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.891+0000 7ff2b8200640 1 -- 172.21.15.86:0/3301732559 >> 172.21.15.86:0/3301732559 conn(0x7ff2b00fd700 msgr2=0x7ff2b00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:02.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.892+0000 7ff2b8200640 1 -- 172.21.15.86:0/3301732559 shutdown_connections 2024-09-13T16:10:02.894 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.892+0000 7ff2b8200640 1 -- 172.21.15.86:0/3301732559 wait complete. 2024-09-13T16:10:02.896 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.892+0000 7ff2b8200640 1 Processor -- start 2024-09-13T16:10:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.893+0000 7ff2b8200640 1 -- start start 2024-09-13T16:10:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.893+0000 7ff2b8200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2b0101f80 0x7ff2b0198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.893+0000 7ff2b8200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2b0103170 0x7ff2b0198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.893+0000 7ff2b8200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2b0103b30 0x7ff2b019f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.893+0000 7ff2b8200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b019fac0 con 0x7ff2b0103b30 2024-09-13T16:10:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.893+0000 7ff2b8200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b019fc30 con 0x7ff2b0101f80 2024-09-13T16:10:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.893+0000 7ff2b8200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b019fdf0 con 0x7ff2b0103170 2024-09-13T16:10:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.893+0000 7ff2b6200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2b0103b30 0x7ff2b019f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.893+0000 7ff2b6200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2b0103b30 0x7ff2b019f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36926/0 (socket says 172.21.15.86:36926) 2024-09-13T16:10:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.893+0000 7ff2b6200640 1 -- 172.21.15.86:0/1868534369 learned_addr learned my addr 172.21.15.86:0/1868534369 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.893+0000 7ff2b4e00640 1 --2- 172.21.15.86:0/1868534369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2b0103170 0x7ff2b0198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.893+0000 7ff2b5800640 1 --2- 172.21.15.86:0/1868534369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2b0101f80 0x7ff2b0198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:02.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.893+0000 7ff2b6200640 1 -- 172.21.15.86:0/1868534369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2b0103170 msgr2=0x7ff2b0198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:02.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.893+0000 7ff2b6200640 1 --2- 172.21.15.86:0/1868534369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2b0103170 0x7ff2b0198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.893+0000 7ff2b6200640 1 -- 172.21.15.86:0/1868534369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2b0101f80 msgr2=0x7ff2b0198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:02.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.893+0000 7ff2b6200640 1 --2- 172.21.15.86:0/1868534369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2b0101f80 0x7ff2b0198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:02.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.893+0000 7ff2b6200640 1 -- 172.21.15.86:0/1868534369 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a8009900 con 0x7ff2b0103b30 2024-09-13T16:10:02.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.894+0000 7ff2b6200640 1 --2- 172.21.15.86:0/1868534369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2b0103b30 0x7ff2b019f580 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff2a802aeb0 tx=0x7ff2a8003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:02.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.894+0000 7ff2ae000640 1 -- 172.21.15.86:0/1868534369 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8031450 con 0x7ff2b0103b30 2024-09-13T16:10:02.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.894+0000 7ff2ae000640 1 -- 172.21.15.86:0/1868534369 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff2a8040070 con 0x7ff2b0103b30 2024-09-13T16:10:02.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.894+0000 7ff2ae000640 1 -- 172.21.15.86:0/1868534369 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8030820 con 0x7ff2b0103b30 2024-09-13T16:10:02.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.894+0000 7ff2b8200640 1 -- 172.21.15.86:0/1868534369 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b01a0070 con 0x7ff2b0103b30 2024-09-13T16:10:02.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.894+0000 7ff2b8200640 1 -- 172.21.15.86:0/1868534369 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b01a0530 con 0x7ff2b0103b30 2024-09-13T16:10:02.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.895+0000 7ff2b8200640 1 -- 172.21.15.86:0/1868534369 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b0109340 con 0x7ff2b0103b30 2024-09-13T16:10:02.899 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.897+0000 7ff2ae000640 1 -- 172.21.15.86:0/1868534369 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff2a8042030 con 0x7ff2b0103b30 2024-09-13T16:10:02.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.898+0000 7ff2ae000640 1 --2- 172.21.15.86:0/1868534369 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff2980a1090 0x7ff2980a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:02.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.898+0000 7ff2ae000640 1 -- 172.21.15.86:0/1868534369 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7ff2a80ee250 con 0x7ff2b0103b30 2024-09-13T16:10:02.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.898+0000 7ff2b5800640 1 --2- 172.21.15.86:0/1868534369 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff2980a1090 0x7ff2980a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:02.900 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.899+0000 7ff2b5800640 1 --2- 172.21.15.86:0/1868534369 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff2980a1090 0x7ff2980a3550 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0102fd0 tx=0x7ff2a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:02.903 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:02.902+0000 7ff2ae000640 1 -- 172.21.15.86:0/1868534369 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff2a80b75c0 con 0x7ff2b0103b30 2024-09-13T16:10:02.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:02 smithi139 ceph-mon[35320]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-13T16:10:02.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:02 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/941570096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:10:02.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:02 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1348103325' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:10:03.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:02 smithi194 ceph-mon[35694]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-13T16:10:03.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:02 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/941570096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:10:03.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:02 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1348103325' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:10:03.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.084+0000 7ff2b8200640 1 -- 172.21.15.86:0/1868534369 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff2b002c3e0 con 0x7ff2b0103b30 2024-09-13T16:10:03.086 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.085+0000 7ff2ae000640 1 -- 172.21.15.86:0/1868534369 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff2a80babe0 con 0x7ff2b0103b30 2024-09-13T16:10:03.087 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-09-13T16:10:03.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.087+0000 7ff2b8200640 1 -- 172.21.15.86:0/1868534369 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff2980a1090 msgr2=0x7ff2980a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:03.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.087+0000 7ff2b8200640 1 --2- 172.21.15.86:0/1868534369 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff2980a1090 0x7ff2980a3550 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0102fd0 tx=0x7ff2a4005f90 comp rx=0 tx=0).stop 2024-09-13T16:10:03.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.087+0000 7ff2b8200640 1 -- 172.21.15.86:0/1868534369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2b0103b30 msgr2=0x7ff2b019f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:03.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.087+0000 7ff2b8200640 1 --2- 172.21.15.86:0/1868534369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2b0103b30 0x7ff2b019f580 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff2a802aeb0 tx=0x7ff2a8003c00 comp rx=0 tx=0).stop 2024-09-13T16:10:03.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.087+0000 7ff2b8200640 1 -- 172.21.15.86:0/1868534369 shutdown_connections 2024-09-13T16:10:03.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.087+0000 7ff2b8200640 1 --2- 172.21.15.86:0/1868534369 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7ff2980a1090 0x7ff2980a3550 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.087+0000 7ff2b8200640 1 --2- 172.21.15.86:0/1868534369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2b0103b30 0x7ff2b019f580 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.087+0000 7ff2b8200640 1 --2- 172.21.15.86:0/1868534369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2b0103170 0x7ff2b0198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.087+0000 7ff2b8200640 1 --2- 172.21.15.86:0/1868534369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2b0101f80 0x7ff2b0198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.087+0000 7ff2b8200640 1 -- 172.21.15.86:0/1868534369 >> 172.21.15.86:0/1868534369 conn(0x7ff2b00fd700 msgr2=0x7ff2b0106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:03.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.087+0000 7ff2b8200640 1 -- 172.21.15.86:0/1868534369 shutdown_connections 2024-09-13T16:10:03.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.087+0000 7ff2b8200640 1 -- 172.21.15.86:0/1868534369 wait complete. 2024-09-13T16:10:03.102 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:02 smithi086 ceph-mon[30379]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-13T16:10:03.102 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:02 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/941570096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:10:03.102 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:02 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1348103325' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:10:03.104 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:10:03.258 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.256+0000 7f7d51200640 1 -- 172.21.15.86:0/2736330565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c102fb0 msgr2=0x7f7d4c103430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:03.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.256+0000 7f7d51200640 1 --2- 172.21.15.86:0/2736330565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c102fb0 0x7f7d4c103430 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009900 tx=0x7f7d3402a410 comp rx=0 tx=0).stop 2024-09-13T16:10:03.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.257+0000 7f7d51200640 1 -- 172.21.15.86:0/2736330565 shutdown_connections 2024-09-13T16:10:03.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.257+0000 7f7d51200640 1 --2- 172.21.15.86:0/2736330565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d4c103970 0x7f7d4c10a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.257+0000 7f7d51200640 1 --2- 172.21.15.86:0/2736330565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c102fb0 0x7f7d4c103430 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.257+0000 7f7d51200640 1 --2- 172.21.15.86:0/2736330565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d4c101dc0 0x7f7d4c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.257+0000 7f7d51200640 1 -- 172.21.15.86:0/2736330565 >> 172.21.15.86:0/2736330565 conn(0x7f7d4c0fd540 msgr2=0x7f7d4c0ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:03.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.257+0000 7f7d51200640 1 -- 172.21.15.86:0/2736330565 shutdown_connections 2024-09-13T16:10:03.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.257+0000 7f7d51200640 1 -- 172.21.15.86:0/2736330565 wait complete. 2024-09-13T16:10:03.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.258+0000 7f7d51200640 1 Processor -- start 2024-09-13T16:10:03.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.258+0000 7f7d51200640 1 -- start start 2024-09-13T16:10:03.261 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.258+0000 7f7d51200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d4c101dc0 0x7f7d4c197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:03.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.258+0000 7f7d51200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c102fb0 0x7f7d4c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:03.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.258+0000 7f7d51200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d4c103970 0x7f7d4c19f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:03.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.258+0000 7f7d51200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c19f990 con 0x7f7d4c102fb0 2024-09-13T16:10:03.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.258+0000 7f7d51200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c19fb00 con 0x7f7d4c103970 2024-09-13T16:10:03.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.258+0000 7f7d51200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c19fcc0 con 0x7f7d4c101dc0 2024-09-13T16:10:03.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.258+0000 7f7d43e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c102fb0 0x7f7d4c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:03.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.258+0000 7f7d43e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c102fb0 0x7f7d4c1983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36934/0 (socket says 172.21.15.86:36934) 2024-09-13T16:10:03.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.258+0000 7f7d43e00640 1 -- 172.21.15.86:0/4004761690 learned_addr learned my addr 172.21.15.86:0/4004761690 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:03.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.258+0000 7f7d4be00640 1 --2- 172.21.15.86:0/4004761690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d4c103970 0x7f7d4c19f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:03.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.258+0000 7f7d4b400640 1 --2- 172.21.15.86:0/4004761690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d4c101dc0 0x7f7d4c197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:03.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.259+0000 7f7d43e00640 1 -- 172.21.15.86:0/4004761690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d4c101dc0 msgr2=0x7f7d4c197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:03.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.259+0000 7f7d43e00640 1 --2- 172.21.15.86:0/4004761690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d4c101dc0 0x7f7d4c197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.259+0000 7f7d43e00640 1 -- 172.21.15.86:0/4004761690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d4c103970 msgr2=0x7f7d4c19f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:03.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.259+0000 7f7d43e00640 1 --2- 172.21.15.86:0/4004761690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d4c103970 0x7f7d4c19f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.259+0000 7f7d43e00640 1 -- 172.21.15.86:0/4004761690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d44009840 con 0x7f7d4c102fb0 2024-09-13T16:10:03.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.259+0000 7f7d43e00640 1 --2- 172.21.15.86:0/4004761690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c102fb0 0x7f7d4c1983e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7d34031510 tx=0x7f7d34004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:03.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.259+0000 7f7d48c00640 1 -- 172.21.15.86:0/4004761690 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34005210 con 0x7f7d4c102fb0 2024-09-13T16:10:03.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.259+0000 7f7d48c00640 1 -- 172.21.15.86:0/4004761690 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7d34004ba0 con 0x7f7d4c102fb0 2024-09-13T16:10:03.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.259+0000 7f7d51200640 1 -- 172.21.15.86:0/4004761690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d34009560 con 0x7f7d4c102fb0 2024-09-13T16:10:03.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.259+0000 7f7d48c00640 1 -- 172.21.15.86:0/4004761690 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34003ab0 con 0x7f7d4c102fb0 2024-09-13T16:10:03.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.259+0000 7f7d51200640 1 -- 172.21.15.86:0/4004761690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c1a0250 con 0x7f7d4c102fb0 2024-09-13T16:10:03.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.260+0000 7f7d51200640 1 -- 172.21.15.86:0/4004761690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c1092a0 con 0x7f7d4c102fb0 2024-09-13T16:10:03.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.262+0000 7f7d48c00640 1 -- 172.21.15.86:0/4004761690 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7d34004d10 con 0x7f7d4c102fb0 2024-09-13T16:10:03.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.263+0000 7f7d48c00640 1 --2- 172.21.15.86:0/4004761690 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7d300a1190 0x7f7d300a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:03.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.263+0000 7f7d48c00640 1 -- 172.21.15.86:0/4004761690 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f7d340ed8b0 con 0x7f7d4c102fb0 2024-09-13T16:10:03.265 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.263+0000 7f7d4b400640 1 --2- 172.21.15.86:0/4004761690 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7d300a1190 0x7f7d300a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:03.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.264+0000 7f7d4b400640 1 --2- 172.21.15.86:0/4004761690 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7d300a1190 0x7f7d300a3650 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c005fd0 tx=0x7f7d3c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:03.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.267+0000 7f7d48c00640 1 -- 172.21.15.86:0/4004761690 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7d340b6c20 con 0x7f7d4c102fb0 2024-09-13T16:10:03.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.470+0000 7f7d51200640 1 -- 172.21.15.86:0/4004761690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d4c10d800 con 0x7f7d4c102fb0 2024-09-13T16:10:03.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.471+0000 7f7d48c00640 1 -- 172.21.15.86:0/4004761690 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f7d340ba240 con 0x7f7d4c102fb0 2024-09-13T16:10:03.473 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:10:03.473 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14508,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1509120923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1509120923},{"type":"v1","addr":"172.21.15.86:6839","nonce":1509120923}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6841/1971775519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":1971775519},{"type":"v1","addr":"172.21.15.86:6841","nonce":1971775519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T16:08:09.202262+0000","modified":"2024-09-13T16:08:32.444959+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24544,"mds_2":24530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/1370900762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1370900762},{"type":"v1","addr":"172.21.15.194:6835","nonce":1370900762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/2460451799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":2460451799},{"type":"v1","addr":"172.21.15.194:6837","nonce":2460451799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24530":{"gid":24530,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.139:6837/2399531832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2399531832},{"type":"v1","addr":"172.21.15.139:6837","nonce":2399531832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6839/3799859182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3799859182},{"type":"v1","addr":"172.21.15.194:6839","nonce":3799859182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.139:6839/3370280063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3370280063},{"type":"v1","addr":"172.21.15.139:6839","nonce":3370280063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:10:03.474 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 24 2024-09-13T16:10:03.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.473+0000 7f7d51200640 1 -- 172.21.15.86:0/4004761690 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7d300a1190 msgr2=0x7f7d300a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:03.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.473+0000 7f7d51200640 1 --2- 172.21.15.86:0/4004761690 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7d300a1190 0x7f7d300a3650 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c005fd0 tx=0x7f7d3c00b410 comp rx=0 tx=0).stop 2024-09-13T16:10:03.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.473+0000 7f7d51200640 1 -- 172.21.15.86:0/4004761690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c102fb0 msgr2=0x7f7d4c1983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:03.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.473+0000 7f7d51200640 1 --2- 172.21.15.86:0/4004761690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c102fb0 0x7f7d4c1983e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7d34031510 tx=0x7f7d34004360 comp rx=0 tx=0).stop 2024-09-13T16:10:03.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.473+0000 7f7d51200640 1 -- 172.21.15.86:0/4004761690 shutdown_connections 2024-09-13T16:10:03.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.473+0000 7f7d51200640 1 --2- 172.21.15.86:0/4004761690 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7d300a1190 0x7f7d300a3650 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.473+0000 7f7d51200640 1 --2- 172.21.15.86:0/4004761690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d4c103970 0x7f7d4c19f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.473+0000 7f7d51200640 1 --2- 172.21.15.86:0/4004761690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c102fb0 0x7f7d4c1983e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.473+0000 7f7d51200640 1 --2- 172.21.15.86:0/4004761690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d4c101dc0 0x7f7d4c197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.473+0000 7f7d51200640 1 -- 172.21.15.86:0/4004761690 >> 172.21.15.86:0/4004761690 conn(0x7f7d4c0fd540 msgr2=0x7f7d4c106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:03.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.473+0000 7f7d51200640 1 -- 172.21.15.86:0/4004761690 shutdown_connections 2024-09-13T16:10:03.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.473+0000 7f7d51200640 1 -- 172.21.15.86:0/4004761690 wait complete. 2024-09-13T16:10:03.491 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:10:03.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.643+0000 7f95bb000640 1 -- 172.21.15.86:0/1014415234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95b40ffd80 msgr2=0x7f95b4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:03.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.643+0000 7f95bb000640 1 --2- 172.21.15.86:0/1014415234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95b40ffd80 0x7f95b4100180 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009900 tx=0x7f95a402a410 comp rx=0 tx=0).stop 2024-09-13T16:10:03.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.643+0000 7f95bb000640 1 -- 172.21.15.86:0/1014415234 shutdown_connections 2024-09-13T16:10:03.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.643+0000 7f95bb000640 1 --2- 172.21.15.86:0/1014415234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95b4101930 0x7f95b41081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.643+0000 7f95bb000640 1 --2- 172.21.15.86:0/1014415234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95b4100f70 0x7f95b41013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.643+0000 7f95bb000640 1 --2- 172.21.15.86:0/1014415234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95b40ffd80 0x7f95b4100180 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.643+0000 7f95bb000640 1 -- 172.21.15.86:0/1014415234 >> 172.21.15.86:0/1014415234 conn(0x7f95b40fb500 msgr2=0x7f95b40fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:03.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.643+0000 7f95bb000640 1 -- 172.21.15.86:0/1014415234 shutdown_connections 2024-09-13T16:10:03.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.643+0000 7f95bb000640 1 -- 172.21.15.86:0/1014415234 wait complete. 2024-09-13T16:10:03.649 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.644+0000 7f95bb000640 1 Processor -- start 2024-09-13T16:10:03.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.644+0000 7f95bb000640 1 -- start start 2024-09-13T16:10:03.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.645+0000 7f95bb000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95b40ffd80 0x7f95b4198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:03.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.645+0000 7f95bb000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95b4100f70 0x7f95b41985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:03.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.645+0000 7f95bb000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95b4101930 0x7f95b419f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:03.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.645+0000 7f95bb000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b419fb50 con 0x7f95b4100f70 2024-09-13T16:10:03.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.645+0000 7f95bb000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b419fcc0 con 0x7f95b4101930 2024-09-13T16:10:03.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.645+0000 7f95bb000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b419fe80 con 0x7f95b40ffd80 2024-09-13T16:10:03.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.645+0000 7f95ab400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95b4100f70 0x7f95b41985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:03.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.645+0000 7f95ab400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95b4100f70 0x7f95b41985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36946/0 (socket says 172.21.15.86:36946) 2024-09-13T16:10:03.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.645+0000 7f95ab400640 1 -- 172.21.15.86:0/317066329 learned_addr learned my addr 172.21.15.86:0/317066329 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:03.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.645+0000 7f95b3e00640 1 --2- 172.21.15.86:0/317066329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95b40ffd80 0x7f95b4198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:03.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.645+0000 7f95b9000640 1 --2- 172.21.15.86:0/317066329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95b4101930 0x7f95b419f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:03.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.645+0000 7f95ab400640 1 -- 172.21.15.86:0/317066329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95b40ffd80 msgr2=0x7f95b4198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:03.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.645+0000 7f95ab400640 1 --2- 172.21.15.86:0/317066329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95b40ffd80 0x7f95b4198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.645+0000 7f95ab400640 1 -- 172.21.15.86:0/317066329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95b4101930 msgr2=0x7f95b419f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:03.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.645+0000 7f95ab400640 1 --2- 172.21.15.86:0/317066329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95b4101930 0x7f95b419f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.645+0000 7f95ab400640 1 -- 172.21.15.86:0/317066329 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a4009560 con 0x7f95b4100f70 2024-09-13T16:10:03.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.645+0000 7f95b9000640 1 --2- 172.21.15.86:0/317066329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95b4101930 0x7f95b419f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:10:03.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.646+0000 7f95ab400640 1 --2- 172.21.15.86:0/317066329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95b4100f70 0x7f95b41985a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f959c00d950 tx=0x7f959c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:03.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.646+0000 7f95b1600640 1 -- 172.21.15.86:0/317066329 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c009c30 con 0x7f95b4100f70 2024-09-13T16:10:03.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.646+0000 7f95b1600640 1 -- 172.21.15.86:0/317066329 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f959c009d90 con 0x7f95b4100f70 2024-09-13T16:10:03.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.646+0000 7f95b1600640 1 -- 172.21.15.86:0/317066329 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c00f7e0 con 0x7f95b4100f70 2024-09-13T16:10:03.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.646+0000 7f95bb000640 1 -- 172.21.15.86:0/317066329 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b41a0160 con 0x7f95b4100f70 2024-09-13T16:10:03.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.646+0000 7f95bb000640 1 -- 172.21.15.86:0/317066329 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b41a0620 con 0x7f95b4100f70 2024-09-13T16:10:03.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.647+0000 7f95bb000640 1 -- 172.21.15.86:0/317066329 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b410b810 con 0x7f95b4100f70 2024-09-13T16:10:03.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.649+0000 7f95b1600640 1 -- 172.21.15.86:0/317066329 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f959c010ad0 con 0x7f95b4100f70 2024-09-13T16:10:03.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.650+0000 7f95b1600640 1 --2- 172.21.15.86:0/317066329 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f95980a1110 0x7f95980a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:03.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.650+0000 7f95b1600640 1 -- 172.21.15.86:0/317066329 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f959c0cca30 con 0x7f95b4100f70 2024-09-13T16:10:03.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.650+0000 7f95b3e00640 1 --2- 172.21.15.86:0/317066329 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f95980a1110 0x7f95980a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:03.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.651+0000 7f95b3e00640 1 --2- 172.21.15.86:0/317066329 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f95980a1110 0x7f95980a35d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009230 tx=0x7f95a40314d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:03.655 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.654+0000 7f95b1600640 1 -- 172.21.15.86:0/317066329 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f959c095da0 con 0x7f95b4100f70 2024-09-13T16:10:03.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.831+0000 7f95bb000640 1 -- 172.21.15.86:0/317066329 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95b410b9f0 con 0x7f95b4100f70 2024-09-13T16:10:03.834 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.832+0000 7f95b1600640 1 -- 172.21.15.86:0/317066329 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24703 (secure 0 0 0) 0x7f959c0993c0 con 0x7f95b4100f70 2024-09-13T16:10:03.834 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:10:03.835 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":94,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:10:00.680229+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":7}]},{"pgid":"3.19","mappings":[{"from":3,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2f","mappings":[{"from":1,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:10:03.836 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.834+0000 7f95bb000640 1 -- 172.21.15.86:0/317066329 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f95980a1110 msgr2=0x7f95980a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:03.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.835+0000 7f95bb000640 1 --2- 172.21.15.86:0/317066329 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f95980a1110 0x7f95980a35d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009230 tx=0x7f95a40314d0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.835+0000 7f95bb000640 1 -- 172.21.15.86:0/317066329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95b4100f70 msgr2=0x7f95b41985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:03.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.835+0000 7f95bb000640 1 --2- 172.21.15.86:0/317066329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95b4100f70 0x7f95b41985a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f959c00d950 tx=0x7f959c00de10 comp rx=0 tx=0).stop 2024-09-13T16:10:03.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.835+0000 7f95bb000640 1 -- 172.21.15.86:0/317066329 shutdown_connections 2024-09-13T16:10:03.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.835+0000 7f95bb000640 1 --2- 172.21.15.86:0/317066329 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f95980a1110 0x7f95980a35d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.835+0000 7f95bb000640 1 --2- 172.21.15.86:0/317066329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95b4101930 0x7f95b419f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.835+0000 7f95bb000640 1 --2- 172.21.15.86:0/317066329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95b4100f70 0x7f95b41985a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.835+0000 7f95bb000640 1 --2- 172.21.15.86:0/317066329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95b40ffd80 0x7f95b4198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:03.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.835+0000 7f95bb000640 1 -- 172.21.15.86:0/317066329 >> 172.21.15.86:0/317066329 conn(0x7f95b40fb500 msgr2=0x7f95b4106790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:03.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.835+0000 7f95bb000640 1 -- 172.21.15.86:0/317066329 shutdown_connections 2024-09-13T16:10:03.837 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:03.835+0000 7f95bb000640 1 -- 172.21.15.86:0/317066329 wait complete. 2024-09-13T16:10:03.851 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:03 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1095309059' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:10:03.851 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:03 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1868534369' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:10:03.851 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:03 smithi086 ceph-mon[30379]: pgmap v356: 129 pgs: 1 peering, 128 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-13T16:10:03.851 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:03 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/4004761690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:10:03.853 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:10:03.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:03 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1095309059' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:10:03.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:03 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1868534369' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:10:03.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:03 smithi139 ceph-mon[35320]: pgmap v356: 129 pgs: 1 peering, 128 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-13T16:10:03.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:03 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/4004761690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:10:04.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:03 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1095309059' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:10:04.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:03 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1868534369' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:10:04.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:03 smithi194 ceph-mon[35694]: pgmap v356: 129 pgs: 1 peering, 128 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-13T16:10:04.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:03 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/4004761690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:10:04.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.005+0000 7fbde4c00640 1 -- 172.21.15.86:0/3416819139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbde0100db0 msgr2=0x7fbde0101230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.005+0000 7fbde4c00640 1 --2- 172.21.15.86:0/3416819139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbde0100db0 0x7fbde0101230 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009900 tx=0x7fbdc802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.005+0000 7fbde4c00640 1 -- 172.21.15.86:0/3416819139 shutdown_connections 2024-09-13T16:10:04.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.005+0000 7fbde4c00640 1 --2- 172.21.15.86:0/3416819139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbde0101770 0x7fbde0108000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.005+0000 7fbde4c00640 1 --2- 172.21.15.86:0/3416819139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbde0100db0 0x7fbde0101230 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.005+0000 7fbde4c00640 1 --2- 172.21.15.86:0/3416819139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbde00ffbc0 0x7fbde00fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.005+0000 7fbde4c00640 1 -- 172.21.15.86:0/3416819139 >> 172.21.15.86:0/3416819139 conn(0x7fbde00fb360 msgr2=0x7fbde00fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.005+0000 7fbde4c00640 1 -- 172.21.15.86:0/3416819139 shutdown_connections 2024-09-13T16:10:04.007 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.005+0000 7fbde4c00640 1 -- 172.21.15.86:0/3416819139 wait complete. 2024-09-13T16:10:04.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.006+0000 7fbde4c00640 1 Processor -- start 2024-09-13T16:10:04.009 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.006+0000 7fbde4c00640 1 -- start start 2024-09-13T16:10:04.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.006+0000 7fbde4c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbde00ffbc0 0x7fbde0074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.006+0000 7fbde4c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbde0100db0 0x7fbde00728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.006+0000 7fbde4c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbde0101770 0x7fbde0072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.006+0000 7fbde4c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde0073540 con 0x7fbde0100db0 2024-09-13T16:10:04.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.006+0000 7fbde4c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde00736b0 con 0x7fbde00ffbc0 2024-09-13T16:10:04.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.006+0000 7fbde4c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde019fc80 con 0x7fbde0101770 2024-09-13T16:10:04.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.007+0000 7fbdd7e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbde0100db0 0x7fbde00728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.007+0000 7fbdd7e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbde0100db0 0x7fbde00728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36962/0 (socket says 172.21.15.86:36962) 2024-09-13T16:10:04.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.007+0000 7fbdd7e00640 1 -- 172.21.15.86:0/2398768806 learned_addr learned my addr 172.21.15.86:0/2398768806 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:04.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.007+0000 7fbddf400640 1 --2- 172.21.15.86:0/2398768806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbde00ffbc0 0x7fbde0074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.007+0000 7fbddfe00640 1 --2- 172.21.15.86:0/2398768806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbde0101770 0x7fbde0072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.010 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.007+0000 7fbdd7e00640 1 -- 172.21.15.86:0/2398768806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbde0101770 msgr2=0x7fbde0072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.007+0000 7fbdd7e00640 1 --2- 172.21.15.86:0/2398768806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbde0101770 0x7fbde0072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.007+0000 7fbdd7e00640 1 -- 172.21.15.86:0/2398768806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbde00ffbc0 msgr2=0x7fbde0074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.007+0000 7fbdd7e00640 1 --2- 172.21.15.86:0/2398768806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbde00ffbc0 0x7fbde0074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.007+0000 7fbdd7e00640 1 -- 172.21.15.86:0/2398768806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc8009560 con 0x7fbde0100db0 2024-09-13T16:10:04.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.007+0000 7fbdd7e00640 1 --2- 172.21.15.86:0/2398768806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbde0100db0 0x7fbde00728a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbdc802a9e0 tx=0x7fbdc8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.008+0000 7fbddcc00640 1 -- 172.21.15.86:0/2398768806 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8005000 con 0x7fbde0100db0 2024-09-13T16:10:04.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.008+0000 7fbddcc00640 1 -- 172.21.15.86:0/2398768806 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbdc80046c0 con 0x7fbde0100db0 2024-09-13T16:10:04.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.008+0000 7fbddcc00640 1 -- 172.21.15.86:0/2398768806 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc80039c0 con 0x7fbde0100db0 2024-09-13T16:10:04.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.008+0000 7fbde4c00640 1 -- 172.21.15.86:0/2398768806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde019fed0 con 0x7fbde0100db0 2024-09-13T16:10:04.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.008+0000 7fbde4c00640 1 -- 172.21.15.86:0/2398768806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde01a02f0 con 0x7fbde0100db0 2024-09-13T16:10:04.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.009+0000 7fbde4c00640 1 -- 172.21.15.86:0/2398768806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde0107000 con 0x7fbde0100db0 2024-09-13T16:10:04.012 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.011+0000 7fbddcc00640 1 -- 172.21.15.86:0/2398768806 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbdc8003d30 con 0x7fbde0100db0 2024-09-13T16:10:04.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.012+0000 7fbddcc00640 1 --2- 172.21.15.86:0/2398768806 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbdc40a1110 0x7fbdc40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.013+0000 7fbddcc00640 1 -- 172.21.15.86:0/2398768806 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fbdc80edad0 con 0x7fbde0100db0 2024-09-13T16:10:04.014 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.013+0000 7fbddf400640 1 --2- 172.21.15.86:0/2398768806 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbdc40a1110 0x7fbdc40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.013+0000 7fbddf400640 1 --2- 172.21.15.86:0/2398768806 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbdc40a1110 0x7fbdc40a35d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbde0100c10 tx=0x7fbdd0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.018 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.016+0000 7fbddcc00640 1 -- 172.21.15.86:0/2398768806 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbdc80b6ef0 con 0x7fbde0100db0 2024-09-13T16:10:04.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.221+0000 7fbde4c00640 1 -- 172.21.15.86:0/2398768806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbde010b600 con 0x7fbde0100db0 2024-09-13T16:10:04.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.222+0000 7fbddcc00640 1 -- 172.21.15.86:0/2398768806 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10877 (secure 0 0 0) 0x7fbdc804a090 con 0x7fbde0100db0 2024-09-13T16:10:04.224 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:10:04.224 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14508,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1509120923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1509120923},{"type":"v1","addr":"172.21.15.86:6839","nonce":1509120923}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6841/1971775519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":1971775519},{"type":"v1","addr":"172.21.15.86:6841","nonce":1971775519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T16:08:09.202262+0000","modified":"2024-09-13T16:08:32.444959+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24544,"mds_2":24530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/1370900762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1370900762},{"type":"v1","addr":"172.21.15.194:6835","nonce":1370900762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/2460451799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":2460451799},{"type":"v1","addr":"172.21.15.194:6837","nonce":2460451799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24530":{"gid":24530,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.139:6837/2399531832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2399531832},{"type":"v1","addr":"172.21.15.139:6837","nonce":2399531832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6839/3799859182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3799859182},{"type":"v1","addr":"172.21.15.194:6839","nonce":3799859182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.139:6839/3370280063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3370280063},{"type":"v1","addr":"172.21.15.139:6839","nonce":3370280063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:10:04.224 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 24 2024-09-13T16:10:04.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.224+0000 7fbde4c00640 1 -- 172.21.15.86:0/2398768806 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbdc40a1110 msgr2=0x7fbdc40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.224+0000 7fbde4c00640 1 --2- 172.21.15.86:0/2398768806 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbdc40a1110 0x7fbdc40a35d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbde0100c10 tx=0x7fbdd0005f90 comp rx=0 tx=0).stop 2024-09-13T16:10:04.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.224+0000 7fbde4c00640 1 -- 172.21.15.86:0/2398768806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbde0100db0 msgr2=0x7fbde00728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.224+0000 7fbde4c00640 1 --2- 172.21.15.86:0/2398768806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbde0100db0 0x7fbde00728a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbdc802a9e0 tx=0x7fbdc8004270 comp rx=0 tx=0).stop 2024-09-13T16:10:04.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.224+0000 7fbde4c00640 1 -- 172.21.15.86:0/2398768806 shutdown_connections 2024-09-13T16:10:04.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.224+0000 7fbde4c00640 1 --2- 172.21.15.86:0/2398768806 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbdc40a1110 0x7fbdc40a35d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.224+0000 7fbde4c00640 1 --2- 172.21.15.86:0/2398768806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbde0101770 0x7fbde0072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.224+0000 7fbde4c00640 1 --2- 172.21.15.86:0/2398768806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbde0100db0 0x7fbde00728a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.224+0000 7fbde4c00640 1 --2- 172.21.15.86:0/2398768806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbde00ffbc0 0x7fbde0074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.226 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.224+0000 7fbde4c00640 1 -- 172.21.15.86:0/2398768806 >> 172.21.15.86:0/2398768806 conn(0x7fbde00fb360 msgr2=0x7fbde01041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.224+0000 7fbde4c00640 1 -- 172.21.15.86:0/2398768806 shutdown_connections 2024-09-13T16:10:04.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.224+0000 7fbde4c00640 1 -- 172.21.15.86:0/2398768806 wait complete. 2024-09-13T16:10:04.243 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-13T16:08:09.202262+0000', 'modified': '2024-09-13T16:08:32.444959+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24581, 'mds_1': 24544, 'mds_2': 24530}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24503': {'gid': 24503, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6835/1036892520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6834', 'nonce': 1036892520}, {'type': 'v1', 'addr': '172.21.15.139:6835', 'nonce': 1036892520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24511': {'gid': 24511, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6835/1370900762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6834', 'nonce': 1370900762}, {'type': 'v1', 'addr': '172.21.15.194:6835', 'nonce': 1370900762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24523': {'gid': 24523, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6837/2460451799', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6836', 'nonce': 2460451799}, {'type': 'v1', 'addr': '172.21.15.194:6837', 'nonce': 2460451799}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24530': {'gid': 24530, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.139:6837/2399531832', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6836', 'nonce': 2399531832}, {'type': 'v1', 'addr': '172.21.15.139:6837', 'nonce': 2399531832}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24544': {'gid': 24544, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.194:6839/3799859182', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6838', 'nonce': 3799859182}, {'type': 'v1', 'addr': '172.21.15.194:6839', 'nonce': 3799859182}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24581': {'gid': 24581, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.139:6839/3370280063', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6838', 'nonce': 3370280063}, {'type': 'v1', 'addr': '172.21.15.139:6839', 'nonce': 3370280063}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T16:10:04.243 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-13T16:10:04.243 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-09-13T16:10:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.396+0000 7f71bbe00640 1 -- 172.21.15.86:0/1085676609 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71b4103130 msgr2=0x7f71b4105520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.396+0000 7f71bbe00640 1 --2- 172.21.15.86:0/1085676609 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71b4103130 0x7f71b4105520 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009860 tx=0x7f71a002a340 comp rx=0 tx=0).stop 2024-09-13T16:10:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.396+0000 7f71bbe00640 1 -- 172.21.15.86:0/1085676609 shutdown_connections 2024-09-13T16:10:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.396+0000 7f71bbe00640 1 --2- 172.21.15.86:0/1085676609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71b4105a60 0x7f71b4107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.396+0000 7f71bbe00640 1 --2- 172.21.15.86:0/1085676609 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71b4103130 0x7f71b4105520 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.396+0000 7f71bbe00640 1 --2- 172.21.15.86:0/1085676609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71b4100800 0x7f71b4102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.396+0000 7f71bbe00640 1 -- 172.21.15.86:0/1085676609 >> 172.21.15.86:0/1085676609 conn(0x7f71b40fa3e0 msgr2=0x7f71b40fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.396+0000 7f71bbe00640 1 -- 172.21.15.86:0/1085676609 shutdown_connections 2024-09-13T16:10:04.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.396+0000 7f71bbe00640 1 -- 172.21.15.86:0/1085676609 wait complete. 2024-09-13T16:10:04.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.397+0000 7f71bbe00640 1 Processor -- start 2024-09-13T16:10:04.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.397+0000 7f71bbe00640 1 -- start start 2024-09-13T16:10:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.397+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71b4100800 0x7f71b4198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.397+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71b4103130 0x7f71b4198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.397+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71b4105a60 0x7f71b419f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.397+0000 7f71bbe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b419fc20 con 0x7f71b4103130 2024-09-13T16:10:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.397+0000 7f71bbe00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b419fd90 con 0x7f71b4105a60 2024-09-13T16:10:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.397+0000 7f71bbe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b419ff50 con 0x7f71b4100800 2024-09-13T16:10:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.398+0000 7f71b8a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71b4103130 0x7f71b4198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.398+0000 7f71b9400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71b4100800 0x7f71b4198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.398+0000 7f71b9400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71b4100800 0x7f71b4198130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:34422/0 (socket says 172.21.15.86:34422) 2024-09-13T16:10:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.398+0000 7f71b9400640 1 -- 172.21.15.86:0/354398166 learned_addr learned my addr 172.21.15.86:0/354398166 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.398+0000 7f71b9e00640 1 --2- 172.21.15.86:0/354398166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71b4105a60 0x7f71b419f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.398+0000 7f71b8a00640 1 -- 172.21.15.86:0/354398166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71b4100800 msgr2=0x7f71b4198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.398+0000 7f71b8a00640 1 --2- 172.21.15.86:0/354398166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71b4100800 0x7f71b4198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.398+0000 7f71b8a00640 1 -- 172.21.15.86:0/354398166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71b4105a60 msgr2=0x7f71b419f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.398+0000 7f71b8a00640 1 --2- 172.21.15.86:0/354398166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71b4105a60 0x7f71b419f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.398+0000 7f71b8a00640 1 -- 172.21.15.86:0/354398166 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a8009560 con 0x7f71b4103130 2024-09-13T16:10:04.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.398+0000 7f71b8a00640 1 --2- 172.21.15.86:0/354398166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71b4103130 0x7f71b4198670 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f71a002a860 tx=0x7f71a00326f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.399+0000 7f71b2000640 1 -- 172.21.15.86:0/354398166 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0032ea0 con 0x7f71b4103130 2024-09-13T16:10:04.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.399+0000 7f71b2000640 1 -- 172.21.15.86:0/354398166 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f71a0030340 con 0x7f71b4103130 2024-09-13T16:10:04.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.399+0000 7f71bbe00640 1 -- 172.21.15.86:0/354398166 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ac009840 con 0x7f71b4103130 2024-09-13T16:10:04.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.399+0000 7f71b2000640 1 -- 172.21.15.86:0/354398166 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0003e90 con 0x7f71b4103130 2024-09-13T16:10:04.402 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.399+0000 7f71bbe00640 1 -- 172.21.15.86:0/354398166 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a0009490 con 0x7f71b4103130 2024-09-13T16:10:04.404 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.402+0000 7f71bec3d740 1 Processor -- start 2024-09-13T16:10:04.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.402+0000 7f71b2000640 1 -- 172.21.15.86:0/354398166 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f71a0039040 con 0x7f71b4103130 2024-09-13T16:10:04.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.402+0000 7f71bec3d740 1 -- start start 2024-09-13T16:10:04.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.402+0000 7f71bec3d740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025bab30 0x55c6025baf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.402+0000 7f71bec3d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bb470 0x55c6025bff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.402+0000 7f71bec3d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025c0500 0x55c6025c29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.402+0000 7f71bec3d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c602524ab0 con 0x55c6025c0500 2024-09-13T16:10:04.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.402+0000 7f71bec3d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c602522240 con 0x55c6025bb470 2024-09-13T16:10:04.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.402+0000 7f71bec3d740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c60251db30 con 0x55c6025bab30 2024-09-13T16:10:04.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.403+0000 7f71b9400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bb470 0x55c6025bff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.403+0000 7f71b8a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025c0500 0x55c6025c29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.403+0000 7f71b9400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bb470 0x55c6025bff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:54294/0 (socket says 172.21.15.86:54294) 2024-09-13T16:10:04.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.403+0000 7f71b9400640 1 -- 172.21.15.86:0/3381442184 learned_addr learned my addr 172.21.15.86:0/3381442184 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:04.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.403+0000 7f71b9e00640 1 --2- 172.21.15.86:0/3381442184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025bab30 0x55c6025baf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.403+0000 7f71b9e00640 1 -- 172.21.15.86:0/3381442184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bb470 msgr2=0x55c6025bff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.403+0000 7f71b9e00640 1 --2- 172.21.15.86:0/3381442184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bb470 0x55c6025bff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.403+0000 7f71b9e00640 1 -- 172.21.15.86:0/3381442184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025c0500 msgr2=0x55c6025c29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.403+0000 7f71b9e00640 1 --2- 172.21.15.86:0/3381442184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025c0500 0x55c6025c29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.403+0000 7f71b9e00640 1 -- 172.21.15.86:0/3381442184 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6024e8bd0 con 0x55c6025bab30 2024-09-13T16:10:04.406 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.403+0000 7f71b9400640 1 --2- 172.21.15.86:0/3381442184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bb470 0x55c6025bff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:04.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.403+0000 7f71b9e00640 1 --2- 172.21.15.86:0/3381442184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025bab30 0x55c6025baf30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f71ac005fd0 tx=0x7f71ac0119d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78a7e4dacaa5fc50 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.404+0000 7f71b2000640 1 --2- 172.21.15.86:0/354398166 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f719c0a1090 0x7f719c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.404+0000 7f71a6a00640 1 -- 172.21.15.86:0/3381442184 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac004d20 con 0x55c6025bab30 2024-09-13T16:10:04.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.404+0000 7f71b2000640 1 -- 172.21.15.86:0/354398166 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f71a00ed360 con 0x7f71b4103130 2024-09-13T16:10:04.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.404+0000 7f71a6a00640 1 -- 172.21.15.86:0/3381442184 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f71ac004e80 con 0x55c6025bab30 2024-09-13T16:10:04.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.404+0000 7f71b9400640 1 --2- 172.21.15.86:0/354398166 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f719c0a1090 0x7f719c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.404+0000 7f71a6a00640 1 -- 172.21.15.86:0/3381442184 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00f7c0 con 0x55c6025bab30 2024-09-13T16:10:04.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.405+0000 7f71bec3d740 1 -- 172.21.15.86:0/3381442184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025bab30 msgr2=0x55c6025baf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.405+0000 7f71b9400640 1 --2- 172.21.15.86:0/354398166 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f719c0a1090 0x7f719c0a3550 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55c6025bbea0 tx=0x7f71a8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.405+0000 7f71bec3d740 1 --2- 172.21.15.86:0/3381442184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025bab30 0x55c6025baf30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f71ac005fd0 tx=0x7f71ac0119d0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.405+0000 7f71bec3d740 1 -- 172.21.15.86:0/3381442184 shutdown_connections 2024-09-13T16:10:04.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.405+0000 7f71bec3d740 1 --2- 172.21.15.86:0/3381442184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025c0500 0x55c6025c29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.405+0000 7f71bec3d740 1 --2- 172.21.15.86:0/3381442184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bb470 0x55c6025bff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.405+0000 7f71bec3d740 1 --2- 172.21.15.86:0/3381442184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025bab30 0x55c6025baf30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.405+0000 7f71bec3d740 1 -- 172.21.15.86:0/3381442184 >> 172.21.15.86:0/3381442184 conn(0x55c6025b61a0 msgr2=0x55c6025b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.405+0000 7f71bec3d740 1 -- 172.21.15.86:0/3381442184 shutdown_connections 2024-09-13T16:10:04.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.405+0000 7f71bec3d740 1 -- 172.21.15.86:0/3381442184 wait complete. 2024-09-13T16:10:04.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.405+0000 7f71bec3d740 1 -- start start 2024-09-13T16:10:04.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.405+0000 7f71bec3d740 1 Processor -- start 2024-09-13T16:10:04.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.406+0000 7f71bec3d740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025bab30 0x55c6025c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.406+0000 7f71bec3d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bb470 0x55c6025c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.406+0000 7f71bec3d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025c0500 0x55c6025cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.406+0000 7f71bec3d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6024bf260 con 0x55c6025c0500 2024-09-13T16:10:04.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.406+0000 7f71bec3d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6024bef00 con 0x55c6025bb470 2024-09-13T16:10:04.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.406+0000 7f71bec3d740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c602284f20 con 0x55c6025bab30 2024-09-13T16:10:04.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.406+0000 7f71bec3d740 10 client.0 _ll_register_callbacks cb 0x55c6025171a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:04.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.406+0000 7f71b9e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025c0500 0x55c6025cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.406+0000 7f71b9400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025bab30 0x55c6025c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.406+0000 7f71b9e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025c0500 0x55c6025cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36998/0 (socket says 172.21.15.86:36998) 2024-09-13T16:10:04.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.406+0000 7f71b9e00640 1 -- 172.21.15.86:0/3557564222 learned_addr learned my addr 172.21.15.86:0/3557564222 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:04.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.406+0000 7f71b8a00640 1 --2- 172.21.15.86:0/3557564222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bb470 0x55c6025c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.406+0000 7f71b9400640 1 -- 172.21.15.86:0/3557564222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bb470 msgr2=0x55c6025c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.406+0000 7f71b9400640 1 --2- 172.21.15.86:0/3557564222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bb470 0x55c6025c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.406+0000 7f71b9400640 1 -- 172.21.15.86:0/3557564222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025c0500 msgr2=0x55c6025cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.406+0000 7f71b9400640 1 --2- 172.21.15.86:0/3557564222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025c0500 0x55c6025cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.406+0000 7f71b9400640 1 -- 172.21.15.86:0/3557564222 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ac009d80 con 0x55c6025bab30 2024-09-13T16:10:04.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.407+0000 7f71b9e00640 1 --2- 172.21.15.86:0/3557564222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025c0500 0x55c6025cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:04.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.407+0000 7f71b9400640 1 --2- 172.21.15.86:0/3557564222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025bab30 0x55c6025c47a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f71a8005c80 tx=0x7f71a8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=650a0ce9d984e7e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.407+0000 7f719b400640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-13T16:10:04.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.407+0000 7f719b400640 1 -- 172.21.15.86:0/3557564222 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8017070 con 0x55c6025bab30 2024-09-13T16:10:04.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.407+0000 7f71bec3d740 1 -- 172.21.15.86:0/3557564222 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c6022113c0 con 0x55c6025bab30 2024-09-13T16:10:04.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.407+0000 7f719b400640 1 -- 172.21.15.86:0/3557564222 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f71a8005020 con 0x55c6025bab30 2024-09-13T16:10:04.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.407+0000 7f719b400640 1 -- 172.21.15.86:0/3557564222 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71a80051e0 con 0x55c6025bab30 2024-09-13T16:10:04.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.407+0000 7f71bec3d740 10 client.25153 fetch_fsmap learned FSMap version 24 2024-09-13T16:10:04.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.407+0000 7f71bec3d740 1 -- 172.21.15.86:0/3557564222 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c60251c1b0 con 0x55c6025bab30 2024-09-13T16:10:04.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.408+0000 7f719b400640 1 -- 172.21.15.86:0/3557564222 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55c6022113c0 con 0x55c6025bab30 2024-09-13T16:10:04.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.408+0000 7f719b400640 1 -- 172.21.15.86:0/3557564222 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f71a8011560 con 0x55c6025bab30 2024-09-13T16:10:04.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.408+0000 7f71bec3d740 10 client.25153 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:10:04.413 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.408+0000 7f71bec3d740 10 client.25153 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-13T16:10:04.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.408+0000 7f71bec3d740 20 client.25153 populate_metadata read hostname 'smithi086' 2024-09-13T16:10:04.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.408+0000 7f71bec3d740 1 --2- 172.21.15.86:0/3557564222 >> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] conn(0x55c6025d0b90 0x55c6025d4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.408+0000 7f71bec3d740 4 client.25153 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:10:04.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.408+0000 7f71bec3d740 1 -- 172.21.15.86:0/3557564222 --> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c6022226c0 con 0x55c6025d0b90 2024-09-13T16:10:04.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.408+0000 7f71b8a00640 1 --2- 172.21.15.86:0/3557564222 >> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] conn(0x55c6025d0b90 0x55c6025d4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.409+0000 7f71b8a00640 1 --2- 172.21.15.86:0/3557564222 >> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] conn(0x55c6025d0b90 0x55c6025d4d30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=18df6e4106017cf4 server_cookie=a60e1b5138110fef in_seq=0 out_seq=0 2024-09-13T16:10:04.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.409+0000 7f719b400640 10 client.25153 ms_handle_connect on v2:172.21.15.139:6836/2399531832 2024-09-13T16:10:04.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.410+0000 7f719b400640 1 -- 172.21.15.86:0/3557564222 <== mds.2 v2:172.21.15.139:6836/2399531832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c6022226c0 con 0x55c6025d0b90 2024-09-13T16:10:04.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.410+0000 7f719b400640 10 client.25153 handle_command_reply: tid=0 2024-09-13T16:10:04.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.410+0000 7f71bec3d740 1 client.25153 shutdown 2024-09-13T16:10:04.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.410+0000 7f71bec3d740 1 -- 172.21.15.86:0/3557564222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025bab30 msgr2=0x55c6025c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.410+0000 7f71bec3d740 1 --2- 172.21.15.86:0/3557564222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025bab30 0x55c6025c47a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f71a8005c80 tx=0x7f71a8004730 comp rx=0 tx=0).stop 2024-09-13T16:10:04.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.410+0000 7f71bec3d740 1 -- 172.21.15.86:0/3557564222 shutdown_connections 2024-09-13T16:10:04.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.410+0000 7f71bec3d740 1 --2- 172.21.15.86:0/3557564222 >> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] conn(0x55c6025d0b90 0x55c6025d4d30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.410+0000 7f71bec3d740 1 --2- 172.21.15.86:0/3557564222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025c0500 0x55c6025cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.410+0000 7f71bec3d740 1 --2- 172.21.15.86:0/3557564222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bb470 0x55c6025c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.410+0000 7f71bec3d740 1 --2- 172.21.15.86:0/3557564222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025bab30 0x55c6025c47a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.410+0000 7f719b400640 0 client.25153 ms_handle_reset on v2:172.21.15.139:6836/2399531832 2024-09-13T16:10:04.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.410+0000 7f71bec3d740 1 -- 172.21.15.86:0/3557564222 >> 172.21.15.86:0/3557564222 conn(0x55c6025b61a0 msgr2=0x55c6025b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.410+0000 7f71bec3d740 1 -- 172.21.15.86:0/3557564222 shutdown_connections 2024-09-13T16:10:04.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.410+0000 7f71bec3d740 1 -- 172.21.15.86:0/3557564222 wait complete. 2024-09-13T16:10:04.416 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.410+0000 7f71bec3d740 20 client.25153 trim_cache size 0 max 16384 2024-09-13T16:10:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.425+0000 7f71bec3d740 1 Processor -- start 2024-09-13T16:10:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.425+0000 7f71bec3d740 1 -- start start 2024-09-13T16:10:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.425+0000 7f71bec3d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025b61a0 0x55c6025b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.425+0000 7f71bec3d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bab30 0x55c6025baf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.425+0000 7f71bec3d740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025bb470 0x55c6025c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.425+0000 7f71bec3d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6025bbed0 con 0x55c6025b61a0 2024-09-13T16:10:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.425+0000 7f71bec3d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6022226c0 con 0x55c6025bab30 2024-09-13T16:10:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.425+0000 7f71bec3d740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6022113c0 con 0x55c6025bb470 2024-09-13T16:10:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.426+0000 7f71b9400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025b61a0 0x55c6025b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.426+0000 7f71b9400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025b61a0 0x55c6025b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37000/0 (socket says 172.21.15.86:37000) 2024-09-13T16:10:04.428 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.426+0000 7f71b9400640 1 -- 172.21.15.86:0/1321471695 learned_addr learned my addr 172.21.15.86:0/1321471695 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.426+0000 7f71b9e00640 1 --2- 172.21.15.86:0/1321471695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025bb470 0x55c6025c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.426+0000 7f71b8a00640 1 --2- 172.21.15.86:0/1321471695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bab30 0x55c6025baf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.426+0000 7f71b9400640 1 -- 172.21.15.86:0/1321471695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025bb470 msgr2=0x55c6025c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.426+0000 7f71b9400640 1 --2- 172.21.15.86:0/1321471695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025bb470 0x55c6025c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.426+0000 7f71b9400640 1 -- 172.21.15.86:0/1321471695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bab30 msgr2=0x55c6025baf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.426+0000 7f71b9400640 1 --2- 172.21.15.86:0/1321471695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bab30 0x55c6025baf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.426+0000 7f71b9400640 1 -- 172.21.15.86:0/1321471695 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6024be470 con 0x55c6025b61a0 2024-09-13T16:10:04.429 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.426+0000 7f71b9400640 1 --2- 172.21.15.86:0/1321471695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025b61a0 0x55c6025b5bf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f71a800f3e0 tx=0x7f71a8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b620aaafdccc2ee2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.427+0000 7f71a7400640 1 -- 172.21.15.86:0/1321471695 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8011a90 con 0x55c6025b61a0 2024-09-13T16:10:04.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.427+0000 7f71a7400640 1 -- 172.21.15.86:0/1321471695 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f71a8011bf0 con 0x55c6025b61a0 2024-09-13T16:10:04.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.427+0000 7f71a7400640 1 -- 172.21.15.86:0/1321471695 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8004a00 con 0x55c6025b61a0 2024-09-13T16:10:04.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.427+0000 7f71bec3d740 1 -- 172.21.15.86:0/1321471695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025b61a0 msgr2=0x55c6025b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.427+0000 7f71bec3d740 1 --2- 172.21.15.86:0/1321471695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025b61a0 0x55c6025b5bf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f71a800f3e0 tx=0x7f71a8000bc0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.427+0000 7f71bec3d740 1 -- 172.21.15.86:0/1321471695 shutdown_connections 2024-09-13T16:10:04.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.427+0000 7f71bec3d740 1 --2- 172.21.15.86:0/1321471695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025bb470 0x55c6025c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.427+0000 7f71bec3d740 1 --2- 172.21.15.86:0/1321471695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bab30 0x55c6025baf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.427+0000 7f71bec3d740 1 --2- 172.21.15.86:0/1321471695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025b61a0 0x55c6025b5bf0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.427+0000 7f71bec3d740 1 -- 172.21.15.86:0/1321471695 >> 172.21.15.86:0/1321471695 conn(0x55c6025c2c60 msgr2=0x55c6025d8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.427+0000 7f71bec3d740 1 -- 172.21.15.86:0/1321471695 shutdown_connections 2024-09-13T16:10:04.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.427+0000 7f71bec3d740 1 -- 172.21.15.86:0/1321471695 wait complete. 2024-09-13T16:10:04.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.428+0000 7f71bec3d740 1 -- start start 2024-09-13T16:10:04.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.428+0000 7f71bec3d740 1 Processor -- start 2024-09-13T16:10:04.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.428+0000 7f71bec3d740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025b61a0 0x55c6025c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.434 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.428+0000 7f71bec3d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025bab30 0x55c6025c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.428+0000 7f71bec3d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bb470 0x55c6025ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.428+0000 7f71bec3d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6025ca890 con 0x55c6025bab30 2024-09-13T16:10:04.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.428+0000 7f71bec3d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6025caa00 con 0x55c6025bb470 2024-09-13T16:10:04.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.428+0000 7f71bec3d740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6025cabc0 con 0x55c6025b61a0 2024-09-13T16:10:04.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.428+0000 7f71bec3d740 10 client.0 _ll_register_callbacks cb 0x7f71a8009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:04.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.428+0000 7f71b8a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025bab30 0x55c6025c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.428+0000 7f71b8a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025bab30 0x55c6025c9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37010/0 (socket says 172.21.15.86:37010) 2024-09-13T16:10:04.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.428+0000 7f71b9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bb470 0x55c6025ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.429+0000 7f71b8a00640 1 -- 172.21.15.86:0/2778021725 learned_addr learned my addr 172.21.15.86:0/2778021725 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:04.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.429+0000 7f71b9400640 1 --2- 172.21.15.86:0/2778021725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025b61a0 0x55c6025c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.429+0000 7f71b9400640 1 -- 172.21.15.86:0/2778021725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bb470 msgr2=0x55c6025ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.429+0000 7f71b9400640 1 --2- 172.21.15.86:0/2778021725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bb470 0x55c6025ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.429+0000 7f71b9400640 1 -- 172.21.15.86:0/2778021725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025bab30 msgr2=0x55c6025c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.429+0000 7f71b9400640 1 --2- 172.21.15.86:0/2778021725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025bab30 0x55c6025c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.429+0000 7f71b9400640 1 -- 172.21.15.86:0/2778021725 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c60251c1b0 con 0x55c6025b61a0 2024-09-13T16:10:04.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.429+0000 7f71b8a00640 1 --2- 172.21.15.86:0/2778021725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025bab30 0x55c6025c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:04.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.429+0000 7f71b9e00640 1 --2- 172.21.15.86:0/2778021725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bb470 0x55c6025ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:04.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.429+0000 7f71b9400640 1 --2- 172.21.15.86:0/2778021725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025b61a0 0x55c6025c8e00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009460 tx=0x7f71a80056b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=811189eec8a93a60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.429+0000 7f719b400640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-13T16:10:04.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.429+0000 7f719b400640 1 -- 172.21.15.86:0/2778021725 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8011a90 con 0x55c6025b61a0 2024-09-13T16:10:04.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.429+0000 7f71bec3d740 1 -- 172.21.15.86:0/2778021725 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c602547cd0 con 0x55c6025b61a0 2024-09-13T16:10:04.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.429+0000 7f719b400640 1 -- 172.21.15.86:0/2778021725 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f71a8004840 con 0x55c6025b61a0 2024-09-13T16:10:04.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.430+0000 7f719b400640 1 -- 172.21.15.86:0/2778021725 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71a8004a20 con 0x55c6025b61a0 2024-09-13T16:10:04.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.430+0000 7f71bec3d740 10 client.25159 fetch_fsmap learned FSMap version 24 2024-09-13T16:10:04.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.430+0000 7f71bec3d740 1 -- 172.21.15.86:0/2778021725 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c6024e3980 con 0x55c6025b61a0 2024-09-13T16:10:04.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.430+0000 7f719b400640 1 -- 172.21.15.86:0/2778021725 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55c602547cd0 con 0x55c6025b61a0 2024-09-13T16:10:04.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.430+0000 7f719b400640 1 -- 172.21.15.86:0/2778021725 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f71a8048070 con 0x55c6025b61a0 2024-09-13T16:10:04.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.430+0000 7f71bec3d740 10 client.25159 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:10:04.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.430+0000 7f71bec3d740 10 client.25159 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-13T16:10:04.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.430+0000 7f71bec3d740 20 client.25159 populate_metadata read hostname 'smithi086' 2024-09-13T16:10:04.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.430+0000 7f71bec3d740 1 --2- 172.21.15.86:0/2778021725 >> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] conn(0x55c6025c0500 0x55c602628a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.430+0000 7f71bec3d740 4 client.25159 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T16:10:04.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.430+0000 7f71bec3d740 1 -- 172.21.15.86:0/2778021725 --> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c602275d10 con 0x55c6025c0500 2024-09-13T16:10:04.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.431+0000 7f71b8a00640 1 --2- 172.21.15.86:0/2778021725 >> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] conn(0x55c6025c0500 0x55c602628a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.431+0000 7f71b8a00640 1 --2- 172.21.15.86:0/2778021725 >> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] conn(0x55c6025c0500 0x55c602628a00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f76d1f3f5c8c56ca server_cookie=238e23f4037ce84d in_seq=0 out_seq=0 2024-09-13T16:10:04.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.431+0000 7f719b400640 10 client.25159 ms_handle_connect on v2:172.21.15.139:6836/2399531832 2024-09-13T16:10:04.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.431+0000 7f719b400640 1 -- 172.21.15.86:0/2778021725 <== mds.2 v2:172.21.15.139:6836/2399531832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55c602275d10 con 0x55c6025c0500 2024-09-13T16:10:04.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.431+0000 7f719b400640 10 client.25159 handle_command_reply: tid=0 2024-09-13T16:10:04.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.431+0000 7f71bec3d740 1 client.25159 shutdown 2024-09-13T16:10:04.437 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.431+0000 7f71bec3d740 1 -- 172.21.15.86:0/2778021725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025b61a0 msgr2=0x55c6025c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.431+0000 7f71bec3d740 1 --2- 172.21.15.86:0/2778021725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025b61a0 0x55c6025c8e00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009460 tx=0x7f71a80056b0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.431+0000 7f71bec3d740 1 -- 172.21.15.86:0/2778021725 shutdown_connections 2024-09-13T16:10:04.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.431+0000 7f71bec3d740 1 --2- 172.21.15.86:0/2778021725 >> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] conn(0x55c6025c0500 0x55c602628a00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.431+0000 7f71bec3d740 1 --2- 172.21.15.86:0/2778021725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6025bb470 0x55c6025ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.431+0000 7f71bec3d740 1 --2- 172.21.15.86:0/2778021725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c6025bab30 0x55c6025c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.431+0000 7f71bec3d740 1 --2- 172.21.15.86:0/2778021725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c6025b61a0 0x55c6025c8e00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.431+0000 7f719b400640 0 client.25159 ms_handle_reset on v2:172.21.15.139:6836/2399531832 2024-09-13T16:10:04.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.431+0000 7f71bec3d740 1 -- 172.21.15.86:0/2778021725 >> 172.21.15.86:0/2778021725 conn(0x55c6025c2c60 msgr2=0x55c6025d9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.432+0000 7f71bec3d740 1 -- 172.21.15.86:0/2778021725 shutdown_connections 2024-09-13T16:10:04.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.432+0000 7f71bec3d740 1 -- 172.21.15.86:0/2778021725 wait complete. 2024-09-13T16:10:04.438 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.432+0000 7f71bec3d740 20 client.25159 trim_cache size 0 max 16384 2024-09-13T16:10:04.439 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T16:10:04.439 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "1ecdfbda-71e9-11ef-bceb-c7b262605968", 2024-09-13T16:10:04.439 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 2, 2024-09-13T16:10:04.439 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24530, 2024-09-13T16:10:04.439 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-09-13T16:10:04.439 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-09-13T16:10:04.439 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-09-13T16:10:04.439 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 92.991036046000005, 2024-09-13T16:10:04.439 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 24, 2024-09-13T16:10:04.439 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 94, 2024-09-13T16:10:04.439 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 90, 2024-09-13T16:10:04.439 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 132.50164573800001 2024-09-13T16:10:04.440 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T16:10:04.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.432+0000 7f71bbe00640 1 -- 172.21.15.86:0/354398166 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f719c0a1090 msgr2=0x7f719c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.432+0000 7f71bbe00640 1 --2- 172.21.15.86:0/354398166 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f719c0a1090 0x7f719c0a3550 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55c6025bbea0 tx=0x7f71a8009260 comp rx=0 tx=0).stop 2024-09-13T16:10:04.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.432+0000 7f71bbe00640 1 -- 172.21.15.86:0/354398166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71b4103130 msgr2=0x7f71b4198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.432+0000 7f71bbe00640 1 --2- 172.21.15.86:0/354398166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71b4103130 0x7f71b4198670 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f71a002a860 tx=0x7f71a00326f0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.432+0000 7f71bbe00640 1 -- 172.21.15.86:0/354398166 shutdown_connections 2024-09-13T16:10:04.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.432+0000 7f71bbe00640 1 --2- 172.21.15.86:0/354398166 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f719c0a1090 0x7f719c0a3550 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.432+0000 7f71bbe00640 1 --2- 172.21.15.86:0/354398166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71b4105a60 0x7f71b419f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.432+0000 7f71bbe00640 1 --2- 172.21.15.86:0/354398166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71b4103130 0x7f71b4198670 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.432+0000 7f71bbe00640 1 --2- 172.21.15.86:0/354398166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71b4100800 0x7f71b4198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.432+0000 7f71bbe00640 1 -- 172.21.15.86:0/354398166 >> 172.21.15.86:0/354398166 conn(0x7f71b40fa3e0 msgr2=0x7f71b40fff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.433+0000 7f71bbe00640 1 -- 172.21.15.86:0/354398166 shutdown_connections 2024-09-13T16:10:04.441 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.433+0000 7f71bbe00640 1 -- 172.21.15.86:0/354398166 wait complete. 2024-09-13T16:10:04.450 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-09-13T16:10:04.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.603+0000 7fee19e00640 1 -- 172.21.15.86:0/193362691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee14100f60 msgr2=0x7fee141013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.603+0000 7fee19e00640 1 --2- 172.21.15.86:0/193362691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee14100f60 0x7fee141013e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fedfc009900 tx=0x7fedfc02a410 comp rx=0 tx=0).stop 2024-09-13T16:10:04.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.603+0000 7fee19e00640 1 -- 172.21.15.86:0/193362691 shutdown_connections 2024-09-13T16:10:04.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.603+0000 7fee19e00640 1 --2- 172.21.15.86:0/193362691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee14101920 0x7fee141081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.603+0000 7fee19e00640 1 --2- 172.21.15.86:0/193362691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee14100f60 0x7fee141013e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.603+0000 7fee19e00640 1 --2- 172.21.15.86:0/193362691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee140ffd70 0x7fee14100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.603+0000 7fee19e00640 1 -- 172.21.15.86:0/193362691 >> 172.21.15.86:0/193362691 conn(0x7fee140fb4d0 msgr2=0x7fee140fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.603+0000 7fee19e00640 1 -- 172.21.15.86:0/193362691 shutdown_connections 2024-09-13T16:10:04.606 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.603+0000 7fee19e00640 1 -- 172.21.15.86:0/193362691 wait complete. 2024-09-13T16:10:04.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.604+0000 7fee19e00640 1 Processor -- start 2024-09-13T16:10:04.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.604+0000 7fee19e00640 1 -- start start 2024-09-13T16:10:04.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.604+0000 7fee19e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee140ffd70 0x7fee141980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.604+0000 7fee19e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee14100f60 0x7fee141985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.604+0000 7fee19e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee14101920 0x7fee1419f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.604+0000 7fee19e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1419fb90 con 0x7fee14101920 2024-09-13T16:10:04.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.604+0000 7fee19e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1419fd00 con 0x7fee140ffd70 2024-09-13T16:10:04.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.604+0000 7fee19e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1419fec0 con 0x7fee14100f60 2024-09-13T16:10:04.608 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.604+0000 7fee13400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee14101920 0x7fee1419f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.605+0000 7fee12a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee140ffd70 0x7fee141980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.605+0000 7fee12a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee140ffd70 0x7fee141980a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:54344/0 (socket says 172.21.15.86:54344) 2024-09-13T16:10:04.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.605+0000 7fee13400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee14101920 0x7fee1419f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37032/0 (socket says 172.21.15.86:37032) 2024-09-13T16:10:04.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.605+0000 7fee12a00640 1 -- 172.21.15.86:0/3983752131 learned_addr learned my addr 172.21.15.86:0/3983752131 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:04.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.605+0000 7fee0be00640 1 --2- 172.21.15.86:0/3983752131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee14100f60 0x7fee141985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.605+0000 7fee13400640 1 -- 172.21.15.86:0/3983752131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee14100f60 msgr2=0x7fee141985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.605+0000 7fee13400640 1 --2- 172.21.15.86:0/3983752131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee14100f60 0x7fee141985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.605+0000 7fee13400640 1 -- 172.21.15.86:0/3983752131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee140ffd70 msgr2=0x7fee141980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.605+0000 7fee13400640 1 --2- 172.21.15.86:0/3983752131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee140ffd70 0x7fee141980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.605+0000 7fee13400640 1 -- 172.21.15.86:0/3983752131 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc009560 con 0x7fee14101920 2024-09-13T16:10:04.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.605+0000 7fee12a00640 1 --2- 172.21.15.86:0/3983752131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee140ffd70 0x7fee141980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:04.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.605+0000 7fee13400640 1 --2- 172.21.15.86:0/3983752131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee14101920 0x7fee1419f650 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00da10 tx=0x7fee0c00ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.609 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.605+0000 7fee18a00640 1 -- 172.21.15.86:0/3983752131 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c00bd70 con 0x7fee14101920 2024-09-13T16:10:04.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.605+0000 7fee18a00640 1 -- 172.21.15.86:0/3983752131 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fee0c003e50 con 0x7fee14101920 2024-09-13T16:10:04.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.606+0000 7fee19e00640 1 -- 172.21.15.86:0/3983752131 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee141a01a0 con 0x7fee14101920 2024-09-13T16:10:04.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.606+0000 7fee18a00640 1 -- 172.21.15.86:0/3983752131 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c0106c0 con 0x7fee14101920 2024-09-13T16:10:04.610 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.606+0000 7fee19e00640 1 -- 172.21.15.86:0/3983752131 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee141a0630 con 0x7fee14101920 2024-09-13T16:10:04.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.608+0000 7fee1cc18740 1 Processor -- start 2024-09-13T16:10:04.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.608+0000 7fee18a00640 1 -- 172.21.15.86:0/3983752131 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fee0c0042a0 con 0x7fee14101920 2024-09-13T16:10:04.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.609+0000 7fee1cc18740 1 -- start start 2024-09-13T16:10:04.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.609+0000 7fee1cc18740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a96709bb30 0x55a96709bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.609+0000 7fee1cc18740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709c470 0x55a9670a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.609+0000 7fee1cc18740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9670a1500 0x55a9670a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.612 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.609+0000 7fee1cc18740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a967005ab0 con 0x55a96709c470 2024-09-13T16:10:04.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.609+0000 7fee1cc18740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a967003240 con 0x55a9670a1500 2024-09-13T16:10:04.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.609+0000 7fee1cc18740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a966ffeb30 con 0x55a96709bb30 2024-09-13T16:10:04.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.609+0000 7fee12a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709c470 0x55a9670a0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.609+0000 7fee12a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709c470 0x55a9670a0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37042/0 (socket says 172.21.15.86:37042) 2024-09-13T16:10:04.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.609+0000 7fee12a00640 1 -- 172.21.15.86:0/697424410 learned_addr learned my addr 172.21.15.86:0/697424410 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:04.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.609+0000 7fee0be00640 1 --2- 172.21.15.86:0/697424410 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a96709bb30 0x55a96709bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.609+0000 7fee0be00640 1 --2- 172.21.15.86:0/697424410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9670a1500 0x55a9670a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.610+0000 7fee12a00640 1 -- 172.21.15.86:0/697424410 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a96709bb30 msgr2=0x55a96709bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.610+0000 7fee12a00640 1 --2- 172.21.15.86:0/697424410 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a96709bb30 0x55a96709bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.610+0000 7fee12a00640 1 -- 172.21.15.86:0/697424410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9670a1500 msgr2=0x55a9670a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.610+0000 7fee12a00640 1 --2- 172.21.15.86:0/697424410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9670a1500 0x55a9670a39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.610+0000 7fee12a00640 1 -- 172.21.15.86:0/697424410 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a966fc9bd0 con 0x55a96709c470 2024-09-13T16:10:04.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.610+0000 7fee0be00640 1 --2- 172.21.15.86:0/697424410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9670a1500 0x55a9670a39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:10:04.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.610+0000 7fee12a00640 1 --2- 172.21.15.86:0/697424410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709c470 0x55a9670a0f30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fee040115f0 tx=0x7fee04011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7c9a4d7cfbfd81 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.610+0000 7fee18a00640 1 --2- 172.21.15.86:0/3983752131 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fedf80a1090 0x7fedf80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.610+0000 7fee08c00640 1 -- 172.21.15.86:0/697424410 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04004020 con 0x55a96709c470 2024-09-13T16:10:04.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.610+0000 7fee08c00640 1 -- 172.21.15.86:0/697424410 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fee04004180 con 0x55a96709c470 2024-09-13T16:10:04.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.610+0000 7fee08c00640 1 -- 172.21.15.86:0/697424410 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04003960 con 0x55a96709c470 2024-09-13T16:10:04.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.610+0000 7fee18a00640 1 -- 172.21.15.86:0/3983752131 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fee0c0ccfe0 con 0x7fee14101920 2024-09-13T16:10:04.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.610+0000 7fee0be00640 1 --2- 172.21.15.86:0/3983752131 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fedf80a1090 0x7fedf80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.611+0000 7fee1cc18740 1 -- 172.21.15.86:0/697424410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709c470 msgr2=0x55a9670a0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.611+0000 7fee1cc18740 1 --2- 172.21.15.86:0/697424410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709c470 0x55a9670a0f30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fee040115f0 tx=0x7fee04011ab0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.611+0000 7fee0be00640 1 --2- 172.21.15.86:0/3983752131 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fedf80a1090 0x7fedf80a3550 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fedfc005ab0 tx=0x7fedfc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.611+0000 7fee1cc18740 1 -- 172.21.15.86:0/697424410 shutdown_connections 2024-09-13T16:10:04.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.611+0000 7fee1cc18740 1 --2- 172.21.15.86:0/697424410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9670a1500 0x55a9670a39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.611+0000 7fee1cc18740 1 --2- 172.21.15.86:0/697424410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709c470 0x55a9670a0f30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.611+0000 7fee1cc18740 1 --2- 172.21.15.86:0/697424410 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a96709bb30 0x55a96709bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.611+0000 7fee1cc18740 1 -- 172.21.15.86:0/697424410 >> 172.21.15.86:0/697424410 conn(0x55a9670971a0 msgr2=0x55a9670975a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.611+0000 7fee1cc18740 1 -- 172.21.15.86:0/697424410 shutdown_connections 2024-09-13T16:10:04.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.611+0000 7fee1cc18740 1 -- 172.21.15.86:0/697424410 wait complete. 2024-09-13T16:10:04.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.612+0000 7fee1cc18740 1 -- start start 2024-09-13T16:10:04.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.612+0000 7fee1cc18740 1 Processor -- start 2024-09-13T16:10:04.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.612+0000 7fee1cc18740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a96709bb30 0x55a9670a5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.612+0000 7fee1cc18740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a96709c470 0x55a9670a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.619 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.612+0000 7fee1cc18740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9670a1500 0x55a9670accc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.612+0000 7fee1cc18740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a966fa0260 con 0x55a9670a1500 2024-09-13T16:10:04.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.612+0000 7fee1cc18740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a966f9ff00 con 0x55a96709c470 2024-09-13T16:10:04.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.612+0000 7fee1cc18740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a966d65f20 con 0x55a96709bb30 2024-09-13T16:10:04.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.612+0000 7fee1cc18740 10 client.0 _ll_register_callbacks cb 0x55a966ff81a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:04.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.613+0000 7fee0be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a96709c470 0x55a9670a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.613+0000 7fee13400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9670a1500 0x55a9670accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.613+0000 7fee12a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a96709bb30 0x55a9670a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.613+0000 7fee13400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9670a1500 0x55a9670accc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37046/0 (socket says 172.21.15.86:37046) 2024-09-13T16:10:04.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.613+0000 7fee12a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a96709bb30 0x55a9670a5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:34502/0 (socket says 172.21.15.86:34502) 2024-09-13T16:10:04.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.613+0000 7fee0be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a96709c470 0x55a9670a5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:54370/0 (socket says 172.21.15.86:54370) 2024-09-13T16:10:04.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.613+0000 7fee13400640 1 -- 172.21.15.86:0/645630145 learned_addr learned my addr 172.21.15.86:0/645630145 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:04.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.613+0000 7fee13400640 1 -- 172.21.15.86:0/645630145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a96709bb30 msgr2=0x55a9670a5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.620 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.613+0000 7fee13400640 1 --2- 172.21.15.86:0/645630145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a96709bb30 0x55a9670a5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.613+0000 7fee13400640 1 -- 172.21.15.86:0/645630145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a96709c470 msgr2=0x55a9670a5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.613+0000 7fee13400640 1 --2- 172.21.15.86:0/645630145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a96709c470 0x55a9670a5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.613+0000 7fee13400640 1 -- 172.21.15.86:0/645630145 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee04009d80 con 0x55a9670a1500 2024-09-13T16:10:04.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.613+0000 7fee0be00640 1 --2- 172.21.15.86:0/645630145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a96709c470 0x55a9670a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:04.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.613+0000 7fee13400640 1 --2- 172.21.15.86:0/645630145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9670a1500 0x55a9670accc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fee0c099fa0 tx=0x7fee0c09a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e831a452858f29b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.613+0000 7fee01600640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T16:10:04.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.613+0000 7fee01600640 1 -- 172.21.15.86:0/645630145 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c09de40 con 0x55a9670a1500 2024-09-13T16:10:04.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.613+0000 7fee01600640 1 -- 172.21.15.86:0/645630145 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fee0c0a2490 con 0x55a9670a1500 2024-09-13T16:10:04.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.613+0000 7fee1cc18740 1 -- 172.21.15.86:0/645630145 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a967028cd0 con 0x55a9670a1500 2024-09-13T16:10:04.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.614+0000 7fee01600640 1 -- 172.21.15.86:0/645630145 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee0c096720 con 0x55a9670a1500 2024-09-13T16:10:04.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.614+0000 7fee1cc18740 10 client.15129 fetch_fsmap learned FSMap version 24 2024-09-13T16:10:04.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.614+0000 7fee1cc18740 1 -- 172.21.15.86:0/645630145 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55a966ffd1b0 con 0x55a9670a1500 2024-09-13T16:10:04.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.614+0000 7fee01600640 1 -- 172.21.15.86:0/645630145 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55a967028cd0 con 0x55a9670a1500 2024-09-13T16:10:04.621 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.614+0000 7fee01600640 1 -- 172.21.15.86:0/645630145 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fee0c01a070 con 0x55a9670a1500 2024-09-13T16:10:04.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.614+0000 7fee1cc18740 10 client.15129 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:10:04.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.614+0000 7fee1cc18740 10 client.15129 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T16:10:04.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.614+0000 7fee1cc18740 20 client.15129 populate_metadata read hostname 'smithi086' 2024-09-13T16:10:04.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.614+0000 7fee1cc18740 1 --2- 172.21.15.86:0/645630145 >> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] conn(0x55a9670b15a0 0x55a9670b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.614+0000 7fee1cc18740 4 client.15129 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:10:04.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.614+0000 7fee1cc18740 1 -- 172.21.15.86:0/645630145 --> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a966cf23c0 con 0x55a9670b15a0 2024-09-13T16:10:04.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.615+0000 7fee12a00640 1 --2- 172.21.15.86:0/645630145 >> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] conn(0x55a9670b15a0 0x55a9670b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.615+0000 7fee01600640 10 client.15129 ms_handle_connect on v2:172.21.15.194:6838/3799859182 2024-09-13T16:10:04.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.615+0000 7fee12a00640 1 --2- 172.21.15.86:0/645630145 >> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] conn(0x55a9670b15a0 0x55a9670b5d10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=744d20ab1604b1f8 server_cookie=fb963f059bb21df0 in_seq=0 out_seq=0 2024-09-13T16:10:04.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.616+0000 7fee01600640 1 -- 172.21.15.86:0/645630145 <== mds.1 v2:172.21.15.194:6838/3799859182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a966cf23c0 con 0x55a9670b15a0 2024-09-13T16:10:04.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.616+0000 7fee01600640 10 client.15129 handle_command_reply: tid=0 2024-09-13T16:10:04.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.616+0000 7fee1cc18740 1 client.15129 shutdown 2024-09-13T16:10:04.622 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.617+0000 7fee1cc18740 1 -- 172.21.15.86:0/645630145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9670a1500 msgr2=0x55a9670accc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.617+0000 7fee1cc18740 1 --2- 172.21.15.86:0/645630145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9670a1500 0x55a9670accc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fee0c099fa0 tx=0x7fee0c09a710 comp rx=0 tx=0).stop 2024-09-13T16:10:04.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.617+0000 7fee1cc18740 1 -- 172.21.15.86:0/645630145 shutdown_connections 2024-09-13T16:10:04.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.617+0000 7fee1cc18740 1 --2- 172.21.15.86:0/645630145 >> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] conn(0x55a9670b15a0 0x55a9670b5d10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.617+0000 7fee1cc18740 1 --2- 172.21.15.86:0/645630145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9670a1500 0x55a9670accc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.617+0000 7fee1cc18740 1 --2- 172.21.15.86:0/645630145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a96709c470 0x55a9670a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.617+0000 7fee1cc18740 1 --2- 172.21.15.86:0/645630145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a96709bb30 0x55a9670a5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.617+0000 7fee01600640 0 client.15129 ms_handle_reset on v2:172.21.15.194:6838/3799859182 2024-09-13T16:10:04.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.617+0000 7fee1cc18740 1 -- 172.21.15.86:0/645630145 >> 172.21.15.86:0/645630145 conn(0x55a9670971a0 msgr2=0x55a9670989b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.617+0000 7fee1cc18740 1 -- 172.21.15.86:0/645630145 shutdown_connections 2024-09-13T16:10:04.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.617+0000 7fee1cc18740 1 -- 172.21.15.86:0/645630145 wait complete. 2024-09-13T16:10:04.623 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.617+0000 7fee1cc18740 20 client.15129 trim_cache size 0 max 16384 2024-09-13T16:10:04.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.632+0000 7fee1cc18740 1 Processor -- start 2024-09-13T16:10:04.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.632+0000 7fee1cc18740 1 -- start start 2024-09-13T16:10:04.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.632+0000 7fee1cc18740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a96709bb30 0x55a9670a5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.632+0000 7fee1cc18740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709c470 0x55a9670acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.632+0000 7fee1cc18740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a9670a1500 0x55a9670a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.632+0000 7fee1cc18740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9670a0fd0 con 0x55a96709c470 2024-09-13T16:10:04.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.632+0000 7fee1cc18740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a96709ced0 con 0x55a96709bb30 2024-09-13T16:10:04.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.632+0000 7fee1cc18740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a966cf23c0 con 0x55a9670a1500 2024-09-13T16:10:04.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.633+0000 7fee0be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709c470 0x55a9670acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.633+0000 7fee0be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709c470 0x55a9670acbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37058/0 (socket says 172.21.15.86:37058) 2024-09-13T16:10:04.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.633+0000 7fee0be00640 1 -- 172.21.15.86:0/425028018 learned_addr learned my addr 172.21.15.86:0/425028018 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:04.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.633+0000 7fee12a00640 1 --2- 172.21.15.86:0/425028018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a96709bb30 0x55a9670a5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.633+0000 7fee13400640 1 --2- 172.21.15.86:0/425028018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a9670a1500 0x55a9670a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.633+0000 7fee0be00640 1 -- 172.21.15.86:0/425028018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a9670a1500 msgr2=0x55a9670a5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.633+0000 7fee0be00640 1 --2- 172.21.15.86:0/425028018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a9670a1500 0x55a9670a5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.633+0000 7fee0be00640 1 -- 172.21.15.86:0/425028018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a96709bb30 msgr2=0x55a9670a5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.633+0000 7fee0be00640 1 --2- 172.21.15.86:0/425028018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a96709bb30 0x55a9670a5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.633+0000 7fee0be00640 1 -- 172.21.15.86:0/425028018 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a966f9f470 con 0x55a96709c470 2024-09-13T16:10:04.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.633+0000 7fee0be00640 1 --2- 172.21.15.86:0/425028018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709c470 0x55a9670acbe0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fedfc009900 tx=0x7fedfc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9596726f3dd969 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.634+0000 7fee09600640 1 -- 172.21.15.86:0/425028018 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc050070 con 0x55a96709c470 2024-09-13T16:10:04.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.634+0000 7fee09600640 1 -- 172.21.15.86:0/425028018 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fedfc031cd0 con 0x55a96709c470 2024-09-13T16:10:04.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.634+0000 7fee09600640 1 -- 172.21.15.86:0/425028018 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc03d7d0 con 0x55a96709c470 2024-09-13T16:10:04.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.634+0000 7fee1cc18740 1 -- 172.21.15.86:0/425028018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709c470 msgr2=0x55a9670acbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.634+0000 7fee1cc18740 1 --2- 172.21.15.86:0/425028018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709c470 0x55a9670acbe0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fedfc009900 tx=0x7fedfc02a410 comp rx=0 tx=0).stop 2024-09-13T16:10:04.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.634+0000 7fee1cc18740 1 -- 172.21.15.86:0/425028018 shutdown_connections 2024-09-13T16:10:04.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.634+0000 7fee1cc18740 1 --2- 172.21.15.86:0/425028018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a9670a1500 0x55a9670a5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.634+0000 7fee1cc18740 1 --2- 172.21.15.86:0/425028018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709c470 0x55a9670acbe0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.634+0000 7fee1cc18740 1 --2- 172.21.15.86:0/425028018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a96709bb30 0x55a9670a5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.634+0000 7fee1cc18740 1 -- 172.21.15.86:0/425028018 >> 172.21.15.86:0/425028018 conn(0x55a9670971a0 msgr2=0x55a9670a4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.634+0000 7fee1cc18740 1 -- 172.21.15.86:0/425028018 shutdown_connections 2024-09-13T16:10:04.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.634+0000 7fee1cc18740 1 -- 172.21.15.86:0/425028018 wait complete. 2024-09-13T16:10:04.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.635+0000 7fee1cc18740 1 -- start start 2024-09-13T16:10:04.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.635+0000 7fee1cc18740 1 Processor -- start 2024-09-13T16:10:04.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.635+0000 7fee1cc18740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709bb30 0x55a9670a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.635+0000 7fee1cc18740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a96709c470 0x55a9670a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.635+0000 7fee1cc18740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9670a1500 0x55a9671079d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.635+0000 7fee1cc18740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9670aa530 con 0x55a96709bb30 2024-09-13T16:10:04.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.635+0000 7fee1cc18740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9670aa670 con 0x55a9670a1500 2024-09-13T16:10:04.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.635+0000 7fee1cc18740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a967107f10 con 0x55a96709c470 2024-09-13T16:10:04.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.635+0000 7fee1cc18740 10 client.0 _ll_register_callbacks cb 0x7fee0c005f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:04.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.636+0000 7fee12a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709bb30 0x55a9670a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.636+0000 7fee13400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9670a1500 0x55a9671079d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.636+0000 7fee12a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709bb30 0x55a9670a9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37064/0 (socket says 172.21.15.86:37064) 2024-09-13T16:10:04.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.636+0000 7fee12a00640 1 -- 172.21.15.86:0/1942037918 learned_addr learned my addr 172.21.15.86:0/1942037918 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:04.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.636+0000 7fee0be00640 1 --2- 172.21.15.86:0/1942037918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a96709c470 0x55a9670a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.636+0000 7fee12a00640 1 -- 172.21.15.86:0/1942037918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a96709c470 msgr2=0x55a9670a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.636+0000 7fee12a00640 1 --2- 172.21.15.86:0/1942037918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a96709c470 0x55a9670a9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.636+0000 7fee12a00640 1 -- 172.21.15.86:0/1942037918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9670a1500 msgr2=0x55a9671079d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.636+0000 7fee12a00640 1 --2- 172.21.15.86:0/1942037918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9670a1500 0x55a9671079d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.636+0000 7fee12a00640 1 -- 172.21.15.86:0/1942037918 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee14108ab0 con 0x55a96709bb30 2024-09-13T16:10:04.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.636+0000 7fee13400640 1 --2- 172.21.15.86:0/1942037918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9670a1500 0x55a9671079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:04.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.636+0000 7fee12a00640 1 --2- 172.21.15.86:0/1942037918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709bb30 0x55a9670a9ab0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fee040115f0 tx=0x7fee04005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e0af338c9dcdbb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.636+0000 7fee01600640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T16:10:04.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.636+0000 7fee01600640 1 -- 172.21.15.86:0/1942037918 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04005480 con 0x55a96709bb30 2024-09-13T16:10:04.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.637+0000 7fee01600640 1 -- 172.21.15.86:0/1942037918 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fee040055e0 con 0x55a96709bb30 2024-09-13T16:10:04.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.637+0000 7fee1cc18740 1 -- 172.21.15.86:0/1942037918 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fee04004180 con 0x55a96709bb30 2024-09-13T16:10:04.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.637+0000 7fee01600640 1 -- 172.21.15.86:0/1942037918 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee0400f760 con 0x55a96709bb30 2024-09-13T16:10:04.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.637+0000 7fee1cc18740 10 client.15135 fetch_fsmap learned FSMap version 24 2024-09-13T16:10:04.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.637+0000 7fee1cc18740 1 -- 172.21.15.86:0/1942037918 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55a966fc4980 con 0x55a96709bb30 2024-09-13T16:10:04.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.637+0000 7fee01600640 1 -- 172.21.15.86:0/1942037918 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fee04004180 con 0x55a96709bb30 2024-09-13T16:10:04.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.637+0000 7fee01600640 1 -- 172.21.15.86:0/1942037918 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fee04021070 con 0x55a96709bb30 2024-09-13T16:10:04.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.637+0000 7fee1cc18740 10 client.15135 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:10:04.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.637+0000 7fee1cc18740 10 client.15135 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T16:10:04.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.637+0000 7fee1cc18740 20 client.15135 populate_metadata read hostname 'smithi086' 2024-09-13T16:10:04.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.637+0000 7fee1cc18740 1 --2- 172.21.15.86:0/1942037918 >> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] conn(0x55a96710ccc0 0x55a9671096a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.637+0000 7fee1cc18740 4 client.15135 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T16:10:04.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.637+0000 7fee1cc18740 1 -- 172.21.15.86:0/1942037918 --> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a966d036c0 con 0x55a96710ccc0 2024-09-13T16:10:04.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.638+0000 7fee0be00640 1 --2- 172.21.15.86:0/1942037918 >> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] conn(0x55a96710ccc0 0x55a9671096a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.638+0000 7fee0be00640 1 --2- 172.21.15.86:0/1942037918 >> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] conn(0x55a96710ccc0 0x55a9671096a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=88a95a3caa2362b6 server_cookie=d4095e8d961b2763 in_seq=0 out_seq=0 2024-09-13T16:10:04.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.638+0000 7fee01600640 10 client.15135 ms_handle_connect on v2:172.21.15.194:6838/3799859182 2024-09-13T16:10:04.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.638+0000 7fee01600640 1 -- 172.21.15.86:0/1942037918 <== mds.1 v2:172.21.15.194:6838/3799859182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55a966d036c0 con 0x55a96710ccc0 2024-09-13T16:10:04.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.638+0000 7fee01600640 10 client.15135 handle_command_reply: tid=0 2024-09-13T16:10:04.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.638+0000 7fee1cc18740 1 client.15135 shutdown 2024-09-13T16:10:04.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.638+0000 7fee1cc18740 1 -- 172.21.15.86:0/1942037918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709bb30 msgr2=0x55a9670a9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.638+0000 7fee1cc18740 1 --2- 172.21.15.86:0/1942037918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709bb30 0x55a9670a9ab0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fee040115f0 tx=0x7fee04005040 comp rx=0 tx=0).stop 2024-09-13T16:10:04.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee1cc18740 1 -- 172.21.15.86:0/1942037918 shutdown_connections 2024-09-13T16:10:04.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee1cc18740 1 --2- 172.21.15.86:0/1942037918 >> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] conn(0x55a96710ccc0 0x55a9671096a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee1cc18740 1 --2- 172.21.15.86:0/1942037918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9670a1500 0x55a9671079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee1cc18740 1 --2- 172.21.15.86:0/1942037918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a96709c470 0x55a9670a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee1cc18740 1 --2- 172.21.15.86:0/1942037918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a96709bb30 0x55a9670a9ab0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee1cc18740 1 -- 172.21.15.86:0/1942037918 >> 172.21.15.86:0/1942037918 conn(0x55a9670971a0 msgr2=0x55a9670a5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee01600640 0 client.15135 ms_handle_reset on v2:172.21.15.194:6838/3799859182 2024-09-13T16:10:04.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee1cc18740 1 -- 172.21.15.86:0/1942037918 shutdown_connections 2024-09-13T16:10:04.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee1cc18740 1 -- 172.21.15.86:0/1942037918 wait complete. 2024-09-13T16:10:04.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee1cc18740 20 client.15135 trim_cache size 0 max 16384 2024-09-13T16:10:04.646 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T16:10:04.646 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "1ecdfbda-71e9-11ef-bceb-c7b262605968", 2024-09-13T16:10:04.646 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 1, 2024-09-13T16:10:04.646 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24544, 2024-09-13T16:10:04.646 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-09-13T16:10:04.646 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-09-13T16:10:04.646 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-09-13T16:10:04.646 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 94.213289884000005, 2024-09-13T16:10:04.646 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 24, 2024-09-13T16:10:04.646 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 94, 2024-09-13T16:10:04.646 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 90, 2024-09-13T16:10:04.646 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 130.168957428 2024-09-13T16:10:04.647 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T16:10:04.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee19e00640 1 -- 172.21.15.86:0/3983752131 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fedf80a1090 msgr2=0x7fedf80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee19e00640 1 --2- 172.21.15.86:0/3983752131 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fedf80a1090 0x7fedf80a3550 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fedfc005ab0 tx=0x7fedfc005a20 comp rx=0 tx=0).stop 2024-09-13T16:10:04.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee19e00640 1 -- 172.21.15.86:0/3983752131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee14101920 msgr2=0x7fee1419f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.647 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee19e00640 1 --2- 172.21.15.86:0/3983752131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee14101920 0x7fee1419f650 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00da10 tx=0x7fee0c00ded0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee19e00640 1 -- 172.21.15.86:0/3983752131 shutdown_connections 2024-09-13T16:10:04.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee19e00640 1 --2- 172.21.15.86:0/3983752131 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fedf80a1090 0x7fedf80a3550 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee19e00640 1 --2- 172.21.15.86:0/3983752131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee14101920 0x7fee1419f650 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee19e00640 1 --2- 172.21.15.86:0/3983752131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee14100f60 0x7fee141985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee19e00640 1 --2- 172.21.15.86:0/3983752131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee140ffd70 0x7fee141980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.639+0000 7fee19e00640 1 -- 172.21.15.86:0/3983752131 >> 172.21.15.86:0/3983752131 conn(0x7fee140fb4d0 msgr2=0x7fee14106730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.640+0000 7fee19e00640 1 -- 172.21.15.86:0/3983752131 shutdown_connections 2024-09-13T16:10:04.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.640+0000 7fee19e00640 1 -- 172.21.15.86:0/3983752131 wait complete. 2024-09-13T16:10:04.657 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T16:10:04.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.810+0000 7f76f0e00640 1 -- 172.21.15.86:0/1728735751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76ec0ffbb0 msgr2=0x7f76ec0fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.810+0000 7f76f0e00640 1 --2- 172.21.15.86:0/1728735751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76ec0ffbb0 0x7f76ec0fffb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009900 tx=0x7f76dc02a3f0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.810+0000 7f76f0e00640 1 -- 172.21.15.86:0/1728735751 shutdown_connections 2024-09-13T16:10:04.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.810+0000 7f76f0e00640 1 --2- 172.21.15.86:0/1728735751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76ec101760 0x7f76ec107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.810+0000 7f76f0e00640 1 --2- 172.21.15.86:0/1728735751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76ec100da0 0x7f76ec101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.810+0000 7f76f0e00640 1 --2- 172.21.15.86:0/1728735751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76ec0ffbb0 0x7f76ec0fffb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.810+0000 7f76f0e00640 1 -- 172.21.15.86:0/1728735751 >> 172.21.15.86:0/1728735751 conn(0x7f76ec0fb330 msgr2=0x7f76ec0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.810+0000 7f76f0e00640 1 -- 172.21.15.86:0/1728735751 shutdown_connections 2024-09-13T16:10:04.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.810+0000 7f76f0e00640 1 -- 172.21.15.86:0/1728735751 wait complete. 2024-09-13T16:10:04.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.811+0000 7f76f0e00640 1 Processor -- start 2024-09-13T16:10:04.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.811+0000 7f76f0e00640 1 -- start start 2024-09-13T16:10:04.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.811+0000 7f76f0e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76ec0ffbb0 0x7f76ec197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.811+0000 7f76f0e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76ec100da0 0x7f76ec198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.811+0000 7f76f0e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76ec101760 0x7f76ec19f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.811+0000 7f76f0e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec19f9b0 con 0x7f76ec0ffbb0 2024-09-13T16:10:04.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.811+0000 7f76f0e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec19fb20 con 0x7f76ec100da0 2024-09-13T16:10:04.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.811+0000 7f76f0e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec19fce0 con 0x7f76ec101760 2024-09-13T16:10:04.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.812+0000 7f76eb400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76ec0ffbb0 0x7f76ec197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.812+0000 7f76eb400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76ec0ffbb0 0x7f76ec197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37086/0 (socket says 172.21.15.86:37086) 2024-09-13T16:10:04.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.812+0000 7f76eb400640 1 -- 172.21.15.86:0/170334615 learned_addr learned my addr 172.21.15.86:0/170334615 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:04.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.812+0000 7f76eaa00640 1 --2- 172.21.15.86:0/170334615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76ec100da0 0x7f76ec198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.812+0000 7f76ebe00640 1 --2- 172.21.15.86:0/170334615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76ec101760 0x7f76ec19f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.812+0000 7f76eb400640 1 -- 172.21.15.86:0/170334615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76ec101760 msgr2=0x7f76ec19f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.812+0000 7f76eb400640 1 --2- 172.21.15.86:0/170334615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76ec101760 0x7f76ec19f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.812+0000 7f76eb400640 1 -- 172.21.15.86:0/170334615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76ec100da0 msgr2=0x7f76ec198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.812+0000 7f76eb400640 1 --2- 172.21.15.86:0/170334615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76ec100da0 0x7f76ec198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.812+0000 7f76eb400640 1 -- 172.21.15.86:0/170334615 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e4009840 con 0x7f76ec0ffbb0 2024-09-13T16:10:04.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.812+0000 7f76eb400640 1 --2- 172.21.15.86:0/170334615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76ec0ffbb0 0x7f76ec197ec0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f76dc031510 tx=0x7f76dc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.812+0000 7f76e3e00640 1 -- 172.21.15.86:0/170334615 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc005000 con 0x7f76ec0ffbb0 2024-09-13T16:10:04.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.813+0000 7f76e3e00640 1 -- 172.21.15.86:0/170334615 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f76dc0046c0 con 0x7f76ec0ffbb0 2024-09-13T16:10:04.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.813+0000 7f76f0e00640 1 -- 172.21.15.86:0/170334615 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76dc009560 con 0x7f76ec0ffbb0 2024-09-13T16:10:04.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.813+0000 7f76e3e00640 1 -- 172.21.15.86:0/170334615 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc003a10 con 0x7f76ec0ffbb0 2024-09-13T16:10:04.817 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.813+0000 7f76f0e00640 1 -- 172.21.15.86:0/170334615 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ec1a01d0 con 0x7f76ec0ffbb0 2024-09-13T16:10:04.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.816+0000 7f76e3e00640 1 -- 172.21.15.86:0/170334615 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f76dc004bc0 con 0x7f76ec0ffbb0 2024-09-13T16:10:04.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.816+0000 7f76f53bc740 1 Processor -- start 2024-09-13T16:10:04.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.816+0000 7f76f53bc740 1 -- start start 2024-09-13T16:10:04.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.816+0000 7f76f53bc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e1515ca0 0x5604e15160a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.816+0000 7f76f53bc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e15165e0 0x5604e151b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.816+0000 7f76f53bc740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e151b670 0x5604e151db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.816+0000 7f76f53bc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e147fab0 con 0x5604e1515ca0 2024-09-13T16:10:04.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.816+0000 7f76f53bc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e147d240 con 0x5604e15165e0 2024-09-13T16:10:04.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.816+0000 7f76f53bc740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e1478b30 con 0x5604e151b670 2024-09-13T16:10:04.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.816+0000 7f76ebe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e1515ca0 0x5604e15160a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.817+0000 7f76ebe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e1515ca0 0x5604e15160a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37098/0 (socket says 172.21.15.86:37098) 2024-09-13T16:10:04.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.817+0000 7f76eaa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e151b670 0x5604e151db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.817+0000 7f76ebe00640 1 -- 172.21.15.86:0/3016425431 learned_addr learned my addr 172.21.15.86:0/3016425431 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:04.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.817+0000 7f76eb400640 1 --2- 172.21.15.86:0/3016425431 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e15165e0 0x5604e151b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.817+0000 7f76ebe00640 1 -- 172.21.15.86:0/3016425431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e151b670 msgr2=0x5604e151db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.817+0000 7f76ebe00640 1 --2- 172.21.15.86:0/3016425431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e151b670 0x5604e151db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.817+0000 7f76ebe00640 1 -- 172.21.15.86:0/3016425431 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e15165e0 msgr2=0x5604e151b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.817+0000 7f76ebe00640 1 --2- 172.21.15.86:0/3016425431 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e15165e0 0x5604e151b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.817+0000 7f76ebe00640 1 -- 172.21.15.86:0/3016425431 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604e1443bd0 con 0x5604e1515ca0 2024-09-13T16:10:04.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.817+0000 7f76eb400640 1 --2- 172.21.15.86:0/3016425431 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e15165e0 0x5604e151b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:10:04.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.817+0000 7f76e3e00640 1 --2- 172.21.15.86:0/170334615 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f76d00a1090 0x7f76d00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.817+0000 7f76ebe00640 1 --2- 172.21.15.86:0/3016425431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e1515ca0 0x5604e15160a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f76e4010590 tx=0x7f76e4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8dec77dd07d9d2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.817+0000 7f76e3e00640 1 -- 172.21.15.86:0/170334615 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f76dc0edbb0 con 0x7f76ec0ffbb0 2024-09-13T16:10:04.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.817+0000 7f76eb400640 1 --2- 172.21.15.86:0/170334615 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f76d00a1090 0x7f76d00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.824 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.818+0000 7f76e0c00640 1 -- 172.21.15.86:0/3016425431 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e400e770 con 0x5604e1515ca0 2024-09-13T16:10:04.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.818+0000 7f76e0c00640 1 -- 172.21.15.86:0/3016425431 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f76e4015070 con 0x5604e1515ca0 2024-09-13T16:10:04.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.818+0000 7f76e0c00640 1 -- 172.21.15.86:0/3016425431 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4011d80 con 0x5604e1515ca0 2024-09-13T16:10:04.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.818+0000 7f76f53bc740 1 -- 172.21.15.86:0/3016425431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e1515ca0 msgr2=0x5604e15160a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.818+0000 7f76eb400640 1 --2- 172.21.15.86:0/170334615 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f76d00a1090 0x7f76d00a3550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0b70e0 tx=0x7f76dc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.818+0000 7f76f53bc740 1 --2- 172.21.15.86:0/3016425431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e1515ca0 0x5604e15160a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f76e4010590 tx=0x7f76e4009f90 comp rx=0 tx=0).stop 2024-09-13T16:10:04.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.818+0000 7f76f53bc740 1 -- 172.21.15.86:0/3016425431 shutdown_connections 2024-09-13T16:10:04.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.818+0000 7f76f53bc740 1 --2- 172.21.15.86:0/3016425431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e151b670 0x5604e151db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.818+0000 7f76f53bc740 1 --2- 172.21.15.86:0/3016425431 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e15165e0 0x5604e151b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.818+0000 7f76f53bc740 1 --2- 172.21.15.86:0/3016425431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e1515ca0 0x5604e15160a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.818+0000 7f76f53bc740 1 -- 172.21.15.86:0/3016425431 >> 172.21.15.86:0/3016425431 conn(0x5604e1511310 msgr2=0x5604e1511710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.819+0000 7f76f53bc740 1 -- 172.21.15.86:0/3016425431 shutdown_connections 2024-09-13T16:10:04.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.819+0000 7f76f53bc740 1 -- 172.21.15.86:0/3016425431 wait complete. 2024-09-13T16:10:04.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.819+0000 7f76f53bc740 1 -- start start 2024-09-13T16:10:04.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.819+0000 7f76f53bc740 1 Processor -- start 2024-09-13T16:10:04.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.819+0000 7f76f53bc740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e1515ca0 0x5604e151f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.819+0000 7f76f53bc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e15165e0 0x5604e151fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.819+0000 7f76f53bc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e151b670 0x5604e1526ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.819+0000 7f76f53bc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e141a260 con 0x5604e15165e0 2024-09-13T16:10:04.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.819+0000 7f76f53bc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e1419f00 con 0x5604e151b670 2024-09-13T16:10:04.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.819+0000 7f76f53bc740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e11dff20 con 0x5604e1515ca0 2024-09-13T16:10:04.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.820+0000 7f76f53bc740 10 client.0 _ll_register_callbacks cb 0x5604e14721a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:04.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.820+0000 7f76eaa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e15165e0 0x5604e151fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.820+0000 7f76ebe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e1515ca0 0x5604e151f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.820+0000 7f76eaa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e15165e0 0x5604e151fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37114/0 (socket says 172.21.15.86:37114) 2024-09-13T16:10:04.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.820+0000 7f76ebe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e1515ca0 0x5604e151f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:34554/0 (socket says 172.21.15.86:34554) 2024-09-13T16:10:04.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.820+0000 7f76eaa00640 1 -- 172.21.15.86:0/2339839046 learned_addr learned my addr 172.21.15.86:0/2339839046 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:04.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.820+0000 7f76ebe00640 1 --2- 172.21.15.86:0/2339839046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e151b670 0x5604e1526ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.820+0000 7f76eaa00640 1 -- 172.21.15.86:0/2339839046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e1515ca0 msgr2=0x5604e151f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.820+0000 7f76eaa00640 1 --2- 172.21.15.86:0/2339839046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e1515ca0 0x5604e151f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.820+0000 7f76eaa00640 1 -- 172.21.15.86:0/2339839046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e151b670 msgr2=0x5604e1526ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.820+0000 7f76eaa00640 1 --2- 172.21.15.86:0/2339839046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e151b670 0x5604e1526ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.820+0000 7f76eaa00640 1 -- 172.21.15.86:0/2339839046 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e4009e00 con 0x5604e15165e0 2024-09-13T16:10:04.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.820+0000 7f76ebe00640 1 --2- 172.21.15.86:0/2339839046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e151b670 0x5604e1526ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:10:04.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.820+0000 7f76eaa00640 1 --2- 172.21.15.86:0/2339839046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e15165e0 0x5604e151fe90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f76d8012720 tx=0x7f76d8012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404bf04e71eca918 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.820+0000 7f76d5600640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T16:10:04.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.821+0000 7f76d5600640 1 -- 172.21.15.86:0/2339839046 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d8017070 con 0x5604e15165e0 2024-09-13T16:10:04.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.821+0000 7f76d5600640 1 -- 172.21.15.86:0/2339839046 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f76d800f920 con 0x5604e15165e0 2024-09-13T16:10:04.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.821+0000 7f76f53bc740 1 -- 172.21.15.86:0/2339839046 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604e14a2cd0 con 0x5604e15165e0 2024-09-13T16:10:04.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.821+0000 7f76d5600640 1 -- 172.21.15.86:0/2339839046 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76d800fae0 con 0x5604e15165e0 2024-09-13T16:10:04.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.821+0000 7f76f53bc740 10 client.15147 fetch_fsmap learned FSMap version 24 2024-09-13T16:10:04.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.821+0000 7f76f53bc740 1 -- 172.21.15.86:0/2339839046 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5604e14771b0 con 0x5604e15165e0 2024-09-13T16:10:04.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.821+0000 7f76d5600640 1 -- 172.21.15.86:0/2339839046 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5604e14a2cd0 con 0x5604e15165e0 2024-09-13T16:10:04.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.821+0000 7f76d5600640 1 -- 172.21.15.86:0/2339839046 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f76d801c420 con 0x5604e15165e0 2024-09-13T16:10:04.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.821+0000 7f76f53bc740 10 client.15147 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:10:04.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.821+0000 7f76f53bc740 10 client.15147 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T16:10:04.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.821+0000 7f76f53bc740 20 client.15147 populate_metadata read hostname 'smithi086' 2024-09-13T16:10:04.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.821+0000 7f76f53bc740 1 --2- 172.21.15.86:0/2339839046 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5604e152b400 0x5604e15300a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.822+0000 7f76f53bc740 4 client.15147 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:10:04.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.822+0000 7f76f53bc740 1 -- 172.21.15.86:0/2339839046 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604e116c3c0 con 0x5604e152b400 2024-09-13T16:10:04.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.822+0000 7f76ebe00640 1 --2- 172.21.15.86:0/2339839046 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5604e152b400 0x5604e15300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.822+0000 7f76ebe00640 1 --2- 172.21.15.86:0/2339839046 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5604e152b400 0x5604e15300a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dff2eade0a6b3606 server_cookie=ea03e39da29d2634 in_seq=0 out_seq=0 2024-09-13T16:10:04.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.822+0000 7f76d5600640 10 client.15147 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:10:04.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.823+0000 7f76d5600640 1 -- 172.21.15.86:0/2339839046 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5604e116c3c0 con 0x5604e152b400 2024-09-13T16:10:04.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.823+0000 7f76d5600640 10 client.15147 handle_command_reply: tid=0 2024-09-13T16:10:04.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.823+0000 7f76f53bc740 1 client.15147 shutdown 2024-09-13T16:10:04.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.823+0000 7f76f53bc740 1 -- 172.21.15.86:0/2339839046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e15165e0 msgr2=0x5604e151fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.823+0000 7f76f53bc740 1 --2- 172.21.15.86:0/2339839046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e15165e0 0x5604e151fe90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f76d8012720 tx=0x7f76d8012be0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.824+0000 7f76f53bc740 1 -- 172.21.15.86:0/2339839046 shutdown_connections 2024-09-13T16:10:04.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.824+0000 7f76f53bc740 1 --2- 172.21.15.86:0/2339839046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e151b670 0x5604e1526ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.824+0000 7f76f53bc740 1 --2- 172.21.15.86:0/2339839046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e15165e0 0x5604e151fe90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.824+0000 7f76f53bc740 1 --2- 172.21.15.86:0/2339839046 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5604e152b400 0x5604e15300a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.824+0000 7f76f53bc740 1 --2- 172.21.15.86:0/2339839046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e1515ca0 0x5604e151f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.824+0000 7f76d5600640 0 client.15147 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:10:04.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.824+0000 7f76f53bc740 1 -- 172.21.15.86:0/2339839046 >> 172.21.15.86:0/2339839046 conn(0x5604e1511310 msgr2=0x5604e1510650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.824+0000 7f76f53bc740 1 -- 172.21.15.86:0/2339839046 shutdown_connections 2024-09-13T16:10:04.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.824+0000 7f76f53bc740 1 -- 172.21.15.86:0/2339839046 wait complete. 2024-09-13T16:10:04.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.824+0000 7f76f53bc740 20 client.15147 trim_cache size 0 max 16384 2024-09-13T16:10:04.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.839+0000 7f76f53bc740 1 Processor -- start 2024-09-13T16:10:04.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.839+0000 7f76f53bc740 1 -- start start 2024-09-13T16:10:04.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.839+0000 7f76f53bc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e1515ca0 0x5604e1527940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.839+0000 7f76f53bc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e15165e0 0x5604e1526e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.839+0000 7f76f53bc740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e151b670 0x5604e151fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.839+0000 7f76f53bc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e1520b40 con 0x5604e1515ca0 2024-09-13T16:10:04.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.839+0000 7f76f53bc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e14718d0 con 0x5604e15165e0 2024-09-13T16:10:04.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.839+0000 7f76f53bc740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e14142f0 con 0x5604e151b670 2024-09-13T16:10:04.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.840+0000 7f76ebe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e1515ca0 0x5604e1527940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.840+0000 7f76eaa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e15165e0 0x5604e1526e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.840+0000 7f76eaa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e15165e0 0x5604e1526e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:54404/0 (socket says 172.21.15.86:54404) 2024-09-13T16:10:04.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.840+0000 7f76ebe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e1515ca0 0x5604e1527940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37122/0 (socket says 172.21.15.86:37122) 2024-09-13T16:10:04.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.840+0000 7f76eaa00640 1 -- 172.21.15.86:0/4135389141 learned_addr learned my addr 172.21.15.86:0/4135389141 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:04.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.840+0000 7f76ebe00640 1 --2- 172.21.15.86:0/4135389141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e151b670 0x5604e151fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.840+0000 7f76eaa00640 1 -- 172.21.15.86:0/4135389141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e151b670 msgr2=0x5604e151fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.840+0000 7f76eaa00640 1 --2- 172.21.15.86:0/4135389141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e151b670 0x5604e151fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.840+0000 7f76eaa00640 1 -- 172.21.15.86:0/4135389141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e1515ca0 msgr2=0x5604e1527940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.840+0000 7f76eaa00640 1 --2- 172.21.15.86:0/4135389141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e1515ca0 0x5604e1527940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.840+0000 7f76eaa00640 1 -- 172.21.15.86:0/4135389141 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604e1419470 con 0x5604e15165e0 2024-09-13T16:10:04.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.840+0000 7f76ebe00640 1 --2- 172.21.15.86:0/4135389141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e1515ca0 0x5604e1527940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:04.843 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.840+0000 7f76eaa00640 1 --2- 172.21.15.86:0/4135389141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e15165e0 0x5604e1526e90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f76d8000c00 tx=0x7f76d8009ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55ebec84103b48e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.840+0000 7f76e1600640 1 -- 172.21.15.86:0/4135389141 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d8017040 con 0x5604e15165e0 2024-09-13T16:10:04.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.841+0000 7f76e1600640 1 -- 172.21.15.86:0/4135389141 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f76d800f920 con 0x5604e15165e0 2024-09-13T16:10:04.844 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.841+0000 7f76e1600640 1 -- 172.21.15.86:0/4135389141 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d80054d0 con 0x5604e15165e0 2024-09-13T16:10:04.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.841+0000 7f76f53bc740 1 -- 172.21.15.86:0/4135389141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e15165e0 msgr2=0x5604e1526e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.841+0000 7f76f53bc740 1 --2- 172.21.15.86:0/4135389141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e15165e0 0x5604e1526e90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f76d8000c00 tx=0x7f76d8009ec0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.841+0000 7f76f53bc740 1 -- 172.21.15.86:0/4135389141 shutdown_connections 2024-09-13T16:10:04.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.841+0000 7f76f53bc740 1 --2- 172.21.15.86:0/4135389141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e151b670 0x5604e151fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.841+0000 7f76f53bc740 1 --2- 172.21.15.86:0/4135389141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e15165e0 0x5604e1526e90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.841+0000 7f76f53bc740 1 --2- 172.21.15.86:0/4135389141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e1515ca0 0x5604e1527940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.841+0000 7f76f53bc740 1 -- 172.21.15.86:0/4135389141 >> 172.21.15.86:0/4135389141 conn(0x5604e1511310 msgr2=0x5604e151f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.841+0000 7f76f53bc740 1 -- 172.21.15.86:0/4135389141 shutdown_connections 2024-09-13T16:10:04.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.841+0000 7f76f53bc740 1 -- 172.21.15.86:0/4135389141 wait complete. 2024-09-13T16:10:04.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.842+0000 7f76f53bc740 1 -- start start 2024-09-13T16:10:04.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.842+0000 7f76f53bc740 1 Processor -- start 2024-09-13T16:10:04.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.842+0000 7f76f53bc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e1515ca0 0x5604e1523d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.842+0000 7f76f53bc740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e15165e0 0x5604e1524260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.842+0000 7f76f53bc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e151b670 0x5604e1581d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.842+0000 7f76f53bc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e1524820 con 0x5604e151b670 2024-09-13T16:10:04.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.842+0000 7f76f53bc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e1524990 con 0x5604e1515ca0 2024-09-13T16:10:04.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.842+0000 7f76f53bc740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e1582320 con 0x5604e15165e0 2024-09-13T16:10:04.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.842+0000 7f76f53bc740 10 client.0 _ll_register_callbacks cb 0x7f76d8009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:04.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.842+0000 7f76ebe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e1515ca0 0x5604e1523d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.842+0000 7f76eaa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e15165e0 0x5604e1524260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.849 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.843+0000 7f76eaa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e15165e0 0x5604e1524260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:34574/0 (socket says 172.21.15.86:34574) 2024-09-13T16:10:04.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.843+0000 7f76eaa00640 1 -- 172.21.15.86:0/520344138 learned_addr learned my addr 172.21.15.86:0/520344138 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:04.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.843+0000 7f76ebe00640 1 --2- 172.21.15.86:0/520344138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e151b670 0x5604e1581d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.843+0000 7f76eaa00640 1 -- 172.21.15.86:0/520344138 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e1515ca0 msgr2=0x5604e1523d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.843+0000 7f76eaa00640 1 --2- 172.21.15.86:0/520344138 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e1515ca0 0x5604e1523d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.843+0000 7f76eaa00640 1 -- 172.21.15.86:0/520344138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e151b670 msgr2=0x5604e1581d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:04.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.843+0000 7f76eaa00640 1 --2- 172.21.15.86:0/520344138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e151b670 0x5604e1581d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.843+0000 7f76eaa00640 1 -- 172.21.15.86:0/520344138 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604e1443bd0 con 0x5604e15165e0 2024-09-13T16:10:04.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.843+0000 7f76eaa00640 1 --2- 172.21.15.86:0/520344138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e15165e0 0x5604e1524260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76d801c000 tx=0x7f76d80123a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d97a4a3a717f09a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:04.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.843+0000 7f76d5600640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-13T16:10:04.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.843+0000 7f76d5600640 1 -- 172.21.15.86:0/520344138 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d8017040 con 0x5604e15165e0 2024-09-13T16:10:04.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.843+0000 7f76f53bc740 1 -- 172.21.15.86:0/520344138 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f76e4015070 con 0x5604e15165e0 2024-09-13T16:10:04.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.843+0000 7f76d5600640 1 -- 172.21.15.86:0/520344138 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f76d8000e40 con 0x5604e15165e0 2024-09-13T16:10:04.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.844+0000 7f76d5600640 1 -- 172.21.15.86:0/520344138 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76d801cc00 con 0x5604e15165e0 2024-09-13T16:10:04.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.844+0000 7f76f53bc740 10 client.25195 fetch_fsmap learned FSMap version 24 2024-09-13T16:10:04.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.844+0000 7f76f53bc740 1 -- 172.21.15.86:0/520344138 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5604e14771b0 con 0x5604e15165e0 2024-09-13T16:10:04.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.844+0000 7f76d5600640 1 -- 172.21.15.86:0/520344138 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f76e4015070 con 0x5604e15165e0 2024-09-13T16:10:04.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.844+0000 7f76d5600640 1 -- 172.21.15.86:0/520344138 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f76d8003a60 con 0x5604e15165e0 2024-09-13T16:10:04.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.844+0000 7f76f53bc740 10 client.25195 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:10:04.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.844+0000 7f76f53bc740 10 client.25195 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T16:10:04.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.844+0000 7f76f53bc740 20 client.25195 populate_metadata read hostname 'smithi086' 2024-09-13T16:10:04.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.844+0000 7f76f53bc740 1 --2- 172.21.15.86:0/520344138 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5604e1586eb0 0x5604e1583890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:04.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.844+0000 7f76f53bc740 4 client.25195 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T16:10:04.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.844+0000 7f76f53bc740 1 -- 172.21.15.86:0/520344138 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5604e117d6c0 con 0x5604e1586eb0 2024-09-13T16:10:04.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.844+0000 7f76ebe00640 1 --2- 172.21.15.86:0/520344138 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5604e1586eb0 0x5604e1583890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:04.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.845+0000 7f76ebe00640 1 --2- 172.21.15.86:0/520344138 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5604e1586eb0 0x5604e1583890 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e623b8484da3db03 server_cookie=4953177ab70b965 in_seq=0 out_seq=0 2024-09-13T16:10:04.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.845+0000 7f76d5600640 10 client.25195 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:10:04.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.845+0000 7f76d5600640 1 -- 172.21.15.86:0/520344138 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x5604e117d6c0 con 0x5604e1586eb0 2024-09-13T16:10:04.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.845+0000 7f76d5600640 10 client.25195 handle_command_reply: tid=0 2024-09-13T16:10:04.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.845+0000 7f76f53bc740 1 client.25195 shutdown 2024-09-13T16:10:04.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.845+0000 7f76f53bc740 1 -- 172.21.15.86:0/520344138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e15165e0 msgr2=0x5604e1524260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.845+0000 7f76f53bc740 1 --2- 172.21.15.86:0/520344138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e15165e0 0x5604e1524260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76d801c000 tx=0x7f76d80123a0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.845+0000 7f76f53bc740 1 -- 172.21.15.86:0/520344138 shutdown_connections 2024-09-13T16:10:04.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.845+0000 7f76f53bc740 1 --2- 172.21.15.86:0/520344138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e151b670 0x5604e1581d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.845+0000 7f76f53bc740 1 --2- 172.21.15.86:0/520344138 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5604e1586eb0 0x5604e1583890 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.845+0000 7f76f53bc740 1 --2- 172.21.15.86:0/520344138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604e15165e0 0x5604e1524260 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.845+0000 7f76f53bc740 1 --2- 172.21.15.86:0/520344138 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604e1515ca0 0x5604e1523d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.845+0000 7f76f53bc740 1 -- 172.21.15.86:0/520344138 >> 172.21.15.86:0/520344138 conn(0x5604e1511310 msgr2=0x5604e15340c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.845+0000 7f76d5600640 0 client.25195 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:10:04.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.845+0000 7f76f53bc740 1 -- 172.21.15.86:0/520344138 shutdown_connections 2024-09-13T16:10:04.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.846+0000 7f76f53bc740 1 -- 172.21.15.86:0/520344138 wait complete. 2024-09-13T16:10:04.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.846+0000 7f76f53bc740 20 client.25195 trim_cache size 0 max 16384 2024-09-13T16:10:04.853 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T16:10:04.853 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "1ecdfbda-71e9-11ef-bceb-c7b262605968", 2024-09-13T16:10:04.853 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2024-09-13T16:10:04.853 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24581, 2024-09-13T16:10:04.853 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-09-13T16:10:04.853 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-09-13T16:10:04.853 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-09-13T16:10:04.853 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 115.640592226, 2024-09-13T16:10:04.854 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 24, 2024-09-13T16:10:04.854 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 94, 2024-09-13T16:10:04.854 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 90, 2024-09-13T16:10:04.854 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 120.928350047 2024-09-13T16:10:04.854 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T16:10:04.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.846+0000 7f76f0e00640 1 -- 172.21.15.86:0/170334615 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f76d00a1090 msgr2=0x7f76d00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.846+0000 7f76f0e00640 1 --2- 172.21.15.86:0/170334615 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f76d00a1090 0x7f76d00a3550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0b70e0 tx=0x7f76dc009260 comp rx=0 tx=0).stop 2024-09-13T16:10:04.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.846+0000 7f76f0e00640 1 -- 172.21.15.86:0/170334615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76ec0ffbb0 msgr2=0x7f76ec197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:04.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.846+0000 7f76f0e00640 1 --2- 172.21.15.86:0/170334615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76ec0ffbb0 0x7f76ec197ec0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f76dc031510 tx=0x7f76dc004270 comp rx=0 tx=0).stop 2024-09-13T16:10:04.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.846+0000 7f76f0e00640 1 -- 172.21.15.86:0/170334615 shutdown_connections 2024-09-13T16:10:04.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.846+0000 7f76f0e00640 1 --2- 172.21.15.86:0/170334615 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f76d00a1090 0x7f76d00a3550 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.846+0000 7f76f0e00640 1 --2- 172.21.15.86:0/170334615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76ec101760 0x7f76ec19f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.846+0000 7f76f0e00640 1 --2- 172.21.15.86:0/170334615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76ec100da0 0x7f76ec198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.846+0000 7f76f0e00640 1 --2- 172.21.15.86:0/170334615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76ec0ffbb0 0x7f76ec197ec0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:04.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.846+0000 7f76f0e00640 1 -- 172.21.15.86:0/170334615 >> 172.21.15.86:0/170334615 conn(0x7f76ec0fb330 msgr2=0x7f76ec0726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:04.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.846+0000 7f76f0e00640 1 -- 172.21.15.86:0/170334615 shutdown_connections 2024-09-13T16:10:04.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:04.846+0000 7f76f0e00640 1 -- 172.21.15.86:0/170334615 wait complete. 2024-09-13T16:10:04.861 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:04 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/317066329' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:10:04.861 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:04 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2398768806' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:10:04.863 INFO:tasks.cephadm:Setup complete, yielding 2024-09-13T16:10:04.863 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T16:10:04.873 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T16:10:04.874 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-13T16:10:04.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:04 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/317066329' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:10:04.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:04 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2398768806' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:10:05.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:04 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/317066329' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:10:05.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:04 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2398768806' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:10:05.187 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:10:05.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:05 smithi139 ceph-mon[35320]: pgmap v357: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 639 B/s wr, 5 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-13T16:10:06.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:05 smithi194 ceph-mon[35694]: pgmap v357: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 639 B/s wr, 5 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-13T16:10:06.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:05 smithi086 ceph-mon[30379]: pgmap v357: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 639 B/s wr, 5 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-13T16:10:06.843 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:06 smithi086 ceph-mon[30379]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-13T16:10:06.843 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:06 smithi086 ceph-mon[30379]: Cluster is now healthy 2024-09-13T16:10:06.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:06 smithi139 ceph-mon[35320]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-13T16:10:06.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:06 smithi139 ceph-mon[35320]: Cluster is now healthy 2024-09-13T16:10:07.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:06 smithi194 ceph-mon[35694]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-13T16:10:07.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:06 smithi194 ceph-mon[35694]: Cluster is now healthy 2024-09-13T16:10:07.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.212+0000 7f4944a00640 1 -- 172.21.15.86:0/2473047377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49400fde70 msgr2=0x7f49400fe270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:07.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.212+0000 7f4944a00640 1 --2- 172.21.15.86:0/2473047377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49400fde70 0x7f49400fe270 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4930009900 tx=0x7f493002a410 comp rx=0 tx=0).stop 2024-09-13T16:10:07.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.212+0000 7f4944a00640 1 -- 172.21.15.86:0/2473047377 shutdown_connections 2024-09-13T16:10:07.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.212+0000 7f4944a00640 1 --2- 172.21.15.86:0/2473047377 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49400ff510 0x7f49400ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:07.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.212+0000 7f4944a00640 1 --2- 172.21.15.86:0/2473047377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4940067220 0x7f49400fefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:07.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.212+0000 7f4944a00640 1 --2- 172.21.15.86:0/2473047377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49400fde70 0x7f49400fe270 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:07.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.212+0000 7f4944a00640 1 -- 172.21.15.86:0/2473047377 >> 172.21.15.86:0/2473047377 conn(0x7f49400f9600 msgr2=0x7f49400fba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:07.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.212+0000 7f4944a00640 1 -- 172.21.15.86:0/2473047377 shutdown_connections 2024-09-13T16:10:07.215 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.212+0000 7f4944a00640 1 -- 172.21.15.86:0/2473047377 wait complete. 2024-09-13T16:10:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.213+0000 7f4944a00640 1 Processor -- start 2024-09-13T16:10:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.213+0000 7f4944a00640 1 -- start start 2024-09-13T16:10:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.213+0000 7f4944a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4940067220 0x7f4940197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.213+0000 7f4944a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49400fde70 0x7f4940198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.214+0000 7f4944a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49400ff510 0x7f494019f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.214+0000 7f4944a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494019fa30 con 0x7f49400fde70 2024-09-13T16:10:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.214+0000 7f4944a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494019fba0 con 0x7f4940067220 2024-09-13T16:10:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.214+0000 7f4944a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494019fd60 con 0x7f49400ff510 2024-09-13T16:10:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.214+0000 7f4936a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49400fde70 0x7f4940198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.214+0000 7f493f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4940067220 0x7f4940197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.214+0000 7f4936a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49400fde70 0x7f4940198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37158/0 (socket says 172.21.15.86:37158) 2024-09-13T16:10:07.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.214+0000 7f4936a00640 1 -- 172.21.15.86:0/3319179900 learned_addr learned my addr 172.21.15.86:0/3319179900 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:07.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.214+0000 7f493fe00640 1 --2- 172.21.15.86:0/3319179900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49400ff510 0x7f494019f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.214+0000 7f493f400640 1 -- 172.21.15.86:0/3319179900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49400ff510 msgr2=0x7f494019f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.214+0000 7f493f400640 1 --2- 172.21.15.86:0/3319179900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49400ff510 0x7f494019f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.214+0000 7f493f400640 1 -- 172.21.15.86:0/3319179900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49400fde70 msgr2=0x7f4940198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.214+0000 7f493f400640 1 --2- 172.21.15.86:0/3319179900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49400fde70 0x7f4940198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.214+0000 7f493f400640 1 -- 172.21.15.86:0/3319179900 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4930009560 con 0x7f4940067220 2024-09-13T16:10:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.214+0000 7f493fe00640 1 --2- 172.21.15.86:0/3319179900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49400ff510 0x7f494019f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.215+0000 7f493f400640 1 --2- 172.21.15.86:0/3319179900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4940067220 0x7f4940197f30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f493002a930 tx=0x7f49300055a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:07.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.215+0000 7f493cc00640 1 -- 172.21.15.86:0/3319179900 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4930004b50 con 0x7f4940067220 2024-09-13T16:10:07.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.215+0000 7f4944a00640 1 -- 172.21.15.86:0/3319179900 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494019ffe0 con 0x7f4940067220 2024-09-13T16:10:07.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.215+0000 7f493cc00640 1 -- 172.21.15.86:0/3319179900 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4930004cb0 con 0x7f4940067220 2024-09-13T16:10:07.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.215+0000 7f493cc00640 1 -- 172.21.15.86:0/3319179900 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4930031b30 con 0x7f4940067220 2024-09-13T16:10:07.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.215+0000 7f4944a00640 1 -- 172.21.15.86:0/3319179900 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49401a0390 con 0x7f4940067220 2024-09-13T16:10:07.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.216+0000 7f4944a00640 1 -- 172.21.15.86:0/3319179900 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49401049b0 con 0x7f4940067220 2024-09-13T16:10:07.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.218+0000 7f493cc00640 1 -- 172.21.15.86:0/3319179900 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4930031c90 con 0x7f4940067220 2024-09-13T16:10:07.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.219+0000 7f493cc00640 1 --2- 172.21.15.86:0/3319179900 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f49240a10a0 0x7f49240a3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:07.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.219+0000 7f493cc00640 1 -- 172.21.15.86:0/3319179900 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f49300edcf0 con 0x7f4940067220 2024-09-13T16:10:07.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.220+0000 7f4936a00640 1 --2- 172.21.15.86:0/3319179900 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f49240a10a0 0x7f49240a3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:07.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.220+0000 7f4936a00640 1 --2- 172.21.15.86:0/3319179900 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f49240a10a0 0x7f49240a3560 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4940199450 tx=0x7f4928005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.222+0000 7f493cc00640 1 -- 172.21.15.86:0/3319179900 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f49300b7110 con 0x7f4940067220 2024-09-13T16:10:07.407 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.405+0000 7f4944a00640 1 -- 172.21.15.86:0/3319179900 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f494002c520 con 0x7f49240a10a0 2024-09-13T16:10:07.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.406+0000 7f493cc00640 1 -- 172.21.15.86:0/3319179900 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f494002c520 con 0x7f49240a10a0 2024-09-13T16:10:07.408 INFO:teuthology.orchestra.run.smithi086.stdout:Backend: cephadm 2024-09-13T16:10:07.408 INFO:teuthology.orchestra.run.smithi086.stdout:Available: Yes 2024-09-13T16:10:07.408 INFO:teuthology.orchestra.run.smithi086.stdout:Paused: No 2024-09-13T16:10:07.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.409+0000 7f4944a00640 1 -- 172.21.15.86:0/3319179900 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f49240a10a0 msgr2=0x7f49240a3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:07.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.409+0000 7f4944a00640 1 --2- 172.21.15.86:0/3319179900 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f49240a10a0 0x7f49240a3560 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4940199450 tx=0x7f4928005f90 comp rx=0 tx=0).stop 2024-09-13T16:10:07.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.409+0000 7f4944a00640 1 -- 172.21.15.86:0/3319179900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4940067220 msgr2=0x7f4940197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:07.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.409+0000 7f4944a00640 1 --2- 172.21.15.86:0/3319179900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4940067220 0x7f4940197f30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f493002a930 tx=0x7f49300055a0 comp rx=0 tx=0).stop 2024-09-13T16:10:07.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.409+0000 7f4944a00640 1 -- 172.21.15.86:0/3319179900 shutdown_connections 2024-09-13T16:10:07.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.409+0000 7f4944a00640 1 --2- 172.21.15.86:0/3319179900 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f49240a10a0 0x7f49240a3560 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:07.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.409+0000 7f4944a00640 1 --2- 172.21.15.86:0/3319179900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49400ff510 0x7f494019f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:07.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.409+0000 7f4944a00640 1 --2- 172.21.15.86:0/3319179900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49400fde70 0x7f4940198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:07.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.409+0000 7f4944a00640 1 --2- 172.21.15.86:0/3319179900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4940067220 0x7f4940197f30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:07.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.409+0000 7f4944a00640 1 -- 172.21.15.86:0/3319179900 >> 172.21.15.86:0/3319179900 conn(0x7f49400f9600 msgr2=0x7f49400fb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:07.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.409+0000 7f4944a00640 1 -- 172.21.15.86:0/3319179900 shutdown_connections 2024-09-13T16:10:07.412 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:07.409+0000 7f4944a00640 1 -- 172.21.15.86:0/3319179900 wait complete. 2024-09-13T16:10:07.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:07 smithi139 ceph-mon[35320]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 639 B/s wr, 7 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-13T16:10:07.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:07 smithi139 ceph-mon[35320]: from='client.25196 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:10:08.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:07 smithi194 ceph-mon[35694]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 639 B/s wr, 7 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-13T16:10:08.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:07 smithi194 ceph-mon[35694]: from='client.25196 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:10:08.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:07 smithi086 ceph-mon[30379]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 639 B/s wr, 7 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-13T16:10:08.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:07 smithi086 ceph-mon[30379]: from='client.25196 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:10:08.231 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-13T16:10:08.547 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:10:10.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.519+0000 7f6d34c00640 1 -- 172.21.15.86:0/1606881151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d30103210 msgr2=0x7f6d30103690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:10.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.519+0000 7f6d34c00640 1 --2- 172.21.15.86:0/1606881151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d30103210 0x7f6d30103690 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c009900 tx=0x7f6d1c02a410 comp rx=0 tx=0).stop 2024-09-13T16:10:10.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.519+0000 7f6d34c00640 1 -- 172.21.15.86:0/1606881151 shutdown_connections 2024-09-13T16:10:10.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.519+0000 7f6d34c00640 1 --2- 172.21.15.86:0/1606881151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d30103bd0 0x7f6d3010a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:10.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.519+0000 7f6d34c00640 1 --2- 172.21.15.86:0/1606881151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d30103210 0x7f6d30103690 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:10.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.519+0000 7f6d34c00640 1 --2- 172.21.15.86:0/1606881151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d30102010 0x7f6d30102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:10.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.519+0000 7f6d34c00640 1 -- 172.21.15.86:0/1606881151 >> 172.21.15.86:0/1606881151 conn(0x7f6d300fd7a0 msgr2=0x7f6d300ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:10.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.519+0000 7f6d34c00640 1 -- 172.21.15.86:0/1606881151 shutdown_connections 2024-09-13T16:10:10.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.519+0000 7f6d34c00640 1 -- 172.21.15.86:0/1606881151 wait complete. 2024-09-13T16:10:10.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.520+0000 7f6d34c00640 1 Processor -- start 2024-09-13T16:10:10.526 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.520+0000 7f6d34c00640 1 -- start start 2024-09-13T16:10:10.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.520+0000 7f6d34c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d30102010 0x7f6d301980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:10.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.520+0000 7f6d34c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d30103210 0x7f6d30198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:10.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.520+0000 7f6d34c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d30103bd0 0x7f6d3019f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:10.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.520+0000 7f6d34c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3019fbf0 con 0x7f6d30103210 2024-09-13T16:10:10.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.520+0000 7f6d34c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3019fd60 con 0x7f6d30102010 2024-09-13T16:10:10.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.520+0000 7f6d34c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3019ff20 con 0x7f6d30103bd0 2024-09-13T16:10:10.527 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.521+0000 7f6d2d400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d30103210 0x7f6d30198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:10.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.521+0000 7f6d2de00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d30102010 0x7f6d301980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:10.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.521+0000 7f6d2de00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d30102010 0x7f6d301980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:54440/0 (socket says 172.21.15.86:54440) 2024-09-13T16:10:10.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.521+0000 7f6d2d400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d30103210 0x7f6d30198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37172/0 (socket says 172.21.15.86:37172) 2024-09-13T16:10:10.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.521+0000 7f6d2de00640 1 -- 172.21.15.86:0/3261646043 learned_addr learned my addr 172.21.15.86:0/3261646043 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:10.528 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.521+0000 7f6d2e800640 1 --2- 172.21.15.86:0/3261646043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d30103bd0 0x7f6d3019f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:10.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.521+0000 7f6d2de00640 1 -- 172.21.15.86:0/3261646043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d30103bd0 msgr2=0x7f6d3019f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:10.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.521+0000 7f6d2de00640 1 --2- 172.21.15.86:0/3261646043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d30103bd0 0x7f6d3019f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:10.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.521+0000 7f6d2de00640 1 -- 172.21.15.86:0/3261646043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d30103210 msgr2=0x7f6d30198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:10.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.521+0000 7f6d2de00640 1 --2- 172.21.15.86:0/3261646043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d30103210 0x7f6d30198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:10.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.521+0000 7f6d2de00640 1 -- 172.21.15.86:0/3261646043 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c009560 con 0x7f6d30102010 2024-09-13T16:10:10.529 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.522+0000 7f6d2de00640 1 --2- 172.21.15.86:0/3261646043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d30102010 0x7f6d301980f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d2000e9c0 tx=0x7f6d2000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:10.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.522+0000 7f6d26a00640 1 -- 172.21.15.86:0/3261646043 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d20009700 con 0x7f6d30102010 2024-09-13T16:10:10.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.522+0000 7f6d34c00640 1 -- 172.21.15.86:0/3261646043 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d301a0200 con 0x7f6d30102010 2024-09-13T16:10:10.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.522+0000 7f6d26a00640 1 -- 172.21.15.86:0/3261646043 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6d2000cd80 con 0x7f6d30102010 2024-09-13T16:10:10.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.522+0000 7f6d26a00640 1 -- 172.21.15.86:0/3261646043 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d20010430 con 0x7f6d30102010 2024-09-13T16:10:10.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.522+0000 7f6d34c00640 1 -- 172.21.15.86:0/3261646043 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d301a06d0 con 0x7f6d30102010 2024-09-13T16:10:10.530 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.523+0000 7f6d34c00640 1 -- 172.21.15.86:0/3261646043 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d30109430 con 0x7f6d30102010 2024-09-13T16:10:10.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.525+0000 7f6d26a00640 1 -- 172.21.15.86:0/3261646043 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6d20003680 con 0x7f6d30102010 2024-09-13T16:10:10.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.526+0000 7f6d26a00640 1 --2- 172.21.15.86:0/3261646043 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6d140a10b0 0x7f6d140a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:10.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.526+0000 7f6d26a00640 1 -- 172.21.15.86:0/3261646043 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f6d20014070 con 0x7f6d30102010 2024-09-13T16:10:10.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.526+0000 7f6d2d400640 1 --2- 172.21.15.86:0/3261646043 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6d140a10b0 0x7f6d140a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:10.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.527+0000 7f6d2d400640 1 --2- 172.21.15.86:0/3261646043 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6d140a10b0 0x7f6d140a3570 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c005ab0 tx=0x7f6d1c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:10.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.530+0000 7f6d26a00640 1 -- 172.21.15.86:0/3261646043 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6d20096490 con 0x7f6d30102010 2024-09-13T16:10:10.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.708+0000 7f6d34c00640 1 -- 172.21.15.86:0/3261646043 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d3002c480 con 0x7f6d140a10b0 2024-09-13T16:10:10.710 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:10 smithi086 ceph-mon[30379]: pgmap v359: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 422 B/s wr, 6 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-13T16:10:10.724 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.723+0000 7f6d26a00640 1 -- 172.21.15.86:0/3261646043 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4061 (secure 0 0 0) 0x7f6d3002c480 con 0x7f6d140a10b0 2024-09-13T16:10:10.725 INFO:teuthology.orchestra.run.smithi086.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T16:10:10.725 INFO:teuthology.orchestra.run.smithi086.stdout:mds.a smithi086 running (2m) 34s ago 2m 12.5M - 18.2.4-850-g50bbe7f3 152d8bc6b19e c0475bdd96af 2024-09-13T16:10:10.725 INFO:teuthology.orchestra.run.smithi086.stdout:mds.b smithi139 running (2m) 60s ago 2m 26.2M - 18.2.4-850-g50bbe7f3 152d8bc6b19e b2ac54377799 2024-09-13T16:10:10.725 INFO:teuthology.orchestra.run.smithi086.stdout:mds.c smithi194 running (2m) 60s ago 2m 17.2M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 517ce15e54ba 2024-09-13T16:10:10.725 INFO:teuthology.orchestra.run.smithi086.stdout:mds.d smithi086 running (2m) 34s ago 2m 12.7M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 4e34b5dbcd75 2024-09-13T16:10:10.725 INFO:teuthology.orchestra.run.smithi086.stdout:mds.e smithi139 running (2m) 60s ago 2m 16.5M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 3be8561daa2e 2024-09-13T16:10:10.725 INFO:teuthology.orchestra.run.smithi086.stdout:mds.f smithi194 running (2m) 60s ago 2m 18.5M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 0154c4ab9fa0 2024-09-13T16:10:10.725 INFO:teuthology.orchestra.run.smithi086.stdout:mds.g smithi086 running (2m) 34s ago 2m 12.5M - 18.2.4-850-g50bbe7f3 152d8bc6b19e cfdfe5005aa7 2024-09-13T16:10:10.725 INFO:teuthology.orchestra.run.smithi086.stdout:mds.h smithi139 running (2m) 60s ago 2m 18.7M - 18.2.4-850-g50bbe7f3 152d8bc6b19e f605058cc4e1 2024-09-13T16:10:10.726 INFO:teuthology.orchestra.run.smithi086.stdout:mds.i smithi194 running (2m) 60s ago 2m 19.5M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 2f6ddfb9e971 2024-09-13T16:10:10.726 INFO:teuthology.orchestra.run.smithi086.stdout:mds.j smithi086 running (2m) 34s ago 2m 12.6M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 5d04c9426c8b 2024-09-13T16:10:10.726 INFO:teuthology.orchestra.run.smithi086.stdout:mds.k smithi139 running (2m) 60s ago 2m 15.8M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 3b9d6f6c9c88 2024-09-13T16:10:10.726 INFO:teuthology.orchestra.run.smithi086.stdout:mds.l smithi194 running (2m) 60s ago 2m 16.5M - 18.2.4-850-g50bbe7f3 152d8bc6b19e e07125f3cb3c 2024-09-13T16:10:10.726 INFO:teuthology.orchestra.run.smithi086.stdout:mgr.x smithi086 *:9283,8765 running (9m) 34s ago 9m 499M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 9cb9bd6a37a7 2024-09-13T16:10:10.726 INFO:teuthology.orchestra.run.smithi086.stdout:mgr.y smithi139 *:8443,8765 running (7m) 60s ago 7m 439M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 1ba50c639eb1 2024-09-13T16:10:10.726 INFO:teuthology.orchestra.run.smithi086.stdout:mgr.z smithi194 *:8443,8765 running (8m) 60s ago 7m 441M - 18.2.4-850-g50bbe7f3 152d8bc6b19e ede3a65d0948 2024-09-13T16:10:10.726 INFO:teuthology.orchestra.run.smithi086.stdout:mon.a smithi086 running (9m) 34s ago 10m 48.2M 2048M 18.2.4-850-g50bbe7f3 152d8bc6b19e 6d473c2d7662 2024-09-13T16:10:10.726 INFO:teuthology.orchestra.run.smithi086.stdout:mon.b smithi139 running (8m) 60s ago 8m 41.8M 2048M 18.2.4-850-g50bbe7f3 152d8bc6b19e 6542dd8d5c00 2024-09-13T16:10:10.726 INFO:teuthology.orchestra.run.smithi086.stdout:mon.c smithi194 running (8m) 60s ago 8m 42.5M 2048M 18.2.4-850-g50bbe7f3 152d8bc6b19e aff0ed55faf9 2024-09-13T16:10:10.726 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0 smithi086 running (7m) 34s ago 7m 53.1M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e 6c50cfbf3df4 2024-09-13T16:10:10.726 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1 smithi139 running (7m) 60s ago 7m 55.1M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e 11746891050d 2024-09-13T16:10:10.726 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2 smithi194 running (6m) 60s ago 6m 47.0M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e 4955d8a7766b 2024-09-13T16:10:10.726 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3 smithi086 running (6m) 34s ago 6m 43.2M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e 64256fd7fc49 2024-09-13T16:10:10.726 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4 smithi139 running (5m) 60s ago 5m 51.6M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e 7fa50856c72b 2024-09-13T16:10:10.727 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5 smithi194 running (5m) 60s ago 5m 53.1M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e 3f2721dbfcae 2024-09-13T16:10:10.727 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6 smithi086 running (5m) 34s ago 5m 41.6M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e b30e6ced2ebe 2024-09-13T16:10:10.727 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7 smithi139 running (4m) 60s ago 4m 52.8M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e 897df6a52d47 2024-09-13T16:10:10.727 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8 smithi194 running (4m) 60s ago 4m 52.2M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e f66383921d1b 2024-09-13T16:10:10.727 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9 smithi086 running (3m) 34s ago 3m 42.3M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e 4fcbd150ecf6 2024-09-13T16:10:10.727 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10 smithi139 running (3m) 60s ago 3m 44.6M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e a473654c401d 2024-09-13T16:10:10.727 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11 smithi194 running (3m) 60s ago 3m 49.0M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e 9cfa897f2fc9 2024-09-13T16:10:10.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.725+0000 7f6d34c00640 1 -- 172.21.15.86:0/3261646043 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6d140a10b0 msgr2=0x7f6d140a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:10.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.725+0000 7f6d34c00640 1 --2- 172.21.15.86:0/3261646043 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6d140a10b0 0x7f6d140a3570 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c005ab0 tx=0x7f6d1c005a20 comp rx=0 tx=0).stop 2024-09-13T16:10:10.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.725+0000 7f6d34c00640 1 -- 172.21.15.86:0/3261646043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d30102010 msgr2=0x7f6d301980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:10.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.725+0000 7f6d34c00640 1 --2- 172.21.15.86:0/3261646043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d30102010 0x7f6d301980f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d2000e9c0 tx=0x7f6d2000ee80 comp rx=0 tx=0).stop 2024-09-13T16:10:10.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.725+0000 7f6d34c00640 1 -- 172.21.15.86:0/3261646043 shutdown_connections 2024-09-13T16:10:10.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.725+0000 7f6d34c00640 1 --2- 172.21.15.86:0/3261646043 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6d140a10b0 0x7f6d140a3570 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:10.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.725+0000 7f6d34c00640 1 --2- 172.21.15.86:0/3261646043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d30103bd0 0x7f6d3019f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:10.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.725+0000 7f6d34c00640 1 --2- 172.21.15.86:0/3261646043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d30103210 0x7f6d30198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:10.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.725+0000 7f6d34c00640 1 --2- 172.21.15.86:0/3261646043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d30102010 0x7f6d301980f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:10.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.725+0000 7f6d34c00640 1 -- 172.21.15.86:0/3261646043 >> 172.21.15.86:0/3261646043 conn(0x7f6d300fd7a0 msgr2=0x7f6d30106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:10.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.725+0000 7f6d34c00640 1 -- 172.21.15.86:0/3261646043 shutdown_connections 2024-09-13T16:10:10.728 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:10.725+0000 7f6d34c00640 1 -- 172.21.15.86:0/3261646043 wait complete. 2024-09-13T16:10:10.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:10 smithi139 ceph-mon[35320]: pgmap v359: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 422 B/s wr, 6 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-13T16:10:10.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:10 smithi194 ceph-mon[35694]: pgmap v359: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 422 B/s wr, 6 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-13T16:10:11.547 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-13T16:10:11.870 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:10:12.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:12 smithi139 ceph-mon[35320]: from='client.25202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:10:12.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:12 smithi139 ceph-mon[35320]: pgmap v360: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 8 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-13T16:10:12.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:12 smithi194 ceph-mon[35694]: from='client.25202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:10:12.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:12 smithi194 ceph-mon[35694]: pgmap v360: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 8 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-13T16:10:12.863 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:12 smithi086 ceph-mon[30379]: from='client.25202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:10:12.864 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:12 smithi086 ceph-mon[30379]: pgmap v360: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 8 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-13T16:10:13.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.899+0000 7f8ea4a00640 1 -- 172.21.15.86:0/2254724682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ea0072f10 msgr2=0x7f8ea0073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:13.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.899+0000 7f8ea4a00640 1 --2- 172.21.15.86:0/2254724682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ea0072f10 0x7f8ea0073370 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009900 tx=0x7f8e8c02a410 comp rx=0 tx=0).stop 2024-09-13T16:10:13.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.899+0000 7f8ea4a00640 1 -- 172.21.15.86:0/2254724682 shutdown_connections 2024-09-13T16:10:13.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.899+0000 7f8ea4a00640 1 --2- 172.21.15.86:0/2254724682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ea010c3e0 0x7f8ea010e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:13.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.899+0000 7f8ea4a00640 1 --2- 172.21.15.86:0/2254724682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ea0072f10 0x7f8ea0073370 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:13.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.899+0000 7f8ea4a00640 1 --2- 172.21.15.86:0/2254724682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ea00744e0 0x7f8ea0072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:13.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.900+0000 7f8ea4a00640 1 -- 172.21.15.86:0/2254724682 >> 172.21.15.86:0/2254724682 conn(0x7f8ea00fb590 msgr2=0x7f8ea00fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:13.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.900+0000 7f8ea4a00640 1 -- 172.21.15.86:0/2254724682 shutdown_connections 2024-09-13T16:10:13.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.900+0000 7f8ea4a00640 1 -- 172.21.15.86:0/2254724682 wait complete. 2024-09-13T16:10:13.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.900+0000 7f8ea4a00640 1 Processor -- start 2024-09-13T16:10:13.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.901+0000 7f8ea4a00640 1 -- start start 2024-09-13T16:10:13.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.901+0000 7f8ea4a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ea0072f10 0x7f8ea019c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:13.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.901+0000 7f8ea4a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ea00744e0 0x7f8ea019c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:13.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.901+0000 7f8ea4a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ea010c3e0 0x7f8ea01a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:13.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.901+0000 7f8ea4a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea01a3f40 con 0x7f8ea010c3e0 2024-09-13T16:10:13.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.901+0000 7f8ea4a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea01a40b0 con 0x7f8ea00744e0 2024-09-13T16:10:13.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.901+0000 7f8ea4a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea01a4270 con 0x7f8ea0072f10 2024-09-13T16:10:13.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.901+0000 7f8e9e800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ea010c3e0 0x7f8ea01a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:13.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.901+0000 7f8e9e800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ea010c3e0 0x7f8ea01a3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46804/0 (socket says 172.21.15.86:46804) 2024-09-13T16:10:13.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.901+0000 7f8e9e800640 1 -- 172.21.15.86:0/3252292217 learned_addr learned my addr 172.21.15.86:0/3252292217 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:13.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.901+0000 7f8e9d400640 1 --2- 172.21.15.86:0/3252292217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ea00744e0 0x7f8ea019c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:13.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.901+0000 7f8e9de00640 1 --2- 172.21.15.86:0/3252292217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ea0072f10 0x7f8ea019c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:13.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.902+0000 7f8e9e800640 1 -- 172.21.15.86:0/3252292217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ea0072f10 msgr2=0x7f8ea019c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:13.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.902+0000 7f8e9e800640 1 --2- 172.21.15.86:0/3252292217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ea0072f10 0x7f8ea019c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:13.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.902+0000 7f8e9e800640 1 -- 172.21.15.86:0/3252292217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ea00744e0 msgr2=0x7f8ea019c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:13.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.902+0000 7f8e9e800640 1 --2- 172.21.15.86:0/3252292217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ea00744e0 0x7f8ea019c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:13.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.902+0000 7f8e9e800640 1 -- 172.21.15.86:0/3252292217 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c009560 con 0x7f8ea010c3e0 2024-09-13T16:10:13.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.902+0000 7f8e9e800640 1 --2- 172.21.15.86:0/3252292217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ea010c3e0 0x7f8ea01a3a00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800eb10 tx=0x7f8e9800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:13.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.902+0000 7f8e96a00640 1 -- 172.21.15.86:0/3252292217 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98004b20 con 0x7f8ea010c3e0 2024-09-13T16:10:13.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.902+0000 7f8e96a00640 1 -- 172.21.15.86:0/3252292217 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8e98004c80 con 0x7f8ea010c3e0 2024-09-13T16:10:13.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.902+0000 7f8ea4a00640 1 -- 172.21.15.86:0/3252292217 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea01a4550 con 0x7f8ea010c3e0 2024-09-13T16:10:13.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.902+0000 7f8e96a00640 1 -- 172.21.15.86:0/3252292217 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98010650 con 0x7f8ea010c3e0 2024-09-13T16:10:13.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.902+0000 7f8ea4a00640 1 -- 172.21.15.86:0/3252292217 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea01a49d0 con 0x7f8ea010c3e0 2024-09-13T16:10:13.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.904+0000 7f8ea4a00640 1 -- 172.21.15.86:0/3252292217 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea01025b0 con 0x7f8ea010c3e0 2024-09-13T16:10:13.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.905+0000 7f8e96a00640 1 -- 172.21.15.86:0/3252292217 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8e98005020 con 0x7f8ea010c3e0 2024-09-13T16:10:13.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.906+0000 7f8e96a00640 1 --2- 172.21.15.86:0/3252292217 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f8e840a10b0 0x7f8e840a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:13.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.907+0000 7f8e96a00640 1 -- 172.21.15.86:0/3252292217 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f8e98014070 con 0x7f8ea010c3e0 2024-09-13T16:10:13.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.907+0000 7f8e9de00640 1 --2- 172.21.15.86:0/3252292217 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f8e840a10b0 0x7f8e840a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:13.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.907+0000 7f8e9de00640 1 --2- 172.21.15.86:0/3252292217 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f8e840a10b0 0x7f8e840a3570 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00748c0 tx=0x7f8e90005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:13.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:13.911+0000 7f8e96a00640 1 -- 172.21.15.86:0/3252292217 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8e980965e0 con 0x7f8ea010c3e0 2024-09-13T16:10:14.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:14.090+0000 7f8ea4a00640 1 -- 172.21.15.86:0/3252292217 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ea002c450 con 0x7f8e840a10b0 2024-09-13T16:10:14.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:14.097+0000 7f8e96a00640 1 -- 172.21.15.86:0/3252292217 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f8ea002c450 con 0x7f8e840a10b0 2024-09-13T16:10:14.099 INFO:teuthology.orchestra.run.smithi086.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-13T16:10:14.099 INFO:teuthology.orchestra.run.smithi086.stdout:mds.all 12/12 63s ago 2m smithi086=a;smithi086=d;smithi086=g;smithi086=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2024-09-13T16:10:14.099 INFO:teuthology.orchestra.run.smithi086.stdout:mgr 3/3 63s ago 8m smithi086=x;smithi139=y;smithi194=z;count:3 2024-09-13T16:10:14.099 INFO:teuthology.orchestra.run.smithi086.stdout:mon 3/3 63s ago 8m smithi086:172.21.15.86=a;smithi139:172.21.15.139=b;smithi194:172.21.15.194=c;count:3 2024-09-13T16:10:14.099 INFO:teuthology.orchestra.run.smithi086.stdout:osd 12 63s ago - 2024-09-13T16:10:14.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:14.099+0000 7f8ea4a00640 1 -- 172.21.15.86:0/3252292217 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f8e840a10b0 msgr2=0x7f8e840a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:14.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:14.099+0000 7f8ea4a00640 1 --2- 172.21.15.86:0/3252292217 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f8e840a10b0 0x7f8e840a3570 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00748c0 tx=0x7f8e90005f90 comp rx=0 tx=0).stop 2024-09-13T16:10:14.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:14.099+0000 7f8ea4a00640 1 -- 172.21.15.86:0/3252292217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ea010c3e0 msgr2=0x7f8ea01a3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:14.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:14.099+0000 7f8ea4a00640 1 --2- 172.21.15.86:0/3252292217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ea010c3e0 0x7f8ea01a3a00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800eb10 tx=0x7f8e9800c2d0 comp rx=0 tx=0).stop 2024-09-13T16:10:14.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:14.100+0000 7f8ea4a00640 1 -- 172.21.15.86:0/3252292217 shutdown_connections 2024-09-13T16:10:14.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:14.100+0000 7f8ea4a00640 1 --2- 172.21.15.86:0/3252292217 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f8e840a10b0 0x7f8e840a3570 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:14.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:14.100+0000 7f8ea4a00640 1 --2- 172.21.15.86:0/3252292217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ea010c3e0 0x7f8ea01a3a00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:14.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:14.100+0000 7f8ea4a00640 1 --2- 172.21.15.86:0/3252292217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ea00744e0 0x7f8ea019c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:14.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:14.100+0000 7f8ea4a00640 1 --2- 172.21.15.86:0/3252292217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ea0072f10 0x7f8ea019c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:14.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:14.100+0000 7f8ea4a00640 1 -- 172.21.15.86:0/3252292217 >> 172.21.15.86:0/3252292217 conn(0x7f8ea00fb590 msgr2=0x7f8ea00ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:14.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:14.100+0000 7f8ea4a00640 1 -- 172.21.15.86:0/3252292217 shutdown_connections 2024-09-13T16:10:14.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:14.100+0000 7f8ea4a00640 1 -- 172.21.15.86:0/3252292217 wait complete. 2024-09-13T16:10:14.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:14 smithi139 ceph-mon[35320]: pgmap v361: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-13T16:10:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:14 smithi194 ceph-mon[35694]: pgmap v361: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-13T16:10:14.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:14 smithi086 ceph-mon[30379]: pgmap v361: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-13T16:10:15.000 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-13T16:10:15.318 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:10:15.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:15 smithi139 ceph-mon[35320]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:10:15.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:15 smithi194 ceph-mon[35694]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:10:15.772 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:15 smithi086 ceph-mon[30379]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:10:16.610 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:16 smithi086 ceph-mon[30379]: pgmap v362: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-13T16:10:16.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:16 smithi139 ceph-mon[35320]: pgmap v362: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-13T16:10:16.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:16 smithi194 ceph-mon[35694]: pgmap v362: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-13T16:10:17.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.343+0000 7f4614400640 1 -- 172.21.15.86:0/3210150669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c103bd0 msgr2=0x7f460c10a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:17.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.343+0000 7f4614400640 1 --2- 172.21.15.86:0/3210150669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c103bd0 0x7f460c10a460 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4604009ca0 tx=0x7f460402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:10:17.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.343+0000 7f4614400640 1 -- 172.21.15.86:0/3210150669 shutdown_connections 2024-09-13T16:10:17.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.343+0000 7f4614400640 1 --2- 172.21.15.86:0/3210150669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c103bd0 0x7f460c10a460 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:17.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.343+0000 7f4614400640 1 --2- 172.21.15.86:0/3210150669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f460c103210 0x7f460c103690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:17.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.343+0000 7f4614400640 1 --2- 172.21.15.86:0/3210150669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f460c102010 0x7f460c102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:17.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.343+0000 7f4614400640 1 -- 172.21.15.86:0/3210150669 >> 172.21.15.86:0/3210150669 conn(0x7f460c0fd7a0 msgr2=0x7f460c0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:17.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.343+0000 7f4614400640 1 -- 172.21.15.86:0/3210150669 shutdown_connections 2024-09-13T16:10:17.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.343+0000 7f4614400640 1 -- 172.21.15.86:0/3210150669 wait complete. 2024-09-13T16:10:17.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.344+0000 7f4614400640 1 Processor -- start 2024-09-13T16:10:17.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.344+0000 7f4614400640 1 -- start start 2024-09-13T16:10:17.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.345+0000 7f4614400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c102010 0x7f460c198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:17.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.345+0000 7f4614400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f460c103210 0x7f460c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:17.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.345+0000 7f4614400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f460c103bd0 0x7f460c19f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:17.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.345+0000 7f4614400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c19fb00 con 0x7f460c102010 2024-09-13T16:10:17.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.345+0000 7f4614400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c19fc70 con 0x7f460c103210 2024-09-13T16:10:17.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.345+0000 7f4614400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c19fe30 con 0x7f460c103bd0 2024-09-13T16:10:17.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.345+0000 7f4611a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c102010 0x7f460c198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:17.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.345+0000 7f4611a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c102010 0x7f460c198000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46816/0 (socket says 172.21.15.86:46816) 2024-09-13T16:10:17.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.345+0000 7f4611a00640 1 -- 172.21.15.86:0/2599027807 learned_addr learned my addr 172.21.15.86:0/2599027807 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:17.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.345+0000 7f4611000640 1 --2- 172.21.15.86:0/2599027807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f460c103210 0x7f460c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:17.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.345+0000 7f4612400640 1 --2- 172.21.15.86:0/2599027807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f460c103bd0 0x7f460c19f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:17.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.345+0000 7f4611a00640 1 -- 172.21.15.86:0/2599027807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f460c103bd0 msgr2=0x7f460c19f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:17.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.345+0000 7f4611a00640 1 --2- 172.21.15.86:0/2599027807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f460c103bd0 0x7f460c19f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:17.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.345+0000 7f4611a00640 1 -- 172.21.15.86:0/2599027807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f460c103210 msgr2=0x7f460c198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:17.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.345+0000 7f4611a00640 1 --2- 172.21.15.86:0/2599027807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f460c103210 0x7f460c198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:17.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.345+0000 7f4611a00640 1 -- 172.21.15.86:0/2599027807 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4604009900 con 0x7f460c102010 2024-09-13T16:10:17.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.346+0000 7f4611a00640 1 --2- 172.21.15.86:0/2599027807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c102010 0x7f460c198000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f460000e9c0 tx=0x7f460000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:17.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.346+0000 7f460a000640 1 -- 172.21.15.86:0/2599027807 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600009700 con 0x7f460c102010 2024-09-13T16:10:17.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.346+0000 7f460a000640 1 -- 172.21.15.86:0/2599027807 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f460000cd80 con 0x7f460c102010 2024-09-13T16:10:17.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.346+0000 7f4614400640 1 -- 172.21.15.86:0/2599027807 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460c1a0110 con 0x7f460c102010 2024-09-13T16:10:17.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.346+0000 7f460a000640 1 -- 172.21.15.86:0/2599027807 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600010430 con 0x7f460c102010 2024-09-13T16:10:17.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.346+0000 7f4614400640 1 -- 172.21.15.86:0/2599027807 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460c1a0610 con 0x7f460c102010 2024-09-13T16:10:17.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.347+0000 7f4614400640 1 -- 172.21.15.86:0/2599027807 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f460c1093e0 con 0x7f460c102010 2024-09-13T16:10:17.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.349+0000 7f460a000640 1 -- 172.21.15.86:0/2599027807 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4600003680 con 0x7f460c102010 2024-09-13T16:10:17.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.350+0000 7f460a000640 1 --2- 172.21.15.86:0/2599027807 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f45f40a10b0 0x7f45f40a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:17.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.350+0000 7f460a000640 1 -- 172.21.15.86:0/2599027807 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f4600014070 con 0x7f460c102010 2024-09-13T16:10:17.352 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.351+0000 7f4611000640 1 --2- 172.21.15.86:0/2599027807 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f45f40a10b0 0x7f45f40a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:17.353 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.351+0000 7f4611000640 1 --2- 172.21.15.86:0/2599027807 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f45f40a10b0 0x7f45f40a3570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f460c199520 tx=0x7f45f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:17.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.354+0000 7f460a000640 1 -- 172.21.15.86:0/2599027807 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4600096490 con 0x7f460c102010 2024-09-13T16:10:17.532 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.530+0000 7f4614400640 1 -- 172.21.15.86:0/2599027807 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f460c02c450 con 0x7f45f40a10b0 2024-09-13T16:10:17.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.532+0000 7f460a000640 1 -- 172.21.15.86:0/2599027807 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f460c02c450 con 0x7f45f40a10b0 2024-09-13T16:10:17.533 INFO:teuthology.orchestra.run.smithi086.stdout:HOST ADDR LABELS STATUS 2024-09-13T16:10:17.534 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086 172.21.15.86 2024-09-13T16:10:17.534 INFO:teuthology.orchestra.run.smithi086.stdout:smithi139 172.21.15.139 2024-09-13T16:10:17.534 INFO:teuthology.orchestra.run.smithi086.stdout:smithi194 172.21.15.194 2024-09-13T16:10:17.534 INFO:teuthology.orchestra.run.smithi086.stdout:3 hosts in cluster 2024-09-13T16:10:17.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.534+0000 7f4614400640 1 -- 172.21.15.86:0/2599027807 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f45f40a10b0 msgr2=0x7f45f40a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:17.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.534+0000 7f4614400640 1 --2- 172.21.15.86:0/2599027807 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f45f40a10b0 0x7f45f40a3570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f460c199520 tx=0x7f45f8005f90 comp rx=0 tx=0).stop 2024-09-13T16:10:17.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.534+0000 7f4614400640 1 -- 172.21.15.86:0/2599027807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c102010 msgr2=0x7f460c198000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:17.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.534+0000 7f4614400640 1 --2- 172.21.15.86:0/2599027807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c102010 0x7f460c198000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f460000e9c0 tx=0x7f460000ee80 comp rx=0 tx=0).stop 2024-09-13T16:10:17.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.534+0000 7f4614400640 1 -- 172.21.15.86:0/2599027807 shutdown_connections 2024-09-13T16:10:17.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.534+0000 7f4614400640 1 --2- 172.21.15.86:0/2599027807 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f45f40a10b0 0x7f45f40a3570 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:17.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.534+0000 7f4614400640 1 --2- 172.21.15.86:0/2599027807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f460c103bd0 0x7f460c19f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:17.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.534+0000 7f4614400640 1 --2- 172.21.15.86:0/2599027807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f460c103210 0x7f460c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:17.536 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.534+0000 7f4614400640 1 --2- 172.21.15.86:0/2599027807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c102010 0x7f460c198000 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:17.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.534+0000 7f4614400640 1 -- 172.21.15.86:0/2599027807 >> 172.21.15.86:0/2599027807 conn(0x7f460c0fd7a0 msgr2=0x7f460c1065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:17.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.534+0000 7f4614400640 1 -- 172.21.15.86:0/2599027807 shutdown_connections 2024-09-13T16:10:17.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:17.534+0000 7f4614400640 1 -- 172.21.15.86:0/2599027807 wait complete. 2024-09-13T16:10:18.257 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-13T16:10:18.571 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:10:18.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:18 smithi086 ceph-mon[30379]: pgmap v363: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T16:10:18.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:18 smithi086 ceph-mon[30379]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:10:18.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:18 smithi139 ceph-mon[35320]: pgmap v363: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T16:10:18.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:18 smithi139 ceph-mon[35320]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:10:18.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:18 smithi194 ceph-mon[35694]: pgmap v363: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T16:10:18.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:18 smithi194 ceph-mon[35694]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:10:20.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.500+0000 7fc600200640 1 -- 172.21.15.86:0/2382629799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5f8103bd0 msgr2=0x7fc5f810a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:20.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.500+0000 7fc600200640 1 --2- 172.21.15.86:0/2382629799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5f8103bd0 0x7fc5f810a460 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009ca0 tx=0x7fc5f002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:10:20.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.500+0000 7fc600200640 1 -- 172.21.15.86:0/2382629799 shutdown_connections 2024-09-13T16:10:20.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.500+0000 7fc600200640 1 --2- 172.21.15.86:0/2382629799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5f8103bd0 0x7fc5f810a460 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:20.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.500+0000 7fc600200640 1 --2- 172.21.15.86:0/2382629799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5f8103210 0x7fc5f8103690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:20.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.500+0000 7fc600200640 1 --2- 172.21.15.86:0/2382629799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5f8102010 0x7fc5f8102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:20.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.500+0000 7fc600200640 1 -- 172.21.15.86:0/2382629799 >> 172.21.15.86:0/2382629799 conn(0x7fc5f80fd7a0 msgr2=0x7fc5f80ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:20.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.500+0000 7fc600200640 1 -- 172.21.15.86:0/2382629799 shutdown_connections 2024-09-13T16:10:20.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.500+0000 7fc600200640 1 -- 172.21.15.86:0/2382629799 wait complete. 2024-09-13T16:10:20.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.502+0000 7fc600200640 1 Processor -- start 2024-09-13T16:10:20.505 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.502+0000 7fc600200640 1 -- start start 2024-09-13T16:10:20.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.502+0000 7fc600200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5f8102010 0x7fc5f8198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:20.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.502+0000 7fc600200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5f8103210 0x7fc5f8198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:20.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.502+0000 7fc600200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5f8103bd0 0x7fc5f819f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:20.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.502+0000 7fc600200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f819fb00 con 0x7fc5f8103210 2024-09-13T16:10:20.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.502+0000 7fc600200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f819fc70 con 0x7fc5f8103bd0 2024-09-13T16:10:20.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.502+0000 7fc600200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f819fe30 con 0x7fc5f8102010 2024-09-13T16:10:20.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.503+0000 7fc5fce00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5f8103210 0x7fc5f8198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:20.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.503+0000 7fc5fce00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5f8103210 0x7fc5f8198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46836/0 (socket says 172.21.15.86:46836) 2024-09-13T16:10:20.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.503+0000 7fc5fce00640 1 -- 172.21.15.86:0/2982487644 learned_addr learned my addr 172.21.15.86:0/2982487644 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:20.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.503+0000 7fc5fd800640 1 --2- 172.21.15.86:0/2982487644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5f8102010 0x7fc5f8198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:20.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.503+0000 7fc5fe200640 1 --2- 172.21.15.86:0/2982487644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5f8103bd0 0x7fc5f819f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:20.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.503+0000 7fc5fce00640 1 -- 172.21.15.86:0/2982487644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5f8102010 msgr2=0x7fc5f8198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:20.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.503+0000 7fc5fce00640 1 --2- 172.21.15.86:0/2982487644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5f8102010 0x7fc5f8198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:20.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.503+0000 7fc5fce00640 1 -- 172.21.15.86:0/2982487644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5f8103bd0 msgr2=0x7fc5f819f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:20.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.503+0000 7fc5fce00640 1 --2- 172.21.15.86:0/2982487644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5f8103bd0 0x7fc5f819f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:20.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.503+0000 7fc5fce00640 1 -- 172.21.15.86:0/2982487644 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f0009900 con 0x7fc5f8103210 2024-09-13T16:10:20.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.504+0000 7fc5fce00640 1 --2- 172.21.15.86:0/2982487644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5f8103210 0x7fc5f8198540 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc5e400d770 tx=0x7fc5e400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:20.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.504+0000 7fc5f6000640 1 -- 172.21.15.86:0/2982487644 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4009c30 con 0x7fc5f8103210 2024-09-13T16:10:20.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.504+0000 7fc600200640 1 -- 172.21.15.86:0/2982487644 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f81a0110 con 0x7fc5f8103210 2024-09-13T16:10:20.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.504+0000 7fc5f6000640 1 -- 172.21.15.86:0/2982487644 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc5e400de80 con 0x7fc5f8103210 2024-09-13T16:10:20.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.504+0000 7fc600200640 1 -- 172.21.15.86:0/2982487644 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f81a0610 con 0x7fc5f8103210 2024-09-13T16:10:20.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.504+0000 7fc5f6000640 1 -- 172.21.15.86:0/2982487644 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4004e20 con 0x7fc5f8103210 2024-09-13T16:10:20.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.505+0000 7fc600200640 1 -- 172.21.15.86:0/2982487644 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f81093e0 con 0x7fc5f8103210 2024-09-13T16:10:20.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.507+0000 7fc5f6000640 1 -- 172.21.15.86:0/2982487644 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc5e4004f80 con 0x7fc5f8103210 2024-09-13T16:10:20.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.508+0000 7fc5f6000640 1 --2- 172.21.15.86:0/2982487644 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc5e00a10b0 0x7fc5e00a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:20.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.508+0000 7fc5f6000640 1 -- 172.21.15.86:0/2982487644 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fc5e40cc770 con 0x7fc5f8103210 2024-09-13T16:10:20.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.508+0000 7fc5fd800640 1 --2- 172.21.15.86:0/2982487644 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc5e00a10b0 0x7fc5e00a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:20.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.509+0000 7fc5fd800640 1 --2- 172.21.15.86:0/2982487644 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc5e00a10b0 0x7fc5e00a3570 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8103070 tx=0x7fc5ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:20.514 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.512+0000 7fc5f6000640 1 -- 172.21.15.86:0/2982487644 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc5e4095b90 con 0x7fc5f8103210 2024-09-13T16:10:20.694 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.692+0000 7fc600200640 1 -- 172.21.15.86:0/2982487644 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5f802c450 con 0x7fc5e00a10b0 2024-09-13T16:10:20.694 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:20 smithi086 ceph-mon[30379]: pgmap v364: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:10:20.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.694+0000 7fc5f6000640 1 -- 172.21.15.86:0/2982487644 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7fc5f802c450 con 0x7fc5e00a10b0 2024-09-13T16:10:20.696 INFO:teuthology.orchestra.run.smithi086.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-13T16:10:20.696 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400UL400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-13T16:10:20.696 INFO:teuthology.orchestra.run.smithi086.stdout:smithi139 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500N6400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-13T16:10:20.696 INFO:teuthology.orchestra.run.smithi086.stdout:smithi194 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6240002A400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-13T16:10:20.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.696+0000 7fc600200640 1 -- 172.21.15.86:0/2982487644 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc5e00a10b0 msgr2=0x7fc5e00a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:20.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.696+0000 7fc600200640 1 --2- 172.21.15.86:0/2982487644 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc5e00a10b0 0x7fc5e00a3570 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8103070 tx=0x7fc5ec005f90 comp rx=0 tx=0).stop 2024-09-13T16:10:20.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.696+0000 7fc600200640 1 -- 172.21.15.86:0/2982487644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5f8103210 msgr2=0x7fc5f8198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:20.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.696+0000 7fc600200640 1 --2- 172.21.15.86:0/2982487644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5f8103210 0x7fc5f8198540 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc5e400d770 tx=0x7fc5e400dc30 comp rx=0 tx=0).stop 2024-09-13T16:10:20.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.696+0000 7fc600200640 1 -- 172.21.15.86:0/2982487644 shutdown_connections 2024-09-13T16:10:20.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.696+0000 7fc600200640 1 --2- 172.21.15.86:0/2982487644 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc5e00a10b0 0x7fc5e00a3570 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:20.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.696+0000 7fc600200640 1 --2- 172.21.15.86:0/2982487644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5f8103bd0 0x7fc5f819f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:20.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.696+0000 7fc600200640 1 --2- 172.21.15.86:0/2982487644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5f8103210 0x7fc5f8198540 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:20.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.696+0000 7fc600200640 1 --2- 172.21.15.86:0/2982487644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5f8102010 0x7fc5f8198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:20.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.696+0000 7fc600200640 1 -- 172.21.15.86:0/2982487644 >> 172.21.15.86:0/2982487644 conn(0x7fc5f80fd7a0 msgr2=0x7fc5f81065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:20.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.696+0000 7fc600200640 1 -- 172.21.15.86:0/2982487644 shutdown_connections 2024-09-13T16:10:20.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:20.696+0000 7fc600200640 1 -- 172.21.15.86:0/2982487644 wait complete. 2024-09-13T16:10:20.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:20 smithi139 ceph-mon[35320]: pgmap v364: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:10:20.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:20 smithi194 ceph-mon[35694]: pgmap v364: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:10:21.423 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T16:10:21.436 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T16:10:21.436 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T16:10:21.753 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:10:22.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:22 smithi086 ceph-mon[30379]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:10:22.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:22 smithi086 ceph-mon[30379]: pgmap v365: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T16:10:22.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:22 smithi139 ceph-mon[35320]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:10:22.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:22 smithi139 ceph-mon[35320]: pgmap v365: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T16:10:22.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:22 smithi194 ceph-mon[35694]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:10:22.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:22 smithi194 ceph-mon[35694]: pgmap v365: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T16:10:23.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.732+0000 7f73e7000640 1 -- 172.21.15.86:0/721156825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73e0102f90 msgr2=0x7f73e0103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:23.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.732+0000 7f73e7000640 1 --2- 172.21.15.86:0/721156825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73e0102f90 0x7f73e0103410 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f73cc009900 tx=0x7f73cc02a410 comp rx=0 tx=0).stop 2024-09-13T16:10:23.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.732+0000 7f73e7000640 1 -- 172.21.15.86:0/721156825 shutdown_connections 2024-09-13T16:10:23.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.732+0000 7f73e7000640 1 --2- 172.21.15.86:0/721156825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e0103950 0x7f73e010a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:23.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.732+0000 7f73e7000640 1 --2- 172.21.15.86:0/721156825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73e0102f90 0x7f73e0103410 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:23.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.732+0000 7f73e7000640 1 --2- 172.21.15.86:0/721156825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73e0101e30 0x7f73e0102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:23.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.732+0000 7f73e7000640 1 -- 172.21.15.86:0/721156825 >> 172.21.15.86:0/721156825 conn(0x7f73e00fd5e0 msgr2=0x7f73e00ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:23.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.732+0000 7f73e7000640 1 -- 172.21.15.86:0/721156825 shutdown_connections 2024-09-13T16:10:23.735 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.732+0000 7f73e7000640 1 -- 172.21.15.86:0/721156825 wait complete. 2024-09-13T16:10:23.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.733+0000 7f73e7000640 1 Processor -- start 2024-09-13T16:10:23.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.733+0000 7f73e7000640 1 -- start start 2024-09-13T16:10:23.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.734+0000 7f73e7000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e0101e30 0x7f73e0197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:23.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.734+0000 7f73e7000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73e0102f90 0x7f73e01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:23.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.734+0000 7f73e7000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73e0103950 0x7f73e019f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:23.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.734+0000 7f73e7000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e019f9b0 con 0x7f73e0102f90 2024-09-13T16:10:23.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.734+0000 7f73e7000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e019fb20 con 0x7f73e0103950 2024-09-13T16:10:23.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.734+0000 7f73e7000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e019fce0 con 0x7f73e0101e30 2024-09-13T16:10:23.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.734+0000 7f73e5200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73e0102f90 0x7f73e01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:23.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.734+0000 7f73e5c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e0101e30 0x7f73e0197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:23.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.734+0000 7f73e5200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73e0102f90 0x7f73e01983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43094/0 (socket says 172.21.15.86:43094) 2024-09-13T16:10:23.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.734+0000 7f73e5200640 1 -- 172.21.15.86:0/1183733736 learned_addr learned my addr 172.21.15.86:0/1183733736 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:23.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.734+0000 7f73e6600640 1 --2- 172.21.15.86:0/1183733736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73e0103950 0x7f73e019f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:23.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.734+0000 7f73e5c00640 1 -- 172.21.15.86:0/1183733736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73e0103950 msgr2=0x7f73e019f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:23.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.734+0000 7f73e5c00640 1 --2- 172.21.15.86:0/1183733736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73e0103950 0x7f73e019f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:23.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.734+0000 7f73e5c00640 1 -- 172.21.15.86:0/1183733736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73e0102f90 msgr2=0x7f73e01983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:23.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.734+0000 7f73e5c00640 1 --2- 172.21.15.86:0/1183733736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73e0102f90 0x7f73e01983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:23.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.734+0000 7f73e5c00640 1 -- 172.21.15.86:0/1183733736 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc009560 con 0x7f73e0101e30 2024-09-13T16:10:23.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.735+0000 7f73e5c00640 1 --2- 172.21.15.86:0/1183733736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e0101e30 0x7f73e0197eb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f73d400e9f0 tx=0x7f73d400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:23.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.735+0000 7f73de000640 1 -- 172.21.15.86:0/1183733736 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d400ccc0 con 0x7f73e0101e30 2024-09-13T16:10:23.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.735+0000 7f73de000640 1 -- 172.21.15.86:0/1183733736 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f73d400ce20 con 0x7f73e0101e30 2024-09-13T16:10:23.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.735+0000 7f73e7000640 1 -- 172.21.15.86:0/1183733736 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e019ffc0 con 0x7f73e0101e30 2024-09-13T16:10:23.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.735+0000 7f73de000640 1 -- 172.21.15.86:0/1183733736 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d4018920 con 0x7f73e0101e30 2024-09-13T16:10:23.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.735+0000 7f73e7000640 1 -- 172.21.15.86:0/1183733736 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e01a03e0 con 0x7f73e0101e30 2024-09-13T16:10:23.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.736+0000 7f73e7000640 1 -- 172.21.15.86:0/1183733736 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e01091d0 con 0x7f73e0101e30 2024-09-13T16:10:23.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.738+0000 7f73de000640 1 -- 172.21.15.86:0/1183733736 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f73d4018a80 con 0x7f73e0101e30 2024-09-13T16:10:23.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.739+0000 7f73de000640 1 --2- 172.21.15.86:0/1183733736 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f73c80a1120 0x7f73c80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:23.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.739+0000 7f73de000640 1 -- 172.21.15.86:0/1183733736 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f73d4014070 con 0x7f73e0101e30 2024-09-13T16:10:23.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.740+0000 7f73e5200640 1 --2- 172.21.15.86:0/1183733736 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f73c80a1120 0x7f73c80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:23.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.740+0000 7f73e5200640 1 --2- 172.21.15.86:0/1183733736 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f73c80a1120 0x7f73c80a35e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f73cc006010 tx=0x7f73cc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:23.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.741+0000 7f73de000640 1 -- 172.21.15.86:0/1183733736 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f73d4096330 con 0x7f73e0101e30 2024-09-13T16:10:23.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.948+0000 7f73e7000640 1 -- 172.21.15.86:0/1183733736 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f73e010db50 con 0x7f73e0101e30 2024-09-13T16:10:23.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.948+0000 7f73de000640 1 -- 172.21.15.86:0/1183733736 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+2905 (secure 0 0 0) 0x7f73d4099950 con 0x7f73e0101e30 2024-09-13T16:10:23.951 INFO:teuthology.orchestra.run.smithi086.stdout:e24 2024-09-13T16:10:23.951 INFO:teuthology.orchestra.run.smithi086.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T16:10:23.951 INFO:teuthology.orchestra.run.smithi086.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T16:10:23.951 INFO:teuthology.orchestra.run.smithi086.stdout:legacy client fscid: 1 2024-09-13T16:10:23.951 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:10:23.951 INFO:teuthology.orchestra.run.smithi086.stdout:Filesystem 'cephfs' (1) 2024-09-13T16:10:23.951 INFO:teuthology.orchestra.run.smithi086.stdout:fs_name cephfs 2024-09-13T16:10:23.951 INFO:teuthology.orchestra.run.smithi086.stdout:epoch 24 2024-09-13T16:10:23.951 INFO:teuthology.orchestra.run.smithi086.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T16:10:23.951 INFO:teuthology.orchestra.run.smithi086.stdout:created 2024-09-13T16:08:09.202262+0000 2024-09-13T16:10:23.951 INFO:teuthology.orchestra.run.smithi086.stdout:modified 2024-09-13T16:08:32.444959+0000 2024-09-13T16:10:23.951 INFO:teuthology.orchestra.run.smithi086.stdout:tableserver 0 2024-09-13T16:10:23.952 INFO:teuthology.orchestra.run.smithi086.stdout:root 0 2024-09-13T16:10:23.952 INFO:teuthology.orchestra.run.smithi086.stdout:session_timeout 300 2024-09-13T16:10:23.952 INFO:teuthology.orchestra.run.smithi086.stdout:session_autoclose 300 2024-09-13T16:10:23.952 INFO:teuthology.orchestra.run.smithi086.stdout:max_file_size 1099511627776 2024-09-13T16:10:23.952 INFO:teuthology.orchestra.run.smithi086.stdout:max_xattr_size 65536 2024-09-13T16:10:23.952 INFO:teuthology.orchestra.run.smithi086.stdout:required_client_features {} 2024-09-13T16:10:23.952 INFO:teuthology.orchestra.run.smithi086.stdout:last_failure 0 2024-09-13T16:10:23.952 INFO:teuthology.orchestra.run.smithi086.stdout:last_failure_osd_epoch 0 2024-09-13T16:10:23.952 INFO:teuthology.orchestra.run.smithi086.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T16:10:23.952 INFO:teuthology.orchestra.run.smithi086.stdout:max_mds 3 2024-09-13T16:10:23.952 INFO:teuthology.orchestra.run.smithi086.stdout:in 0,1,2 2024-09-13T16:10:23.952 INFO:teuthology.orchestra.run.smithi086.stdout:up {0=24581,1=24544,2=24530} 2024-09-13T16:10:23.953 INFO:teuthology.orchestra.run.smithi086.stdout:failed 2024-09-13T16:10:23.953 INFO:teuthology.orchestra.run.smithi086.stdout:damaged 2024-09-13T16:10:23.953 INFO:teuthology.orchestra.run.smithi086.stdout:stopped 2024-09-13T16:10:23.953 INFO:teuthology.orchestra.run.smithi086.stdout:data_pools [3,4] 2024-09-13T16:10:23.953 INFO:teuthology.orchestra.run.smithi086.stdout:metadata_pool 2 2024-09-13T16:10:23.953 INFO:teuthology.orchestra.run.smithi086.stdout:inline_data disabled 2024-09-13T16:10:23.953 INFO:teuthology.orchestra.run.smithi086.stdout:balancer 2024-09-13T16:10:23.953 INFO:teuthology.orchestra.run.smithi086.stdout:bal_rank_mask -1 2024-09-13T16:10:23.953 INFO:teuthology.orchestra.run.smithi086.stdout:standby_count_wanted 0 2024-09-13T16:10:23.953 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b{0:24581} state up:active seq 3 addr [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:10:23.953 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c{0:24523} state up:standby-replay seq 1 addr [v2:172.21.15.194:6836/2460451799,v1:172.21.15.194:6837/2460451799] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:10:23.953 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.i{1:24544} state up:active seq 10 addr [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:10:23.953 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.f{1:24511} state up:standby-replay seq 1 addr [v2:172.21.15.194:6834/1370900762,v1:172.21.15.194:6835/1370900762] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:10:23.954 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.h{2:24530} state up:active seq 11 addr [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:10:23.954 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.e{2:24503} state up:standby-replay seq 1 addr [v2:172.21.15.139:6834/1036892520,v1:172.21.15.139:6835/1036892520] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:10:23.954 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:10:23.954 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:10:23.954 INFO:teuthology.orchestra.run.smithi086.stdout:Standby daemons: 2024-09-13T16:10:23.954 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:10:23.954 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.j{-1:14442} state up:standby seq 1 addr [v2:172.21.15.86:6834/3476661600,v1:172.21.15.86:6835/3476661600] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:10:23.954 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.g{-1:14508} state up:standby seq 1 addr [v2:172.21.15.86:6838/1509120923,v1:172.21.15.86:6839/1509120923] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:10:23.954 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a{-1:14526} state up:standby seq 1 addr [v2:172.21.15.86:6840/1971775519,v1:172.21.15.86:6841/1971775519] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:10:23.954 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.l{-1:24448} state up:standby seq 1 addr [v2:172.21.15.194:6832/750435531,v1:172.21.15.194:6833/750435531] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:10:23.954 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.k{-1:24461} state up:standby seq 1 addr [v2:172.21.15.139:6832/1329253837,v1:172.21.15.139:6833/1329253837] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:10:23.954 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d{-1:24487} state up:standby seq 1 addr [v2:172.21.15.86:6836/396399488,v1:172.21.15.86:6837/396399488] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:10:23.955 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 24 2024-09-13T16:10:23.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.950+0000 7f73e7000640 1 -- 172.21.15.86:0/1183733736 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f73c80a1120 msgr2=0x7f73c80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:23.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.950+0000 7f73e7000640 1 --2- 172.21.15.86:0/1183733736 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f73c80a1120 0x7f73c80a35e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f73cc006010 tx=0x7f73cc005a20 comp rx=0 tx=0).stop 2024-09-13T16:10:23.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.951+0000 7f73e7000640 1 -- 172.21.15.86:0/1183733736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e0101e30 msgr2=0x7f73e0197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:23.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.951+0000 7f73e7000640 1 --2- 172.21.15.86:0/1183733736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e0101e30 0x7f73e0197eb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f73d400e9f0 tx=0x7f73d400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:10:23.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.951+0000 7f73e7000640 1 -- 172.21.15.86:0/1183733736 shutdown_connections 2024-09-13T16:10:23.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.951+0000 7f73e7000640 1 --2- 172.21.15.86:0/1183733736 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f73c80a1120 0x7f73c80a35e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:23.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.951+0000 7f73e7000640 1 --2- 172.21.15.86:0/1183733736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73e0103950 0x7f73e019f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:23.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.951+0000 7f73e7000640 1 --2- 172.21.15.86:0/1183733736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73e0102f90 0x7f73e01983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:23.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.951+0000 7f73e7000640 1 --2- 172.21.15.86:0/1183733736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e0101e30 0x7f73e0197eb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:23.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.951+0000 7f73e7000640 1 -- 172.21.15.86:0/1183733736 >> 172.21.15.86:0/1183733736 conn(0x7f73e00fd5e0 msgr2=0x7f73e01063a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:23.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.951+0000 7f73e7000640 1 -- 172.21.15.86:0/1183733736 shutdown_connections 2024-09-13T16:10:23.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:23.951+0000 7f73e7000640 1 -- 172.21.15.86:0/1183733736 wait complete. 2024-09-13T16:10:24.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:24 smithi086 ceph-mon[30379]: pgmap v366: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:10:24.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:24 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1183733736' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T16:10:24.690 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-13T16:10:24.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:24 smithi139 ceph-mon[35320]: pgmap v366: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:10:24.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:24 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1183733736' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T16:10:24.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:24 smithi194 ceph-mon[35694]: pgmap v366: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:10:24.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:24 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1183733736' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T16:10:25.006 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:10:26.518 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:26 smithi086 ceph-mon[30379]: pgmap v367: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:10:26.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:26 smithi139 ceph-mon[35320]: pgmap v367: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:10:26.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:26 smithi194 ceph-mon[35694]: pgmap v367: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:10:26.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.905+0000 7fc7f6800640 1 -- 172.21.15.86:0/3567334399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7f0102f90 msgr2=0x7fc7f0103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:26.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.905+0000 7fc7f6800640 1 --2- 172.21.15.86:0/3567334399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7f0102f90 0x7fc7f0103410 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009900 tx=0x7fc7dc02a410 comp rx=0 tx=0).stop 2024-09-13T16:10:26.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.905+0000 7fc7f6800640 1 -- 172.21.15.86:0/3567334399 shutdown_connections 2024-09-13T16:10:26.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.905+0000 7fc7f6800640 1 --2- 172.21.15.86:0/3567334399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7f0103950 0x7fc7f010a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:26.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.905+0000 7fc7f6800640 1 --2- 172.21.15.86:0/3567334399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7f0102f90 0x7fc7f0103410 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:26.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.905+0000 7fc7f6800640 1 --2- 172.21.15.86:0/3567334399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7f0101e30 0x7fc7f0102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:26.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.905+0000 7fc7f6800640 1 -- 172.21.15.86:0/3567334399 >> 172.21.15.86:0/3567334399 conn(0x7fc7f00fd5e0 msgr2=0x7fc7f00ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:26.907 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.905+0000 7fc7f6800640 1 -- 172.21.15.86:0/3567334399 shutdown_connections 2024-09-13T16:10:26.908 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.905+0000 7fc7f6800640 1 -- 172.21.15.86:0/3567334399 wait complete. 2024-09-13T16:10:26.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.906+0000 7fc7f6800640 1 Processor -- start 2024-09-13T16:10:26.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.906+0000 7fc7f6800640 1 -- start start 2024-09-13T16:10:26.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.906+0000 7fc7f6800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7f0101e30 0x7fc7f0197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:26.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.906+0000 7fc7f6800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7f0102f90 0x7fc7f01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:26.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.906+0000 7fc7f6800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7f0103950 0x7fc7f019f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:26.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.906+0000 7fc7f6800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f019f960 con 0x7fc7f0101e30 2024-09-13T16:10:26.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.906+0000 7fc7f6800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f019fad0 con 0x7fc7f0103950 2024-09-13T16:10:26.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.906+0000 7fc7f6800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f019fc90 con 0x7fc7f0102f90 2024-09-13T16:10:26.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.907+0000 7fc7f5400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7f0101e30 0x7fc7f0197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:26.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.907+0000 7fc7f5400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7f0101e30 0x7fc7f0197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43116/0 (socket says 172.21.15.86:43116) 2024-09-13T16:10:26.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.907+0000 7fc7f5400640 1 -- 172.21.15.86:0/3483565671 learned_addr learned my addr 172.21.15.86:0/3483565671 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:26.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.907+0000 7fc7f4a00640 1 --2- 172.21.15.86:0/3483565671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7f0102f90 0x7fc7f01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:26.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.907+0000 7fc7f5e00640 1 --2- 172.21.15.86:0/3483565671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7f0103950 0x7fc7f019f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:26.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.907+0000 7fc7f5400640 1 -- 172.21.15.86:0/3483565671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7f0102f90 msgr2=0x7fc7f01983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:26.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.907+0000 7fc7f5400640 1 --2- 172.21.15.86:0/3483565671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7f0102f90 0x7fc7f01983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:26.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.907+0000 7fc7f5400640 1 -- 172.21.15.86:0/3483565671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7f0103950 msgr2=0x7fc7f019f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:26.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.907+0000 7fc7f5400640 1 --2- 172.21.15.86:0/3483565671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7f0103950 0x7fc7f019f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:26.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.907+0000 7fc7f5400640 1 -- 172.21.15.86:0/3483565671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc009560 con 0x7fc7f0101e30 2024-09-13T16:10:26.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.907+0000 7fc7f4a00640 1 --2- 172.21.15.86:0/3483565671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7f0102f90 0x7fc7f01983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:10:26.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.907+0000 7fc7f5e00640 1 --2- 172.21.15.86:0/3483565671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7f0103950 0x7fc7f019f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:10:26.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.907+0000 7fc7f5400640 1 --2- 172.21.15.86:0/3483565671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7f0101e30 0x7fc7f0197e60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400e9f0 tx=0x7fc7e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:26.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.908+0000 7fc7ee000640 1 -- 172.21.15.86:0/3483565671 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4009700 con 0x7fc7f0101e30 2024-09-13T16:10:26.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.908+0000 7fc7ee000640 1 -- 172.21.15.86:0/3483565671 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc7e400cd80 con 0x7fc7f0101e30 2024-09-13T16:10:26.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.908+0000 7fc7f6800640 1 -- 172.21.15.86:0/3483565671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f019ff70 con 0x7fc7f0101e30 2024-09-13T16:10:26.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.908+0000 7fc7ee000640 1 -- 172.21.15.86:0/3483565671 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4018920 con 0x7fc7f0101e30 2024-09-13T16:10:26.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.908+0000 7fc7f6800640 1 -- 172.21.15.86:0/3483565671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f01a0380 con 0x7fc7f0101e30 2024-09-13T16:10:26.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.909+0000 7fc7f6800640 1 -- 172.21.15.86:0/3483565671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f01091d0 con 0x7fc7f0101e30 2024-09-13T16:10:26.913 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.911+0000 7fc7ee000640 1 -- 172.21.15.86:0/3483565671 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc7e4018a80 con 0x7fc7f0101e30 2024-09-13T16:10:26.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.912+0000 7fc7ee000640 1 --2- 172.21.15.86:0/3483565671 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc7d80a10a0 0x7fc7d80a3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:26.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.912+0000 7fc7ee000640 1 -- 172.21.15.86:0/3483565671 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fc7e4014070 con 0x7fc7f0101e30 2024-09-13T16:10:26.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.912+0000 7fc7f4a00640 1 --2- 172.21.15.86:0/3483565671 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc7d80a10a0 0x7fc7d80a3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:26.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.913+0000 7fc7f4a00640 1 --2- 172.21.15.86:0/3483565671 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc7d80a10a0 0x7fc7d80a3560 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc02aa00 tx=0x7fc7dc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:26.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:26.916+0000 7fc7ee000640 1 -- 172.21.15.86:0/3483565671 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc7e4052e20 con 0x7fc7f0101e30 2024-09-13T16:10:27.091 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:27.090+0000 7fc7f6800640 1 -- 172.21.15.86:0/3483565671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7fc7f002c4b0 con 0x7fc7f0101e30 2024-09-13T16:10:27.092 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:27.091+0000 7fc7ee000640 1 -- 172.21.15.86:0/3483565671 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v94) v1 ==== 56+0+5755 (secure 0 0 0) 0x7fc7e4096510 con 0x7fc7f0101e30 2024-09-13T16:10:27.093 INFO:teuthology.orchestra.run.smithi086.stdout:epoch 94 2024-09-13T16:10:27.093 INFO:teuthology.orchestra.run.smithi086.stdout:fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:10:27.093 INFO:teuthology.orchestra.run.smithi086.stdout:created 2024-09-13T16:00:07.737021+0000 2024-09-13T16:10:27.093 INFO:teuthology.orchestra.run.smithi086.stdout:modified 2024-09-13T16:10:00.680229+0000 2024-09-13T16:10:27.093 INFO:teuthology.orchestra.run.smithi086.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-13T16:10:27.093 INFO:teuthology.orchestra.run.smithi086.stdout:crush_version 27 2024-09-13T16:10:27.093 INFO:teuthology.orchestra.run.smithi086.stdout:full_ratio 0.95 2024-09-13T16:10:27.093 INFO:teuthology.orchestra.run.smithi086.stdout:backfillfull_ratio 0.9 2024-09-13T16:10:27.093 INFO:teuthology.orchestra.run.smithi086.stdout:nearfull_ratio 0.85 2024-09-13T16:10:27.094 INFO:teuthology.orchestra.run.smithi086.stdout:require_min_compat_client luminous 2024-09-13T16:10:27.094 INFO:teuthology.orchestra.run.smithi086.stdout:min_compat_client luminous 2024-09-13T16:10:27.094 INFO:teuthology.orchestra.run.smithi086.stdout:require_osd_release reef 2024-09-13T16:10:27.094 INFO:teuthology.orchestra.run.smithi086.stdout:stretch_mode_enabled false 2024-09-13T16:10:27.094 INFO:teuthology.orchestra.run.smithi086.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-13T16:10:27.094 INFO:teuthology.orchestra.run.smithi086.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-13T16:10:27.094 INFO:teuthology.orchestra.run.smithi086.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-13T16:10:27.094 INFO:teuthology.orchestra.run.smithi086.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 90 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-13T16:10:27.094 INFO:teuthology.orchestra.run.smithi086.stdout:max_osd 12 2024-09-13T16:10:27.094 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0 up in weight 1 up_from 8 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6802/4268534994,v1:172.21.15.86:6803/4268534994] [v2:172.21.15.86:6804/4268534994,v1:172.21.15.86:6805/4268534994] exists,up 12239385-09af-43d5-9d41-bd3c2a6a7c23 2024-09-13T16:10:27.094 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1 up in weight 1 up_from 13 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6800/341901766,v1:172.21.15.139:6801/341901766] [v2:172.21.15.139:6802/341901766,v1:172.21.15.139:6803/341901766] exists,up ffcf9a5b-5119-4f86-9167-a0e04732f974 2024-09-13T16:10:27.094 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2 up in weight 1 up_from 18 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6800/2776695129,v1:172.21.15.194:6801/2776695129] [v2:172.21.15.194:6802/2776695129,v1:172.21.15.194:6803/2776695129] exists,up bbe88e68-9e6f-47d2-a401-ab8c02700099 2024-09-13T16:10:27.095 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3 up in weight 1 up_from 26 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6810/942908096,v1:172.21.15.86:6811/942908096] [v2:172.21.15.86:6812/942908096,v1:172.21.15.86:6813/942908096] exists,up 4fc18705-76a0-44bc-a402-abf53572dd15 2024-09-13T16:10:27.095 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4 up in weight 1 up_from 34 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6808/2161852608,v1:172.21.15.139:6809/2161852608] [v2:172.21.15.139:6810/2161852608,v1:172.21.15.139:6811/2161852608] exists,up c9e36a79-e2ce-4639-8aa0-5c231156fe58 2024-09-13T16:10:27.095 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5 up in weight 1 up_from 39 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6808/290656117,v1:172.21.15.194:6809/290656117] [v2:172.21.15.194:6810/290656117,v1:172.21.15.194:6811/290656117] exists,up 8564481f-4357-4cdb-ad3f-ce793ce8d590 2024-09-13T16:10:27.095 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6 up in weight 1 up_from 47 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6818/2271757372,v1:172.21.15.86:6819/2271757372] [v2:172.21.15.86:6820/2271757372,v1:172.21.15.86:6821/2271757372] exists,up 4b725bb8-2413-455e-bd91-56fb50a5903a 2024-09-13T16:10:27.095 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7 up in weight 1 up_from 52 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6816/2698233714,v1:172.21.15.139:6817/2698233714] [v2:172.21.15.139:6818/2698233714,v1:172.21.15.139:6819/2698233714] exists,up 16cd9e1d-c8b7-4aba-b735-f89cd340af5c 2024-09-13T16:10:27.095 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8 up in weight 1 up_from 60 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6816/1203296705,v1:172.21.15.194:6817/1203296705] [v2:172.21.15.194:6818/1203296705,v1:172.21.15.194:6819/1203296705] exists,up f925eb0e-8f3f-478d-a2f0-442d7c3a47f1 2024-09-13T16:10:27.095 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9 up in weight 1 up_from 68 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6826/2812182980,v1:172.21.15.86:6827/2812182980] [v2:172.21.15.86:6828/2812182980,v1:172.21.15.86:6829/2812182980] exists,up 9c8594d9-50ac-433d-ba13-ad218f127bda 2024-09-13T16:10:27.095 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10 up in weight 1 up_from 73 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6824/4290408323,v1:172.21.15.139:6825/4290408323] [v2:172.21.15.139:6826/4290408323,v1:172.21.15.139:6827/4290408323] exists,up 76100365-5171-4b49-86f5-6dafe8134186 2024-09-13T16:10:27.095 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11 up in weight 1 up_from 81 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6824/886506943,v1:172.21.15.194:6825/886506943] [v2:172.21.15.194:6826/886506943,v1:172.21.15.194:6827/886506943] exists,up fc3ff2ca-ee19-400d-90cf-3954079ab602 2024-09-13T16:10:27.095 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 2.0 [8,1] 2024-09-13T16:10:27.095 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 2.8 [2,11] 2024-09-13T16:10:27.095 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 2.13 [2,11] 2024-09-13T16:10:27.095 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 3.e [4,7] 2024-09-13T16:10:27.095 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 3.19 [3,8] 2024-09-13T16:10:27.096 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 3.1a [5,6] 2024-09-13T16:10:27.096 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 3.1b [4,8] 2024-09-13T16:10:27.096 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 3.1d [4,7] 2024-09-13T16:10:27.096 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 3.1e [3,9] 2024-09-13T16:10:27.096 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 3.24 [4,9] 2024-09-13T16:10:27.096 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 3.2f [1,9] 2024-09-13T16:10:27.096 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 3.39 [5,6] 2024-09-13T16:10:27.096 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 4.6 [9,11] 2024-09-13T16:10:27.096 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 4.13 [9,8] 2024-09-13T16:10:27.096 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 4.15 [5,10] 2024-09-13T16:10:27.096 INFO:teuthology.orchestra.run.smithi086.stdout:pg_upmap_items 4.17 [9,8] 2024-09-13T16:10:27.096 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:6801/3020585994 expires 2024-09-14T16:00:59.245481+0000 2024-09-13T16:10:27.097 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:6800/3020585994 expires 2024-09-14T16:00:59.245481+0000 2024-09-13T16:10:27.097 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:0/3295688385 expires 2024-09-14T16:00:32.423780+0000 2024-09-13T16:10:27.097 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:0/3012247455 expires 2024-09-14T16:00:59.245481+0000 2024-09-13T16:10:27.097 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:0/4048858537 expires 2024-09-14T16:00:32.423780+0000 2024-09-13T16:10:27.097 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:0/538861985 expires 2024-09-14T16:00:59.245481+0000 2024-09-13T16:10:27.097 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:0/1103077747 expires 2024-09-14T16:00:32.423780+0000 2024-09-13T16:10:27.097 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:6801/2495317297 expires 2024-09-14T16:00:32.423780+0000 2024-09-13T16:10:27.097 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:0/3038340163 expires 2024-09-14T16:00:59.245481+0000 2024-09-13T16:10:27.097 INFO:teuthology.orchestra.run.smithi086.stdout:blocklist 172.21.15.86:6800/2495317297 expires 2024-09-14T16:00:32.423780+0000 2024-09-13T16:10:27.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:27.094+0000 7fc7f6800640 1 -- 172.21.15.86:0/3483565671 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc7d80a10a0 msgr2=0x7fc7d80a3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:27.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:27.094+0000 7fc7f6800640 1 --2- 172.21.15.86:0/3483565671 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc7d80a10a0 0x7fc7d80a3560 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc02aa00 tx=0x7fc7dc000bc0 comp rx=0 tx=0).stop 2024-09-13T16:10:27.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:27.094+0000 7fc7f6800640 1 -- 172.21.15.86:0/3483565671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7f0101e30 msgr2=0x7fc7f0197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:27.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:27.094+0000 7fc7f6800640 1 --2- 172.21.15.86:0/3483565671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7f0101e30 0x7fc7f0197e60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400e9f0 tx=0x7fc7e400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:10:27.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:27.094+0000 7fc7f6800640 1 -- 172.21.15.86:0/3483565671 shutdown_connections 2024-09-13T16:10:27.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:27.094+0000 7fc7f6800640 1 --2- 172.21.15.86:0/3483565671 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc7d80a10a0 0x7fc7d80a3560 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:27.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:27.094+0000 7fc7f6800640 1 --2- 172.21.15.86:0/3483565671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7f0103950 0x7fc7f019f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:27.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:27.094+0000 7fc7f6800640 1 --2- 172.21.15.86:0/3483565671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7f0102f90 0x7fc7f01983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:27.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:27.094+0000 7fc7f6800640 1 --2- 172.21.15.86:0/3483565671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7f0101e30 0x7fc7f0197e60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:27.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:27.095+0000 7fc7f6800640 1 -- 172.21.15.86:0/3483565671 >> 172.21.15.86:0/3483565671 conn(0x7fc7f00fd5e0 msgr2=0x7fc7f01063a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:27.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:27.095+0000 7fc7f6800640 1 -- 172.21.15.86:0/3483565671 shutdown_connections 2024-09-13T16:10:27.099 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:27.095+0000 7fc7f6800640 1 -- 172.21.15.86:0/3483565671 wait complete. 2024-09-13T16:10:27.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:27 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3483565671' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-13T16:10:27.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:27 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3483565671' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-13T16:10:27.826 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:27 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3483565671' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-13T16:10:27.857 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-13T16:10:27.869 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:10:28.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.024+0000 7f9fd2e00640 1 -- 172.21.15.86:0/2633853568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fcc072eb0 msgr2=0x7f9fcc073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:28.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.024+0000 7f9fd2e00640 1 --2- 172.21.15.86:0/2633853568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fcc072eb0 0x7f9fcc073310 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009900 tx=0x7f9fb802a480 comp rx=0 tx=0).stop 2024-09-13T16:10:28.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.024+0000 7f9fd2e00640 1 -- 172.21.15.86:0/2633853568 shutdown_connections 2024-09-13T16:10:28.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.024+0000 7f9fd2e00640 1 --2- 172.21.15.86:0/2633853568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9fcc107c30 0x7f9fcc10a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.024+0000 7f9fd2e00640 1 --2- 172.21.15.86:0/2633853568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fcc072eb0 0x7f9fcc073310 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.024+0000 7f9fd2e00640 1 --2- 172.21.15.86:0/2633853568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fcc074490 0x7f9fcc0728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.024+0000 7f9fd2e00640 1 -- 172.21.15.86:0/2633853568 >> 172.21.15.86:0/2633853568 conn(0x7f9fcc0fb520 msgr2=0x7f9fcc0fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:28.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.024+0000 7f9fd2e00640 1 -- 172.21.15.86:0/2633853568 shutdown_connections 2024-09-13T16:10:28.026 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.024+0000 7f9fd2e00640 1 -- 172.21.15.86:0/2633853568 wait complete. 2024-09-13T16:10:28.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.025+0000 7f9fd2e00640 1 Processor -- start 2024-09-13T16:10:28.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.025+0000 7f9fd2e00640 1 -- start start 2024-09-13T16:10:28.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.025+0000 7f9fd2e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fcc072eb0 0x7f9fcc198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:28.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.025+0000 7f9fd2e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9fcc074490 0x7f9fcc198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:28.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.025+0000 7f9fd2e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fcc107c30 0x7f9fcc19f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:28.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.025+0000 7f9fd2e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc19fc00 con 0x7f9fcc107c30 2024-09-13T16:10:28.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.025+0000 7f9fd2e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc19fd70 con 0x7f9fcc074490 2024-09-13T16:10:28.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.025+0000 7f9fd2e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc19ff30 con 0x7f9fcc072eb0 2024-09-13T16:10:28.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.025+0000 7f9fd0e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fcc107c30 0x7f9fcc19f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:28.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.025+0000 7f9fd0e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fcc107c30 0x7f9fcc19f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43134/0 (socket says 172.21.15.86:43134) 2024-09-13T16:10:28.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.025+0000 7f9fd0e00640 1 -- 172.21.15.86:0/1184378715 learned_addr learned my addr 172.21.15.86:0/1184378715 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:28.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.025+0000 7f9fcbe00640 1 --2- 172.21.15.86:0/1184378715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fcc072eb0 0x7f9fcc198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:28.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.025+0000 7f9fcb400640 1 --2- 172.21.15.86:0/1184378715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9fcc074490 0x7f9fcc198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:28.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.026+0000 7f9fd0e00640 1 -- 172.21.15.86:0/1184378715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fcc072eb0 msgr2=0x7f9fcc198110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:28.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.026+0000 7f9fd0e00640 1 --2- 172.21.15.86:0/1184378715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fcc072eb0 0x7f9fcc198110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.026+0000 7f9fd0e00640 1 -- 172.21.15.86:0/1184378715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9fcc074490 msgr2=0x7f9fcc198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:28.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.026+0000 7f9fd0e00640 1 --2- 172.21.15.86:0/1184378715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9fcc074490 0x7f9fcc198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.026+0000 7f9fd0e00640 1 -- 172.21.15.86:0/1184378715 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb8009560 con 0x7f9fcc107c30 2024-09-13T16:10:28.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.026+0000 7f9fcbe00640 1 --2- 172.21.15.86:0/1184378715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fcc072eb0 0x7f9fcc198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:28.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.026+0000 7f9fd0e00640 1 --2- 172.21.15.86:0/1184378715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fcc107c30 0x7f9fcc19f6c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4009fd0 tx=0x7f9fc400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:28.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.026+0000 7f9fc8c00640 1 -- 172.21.15.86:0/1184378715 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc400bea0 con 0x7f9fcc107c30 2024-09-13T16:10:28.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.026+0000 7f9fc8c00640 1 -- 172.21.15.86:0/1184378715 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9fc4009940 con 0x7f9fcc107c30 2024-09-13T16:10:28.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.026+0000 7f9fd2e00640 1 -- 172.21.15.86:0/1184378715 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fcc1a0210 con 0x7f9fcc107c30 2024-09-13T16:10:28.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.026+0000 7f9fc8c00640 1 -- 172.21.15.86:0/1184378715 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc40106c0 con 0x7f9fcc107c30 2024-09-13T16:10:28.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.026+0000 7f9fd2e00640 1 -- 172.21.15.86:0/1184378715 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fcc1a06f0 con 0x7f9fcc107c30 2024-09-13T16:10:28.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.027+0000 7f9fd2e00640 1 -- 172.21.15.86:0/1184378715 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fcc1069f0 con 0x7f9fcc107c30 2024-09-13T16:10:28.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.029+0000 7f9fc8c00640 1 -- 172.21.15.86:0/1184378715 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9fc4004220 con 0x7f9fcc107c30 2024-09-13T16:10:28.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.030+0000 7f9fc8c00640 1 --2- 172.21.15.86:0/1184378715 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9fb00a1110 0x7f9fb00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:28.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.031+0000 7f9fc8c00640 1 -- 172.21.15.86:0/1184378715 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f9fc40cc8c0 con 0x7f9fcc107c30 2024-09-13T16:10:28.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.031+0000 7f9fcbe00640 1 --2- 172.21.15.86:0/1184378715 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9fb00a1110 0x7f9fb00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:28.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.031+0000 7f9fcbe00640 1 --2- 172.21.15.86:0/1184378715 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9fb00a1110 0x7f9fb00a35d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009fc0 tx=0x7f9fbc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:28.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.034+0000 7f9fc8c00640 1 -- 172.21.15.86:0/1184378715 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9fc4095ce0 con 0x7f9fcc107c30 2024-09-13T16:10:28.209 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.207+0000 7f9fd2e00640 1 -- 172.21.15.86:0/1184378715 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fcc10da00 con 0x7f9fcc107c30 2024-09-13T16:10:28.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.209+0000 7f9fc8c00640 1 -- 172.21.15.86:0/1184378715 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24703 (secure 0 0 0) 0x7f9fc4099300 con 0x7f9fcc107c30 2024-09-13T16:10:28.211 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:10:28.211 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":94,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:10:00.680229+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":7}]},{"pgid":"3.19","mappings":[{"from":3,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2f","mappings":[{"from":1,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:10:28.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.211+0000 7f9fd2e00640 1 -- 172.21.15.86:0/1184378715 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9fb00a1110 msgr2=0x7f9fb00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:28.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.211+0000 7f9fd2e00640 1 --2- 172.21.15.86:0/1184378715 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9fb00a1110 0x7f9fb00a35d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009fc0 tx=0x7f9fbc005f90 comp rx=0 tx=0).stop 2024-09-13T16:10:28.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.211+0000 7f9fd2e00640 1 -- 172.21.15.86:0/1184378715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fcc107c30 msgr2=0x7f9fcc19f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:28.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.211+0000 7f9fd2e00640 1 --2- 172.21.15.86:0/1184378715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fcc107c30 0x7f9fcc19f6c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4009fd0 tx=0x7f9fc400b260 comp rx=0 tx=0).stop 2024-09-13T16:10:28.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.211+0000 7f9fd2e00640 1 -- 172.21.15.86:0/1184378715 shutdown_connections 2024-09-13T16:10:28.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.211+0000 7f9fd2e00640 1 --2- 172.21.15.86:0/1184378715 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9fb00a1110 0x7f9fb00a35d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.211+0000 7f9fd2e00640 1 --2- 172.21.15.86:0/1184378715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fcc107c30 0x7f9fcc19f6c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.211+0000 7f9fd2e00640 1 --2- 172.21.15.86:0/1184378715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9fcc074490 0x7f9fcc198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.211+0000 7f9fd2e00640 1 --2- 172.21.15.86:0/1184378715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fcc072eb0 0x7f9fcc198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.211+0000 7f9fd2e00640 1 -- 172.21.15.86:0/1184378715 >> 172.21.15.86:0/1184378715 conn(0x7f9fcc0fb520 msgr2=0x7f9fcc103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:28.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.211+0000 7f9fd2e00640 1 -- 172.21.15.86:0/1184378715 shutdown_connections 2024-09-13T16:10:28.214 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.212+0000 7f9fd2e00640 1 -- 172.21.15.86:0/1184378715 wait complete. 2024-09-13T16:10:28.230 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:03:27.830423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:08:07.732536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:08:08.742145+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T16:08:11.721740+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T16:10:28.230 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:10:28.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.384+0000 7f658ec00640 1 -- 172.21.15.86:0/3129441960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6588101920 msgr2=0x7f65881081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:28.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.384+0000 7f658ec00640 1 --2- 172.21.15.86:0/3129441960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6588101920 0x7f65881081b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6580009ca0 tx=0x7f658002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.384+0000 7f658ec00640 1 -- 172.21.15.86:0/3129441960 shutdown_connections 2024-09-13T16:10:28.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.384+0000 7f658ec00640 1 --2- 172.21.15.86:0/3129441960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6588101920 0x7f65881081b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.384+0000 7f658ec00640 1 --2- 172.21.15.86:0/3129441960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6588100f60 0x7f65881013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.384+0000 7f658ec00640 1 --2- 172.21.15.86:0/3129441960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65880ffd70 0x7f6588100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.384+0000 7f658ec00640 1 -- 172.21.15.86:0/3129441960 >> 172.21.15.86:0/3129441960 conn(0x7f65880fb4d0 msgr2=0x7f65880fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:28.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.384+0000 7f658ec00640 1 -- 172.21.15.86:0/3129441960 shutdown_connections 2024-09-13T16:10:28.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.384+0000 7f658ec00640 1 -- 172.21.15.86:0/3129441960 wait complete. 2024-09-13T16:10:28.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.385+0000 7f658ec00640 1 Processor -- start 2024-09-13T16:10:28.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.385+0000 7f658ec00640 1 -- start start 2024-09-13T16:10:28.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.385+0000 7f658ec00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65880ffd70 0x7f6588074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:28.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.385+0000 7f658ec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6588100f60 0x7f65880728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:28.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.385+0000 7f658ec00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6588101920 0x7f6588072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:28.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.385+0000 7f658ec00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6588073540 con 0x7f6588101920 2024-09-13T16:10:28.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.385+0000 7f658ec00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65880736b0 con 0x7f65880ffd70 2024-09-13T16:10:28.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.385+0000 7f658ec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658819fe30 con 0x7f6588100f60 2024-09-13T16:10:28.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.386+0000 7f658cc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6588101920 0x7f6588072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:28.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.386+0000 7f658cc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6588101920 0x7f6588072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43160/0 (socket says 172.21.15.86:43160) 2024-09-13T16:10:28.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.386+0000 7f658cc00640 1 -- 172.21.15.86:0/2462408648 learned_addr learned my addr 172.21.15.86:0/2462408648 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:28.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.386+0000 7f6587400640 1 --2- 172.21.15.86:0/2462408648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6588100f60 0x7f65880728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:28.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.386+0000 7f6587e00640 1 --2- 172.21.15.86:0/2462408648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65880ffd70 0x7f6588074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:28.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.386+0000 7f658cc00640 1 -- 172.21.15.86:0/2462408648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6588100f60 msgr2=0x7f65880728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:28.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.386+0000 7f658cc00640 1 --2- 172.21.15.86:0/2462408648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6588100f60 0x7f65880728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.386+0000 7f658cc00640 1 -- 172.21.15.86:0/2462408648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65880ffd70 msgr2=0x7f6588074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:28.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.386+0000 7f658cc00640 1 --2- 172.21.15.86:0/2462408648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65880ffd70 0x7f6588074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.386+0000 7f658cc00640 1 -- 172.21.15.86:0/2462408648 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6574009490 con 0x7f6588101920 2024-09-13T16:10:28.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.386+0000 7f658cc00640 1 --2- 172.21.15.86:0/2462408648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6588101920 0x7f6588072de0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6580033040 tx=0x7f6580003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:28.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.387+0000 7f6584c00640 1 -- 172.21.15.86:0/2462408648 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580031450 con 0x7f6588101920 2024-09-13T16:10:28.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.387+0000 7f6584c00640 1 -- 172.21.15.86:0/2462408648 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6580040070 con 0x7f6588101920 2024-09-13T16:10:28.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.387+0000 7f658ec00640 1 -- 172.21.15.86:0/2462408648 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6580009900 con 0x7f6588101920 2024-09-13T16:10:28.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.387+0000 7f6584c00640 1 -- 172.21.15.86:0/2462408648 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580030820 con 0x7f6588101920 2024-09-13T16:10:28.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.387+0000 7f658ec00640 1 -- 172.21.15.86:0/2462408648 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65881a0400 con 0x7f6588101920 2024-09-13T16:10:28.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.388+0000 7f658ec00640 1 -- 172.21.15.86:0/2462408648 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65881070b0 con 0x7f6588101920 2024-09-13T16:10:28.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.390+0000 7f6584c00640 1 -- 172.21.15.86:0/2462408648 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6580042030 con 0x7f6588101920 2024-09-13T16:10:28.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.392+0000 7f6584c00640 1 --2- 172.21.15.86:0/2462408648 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f656c0a1090 0x7f656c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:28.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.392+0000 7f6584c00640 1 -- 172.21.15.86:0/2462408648 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f65800ee1a0 con 0x7f6588101920 2024-09-13T16:10:28.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.392+0000 7f6587e00640 1 --2- 172.21.15.86:0/2462408648 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f656c0a1090 0x7f656c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:28.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.393+0000 7f6587e00640 1 --2- 172.21.15.86:0/2462408648 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f656c0a1090 0x7f656c0a3550 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6588100dc0 tx=0x7f6578005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:28.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.396+0000 7f6584c00640 1 -- 172.21.15.86:0/2462408648 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f65800b7510 con 0x7f6588101920 2024-09-13T16:10:28.570 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.569+0000 7f658ec00640 1 -- 172.21.15.86:0/2462408648 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f658810b800 con 0x7f6588101920 2024-09-13T16:10:28.571 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.569+0000 7f6584c00640 1 -- 172.21.15.86:0/2462408648 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f658810b800 con 0x7f6588101920 2024-09-13T16:10:28.571 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-09-13T16:10:28.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.571+0000 7f658ec00640 1 -- 172.21.15.86:0/2462408648 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f656c0a1090 msgr2=0x7f656c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:28.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.571+0000 7f658ec00640 1 --2- 172.21.15.86:0/2462408648 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f656c0a1090 0x7f656c0a3550 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6588100dc0 tx=0x7f6578005f90 comp rx=0 tx=0).stop 2024-09-13T16:10:28.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.571+0000 7f658ec00640 1 -- 172.21.15.86:0/2462408648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6588101920 msgr2=0x7f6588072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:28.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.571+0000 7f658ec00640 1 --2- 172.21.15.86:0/2462408648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6588101920 0x7f6588072de0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6580033040 tx=0x7f6580003ba0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.571+0000 7f658ec00640 1 -- 172.21.15.86:0/2462408648 shutdown_connections 2024-09-13T16:10:28.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.571+0000 7f658ec00640 1 --2- 172.21.15.86:0/2462408648 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f656c0a1090 0x7f656c0a3550 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.571+0000 7f658ec00640 1 --2- 172.21.15.86:0/2462408648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6588101920 0x7f6588072de0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.571+0000 7f658ec00640 1 --2- 172.21.15.86:0/2462408648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6588100f60 0x7f65880728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.571+0000 7f658ec00640 1 --2- 172.21.15.86:0/2462408648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65880ffd70 0x7f6588074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.571+0000 7f658ec00640 1 -- 172.21.15.86:0/2462408648 >> 172.21.15.86:0/2462408648 conn(0x7f65880fb4d0 msgr2=0x7f6588104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:28.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.572+0000 7f658ec00640 1 -- 172.21.15.86:0/2462408648 shutdown_connections 2024-09-13T16:10:28.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.572+0000 7f658ec00640 1 -- 172.21.15.86:0/2462408648 wait complete. 2024-09-13T16:10:28.586 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:28 smithi086 ceph-mon[30379]: pgmap v368: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:10:28.587 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:28 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1184378715' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:10:28.589 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:10:28.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.745+0000 7f4138600640 1 -- 172.21.15.86:0/1675928611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4130100f60 msgr2=0x7f41301013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:28.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.745+0000 7f4138600640 1 --2- 172.21.15.86:0/1675928611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4130100f60 0x7f41301013e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f411c009900 tx=0x7f411c02a410 comp rx=0 tx=0).stop 2024-09-13T16:10:28.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.745+0000 7f4138600640 1 -- 172.21.15.86:0/1675928611 shutdown_connections 2024-09-13T16:10:28.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.745+0000 7f4138600640 1 --2- 172.21.15.86:0/1675928611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4130101920 0x7f41301081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.745+0000 7f4138600640 1 --2- 172.21.15.86:0/1675928611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4130100f60 0x7f41301013e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.745+0000 7f4138600640 1 --2- 172.21.15.86:0/1675928611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41300ffd70 0x7f4130100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.745+0000 7f4138600640 1 -- 172.21.15.86:0/1675928611 >> 172.21.15.86:0/1675928611 conn(0x7f41300fb4d0 msgr2=0x7f41300fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:28.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.745+0000 7f4138600640 1 -- 172.21.15.86:0/1675928611 shutdown_connections 2024-09-13T16:10:28.748 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.745+0000 7f4138600640 1 -- 172.21.15.86:0/1675928611 wait complete. 2024-09-13T16:10:28.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:28 smithi139 ceph-mon[35320]: pgmap v368: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:10:28.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:28 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1184378715' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:10:28.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.746+0000 7f4138600640 1 Processor -- start 2024-09-13T16:10:28.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.746+0000 7f4138600640 1 -- start start 2024-09-13T16:10:28.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.747+0000 7f4138600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41300ffd70 0x7f4130074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:28.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.747+0000 7f4138600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4130100f60 0x7f41300728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:28.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.747+0000 7f4138600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4130101920 0x7f4130072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.747+0000 7f4138600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4130073540 con 0x7f4130101920 2024-09-13T16:10:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.747+0000 7f4138600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41300736b0 con 0x7f41300ffd70 2024-09-13T16:10:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.747+0000 7f4138600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413019fe70 con 0x7f4130100f60 2024-09-13T16:10:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.747+0000 7f4136600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4130101920 0x7f4130072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.747+0000 7f4136600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4130101920 0x7f4130072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43178/0 (socket says 172.21.15.86:43178) 2024-09-13T16:10:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.747+0000 7f4135c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41300ffd70 0x7f4130074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.747+0000 7f4136600640 1 -- 172.21.15.86:0/251147198 learned_addr learned my addr 172.21.15.86:0/251147198 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.747+0000 7f4135200640 1 --2- 172.21.15.86:0/251147198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4130100f60 0x7f41300728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.747+0000 7f4136600640 1 -- 172.21.15.86:0/251147198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4130100f60 msgr2=0x7f41300728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.747+0000 7f4136600640 1 --2- 172.21.15.86:0/251147198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4130100f60 0x7f41300728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.747+0000 7f4136600640 1 -- 172.21.15.86:0/251147198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41300ffd70 msgr2=0x7f4130074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.747+0000 7f4136600640 1 --2- 172.21.15.86:0/251147198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41300ffd70 0x7f4130074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.747+0000 7f4136600640 1 -- 172.21.15.86:0/251147198 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c009560 con 0x7f4130101920 2024-09-13T16:10:28.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.747+0000 7f4135c00640 1 --2- 172.21.15.86:0/251147198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41300ffd70 0x7f4130074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:28.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.748+0000 7f4136600640 1 --2- 172.21.15.86:0/251147198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4130101920 0x7f4130072de0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f412800eb40 tx=0x7f412800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:28.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.748+0000 7f412e000640 1 -- 172.21.15.86:0/251147198 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4128004b20 con 0x7f4130101920 2024-09-13T16:10:28.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.748+0000 7f412e000640 1 -- 172.21.15.86:0/251147198 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4128004c80 con 0x7f4130101920 2024-09-13T16:10:28.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.748+0000 7f4138600640 1 -- 172.21.15.86:0/251147198 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41301a0120 con 0x7f4130101920 2024-09-13T16:10:28.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.748+0000 7f412e000640 1 -- 172.21.15.86:0/251147198 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4128010670 con 0x7f4130101920 2024-09-13T16:10:28.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.748+0000 7f4138600640 1 -- 172.21.15.86:0/251147198 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41301a0600 con 0x7f4130101920 2024-09-13T16:10:28.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.749+0000 7f4138600640 1 -- 172.21.15.86:0/251147198 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41301071b0 con 0x7f4130101920 2024-09-13T16:10:28.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.751+0000 7f412e000640 1 -- 172.21.15.86:0/251147198 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4128005020 con 0x7f4130101920 2024-09-13T16:10:28.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.752+0000 7f412e000640 1 --2- 172.21.15.86:0/251147198 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f41180a1090 0x7f41180a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:28.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.752+0000 7f412e000640 1 -- 172.21.15.86:0/251147198 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f4128014070 con 0x7f4130101920 2024-09-13T16:10:28.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.752+0000 7f4135c00640 1 --2- 172.21.15.86:0/251147198 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f41180a1090 0x7f41180a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:28.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.753+0000 7f4135c00640 1 --2- 172.21.15.86:0/251147198 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f41180a1090 0x7f41180a3550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4130100dc0 tx=0x7f4124005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:28 smithi194 ceph-mon[35694]: pgmap v368: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:10:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:28 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1184378715' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:10:28.757 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.756+0000 7f412e000640 1 -- 172.21.15.86:0/251147198 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4128096750 con 0x7f4130101920 2024-09-13T16:10:28.927 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.925+0000 7f4138600640 1 -- 172.21.15.86:0/251147198 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f413010ba40 con 0x7f4130101920 2024-09-13T16:10:28.927 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.926+0000 7f412e000640 1 -- 172.21.15.86:0/251147198 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4128099d70 con 0x7f4130101920 2024-09-13T16:10:28.928 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-09-13T16:10:28.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.928+0000 7f4138600640 1 -- 172.21.15.86:0/251147198 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f41180a1090 msgr2=0x7f41180a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:28.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.928+0000 7f4138600640 1 --2- 172.21.15.86:0/251147198 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f41180a1090 0x7f41180a3550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4130100dc0 tx=0x7f4124005f90 comp rx=0 tx=0).stop 2024-09-13T16:10:28.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.928+0000 7f4138600640 1 -- 172.21.15.86:0/251147198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4130101920 msgr2=0x7f4130072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:28.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.928+0000 7f4138600640 1 --2- 172.21.15.86:0/251147198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4130101920 0x7f4130072de0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f412800eb40 tx=0x7f412800c2d0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.928+0000 7f4138600640 1 -- 172.21.15.86:0/251147198 shutdown_connections 2024-09-13T16:10:28.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.928+0000 7f4138600640 1 --2- 172.21.15.86:0/251147198 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f41180a1090 0x7f41180a3550 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.928+0000 7f4138600640 1 --2- 172.21.15.86:0/251147198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4130101920 0x7f4130072de0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.928+0000 7f4138600640 1 --2- 172.21.15.86:0/251147198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4130100f60 0x7f41300728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.928+0000 7f4138600640 1 --2- 172.21.15.86:0/251147198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41300ffd70 0x7f4130074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:28.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.928+0000 7f4138600640 1 -- 172.21.15.86:0/251147198 >> 172.21.15.86:0/251147198 conn(0x7f41300fb4d0 msgr2=0x7f4130104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:28.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.928+0000 7f4138600640 1 -- 172.21.15.86:0/251147198 shutdown_connections 2024-09-13T16:10:28.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:28.928+0000 7f4138600640 1 -- 172.21.15.86:0/251147198 wait complete. 2024-09-13T16:10:28.946 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:10:29.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.101+0000 7f599be00640 1 -- 172.21.15.86:0/2662335799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5994103190 msgr2=0x7f5994103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:29.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.101+0000 7f599be00640 1 --2- 172.21.15.86:0/2662335799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5994103190 0x7f5994103610 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5980009900 tx=0x7f598002a410 comp rx=0 tx=0).stop 2024-09-13T16:10:29.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.101+0000 7f599be00640 1 -- 172.21.15.86:0/2662335799 shutdown_connections 2024-09-13T16:10:29.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.101+0000 7f599be00640 1 --2- 172.21.15.86:0/2662335799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5994103b50 0x7f599410a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.101+0000 7f599be00640 1 --2- 172.21.15.86:0/2662335799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5994103190 0x7f5994103610 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.101+0000 7f599be00640 1 --2- 172.21.15.86:0/2662335799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5994101fa0 0x7f59941023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.101+0000 7f599be00640 1 -- 172.21.15.86:0/2662335799 >> 172.21.15.86:0/2662335799 conn(0x7f59940fd700 msgr2=0x7f59940ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:29.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.101+0000 7f599be00640 1 -- 172.21.15.86:0/2662335799 shutdown_connections 2024-09-13T16:10:29.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.101+0000 7f599be00640 1 -- 172.21.15.86:0/2662335799 wait complete. 2024-09-13T16:10:29.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.102+0000 7f599be00640 1 Processor -- start 2024-09-13T16:10:29.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.102+0000 7f599be00640 1 -- start start 2024-09-13T16:10:29.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.102+0000 7f599be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5994101fa0 0x7f59941980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:29.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.103+0000 7f599be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5994103190 0x7f59941985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:29.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.103+0000 7f599be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5994103b50 0x7f599419f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:29.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.103+0000 7f599be00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599419fb90 con 0x7f5994103b50 2024-09-13T16:10:29.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.103+0000 7f599be00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599419fd00 con 0x7f5994103190 2024-09-13T16:10:29.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.103+0000 7f599be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599419fec0 con 0x7f5994101fa0 2024-09-13T16:10:29.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.103+0000 7f5999e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5994103b50 0x7f599419f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:29.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.103+0000 7f5999e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5994103b50 0x7f599419f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43202/0 (socket says 172.21.15.86:43202) 2024-09-13T16:10:29.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.103+0000 7f5999e00640 1 -- 172.21.15.86:0/3519109375 learned_addr learned my addr 172.21.15.86:0/3519109375 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:29.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.103+0000 7f5999400640 1 --2- 172.21.15.86:0/3519109375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5994101fa0 0x7f59941980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:29.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.103+0000 7f5998a00640 1 --2- 172.21.15.86:0/3519109375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5994103190 0x7f59941985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:29.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.103+0000 7f5999e00640 1 -- 172.21.15.86:0/3519109375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5994101fa0 msgr2=0x7f59941980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:29.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.103+0000 7f5999e00640 1 --2- 172.21.15.86:0/3519109375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5994101fa0 0x7f59941980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.103+0000 7f5999e00640 1 -- 172.21.15.86:0/3519109375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5994103190 msgr2=0x7f59941985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:29.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.103+0000 7f5999e00640 1 --2- 172.21.15.86:0/3519109375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5994103190 0x7f59941985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.103+0000 7f5999e00640 1 -- 172.21.15.86:0/3519109375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c009840 con 0x7f5994103b50 2024-09-13T16:10:29.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.103+0000 7f5999e00640 1 --2- 172.21.15.86:0/3519109375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5994103b50 0x7f599419f650 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f598c00efd0 tx=0x7f598c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:29.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.104+0000 7f5992000640 1 -- 172.21.15.86:0/3519109375 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c009b40 con 0x7f5994103b50 2024-09-13T16:10:29.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.104+0000 7f5992000640 1 -- 172.21.15.86:0/3519109375 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f598c003b70 con 0x7f5994103b50 2024-09-13T16:10:29.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.104+0000 7f5992000640 1 -- 172.21.15.86:0/3519109375 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c0108f0 con 0x7f5994103b50 2024-09-13T16:10:29.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.104+0000 7f599be00640 1 -- 172.21.15.86:0/3519109375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5980009560 con 0x7f5994103b50 2024-09-13T16:10:29.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.104+0000 7f599be00640 1 -- 172.21.15.86:0/3519109375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59941a04a0 con 0x7f5994103b50 2024-09-13T16:10:29.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.105+0000 7f599be00640 1 -- 172.21.15.86:0/3519109375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5994109430 con 0x7f5994103b50 2024-09-13T16:10:29.108 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.107+0000 7f5992000640 1 -- 172.21.15.86:0/3519109375 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f598c003ce0 con 0x7f5994103b50 2024-09-13T16:10:29.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.108+0000 7f5992000640 1 --2- 172.21.15.86:0/3519109375 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f597c0a1110 0x7f597c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:29.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.108+0000 7f5992000640 1 -- 172.21.15.86:0/3519109375 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f598c014070 con 0x7f5994103b50 2024-09-13T16:10:29.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.108+0000 7f5999400640 1 --2- 172.21.15.86:0/3519109375 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f597c0a1110 0x7f597c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:29.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.109+0000 7f5999400640 1 --2- 172.21.15.86:0/3519109375 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f597c0a1110 0x7f597c0a35d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5994102ff0 tx=0x7f5988005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:29.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.112+0000 7f5992000640 1 -- 172.21.15.86:0/3519109375 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f598c096640 con 0x7f5994103b50 2024-09-13T16:10:29.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.287+0000 7f599be00640 1 -- 172.21.15.86:0/3519109375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f599402c3e0 con 0x7f5994103b50 2024-09-13T16:10:29.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.287+0000 7f5992000640 1 -- 172.21.15.86:0/3519109375 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f598c099c60 con 0x7f5994103b50 2024-09-13T16:10:29.289 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2024-09-13T16:10:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.289+0000 7f599be00640 1 -- 172.21.15.86:0/3519109375 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f597c0a1110 msgr2=0x7f597c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.289+0000 7f599be00640 1 --2- 172.21.15.86:0/3519109375 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f597c0a1110 0x7f597c0a35d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5994102ff0 tx=0x7f5988005f90 comp rx=0 tx=0).stop 2024-09-13T16:10:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.289+0000 7f599be00640 1 -- 172.21.15.86:0/3519109375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5994103b50 msgr2=0x7f599419f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.289+0000 7f599be00640 1 --2- 172.21.15.86:0/3519109375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5994103b50 0x7f599419f650 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f598c00efd0 tx=0x7f598c00c6a0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.289+0000 7f599be00640 1 -- 172.21.15.86:0/3519109375 shutdown_connections 2024-09-13T16:10:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.289+0000 7f599be00640 1 --2- 172.21.15.86:0/3519109375 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f597c0a1110 0x7f597c0a35d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.289+0000 7f599be00640 1 --2- 172.21.15.86:0/3519109375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5994103b50 0x7f599419f650 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.289+0000 7f599be00640 1 --2- 172.21.15.86:0/3519109375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5994103190 0x7f59941985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.289+0000 7f599be00640 1 --2- 172.21.15.86:0/3519109375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5994101fa0 0x7f59941980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.289+0000 7f599be00640 1 -- 172.21.15.86:0/3519109375 >> 172.21.15.86:0/3519109375 conn(0x7f59940fd700 msgr2=0x7f5994106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:29.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.289+0000 7f599be00640 1 -- 172.21.15.86:0/3519109375 shutdown_connections 2024-09-13T16:10:29.294 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.289+0000 7f599be00640 1 -- 172.21.15.86:0/3519109375 wait complete. 2024-09-13T16:10:29.308 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T16:10:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.464+0000 7f9c58000640 1 -- 172.21.15.86:0/2300956810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c50101f80 msgr2=0x7f9c50102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.464+0000 7f9c58000640 1 --2- 172.21.15.86:0/2300956810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c50101f80 0x7f9c50102380 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009900 tx=0x7f9c4402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.464+0000 7f9c58000640 1 -- 172.21.15.86:0/2300956810 shutdown_connections 2024-09-13T16:10:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.464+0000 7f9c58000640 1 --2- 172.21.15.86:0/2300956810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c50103b30 0x7f9c5010a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.464+0000 7f9c58000640 1 --2- 172.21.15.86:0/2300956810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c50103170 0x7f9c501035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.464+0000 7f9c58000640 1 --2- 172.21.15.86:0/2300956810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c50101f80 0x7f9c50102380 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.464+0000 7f9c58000640 1 -- 172.21.15.86:0/2300956810 >> 172.21.15.86:0/2300956810 conn(0x7f9c500fd700 msgr2=0x7f9c500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:29.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.464+0000 7f9c58000640 1 -- 172.21.15.86:0/2300956810 shutdown_connections 2024-09-13T16:10:29.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.464+0000 7f9c58000640 1 -- 172.21.15.86:0/2300956810 wait complete. 2024-09-13T16:10:29.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.465+0000 7f9c58000640 1 Processor -- start 2024-09-13T16:10:29.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.465+0000 7f9c58000640 1 -- start start 2024-09-13T16:10:29.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.466+0000 7f9c58000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c50101f80 0x7f9c501980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:29.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.466+0000 7f9c58000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c50103170 0x7f9c50198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:29.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.466+0000 7f9c58000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c50103b30 0x7f9c5019f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:29.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.466+0000 7f9c58000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5019fb70 con 0x7f9c50103170 2024-09-13T16:10:29.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.466+0000 7f9c58000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5019fce0 con 0x7f9c50103b30 2024-09-13T16:10:29.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.466+0000 7f9c58000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5019fea0 con 0x7f9c50101f80 2024-09-13T16:10:29.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.466+0000 7f9c54c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c50103170 0x7f9c50198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:29.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.466+0000 7f9c55600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c50101f80 0x7f9c501980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:29.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.466+0000 7f9c55600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c50101f80 0x7f9c501980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:45364/0 (socket says 172.21.15.86:45364) 2024-09-13T16:10:29.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.466+0000 7f9c55600640 1 -- 172.21.15.86:0/570576128 learned_addr learned my addr 172.21.15.86:0/570576128 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:29.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.466+0000 7f9c56000640 1 --2- 172.21.15.86:0/570576128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c50103b30 0x7f9c5019f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:29.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.466+0000 7f9c54c00640 1 -- 172.21.15.86:0/570576128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c50101f80 msgr2=0x7f9c501980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.466+0000 7f9c54c00640 1 --2- 172.21.15.86:0/570576128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c50101f80 0x7f9c501980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.466+0000 7f9c54c00640 1 -- 172.21.15.86:0/570576128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c50103b30 msgr2=0x7f9c5019f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.466+0000 7f9c54c00640 1 --2- 172.21.15.86:0/570576128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c50103b30 0x7f9c5019f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.466+0000 7f9c54c00640 1 -- 172.21.15.86:0/570576128 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c44009560 con 0x7f9c50103170 2024-09-13T16:10:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.466+0000 7f9c55600640 1 --2- 172.21.15.86:0/570576128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c50101f80 0x7f9c501980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.467+0000 7f9c54c00640 1 --2- 172.21.15.86:0/570576128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c50103170 0x7f9c50198610 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00e9f0 tx=0x7f9c3c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.467+0000 7f9c4e000640 1 -- 172.21.15.86:0/570576128 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c00ccc0 con 0x7f9c50103170 2024-09-13T16:10:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.467+0000 7f9c4e000640 1 -- 172.21.15.86:0/570576128 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9c3c00ce20 con 0x7f9c50103170 2024-09-13T16:10:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.467+0000 7f9c58000640 1 -- 172.21.15.86:0/570576128 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c501a0180 con 0x7f9c50103170 2024-09-13T16:10:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.467+0000 7f9c4e000640 1 -- 172.21.15.86:0/570576128 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c018920 con 0x7f9c50103170 2024-09-13T16:10:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.467+0000 7f9c58000640 1 -- 172.21.15.86:0/570576128 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c501a06e0 con 0x7f9c50103170 2024-09-13T16:10:29.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.468+0000 7f9c58000640 1 -- 172.21.15.86:0/570576128 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c50109370 con 0x7f9c50103170 2024-09-13T16:10:29.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.470+0000 7f9c4e000640 1 -- 172.21.15.86:0/570576128 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9c3c018a80 con 0x7f9c50103170 2024-09-13T16:10:29.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.472+0000 7f9c4e000640 1 --2- 172.21.15.86:0/570576128 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9c380a1110 0x7f9c380a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:29.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.472+0000 7f9c4e000640 1 -- 172.21.15.86:0/570576128 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f9c3c014070 con 0x7f9c50103170 2024-09-13T16:10:29.473 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.472+0000 7f9c55600640 1 --2- 172.21.15.86:0/570576128 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9c380a1110 0x7f9c380a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:29.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.473+0000 7f9c55600640 1 --2- 172.21.15.86:0/570576128 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9c380a1110 0x7f9c380a35d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9c44006010 tx=0x7f9c44005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:29.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.475+0000 7f9c4e000640 1 -- 172.21.15.86:0/570576128 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9c3c052e20 con 0x7f9c50103170 2024-09-13T16:10:29.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:29 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2462408648' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:10:29.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:29 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/251147198' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:10:29.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:29 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3519109375' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:10:29.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.648+0000 7f9c58000640 1 -- 172.21.15.86:0/570576128 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9c50108de0 con 0x7f9c50103170 2024-09-13T16:10:29.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.649+0000 7f9c4e000640 1 -- 172.21.15.86:0/570576128 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9c3c099e00 con 0x7f9c50103170 2024-09-13T16:10:29.651 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-09-13T16:10:29.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.651+0000 7f9c58000640 1 -- 172.21.15.86:0/570576128 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9c380a1110 msgr2=0x7f9c380a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:29.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.651+0000 7f9c58000640 1 --2- 172.21.15.86:0/570576128 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9c380a1110 0x7f9c380a35d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9c44006010 tx=0x7f9c44005a20 comp rx=0 tx=0).stop 2024-09-13T16:10:29.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.651+0000 7f9c58000640 1 -- 172.21.15.86:0/570576128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c50103170 msgr2=0x7f9c50198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:29.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.651+0000 7f9c58000640 1 --2- 172.21.15.86:0/570576128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c50103170 0x7f9c50198610 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00e9f0 tx=0x7f9c3c00eeb0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.651+0000 7f9c58000640 1 -- 172.21.15.86:0/570576128 shutdown_connections 2024-09-13T16:10:29.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.651+0000 7f9c58000640 1 --2- 172.21.15.86:0/570576128 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f9c380a1110 0x7f9c380a35d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.651+0000 7f9c58000640 1 --2- 172.21.15.86:0/570576128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c50103b30 0x7f9c5019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.651+0000 7f9c58000640 1 --2- 172.21.15.86:0/570576128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c50103170 0x7f9c50198610 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.651+0000 7f9c58000640 1 --2- 172.21.15.86:0/570576128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c50101f80 0x7f9c501980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.651+0000 7f9c58000640 1 -- 172.21.15.86:0/570576128 >> 172.21.15.86:0/570576128 conn(0x7f9c500fd700 msgr2=0x7f9c50106540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:29.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.651+0000 7f9c58000640 1 -- 172.21.15.86:0/570576128 shutdown_connections 2024-09-13T16:10:29.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.651+0000 7f9c58000640 1 -- 172.21.15.86:0/570576128 wait complete. 2024-09-13T16:10:29.670 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:10:29.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:29 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2462408648' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:10:29.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:29 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/251147198' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:10:29.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:29 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3519109375' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:10:29.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:29 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2462408648' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:10:29.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:29 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/251147198' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:10:29.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:29 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3519109375' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:10:29.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.823+0000 7fc3d4e00640 1 -- 172.21.15.86:0/2960715670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3d0102f40 msgr2=0x7fc3d0105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:29.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.823+0000 7fc3d4e00640 1 --2- 172.21.15.86:0/2960715670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3d0102f40 0x7fc3d0105330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc009900 tx=0x7fc3bc02a410 comp rx=0 tx=0).stop 2024-09-13T16:10:29.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.823+0000 7fc3d4e00640 1 -- 172.21.15.86:0/2960715670 shutdown_connections 2024-09-13T16:10:29.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.823+0000 7fc3d4e00640 1 --2- 172.21.15.86:0/2960715670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3d0105870 0x7fc3d0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.823+0000 7fc3d4e00640 1 --2- 172.21.15.86:0/2960715670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3d0102f40 0x7fc3d0105330 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.823+0000 7fc3d4e00640 1 --2- 172.21.15.86:0/2960715670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d0100610 0x7fc3d0102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.823+0000 7fc3d4e00640 1 -- 172.21.15.86:0/2960715670 >> 172.21.15.86:0/2960715670 conn(0x7fc3d00fa1f0 msgr2=0x7fc3d00fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:29.825 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.823+0000 7fc3d4e00640 1 -- 172.21.15.86:0/2960715670 shutdown_connections 2024-09-13T16:10:29.826 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.823+0000 7fc3d4e00640 1 -- 172.21.15.86:0/2960715670 wait complete. 2024-09-13T16:10:29.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.824+0000 7fc3d4e00640 1 Processor -- start 2024-09-13T16:10:29.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.824+0000 7fc3d4e00640 1 -- start start 2024-09-13T16:10:29.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.824+0000 7fc3d4e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3d0100610 0x7fc3d0197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:29.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.824+0000 7fc3d4e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3d0102f40 0x7fc3d0198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:29.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.824+0000 7fc3d4e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d0105870 0x7fc3d019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:29.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.824+0000 7fc3d4e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d019f9c0 con 0x7fc3d0102f40 2024-09-13T16:10:29.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.824+0000 7fc3d4e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d019fb30 con 0x7fc3d0100610 2024-09-13T16:10:29.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.824+0000 7fc3d4e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d019fcf0 con 0x7fc3d0105870 2024-09-13T16:10:29.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.824+0000 7fc3cea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3d0102f40 0x7fc3d0198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:29.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.824+0000 7fc3cf400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3d0100610 0x7fc3d0197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:29.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.824+0000 7fc3cf400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3d0100610 0x7fc3d0197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:52488/0 (socket says 172.21.15.86:52488) 2024-09-13T16:10:29.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.824+0000 7fc3cf400640 1 -- 172.21.15.86:0/1007162137 learned_addr learned my addr 172.21.15.86:0/1007162137 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:29.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.825+0000 7fc3cfe00640 1 --2- 172.21.15.86:0/1007162137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d0105870 0x7fc3d019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:29.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.825+0000 7fc3cf400640 1 -- 172.21.15.86:0/1007162137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d0105870 msgr2=0x7fc3d019f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:29.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.825+0000 7fc3cf400640 1 --2- 172.21.15.86:0/1007162137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d0105870 0x7fc3d019f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.825+0000 7fc3cf400640 1 -- 172.21.15.86:0/1007162137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3d0102f40 msgr2=0x7fc3d0198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:29.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.825+0000 7fc3cf400640 1 --2- 172.21.15.86:0/1007162137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3d0102f40 0x7fc3d0198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:29.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.825+0000 7fc3cf400640 1 -- 172.21.15.86:0/1007162137 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc009560 con 0x7fc3d0100610 2024-09-13T16:10:29.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.825+0000 7fc3cf400640 1 --2- 172.21.15.86:0/1007162137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3d0100610 0x7fc3d0197ed0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000e9f0 tx=0x7fc3c000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:29.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.825+0000 7fc3c7e00640 1 -- 172.21.15.86:0/1007162137 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0009720 con 0x7fc3d0100610 2024-09-13T16:10:29.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.825+0000 7fc3c7e00640 1 -- 172.21.15.86:0/1007162137 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc3c000cd80 con 0x7fc3d0100610 2024-09-13T16:10:29.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.825+0000 7fc3d4e00640 1 -- 172.21.15.86:0/1007162137 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d019ffd0 con 0x7fc3d0100610 2024-09-13T16:10:29.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.825+0000 7fc3c7e00640 1 -- 172.21.15.86:0/1007162137 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0010690 con 0x7fc3d0100610 2024-09-13T16:10:29.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.826+0000 7fc3d4e00640 1 -- 172.21.15.86:0/1007162137 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d01a03a0 con 0x7fc3d0100610 2024-09-13T16:10:29.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.826+0000 7fc3d4e00640 1 -- 172.21.15.86:0/1007162137 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d01073e0 con 0x7fc3d0100610 2024-09-13T16:10:29.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.829+0000 7fc3c7e00640 1 -- 172.21.15.86:0/1007162137 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc3c00046c0 con 0x7fc3d0100610 2024-09-13T16:10:29.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.830+0000 7fc3c7e00640 1 --2- 172.21.15.86:0/1007162137 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc3b40a1090 0x7fc3b40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:29.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.830+0000 7fc3c7e00640 1 -- 172.21.15.86:0/1007162137 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fc3c0014070 con 0x7fc3d0100610 2024-09-13T16:10:29.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.830+0000 7fc3cea00640 1 --2- 172.21.15.86:0/1007162137 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc3b40a1090 0x7fc3b40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:29.832 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.831+0000 7fc3cea00640 1 --2- 172.21.15.86:0/1007162137 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc3b40a1090 0x7fc3b40a3550 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc02aa00 tx=0x7fc3bc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:29.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:29.832+0000 7fc3c7e00640 1 -- 172.21.15.86:0/1007162137 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc3c0096580 con 0x7fc3d0100610 2024-09-13T16:10:30.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.038+0000 7fc3d4e00640 1 -- 172.21.15.86:0/1007162137 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3d010b5c0 con 0x7fc3d0100610 2024-09-13T16:10:30.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.039+0000 7fc3c7e00640 1 -- 172.21.15.86:0/1007162137 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10877 (secure 0 0 0) 0x7fc3c0099ba0 con 0x7fc3d0100610 2024-09-13T16:10:30.041 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:10:30.041 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14508,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1509120923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1509120923},{"type":"v1","addr":"172.21.15.86:6839","nonce":1509120923}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6841/1971775519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":1971775519},{"type":"v1","addr":"172.21.15.86:6841","nonce":1971775519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T16:08:09.202262+0000","modified":"2024-09-13T16:08:32.444959+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24544,"mds_2":24530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/1370900762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1370900762},{"type":"v1","addr":"172.21.15.194:6835","nonce":1370900762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/2460451799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":2460451799},{"type":"v1","addr":"172.21.15.194:6837","nonce":2460451799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24530":{"gid":24530,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.139:6837/2399531832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2399531832},{"type":"v1","addr":"172.21.15.139:6837","nonce":2399531832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6839/3799859182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3799859182},{"type":"v1","addr":"172.21.15.194:6839","nonce":3799859182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.139:6839/3370280063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3370280063},{"type":"v1","addr":"172.21.15.139:6839","nonce":3370280063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:10:30.041 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 24 2024-09-13T16:10:30.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.041+0000 7fc3d4e00640 1 -- 172.21.15.86:0/1007162137 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc3b40a1090 msgr2=0x7fc3b40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:30.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.041+0000 7fc3d4e00640 1 --2- 172.21.15.86:0/1007162137 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc3b40a1090 0x7fc3b40a3550 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc02aa00 tx=0x7fc3bc0058d0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.041+0000 7fc3d4e00640 1 -- 172.21.15.86:0/1007162137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3d0100610 msgr2=0x7fc3d0197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:30.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.041+0000 7fc3d4e00640 1 --2- 172.21.15.86:0/1007162137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3d0100610 0x7fc3d0197ed0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000e9f0 tx=0x7fc3c000edf0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.041+0000 7fc3d4e00640 1 -- 172.21.15.86:0/1007162137 shutdown_connections 2024-09-13T16:10:30.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.041+0000 7fc3d4e00640 1 --2- 172.21.15.86:0/1007162137 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc3b40a1090 0x7fc3b40a3550 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.041+0000 7fc3d4e00640 1 --2- 172.21.15.86:0/1007162137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d0105870 0x7fc3d019f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.041+0000 7fc3d4e00640 1 --2- 172.21.15.86:0/1007162137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3d0102f40 0x7fc3d0198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.041+0000 7fc3d4e00640 1 --2- 172.21.15.86:0/1007162137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3d0100610 0x7fc3d0197ed0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.041+0000 7fc3d4e00640 1 -- 172.21.15.86:0/1007162137 >> 172.21.15.86:0/1007162137 conn(0x7fc3d00fa1f0 msgr2=0x7fc3d00ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:30.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.042+0000 7fc3d4e00640 1 -- 172.21.15.86:0/1007162137 shutdown_connections 2024-09-13T16:10:30.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.042+0000 7fc3d4e00640 1 -- 172.21.15.86:0/1007162137 wait complete. 2024-09-13T16:10:30.059 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:10:30.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.211+0000 7f388f200640 1 -- 172.21.15.86:0/3418680107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3888100820 msgr2=0x7f3888102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:30.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.211+0000 7f388f200640 1 --2- 172.21.15.86:0/3418680107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3888100820 0x7f3888102c10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3878009900 tx=0x7f387802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.211+0000 7f388f200640 1 -- 172.21.15.86:0/3418680107 shutdown_connections 2024-09-13T16:10:30.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.211+0000 7f388f200640 1 --2- 172.21.15.86:0/3418680107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3888105a80 0x7f3888107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.211+0000 7f388f200640 1 --2- 172.21.15.86:0/3418680107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3888103150 0x7f3888105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.211+0000 7f388f200640 1 --2- 172.21.15.86:0/3418680107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3888100820 0x7f3888102c10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.211+0000 7f388f200640 1 -- 172.21.15.86:0/3418680107 >> 172.21.15.86:0/3418680107 conn(0x7f38880fa420 msgr2=0x7f38880fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:30.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.211+0000 7f388f200640 1 -- 172.21.15.86:0/3418680107 shutdown_connections 2024-09-13T16:10:30.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.211+0000 7f388f200640 1 -- 172.21.15.86:0/3418680107 wait complete. 2024-09-13T16:10:30.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.212+0000 7f388f200640 1 Processor -- start 2024-09-13T16:10:30.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.212+0000 7f388f200640 1 -- start start 2024-09-13T16:10:30.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.213+0000 7f388f200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3888100820 0x7f3888198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:30.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.213+0000 7f388f200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3888103150 0x7f3888198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:30.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.213+0000 7f388f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3888105a80 0x7f388819f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:30.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.213+0000 7f388f200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388819fbf0 con 0x7f3888103150 2024-09-13T16:10:30.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.213+0000 7f388f200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388819fd60 con 0x7f3888100820 2024-09-13T16:10:30.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.213+0000 7f388f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388819ff20 con 0x7f3888105a80 2024-09-13T16:10:30.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.213+0000 7f3887400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3888103150 0x7f3888198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:30.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.213+0000 7f3887400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3888103150 0x7f3888198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43280/0 (socket says 172.21.15.86:43280) 2024-09-13T16:10:30.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.213+0000 7f3887400640 1 -- 172.21.15.86:0/424887670 learned_addr learned my addr 172.21.15.86:0/424887670 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:30.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.213+0000 7f388d200640 1 --2- 172.21.15.86:0/424887670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3888105a80 0x7f388819f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:30.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.213+0000 7f3887e00640 1 --2- 172.21.15.86:0/424887670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3888100820 0x7f3888198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:30.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.213+0000 7f3887400640 1 -- 172.21.15.86:0/424887670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3888105a80 msgr2=0x7f388819f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:30.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.213+0000 7f3887400640 1 --2- 172.21.15.86:0/424887670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3888105a80 0x7f388819f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.213+0000 7f3887400640 1 -- 172.21.15.86:0/424887670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3888100820 msgr2=0x7f3888198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:30.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.213+0000 7f3887400640 1 --2- 172.21.15.86:0/424887670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3888100820 0x7f3888198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.213+0000 7f3887400640 1 -- 172.21.15.86:0/424887670 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3878009560 con 0x7f3888103150 2024-09-13T16:10:30.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.214+0000 7f3887400640 1 --2- 172.21.15.86:0/424887670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3888103150 0x7f3888198640 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f387400e9c0 tx=0x7f387400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:30.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.214+0000 7f3884c00640 1 -- 172.21.15.86:0/424887670 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874009700 con 0x7f3888103150 2024-09-13T16:10:30.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.214+0000 7f3884c00640 1 -- 172.21.15.86:0/424887670 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f387400cd80 con 0x7f3888103150 2024-09-13T16:10:30.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.214+0000 7f3884c00640 1 -- 172.21.15.86:0/424887670 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874010430 con 0x7f3888103150 2024-09-13T16:10:30.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.214+0000 7f388f200640 1 -- 172.21.15.86:0/424887670 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38881a0200 con 0x7f3888103150 2024-09-13T16:10:30.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.214+0000 7f388f200640 1 -- 172.21.15.86:0/424887670 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38881a06c0 con 0x7f3888103150 2024-09-13T16:10:30.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.215+0000 7f388f200640 1 -- 172.21.15.86:0/424887670 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38881075f0 con 0x7f3888103150 2024-09-13T16:10:30.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.217+0000 7f3884c00640 1 -- 172.21.15.86:0/424887670 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3874005000 con 0x7f3888103150 2024-09-13T16:10:30.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.219+0000 7f3884c00640 1 --2- 172.21.15.86:0/424887670 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f386c0a1110 0x7f386c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:30.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.219+0000 7f3884c00640 1 -- 172.21.15.86:0/424887670 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f3874014070 con 0x7f3888103150 2024-09-13T16:10:30.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.219+0000 7f3887e00640 1 --2- 172.21.15.86:0/424887670 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f386c0a1110 0x7f386c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:30.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.220+0000 7f3887e00640 1 --2- 172.21.15.86:0/424887670 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f386c0a1110 0x7f386c0a35d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3878006010 tx=0x7f3878000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:30.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.222+0000 7f3884c00640 1 -- 172.21.15.86:0/424887670 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3874096500 con 0x7f3888103150 2024-09-13T16:10:30.394 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.392+0000 7f388f200640 1 -- 172.21.15.86:0/424887670 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3888107060 con 0x7f3888103150 2024-09-13T16:10:30.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.394+0000 7f3884c00640 1 -- 172.21.15.86:0/424887670 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24703 (secure 0 0 0) 0x7f3874099b20 con 0x7f3888103150 2024-09-13T16:10:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:10:30.396 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":94,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:10:00.680229+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":7}]},{"pgid":"3.19","mappings":[{"from":3,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2f","mappings":[{"from":1,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:10:30.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.396+0000 7f388f200640 1 -- 172.21.15.86:0/424887670 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f386c0a1110 msgr2=0x7f386c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:30.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.396+0000 7f388f200640 1 --2- 172.21.15.86:0/424887670 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f386c0a1110 0x7f386c0a35d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3878006010 tx=0x7f3878000bc0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.396+0000 7f388f200640 1 -- 172.21.15.86:0/424887670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3888103150 msgr2=0x7f3888198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:30.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.396+0000 7f388f200640 1 --2- 172.21.15.86:0/424887670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3888103150 0x7f3888198640 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f387400e9c0 tx=0x7f387400ee80 comp rx=0 tx=0).stop 2024-09-13T16:10:30.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.396+0000 7f388f200640 1 -- 172.21.15.86:0/424887670 shutdown_connections 2024-09-13T16:10:30.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.396+0000 7f388f200640 1 --2- 172.21.15.86:0/424887670 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f386c0a1110 0x7f386c0a35d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.396+0000 7f388f200640 1 --2- 172.21.15.86:0/424887670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3888105a80 0x7f388819f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.396+0000 7f388f200640 1 --2- 172.21.15.86:0/424887670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3888103150 0x7f3888198640 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.396+0000 7f388f200640 1 --2- 172.21.15.86:0/424887670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3888100820 0x7f3888198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.396+0000 7f388f200640 1 -- 172.21.15.86:0/424887670 >> 172.21.15.86:0/424887670 conn(0x7f38880fa420 msgr2=0x7f38880fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:30.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.396+0000 7f388f200640 1 -- 172.21.15.86:0/424887670 shutdown_connections 2024-09-13T16:10:30.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.396+0000 7f388f200640 1 -- 172.21.15.86:0/424887670 wait complete. 2024-09-13T16:10:30.415 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:03:27.830423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:08:07.732536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:08:08.742145+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T16:08:11.721740+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T16:10:30.415 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:10:30.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.571+0000 7f7c04e00640 1 -- 172.21.15.86:0/3825564080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c00100f60 msgr2=0x7f7c001013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:30.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.571+0000 7f7c04e00640 1 --2- 172.21.15.86:0/3825564080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c00100f60 0x7f7c001013e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009900 tx=0x7f7be802a410 comp rx=0 tx=0).stop 2024-09-13T16:10:30.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.571+0000 7f7c04e00640 1 -- 172.21.15.86:0/3825564080 shutdown_connections 2024-09-13T16:10:30.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.571+0000 7f7c04e00640 1 --2- 172.21.15.86:0/3825564080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c00101920 0x7f7c001081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.571+0000 7f7c04e00640 1 --2- 172.21.15.86:0/3825564080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c00100f60 0x7f7c001013e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.571+0000 7f7c04e00640 1 --2- 172.21.15.86:0/3825564080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c000ffd70 0x7f7c00100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.573 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.571+0000 7f7c04e00640 1 -- 172.21.15.86:0/3825564080 >> 172.21.15.86:0/3825564080 conn(0x7f7c000fb4d0 msgr2=0x7f7c000fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:30.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.571+0000 7f7c04e00640 1 -- 172.21.15.86:0/3825564080 shutdown_connections 2024-09-13T16:10:30.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.571+0000 7f7c04e00640 1 -- 172.21.15.86:0/3825564080 wait complete. 2024-09-13T16:10:30.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.572+0000 7f7c04e00640 1 Processor -- start 2024-09-13T16:10:30.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.572+0000 7f7c04e00640 1 -- start start 2024-09-13T16:10:30.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.572+0000 7f7c04e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c000ffd70 0x7f7c00195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:30.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.572+0000 7f7c04e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c00100f60 0x7f7c00196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:30.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.572+0000 7f7c04e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c00101920 0x7f7c0019d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:30.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.572+0000 7f7c04e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0019d8e0 con 0x7f7c00101920 2024-09-13T16:10:30.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.572+0000 7f7c04e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0019da50 con 0x7f7c00100f60 2024-09-13T16:10:30.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.572+0000 7f7c04e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0019dc10 con 0x7f7c000ffd70 2024-09-13T16:10:30.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.573+0000 7f7bfe800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c00101920 0x7f7c0019d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:30.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.573+0000 7f7bfe800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c00101920 0x7f7c0019d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43292/0 (socket says 172.21.15.86:43292) 2024-09-13T16:10:30.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.573+0000 7f7bfe800640 1 -- 172.21.15.86:0/1958646901 learned_addr learned my addr 172.21.15.86:0/1958646901 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:30.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.573+0000 7f7bf7e00640 1 --2- 172.21.15.86:0/1958646901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c00100f60 0x7f7c00196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:30.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.573+0000 7f7bfde00640 1 --2- 172.21.15.86:0/1958646901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c000ffd70 0x7f7c00195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:30.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.573+0000 7f7bfe800640 1 -- 172.21.15.86:0/1958646901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c000ffd70 msgr2=0x7f7c00195df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:30.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.573+0000 7f7bfe800640 1 --2- 172.21.15.86:0/1958646901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c000ffd70 0x7f7c00195df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.573+0000 7f7bfe800640 1 -- 172.21.15.86:0/1958646901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c00100f60 msgr2=0x7f7c00196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:30.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.573+0000 7f7bfe800640 1 --2- 172.21.15.86:0/1958646901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c00100f60 0x7f7c00196330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.573+0000 7f7bfe800640 1 -- 172.21.15.86:0/1958646901 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be8009560 con 0x7f7c00101920 2024-09-13T16:10:30.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.573+0000 7f7bfde00640 1 --2- 172.21.15.86:0/1958646901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c000ffd70 0x7f7c00195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:10:30.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.573+0000 7f7bf7e00640 1 --2- 172.21.15.86:0/1958646901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c00100f60 0x7f7c00196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:10:30.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.573+0000 7f7bfe800640 1 --2- 172.21.15.86:0/1958646901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c00101920 0x7f7c0019d3a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800eb10 tx=0x7f7bf800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:30.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.573+0000 7f7bf6a00640 1 -- 172.21.15.86:0/1958646901 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8004b20 con 0x7f7c00101920 2024-09-13T16:10:30.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.573+0000 7f7bf6a00640 1 -- 172.21.15.86:0/1958646901 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7bf8004c80 con 0x7f7c00101920 2024-09-13T16:10:30.577 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.573+0000 7f7c04e00640 1 -- 172.21.15.86:0/1958646901 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0019def0 con 0x7f7c00101920 2024-09-13T16:10:30.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.574+0000 7f7bf6a00640 1 -- 172.21.15.86:0/1958646901 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8010650 con 0x7f7c00101920 2024-09-13T16:10:30.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.574+0000 7f7c04e00640 1 -- 172.21.15.86:0/1958646901 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0019e370 con 0x7f7c00101920 2024-09-13T16:10:30.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.575+0000 7f7c04e00640 1 -- 172.21.15.86:0/1958646901 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c00107100 con 0x7f7c00101920 2024-09-13T16:10:30.578 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.576+0000 7f7bf6a00640 1 -- 172.21.15.86:0/1958646901 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7bf8005020 con 0x7f7c00101920 2024-09-13T16:10:30.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.578+0000 7f7bf6a00640 1 --2- 172.21.15.86:0/1958646901 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7be40a1110 0x7f7be40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:30.579 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.578+0000 7f7bf6a00640 1 -- 172.21.15.86:0/1958646901 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f7bf8014070 con 0x7f7c00101920 2024-09-13T16:10:30.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.578+0000 7f7bfde00640 1 --2- 172.21.15.86:0/1958646901 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7be40a1110 0x7f7be40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:30.580 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.579+0000 7f7bfde00640 1 --2- 172.21.15.86:0/1958646901 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7be40a1110 0x7f7be40a35d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7c00100dc0 tx=0x7f7bf0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:30.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.581+0000 7f7bf6a00640 1 -- 172.21.15.86:0/1958646901 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7bf8096700 con 0x7f7c00101920 2024-09-13T16:10:30.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:30 smithi139 ceph-mon[35320]: pgmap v369: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:10:30.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:30 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/570576128' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:10:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:30 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1007162137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:10:30.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:30 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/424887670' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:10:30.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.750+0000 7f7c04e00640 1 -- 172.21.15.86:0/1958646901 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7c0002c410 con 0x7f7c00101920 2024-09-13T16:10:30.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.750+0000 7f7bf6a00640 1 -- 172.21.15.86:0/1958646901 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7bf8099d20 con 0x7f7c00101920 2024-09-13T16:10:30.752 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-09-13T16:10:30.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.752+0000 7f7c04e00640 1 -- 172.21.15.86:0/1958646901 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7be40a1110 msgr2=0x7f7be40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:30.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.752+0000 7f7c04e00640 1 --2- 172.21.15.86:0/1958646901 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7be40a1110 0x7f7be40a35d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7c00100dc0 tx=0x7f7bf0005f90 comp rx=0 tx=0).stop 2024-09-13T16:10:30.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.753+0000 7f7c04e00640 1 -- 172.21.15.86:0/1958646901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c00101920 msgr2=0x7f7c0019d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:30.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.753+0000 7f7c04e00640 1 --2- 172.21.15.86:0/1958646901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c00101920 0x7f7c0019d3a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800eb10 tx=0x7f7bf800c2d0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.753+0000 7f7c04e00640 1 -- 172.21.15.86:0/1958646901 shutdown_connections 2024-09-13T16:10:30.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.753+0000 7f7c04e00640 1 --2- 172.21.15.86:0/1958646901 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7be40a1110 0x7f7be40a35d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.753+0000 7f7c04e00640 1 --2- 172.21.15.86:0/1958646901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c00101920 0x7f7c0019d3a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.753+0000 7f7c04e00640 1 --2- 172.21.15.86:0/1958646901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c00100f60 0x7f7c00196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.753+0000 7f7c04e00640 1 --2- 172.21.15.86:0/1958646901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c000ffd70 0x7f7c00195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.753+0000 7f7c04e00640 1 -- 172.21.15.86:0/1958646901 >> 172.21.15.86:0/1958646901 conn(0x7f7c000fb4d0 msgr2=0x7f7c001042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:30.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.753+0000 7f7c04e00640 1 -- 172.21.15.86:0/1958646901 shutdown_connections 2024-09-13T16:10:30.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.753+0000 7f7c04e00640 1 -- 172.21.15.86:0/1958646901 wait complete. 2024-09-13T16:10:30.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:30 smithi194 ceph-mon[35694]: pgmap v369: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:10:30.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:30 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/570576128' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:10:30.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:30 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1007162137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:10:30.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:30 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/424887670' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:10:30.769 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:30 smithi086 ceph-mon[30379]: pgmap v369: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:10:30.769 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:30 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/570576128' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:10:30.769 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:30 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1007162137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:10:30.769 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:30 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/424887670' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:10:30.771 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:10:30.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.926+0000 7f86c6800640 1 -- 172.21.15.86:0/1740501832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86c0101920 msgr2=0x7f86c01081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:30.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.926+0000 7f86c6800640 1 --2- 172.21.15.86:0/1740501832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86c0101920 0x7f86c01081b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009ca0 tx=0x7f86b802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.926+0000 7f86c6800640 1 -- 172.21.15.86:0/1740501832 shutdown_connections 2024-09-13T16:10:30.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.926+0000 7f86c6800640 1 --2- 172.21.15.86:0/1740501832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86c0101920 0x7f86c01081b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.926+0000 7f86c6800640 1 --2- 172.21.15.86:0/1740501832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86c0100f60 0x7f86c01013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.926+0000 7f86c6800640 1 --2- 172.21.15.86:0/1740501832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86c00ffd70 0x7f86c0100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.926+0000 7f86c6800640 1 -- 172.21.15.86:0/1740501832 >> 172.21.15.86:0/1740501832 conn(0x7f86c00fb4d0 msgr2=0x7f86c00fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:30.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.926+0000 7f86c6800640 1 -- 172.21.15.86:0/1740501832 shutdown_connections 2024-09-13T16:10:30.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.926+0000 7f86c6800640 1 -- 172.21.15.86:0/1740501832 wait complete. 2024-09-13T16:10:30.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.927+0000 7f86c6800640 1 Processor -- start 2024-09-13T16:10:30.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.927+0000 7f86c6800640 1 -- start start 2024-09-13T16:10:30.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.927+0000 7f86c6800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86c00ffd70 0x7f86c0195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:30.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.927+0000 7f86c6800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86c0100f60 0x7f86c0196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:30.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.927+0000 7f86c6800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86c0101920 0x7f86c019d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:30.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.927+0000 7f86c6800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c019d8f0 con 0x7f86c0101920 2024-09-13T16:10:30.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.927+0000 7f86c6800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c019da60 con 0x7f86c00ffd70 2024-09-13T16:10:30.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.927+0000 7f86c6800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c019dc20 con 0x7f86c0100f60 2024-09-13T16:10:30.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.928+0000 7f86bfe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86c0101920 0x7f86c019d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:30.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.928+0000 7f86bf400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86c00ffd70 0x7f86c0195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:30.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.928+0000 7f86bf400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86c00ffd70 0x7f86c0195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:52538/0 (socket says 172.21.15.86:52538) 2024-09-13T16:10:30.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.928+0000 7f86bf400640 1 -- 172.21.15.86:0/2706190901 learned_addr learned my addr 172.21.15.86:0/2706190901 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:30.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.928+0000 7f86bfe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86c0101920 0x7f86c019d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43302/0 (socket says 172.21.15.86:43302) 2024-09-13T16:10:30.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.928+0000 7f86b6a00640 1 --2- 172.21.15.86:0/2706190901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86c0100f60 0x7f86c0196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:30.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.928+0000 7f86bf400640 1 -- 172.21.15.86:0/2706190901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86c0100f60 msgr2=0x7f86c0196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:30.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.928+0000 7f86bf400640 1 --2- 172.21.15.86:0/2706190901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86c0100f60 0x7f86c0196340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.928+0000 7f86bf400640 1 -- 172.21.15.86:0/2706190901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86c0101920 msgr2=0x7f86c019d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:30.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.928+0000 7f86bf400640 1 --2- 172.21.15.86:0/2706190901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86c0101920 0x7f86c019d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:30.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.928+0000 7f86bf400640 1 -- 172.21.15.86:0/2706190901 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b0009490 con 0x7f86c00ffd70 2024-09-13T16:10:30.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.928+0000 7f86bfe00640 1 --2- 172.21.15.86:0/2706190901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86c0101920 0x7f86c019d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:30.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.928+0000 7f86bf400640 1 --2- 172.21.15.86:0/2706190901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86c00ffd70 0x7f86c0195e00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f86b000e9c0 tx=0x7f86b000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:30.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.929+0000 7f86bcc00640 1 -- 172.21.15.86:0/2706190901 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b000cde0 con 0x7f86c00ffd70 2024-09-13T16:10:30.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.929+0000 7f86c6800640 1 -- 172.21.15.86:0/2706190901 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b8009900 con 0x7f86c00ffd70 2024-09-13T16:10:30.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.929+0000 7f86bcc00640 1 -- 172.21.15.86:0/2706190901 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f86b0010910 con 0x7f86c00ffd70 2024-09-13T16:10:30.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.929+0000 7f86bcc00640 1 -- 172.21.15.86:0/2706190901 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0018960 con 0x7f86c00ffd70 2024-09-13T16:10:30.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.929+0000 7f86c6800640 1 -- 172.21.15.86:0/2706190901 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c019e210 con 0x7f86c00ffd70 2024-09-13T16:10:30.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.930+0000 7f86c6800640 1 -- 172.21.15.86:0/2706190901 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c0107100 con 0x7f86c00ffd70 2024-09-13T16:10:30.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.932+0000 7f86bcc00640 1 -- 172.21.15.86:0/2706190901 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f86b0010a80 con 0x7f86c00ffd70 2024-09-13T16:10:30.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.933+0000 7f86bcc00640 1 --2- 172.21.15.86:0/2706190901 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f86a40a1090 0x7f86a40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:30.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.933+0000 7f86bcc00640 1 -- 172.21.15.86:0/2706190901 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f86b0014070 con 0x7f86c00ffd70 2024-09-13T16:10:30.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.933+0000 7f86b6a00640 1 --2- 172.21.15.86:0/2706190901 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f86a40a1090 0x7f86a40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:30.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.934+0000 7f86b6a00640 1 --2- 172.21.15.86:0/2706190901 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f86a40a1090 0x7f86a40a3550 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f86c0197310 tx=0x7f86a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:30.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:30.935+0000 7f86bcc00640 1 -- 172.21.15.86:0/2706190901 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f86b0096b50 con 0x7f86c00ffd70 2024-09-13T16:10:31.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.105+0000 7f86c6800640 1 -- 172.21.15.86:0/2706190901 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86c002c3e0 con 0x7f86c00ffd70 2024-09-13T16:10:31.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.106+0000 7f86bcc00640 1 -- 172.21.15.86:0/2706190901 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86b009a170 con 0x7f86c00ffd70 2024-09-13T16:10:31.108 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-09-13T16:10:31.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.108+0000 7f86c6800640 1 -- 172.21.15.86:0/2706190901 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f86a40a1090 msgr2=0x7f86a40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:31.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.108+0000 7f86c6800640 1 --2- 172.21.15.86:0/2706190901 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f86a40a1090 0x7f86a40a3550 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f86c0197310 tx=0x7f86a8005f90 comp rx=0 tx=0).stop 2024-09-13T16:10:31.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.108+0000 7f86c6800640 1 -- 172.21.15.86:0/2706190901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86c00ffd70 msgr2=0x7f86c0195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:31.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.108+0000 7f86c6800640 1 --2- 172.21.15.86:0/2706190901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86c00ffd70 0x7f86c0195e00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f86b000e9c0 tx=0x7f86b000ee80 comp rx=0 tx=0).stop 2024-09-13T16:10:31.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.108+0000 7f86c6800640 1 -- 172.21.15.86:0/2706190901 shutdown_connections 2024-09-13T16:10:31.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.108+0000 7f86c6800640 1 --2- 172.21.15.86:0/2706190901 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f86a40a1090 0x7f86a40a3550 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.108+0000 7f86c6800640 1 --2- 172.21.15.86:0/2706190901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86c0101920 0x7f86c019d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.108+0000 7f86c6800640 1 --2- 172.21.15.86:0/2706190901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86c0100f60 0x7f86c0196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.110 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.108+0000 7f86c6800640 1 --2- 172.21.15.86:0/2706190901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86c00ffd70 0x7f86c0195e00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.108+0000 7f86c6800640 1 -- 172.21.15.86:0/2706190901 >> 172.21.15.86:0/2706190901 conn(0x7f86c00fb4d0 msgr2=0x7f86c01042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:31.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.108+0000 7f86c6800640 1 -- 172.21.15.86:0/2706190901 shutdown_connections 2024-09-13T16:10:31.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.108+0000 7f86c6800640 1 -- 172.21.15.86:0/2706190901 wait complete. 2024-09-13T16:10:31.127 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:10:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.282+0000 7f66d8c00640 1 -- 172.21.15.86:0/2198397510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66d4103b50 msgr2=0x7f66d410a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.282+0000 7f66d8c00640 1 --2- 172.21.15.86:0/2198397510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66d4103b50 0x7f66d410a3e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f66cc009ca0 tx=0x7f66cc02a8c0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.282+0000 7f66d8c00640 1 -- 172.21.15.86:0/2198397510 shutdown_connections 2024-09-13T16:10:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.282+0000 7f66d8c00640 1 --2- 172.21.15.86:0/2198397510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66d4103b50 0x7f66d410a3e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.282+0000 7f66d8c00640 1 --2- 172.21.15.86:0/2198397510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66d4103190 0x7f66d4103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.282+0000 7f66d8c00640 1 --2- 172.21.15.86:0/2198397510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66d4101fa0 0x7f66d41023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.282+0000 7f66d8c00640 1 -- 172.21.15.86:0/2198397510 >> 172.21.15.86:0/2198397510 conn(0x7f66d40fd700 msgr2=0x7f66d40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.282+0000 7f66d8c00640 1 -- 172.21.15.86:0/2198397510 shutdown_connections 2024-09-13T16:10:31.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.282+0000 7f66d8c00640 1 -- 172.21.15.86:0/2198397510 wait complete. 2024-09-13T16:10:31.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.283+0000 7f66d8c00640 1 Processor -- start 2024-09-13T16:10:31.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.283+0000 7f66d8c00640 1 -- start start 2024-09-13T16:10:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.283+0000 7f66d8c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66d4101fa0 0x7f66d4198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.283+0000 7f66d8c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66d4103190 0x7f66d41985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.283+0000 7f66d8c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66d4103b50 0x7f66d419f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.283+0000 7f66d8c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d419fb10 con 0x7f66d4103b50 2024-09-13T16:10:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.283+0000 7f66d8c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d419fc80 con 0x7f66d4103190 2024-09-13T16:10:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.283+0000 7f66d8c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d419fe40 con 0x7f66d4101fa0 2024-09-13T16:10:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.284+0000 7f66d2800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66d4103b50 0x7f66d419f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.284+0000 7f66d2800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66d4103b50 0x7f66d419f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43320/0 (socket says 172.21.15.86:43320) 2024-09-13T16:10:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.284+0000 7f66d2800640 1 -- 172.21.15.86:0/3268961783 learned_addr learned my addr 172.21.15.86:0/3268961783 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.284+0000 7f66d1400640 1 --2- 172.21.15.86:0/3268961783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66d4103190 0x7f66d41985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.284+0000 7f66d1e00640 1 --2- 172.21.15.86:0/3268961783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66d4101fa0 0x7f66d4198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.284+0000 7f66d1400640 1 -- 172.21.15.86:0/3268961783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66d4101fa0 msgr2=0x7f66d4198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.284+0000 7f66d1400640 1 --2- 172.21.15.86:0/3268961783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66d4101fa0 0x7f66d4198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.284+0000 7f66d1400640 1 -- 172.21.15.86:0/3268961783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66d4103b50 msgr2=0x7f66d419f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.284+0000 7f66d1400640 1 --2- 172.21.15.86:0/3268961783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66d4103b50 0x7f66d419f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.284+0000 7f66d1400640 1 -- 172.21.15.86:0/3268961783 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc009900 con 0x7f66d4103190 2024-09-13T16:10:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.284+0000 7f66d2800640 1 --2- 172.21.15.86:0/3268961783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66d4103b50 0x7f66d419f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.284+0000 7f66d1400640 1 --2- 172.21.15.86:0/3268961783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66d4103190 0x7f66d41985b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f66c000e9f0 tx=0x7f66c000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.284+0000 7f66caa00640 1 -- 172.21.15.86:0/3268961783 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c000ccc0 con 0x7f66d4103190 2024-09-13T16:10:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.285+0000 7f66caa00640 1 -- 172.21.15.86:0/3268961783 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f66c000ce20 con 0x7f66d4103190 2024-09-13T16:10:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.285+0000 7f66d8c00640 1 -- 172.21.15.86:0/3268961783 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d41a0120 con 0x7f66d4103190 2024-09-13T16:10:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.285+0000 7f66caa00640 1 -- 172.21.15.86:0/3268961783 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0018920 con 0x7f66d4103190 2024-09-13T16:10:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.285+0000 7f66d8c00640 1 -- 172.21.15.86:0/3268961783 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d41a0680 con 0x7f66d4103190 2024-09-13T16:10:31.289 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.286+0000 7f66d8c00640 1 -- 172.21.15.86:0/3268961783 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d41093e0 con 0x7f66d4103190 2024-09-13T16:10:31.290 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.288+0000 7f66caa00640 1 -- 172.21.15.86:0/3268961783 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f66c0018a80 con 0x7f66d4103190 2024-09-13T16:10:31.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.290+0000 7f66caa00640 1 --2- 172.21.15.86:0/3268961783 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f66b80a1110 0x7f66b80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:31.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.290+0000 7f66caa00640 1 -- 172.21.15.86:0/3268961783 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f66c0014070 con 0x7f66d4103190 2024-09-13T16:10:31.291 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.290+0000 7f66d1e00640 1 --2- 172.21.15.86:0/3268961783 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f66b80a1110 0x7f66b80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:31.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.290+0000 7f66d1e00640 1 --2- 172.21.15.86:0/3268961783 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f66b80a1110 0x7f66b80a35d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f66d4102ff0 tx=0x7f66c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:31.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.291+0000 7f66caa00640 1 -- 172.21.15.86:0/3268961783 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f66c00965f0 con 0x7f66d4103190 2024-09-13T16:10:31.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.460+0000 7f66d8c00640 1 -- 172.21.15.86:0/3268961783 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f66d4108e50 con 0x7f66d4103190 2024-09-13T16:10:31.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.461+0000 7f66caa00640 1 -- 172.21.15.86:0/3268961783 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f66c00260a0 con 0x7f66d4103190 2024-09-13T16:10:31.462 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2024-09-13T16:10:31.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.463+0000 7f66d8c00640 1 -- 172.21.15.86:0/3268961783 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f66b80a1110 msgr2=0x7f66b80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:31.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.463+0000 7f66d8c00640 1 --2- 172.21.15.86:0/3268961783 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f66b80a1110 0x7f66b80a35d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f66d4102ff0 tx=0x7f66c4005f90 comp rx=0 tx=0).stop 2024-09-13T16:10:31.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.463+0000 7f66d8c00640 1 -- 172.21.15.86:0/3268961783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66d4103190 msgr2=0x7f66d41985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:31.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.463+0000 7f66d8c00640 1 --2- 172.21.15.86:0/3268961783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66d4103190 0x7f66d41985b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f66c000e9f0 tx=0x7f66c000eeb0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.463+0000 7f66d8c00640 1 -- 172.21.15.86:0/3268961783 shutdown_connections 2024-09-13T16:10:31.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.463+0000 7f66d8c00640 1 --2- 172.21.15.86:0/3268961783 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f66b80a1110 0x7f66b80a35d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.463+0000 7f66d8c00640 1 --2- 172.21.15.86:0/3268961783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66d4103b50 0x7f66d419f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.465 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.463+0000 7f66d8c00640 1 --2- 172.21.15.86:0/3268961783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66d4103190 0x7f66d41985b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.463+0000 7f66d8c00640 1 --2- 172.21.15.86:0/3268961783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66d4101fa0 0x7f66d4198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.463+0000 7f66d8c00640 1 -- 172.21.15.86:0/3268961783 >> 172.21.15.86:0/3268961783 conn(0x7f66d40fd700 msgr2=0x7f66d41065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:31.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.463+0000 7f66d8c00640 1 -- 172.21.15.86:0/3268961783 shutdown_connections 2024-09-13T16:10:31.466 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.463+0000 7f66d8c00640 1 -- 172.21.15.86:0/3268961783 wait complete. 2024-09-13T16:10:31.482 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T16:10:31.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.636+0000 7f1455200640 1 -- 172.21.15.86:0/3159353544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1450101ea0 msgr2=0x7f14501022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:31.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.636+0000 7f1455200640 1 --2- 172.21.15.86:0/3159353544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1450101ea0 0x7f14501022a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1440009ca0 tx=0x7f144002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.637+0000 7f1455200640 1 -- 172.21.15.86:0/3159353544 shutdown_connections 2024-09-13T16:10:31.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.637+0000 7f1455200640 1 --2- 172.21.15.86:0/3159353544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1450103a40 0x7f145010a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.637+0000 7f1455200640 1 --2- 172.21.15.86:0/3159353544 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1450103080 0x7f1450103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.637+0000 7f1455200640 1 --2- 172.21.15.86:0/3159353544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1450101ea0 0x7f14501022a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.637+0000 7f1455200640 1 -- 172.21.15.86:0/3159353544 >> 172.21.15.86:0/3159353544 conn(0x7f14500fd670 msgr2=0x7f14500ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:31.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.637+0000 7f1455200640 1 -- 172.21.15.86:0/3159353544 shutdown_connections 2024-09-13T16:10:31.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.637+0000 7f1455200640 1 -- 172.21.15.86:0/3159353544 wait complete. 2024-09-13T16:10:31.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.638+0000 7f1455200640 1 Processor -- start 2024-09-13T16:10:31.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.638+0000 7f1455200640 1 -- start start 2024-09-13T16:10:31.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.638+0000 7f1455200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1450101ea0 0x7f1450197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:31.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.638+0000 7f1455200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1450103080 0x7f1450198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:31.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.638+0000 7f1455200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1450103a40 0x7f145019f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:31.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.638+0000 7f1455200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145019fad0 con 0x7f1450103080 2024-09-13T16:10:31.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.638+0000 7f1455200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145019fc40 con 0x7f1450101ea0 2024-09-13T16:10:31.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.638+0000 7f1455200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145019fe00 con 0x7f1450103a40 2024-09-13T16:10:31.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.638+0000 7f144ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1450103080 0x7f1450198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:31.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.638+0000 7f144ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1450103080 0x7f1450198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43334/0 (socket says 172.21.15.86:43334) 2024-09-13T16:10:31.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.638+0000 7f144ea00640 1 -- 172.21.15.86:0/3167272565 learned_addr learned my addr 172.21.15.86:0/3167272565 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:31.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.638+0000 7f144f400640 1 --2- 172.21.15.86:0/3167272565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1450101ea0 0x7f1450197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:31.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.639+0000 7f144fe00640 1 --2- 172.21.15.86:0/3167272565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1450103a40 0x7f145019f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:31.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.639+0000 7f144ea00640 1 -- 172.21.15.86:0/3167272565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1450103a40 msgr2=0x7f145019f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:31.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.639+0000 7f144ea00640 1 --2- 172.21.15.86:0/3167272565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1450103a40 0x7f145019f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.639+0000 7f144ea00640 1 -- 172.21.15.86:0/3167272565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1450101ea0 msgr2=0x7f1450197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:31.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.639+0000 7f144ea00640 1 --2- 172.21.15.86:0/3167272565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1450101ea0 0x7f1450197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.639+0000 7f144ea00640 1 -- 172.21.15.86:0/3167272565 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1440009900 con 0x7f1450103080 2024-09-13T16:10:31.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.639+0000 7f144fe00640 1 --2- 172.21.15.86:0/3167272565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1450103a40 0x7f145019f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:10:31.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.639+0000 7f144ea00640 1 --2- 172.21.15.86:0/3167272565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1450103080 0x7f1450198520 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f143c00e9f0 tx=0x7f143c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:31.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.639+0000 7f1447e00640 1 -- 172.21.15.86:0/3167272565 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c009700 con 0x7f1450103080 2024-09-13T16:10:31.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.639+0000 7f1447e00640 1 -- 172.21.15.86:0/3167272565 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f143c00cd80 con 0x7f1450103080 2024-09-13T16:10:31.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.639+0000 7f1455200640 1 -- 172.21.15.86:0/3167272565 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14501a00e0 con 0x7f1450103080 2024-09-13T16:10:31.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.639+0000 7f1447e00640 1 -- 172.21.15.86:0/3167272565 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c018920 con 0x7f1450103080 2024-09-13T16:10:31.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.639+0000 7f1455200640 1 -- 172.21.15.86:0/3167272565 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14501a0640 con 0x7f1450103080 2024-09-13T16:10:31.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.640+0000 7f1455200640 1 -- 172.21.15.86:0/3167272565 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14501093b0 con 0x7f1450103080 2024-09-13T16:10:31.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.642+0000 7f1447e00640 1 -- 172.21.15.86:0/3167272565 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f143c018a80 con 0x7f1450103080 2024-09-13T16:10:31.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.643+0000 7f1447e00640 1 --2- 172.21.15.86:0/3167272565 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f14340a1110 0x7f14340a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:31.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.644+0000 7f1447e00640 1 -- 172.21.15.86:0/3167272565 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f143c014070 con 0x7f1450103080 2024-09-13T16:10:31.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.644+0000 7f144f400640 1 --2- 172.21.15.86:0/3167272565 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f14340a1110 0x7f14340a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:31.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.644+0000 7f144f400640 1 --2- 172.21.15.86:0/3167272565 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f14340a1110 0x7f14340a35d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f144002aeb0 tx=0x7f1440000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:31.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.647+0000 7f1447e00640 1 -- 172.21.15.86:0/3167272565 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f143c052e20 con 0x7f1450103080 2024-09-13T16:10:31.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:31 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1958646901' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:10:31.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:31 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2706190901' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:10:31.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:31 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3268961783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:10:31.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:31 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1958646901' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:10:31.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:31 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2706190901' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:10:31.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:31 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3268961783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:10:31.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.816+0000 7f1455200640 1 -- 172.21.15.86:0/3167272565 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1450108e20 con 0x7f1450103080 2024-09-13T16:10:31.818 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.817+0000 7f1447e00640 1 -- 172.21.15.86:0/3167272565 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f143c096440 con 0x7f1450103080 2024-09-13T16:10:31.819 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-09-13T16:10:31.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.819+0000 7f1455200640 1 -- 172.21.15.86:0/3167272565 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f14340a1110 msgr2=0x7f14340a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:31.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.819+0000 7f1455200640 1 --2- 172.21.15.86:0/3167272565 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f14340a1110 0x7f14340a35d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f144002aeb0 tx=0x7f1440000f40 comp rx=0 tx=0).stop 2024-09-13T16:10:31.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.819+0000 7f1455200640 1 -- 172.21.15.86:0/3167272565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1450103080 msgr2=0x7f1450198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:31.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.819+0000 7f1455200640 1 --2- 172.21.15.86:0/3167272565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1450103080 0x7f1450198520 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f143c00e9f0 tx=0x7f143c00eeb0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.819+0000 7f1455200640 1 -- 172.21.15.86:0/3167272565 shutdown_connections 2024-09-13T16:10:31.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.819+0000 7f1455200640 1 --2- 172.21.15.86:0/3167272565 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f14340a1110 0x7f14340a35d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.819+0000 7f1455200640 1 --2- 172.21.15.86:0/3167272565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1450103a40 0x7f145019f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.821 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.819+0000 7f1455200640 1 --2- 172.21.15.86:0/3167272565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1450103080 0x7f1450198520 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.819+0000 7f1455200640 1 --2- 172.21.15.86:0/3167272565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1450101ea0 0x7f1450197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.819+0000 7f1455200640 1 -- 172.21.15.86:0/3167272565 >> 172.21.15.86:0/3167272565 conn(0x7f14500fd670 msgr2=0x7f1450106580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:31.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.819+0000 7f1455200640 1 -- 172.21.15.86:0/3167272565 shutdown_connections 2024-09-13T16:10:31.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.819+0000 7f1455200640 1 -- 172.21.15.86:0/3167272565 wait complete. 2024-09-13T16:10:31.835 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:31 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1958646901' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:10:31.835 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:31 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2706190901' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:10:31.836 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:31 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3268961783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:10:31.838 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:10:31.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.990+0000 7fefadc00640 1 -- 172.21.15.86:0/3812458101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefa8101f90 msgr2=0x7fefa8102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:31.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.990+0000 7fefadc00640 1 --2- 172.21.15.86:0/3812458101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefa8101f90 0x7fefa8102390 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fef98009ca0 tx=0x7fef9802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.990+0000 7fefadc00640 1 -- 172.21.15.86:0/3812458101 shutdown_connections 2024-09-13T16:10:31.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.990+0000 7fefadc00640 1 --2- 172.21.15.86:0/3812458101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa8103b40 0x7fefa810a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.990+0000 7fefadc00640 1 --2- 172.21.15.86:0/3812458101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefa8103180 0x7fefa8103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.990+0000 7fefadc00640 1 --2- 172.21.15.86:0/3812458101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefa8101f90 0x7fefa8102390 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.990+0000 7fefadc00640 1 -- 172.21.15.86:0/3812458101 >> 172.21.15.86:0/3812458101 conn(0x7fefa80fd730 msgr2=0x7fefa80ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:31.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.990+0000 7fefadc00640 1 -- 172.21.15.86:0/3812458101 shutdown_connections 2024-09-13T16:10:31.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.990+0000 7fefadc00640 1 -- 172.21.15.86:0/3812458101 wait complete. 2024-09-13T16:10:31.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.991+0000 7fefadc00640 1 Processor -- start 2024-09-13T16:10:31.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.991+0000 7fefadc00640 1 -- start start 2024-09-13T16:10:31.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.991+0000 7fefadc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefa8101f90 0x7fefa8198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:31.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.991+0000 7fefadc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa8103180 0x7fefa81985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:31.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.991+0000 7fefadc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefa8103b40 0x7fefa819f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:31.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.991+0000 7fefadc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa819fb60 con 0x7fefa8103b40 2024-09-13T16:10:31.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.991+0000 7fefadc00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa819fcd0 con 0x7fefa8101f90 2024-09-13T16:10:31.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.991+0000 7fefadc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa819fe90 con 0x7fefa8103180 2024-09-13T16:10:31.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.992+0000 7fefa7400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefa8103b40 0x7fefa819f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:31.995 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.992+0000 7fefa7400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefa8103b40 0x7fefa819f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43354/0 (socket says 172.21.15.86:43354) 2024-09-13T16:10:31.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.992+0000 7fefa7400640 1 -- 172.21.15.86:0/965317491 learned_addr learned my addr 172.21.15.86:0/965317491 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:31.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.992+0000 7fefa6a00640 1 --2- 172.21.15.86:0/965317491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefa8101f90 0x7fefa8198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:31.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.992+0000 7fef9e000640 1 --2- 172.21.15.86:0/965317491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa8103180 0x7fefa81985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:31.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.992+0000 7fefa7400640 1 -- 172.21.15.86:0/965317491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa8103180 msgr2=0x7fefa81985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:31.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.992+0000 7fefa7400640 1 --2- 172.21.15.86:0/965317491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa8103180 0x7fefa81985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.992+0000 7fefa7400640 1 -- 172.21.15.86:0/965317491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefa8101f90 msgr2=0x7fefa8198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:31.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.992+0000 7fefa7400640 1 --2- 172.21.15.86:0/965317491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefa8101f90 0x7fefa8198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:31.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.992+0000 7fefa7400640 1 -- 172.21.15.86:0/965317491 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef90009490 con 0x7fefa8103b40 2024-09-13T16:10:31.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.992+0000 7fef9e000640 1 --2- 172.21.15.86:0/965317491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa8103180 0x7fefa81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:10:31.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.992+0000 7fefa7400640 1 --2- 172.21.15.86:0/965317491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefa8103b40 0x7fefa819f620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fefa000e970 tx=0x7fefa000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:31.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.992+0000 7fef9fe00640 1 -- 172.21.15.86:0/965317491 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0009720 con 0x7fefa8103b40 2024-09-13T16:10:31.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.993+0000 7fefadc00640 1 -- 172.21.15.86:0/965317491 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef98009900 con 0x7fefa8103b40 2024-09-13T16:10:31.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.993+0000 7fef9fe00640 1 -- 172.21.15.86:0/965317491 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fefa0005500 con 0x7fefa8103b40 2024-09-13T16:10:31.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.993+0000 7fefadc00640 1 -- 172.21.15.86:0/965317491 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa81a0540 con 0x7fefa8103b40 2024-09-13T16:10:31.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.993+0000 7fef9fe00640 1 -- 172.21.15.86:0/965317491 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0018430 con 0x7fefa8103b40 2024-09-13T16:10:31.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.994+0000 7fefadc00640 1 -- 172.21.15.86:0/965317491 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa81093d0 con 0x7fefa8103b40 2024-09-13T16:10:31.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.995+0000 7fef9fe00640 1 -- 172.21.15.86:0/965317491 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fefa0004f70 con 0x7fefa8103b40 2024-09-13T16:10:31.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.998+0000 7fef9fe00640 1 --2- 172.21.15.86:0/965317491 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fef8c0a1090 0x7fef8c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:31.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.998+0000 7fef9fe00640 1 -- 172.21.15.86:0/965317491 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fefa0014070 con 0x7fefa8103b40 2024-09-13T16:10:31.999 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.998+0000 7fefa6a00640 1 --2- 172.21.15.86:0/965317491 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fef8c0a1090 0x7fef8c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.000 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:31.998+0000 7fefa6a00640 1 --2- 172.21.15.86:0/965317491 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fef8c0a1090 0x7fef8c0a3550 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fef98000f80 tx=0x7fef98009840 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:32.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.000+0000 7fef9fe00640 1 -- 172.21.15.86:0/965317491 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fefa0096750 con 0x7fefa8103b40 2024-09-13T16:10:32.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.204+0000 7fefadc00640 1 -- 172.21.15.86:0/965317491 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefa810d9f0 con 0x7fefa8103b40 2024-09-13T16:10:32.206 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.205+0000 7fef9fe00640 1 -- 172.21.15.86:0/965317491 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10877 (secure 0 0 0) 0x7fefa0005670 con 0x7fefa8103b40 2024-09-13T16:10:32.207 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:10:32.207 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14508,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1509120923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1509120923},{"type":"v1","addr":"172.21.15.86:6839","nonce":1509120923}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6841/1971775519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":1971775519},{"type":"v1","addr":"172.21.15.86:6841","nonce":1971775519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T16:08:09.202262+0000","modified":"2024-09-13T16:08:32.444959+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24544,"mds_2":24530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/1370900762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1370900762},{"type":"v1","addr":"172.21.15.194:6835","nonce":1370900762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/2460451799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":2460451799},{"type":"v1","addr":"172.21.15.194:6837","nonce":2460451799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24530":{"gid":24530,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.139:6837/2399531832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2399531832},{"type":"v1","addr":"172.21.15.139:6837","nonce":2399531832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6839/3799859182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3799859182},{"type":"v1","addr":"172.21.15.194:6839","nonce":3799859182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.139:6839/3370280063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3370280063},{"type":"v1","addr":"172.21.15.139:6839","nonce":3370280063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:10:32.207 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 24 2024-09-13T16:10:32.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.207+0000 7fefadc00640 1 -- 172.21.15.86:0/965317491 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fef8c0a1090 msgr2=0x7fef8c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.207+0000 7fefadc00640 1 --2- 172.21.15.86:0/965317491 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fef8c0a1090 0x7fef8c0a3550 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fef98000f80 tx=0x7fef98009840 comp rx=0 tx=0).stop 2024-09-13T16:10:32.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.207+0000 7fefadc00640 1 -- 172.21.15.86:0/965317491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefa8103b40 msgr2=0x7fefa819f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.207+0000 7fefadc00640 1 --2- 172.21.15.86:0/965317491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefa8103b40 0x7fefa819f620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fefa000e970 tx=0x7fefa000ed70 comp rx=0 tx=0).stop 2024-09-13T16:10:32.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.208+0000 7fefadc00640 1 -- 172.21.15.86:0/965317491 shutdown_connections 2024-09-13T16:10:32.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.208+0000 7fefadc00640 1 --2- 172.21.15.86:0/965317491 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fef8c0a1090 0x7fef8c0a3550 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.210 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.208+0000 7fefadc00640 1 --2- 172.21.15.86:0/965317491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefa8103b40 0x7fefa819f620 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.208+0000 7fefadc00640 1 --2- 172.21.15.86:0/965317491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa8103180 0x7fefa81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.208+0000 7fefadc00640 1 --2- 172.21.15.86:0/965317491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefa8101f90 0x7fefa8198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.208+0000 7fefadc00640 1 -- 172.21.15.86:0/965317491 >> 172.21.15.86:0/965317491 conn(0x7fefa80fd730 msgr2=0x7fefa81065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:32.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.208+0000 7fefadc00640 1 -- 172.21.15.86:0/965317491 shutdown_connections 2024-09-13T16:10:32.211 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.208+0000 7fefadc00640 1 -- 172.21.15.86:0/965317491 wait complete. 2024-09-13T16:10:32.226 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:10:32.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.377+0000 7f2e01a00640 1 -- 172.21.15.86:0/1832740882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc103970 msgr2=0x7f2dfc10a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.377+0000 7f2e01a00640 1 --2- 172.21.15.86:0/1832740882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc103970 0x7f2dfc10a200 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009ca0 tx=0x7f2df402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.378+0000 7f2e01a00640 1 -- 172.21.15.86:0/1832740882 shutdown_connections 2024-09-13T16:10:32.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.378+0000 7f2e01a00640 1 --2- 172.21.15.86:0/1832740882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc103970 0x7f2dfc10a200 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.378+0000 7f2e01a00640 1 --2- 172.21.15.86:0/1832740882 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2dfc102fb0 0x7f2dfc103430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.378+0000 7f2e01a00640 1 --2- 172.21.15.86:0/1832740882 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dfc101dc0 0x7f2dfc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.378+0000 7f2e01a00640 1 -- 172.21.15.86:0/1832740882 >> 172.21.15.86:0/1832740882 conn(0x7f2dfc0fd540 msgr2=0x7f2dfc0ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:32.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.378+0000 7f2e01a00640 1 -- 172.21.15.86:0/1832740882 shutdown_connections 2024-09-13T16:10:32.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.378+0000 7f2e01a00640 1 -- 172.21.15.86:0/1832740882 wait complete. 2024-09-13T16:10:32.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.379+0000 7f2e01a00640 1 Processor -- start 2024-09-13T16:10:32.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.379+0000 7f2e01a00640 1 -- start start 2024-09-13T16:10:32.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.379+0000 7f2e01a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc101dc0 0x7f2dfc197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.379+0000 7f2e01a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2dfc102fb0 0x7f2dfc198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.379+0000 7f2e01a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dfc103970 0x7f2dfc19f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.379+0000 7f2e01a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc19f8e0 con 0x7f2dfc101dc0 2024-09-13T16:10:32.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.379+0000 7f2e01a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc19fa50 con 0x7f2dfc102fb0 2024-09-13T16:10:32.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.379+0000 7f2e01a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc19fc10 con 0x7f2dfc103970 2024-09-13T16:10:32.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.379+0000 7f2dfbe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc101dc0 0x7f2dfc197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.379+0000 7f2dfbe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc101dc0 0x7f2dfc197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43366/0 (socket says 172.21.15.86:43366) 2024-09-13T16:10:32.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.379+0000 7f2dfbe00640 1 -- 172.21.15.86:0/712880461 learned_addr learned my addr 172.21.15.86:0/712880461 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:32.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.379+0000 7f2df3e00640 1 --2- 172.21.15.86:0/712880461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2dfc102fb0 0x7f2dfc198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.379+0000 7f2e01000640 1 --2- 172.21.15.86:0/712880461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dfc103970 0x7f2dfc19f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.380+0000 7f2dfbe00640 1 -- 172.21.15.86:0/712880461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dfc103970 msgr2=0x7f2dfc19f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.380+0000 7f2dfbe00640 1 --2- 172.21.15.86:0/712880461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dfc103970 0x7f2dfc19f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.380+0000 7f2dfbe00640 1 -- 172.21.15.86:0/712880461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2dfc102fb0 msgr2=0x7f2dfc198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.380+0000 7f2dfbe00640 1 --2- 172.21.15.86:0/712880461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2dfc102fb0 0x7f2dfc198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.380+0000 7f2dfbe00640 1 -- 172.21.15.86:0/712880461 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df4009900 con 0x7f2dfc101dc0 2024-09-13T16:10:32.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.380+0000 7f2df3e00640 1 --2- 172.21.15.86:0/712880461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2dfc102fb0 0x7f2dfc198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:10:32.384 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.380+0000 7f2dfbe00640 1 --2- 172.21.15.86:0/712880461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc101dc0 0x7f2dfc197df0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00e9c0 tx=0x7f2dec00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:32.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.380+0000 7f2df9600640 1 -- 172.21.15.86:0/712880461 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec0096e0 con 0x7f2dfc101dc0 2024-09-13T16:10:32.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.380+0000 7f2df9600640 1 -- 172.21.15.86:0/712880461 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2dec00cd80 con 0x7f2dfc101dc0 2024-09-13T16:10:32.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.380+0000 7f2e01a00640 1 -- 172.21.15.86:0/712880461 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dfc19fef0 con 0x7f2dfc101dc0 2024-09-13T16:10:32.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.380+0000 7f2df9600640 1 -- 172.21.15.86:0/712880461 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec010430 con 0x7f2dfc101dc0 2024-09-13T16:10:32.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.380+0000 7f2e01a00640 1 -- 172.21.15.86:0/712880461 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dfc1a02c0 con 0x7f2dfc101dc0 2024-09-13T16:10:32.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.381+0000 7f2e01a00640 1 -- 172.21.15.86:0/712880461 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dfc1021c0 con 0x7f2dfc101dc0 2024-09-13T16:10:32.385 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.383+0000 7f2df9600640 1 -- 172.21.15.86:0/712880461 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2dec003680 con 0x7f2dfc101dc0 2024-09-13T16:10:32.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.384+0000 7f2df9600640 1 --2- 172.21.15.86:0/712880461 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2de00a1090 0x7f2de00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.384+0000 7f2df9600640 1 -- 172.21.15.86:0/712880461 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f2dec014070 con 0x7f2dfc101dc0 2024-09-13T16:10:32.386 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.385+0000 7f2df3e00640 1 --2- 172.21.15.86:0/712880461 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2de00a1090 0x7f2de00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.387 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.385+0000 7f2df3e00640 1 --2- 172.21.15.86:0/712880461 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2de00a1090 0x7f2de00a3550 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2de40058c0 tx=0x7f2de4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:32.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.388+0000 7f2df9600640 1 -- 172.21.15.86:0/712880461 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2dec096550 con 0x7f2dfc101dc0 2024-09-13T16:10:32.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.561+0000 7f2e01a00640 1 -- 172.21.15.86:0/712880461 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2dfc1091b0 con 0x7f2dfc101dc0 2024-09-13T16:10:32.564 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.563+0000 7f2df9600640 1 -- 172.21.15.86:0/712880461 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24703 (secure 0 0 0) 0x7f2dec099b70 con 0x7f2dfc101dc0 2024-09-13T16:10:32.565 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:10:32.565 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":94,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:10:00.680229+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":7}]},{"pgid":"3.19","mappings":[{"from":3,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2f","mappings":[{"from":1,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:10:32.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.565+0000 7f2e01a00640 1 -- 172.21.15.86:0/712880461 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2de00a1090 msgr2=0x7f2de00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.565+0000 7f2e01a00640 1 --2- 172.21.15.86:0/712880461 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2de00a1090 0x7f2de00a3550 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2de40058c0 tx=0x7f2de4005850 comp rx=0 tx=0).stop 2024-09-13T16:10:32.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.565+0000 7f2e01a00640 1 -- 172.21.15.86:0/712880461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc101dc0 msgr2=0x7f2dfc197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.565+0000 7f2e01a00640 1 --2- 172.21.15.86:0/712880461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc101dc0 0x7f2dfc197df0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00e9c0 tx=0x7f2dec00ee80 comp rx=0 tx=0).stop 2024-09-13T16:10:32.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.565+0000 7f2e01a00640 1 -- 172.21.15.86:0/712880461 shutdown_connections 2024-09-13T16:10:32.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.565+0000 7f2e01a00640 1 --2- 172.21.15.86:0/712880461 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2de00a1090 0x7f2de00a3550 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.565+0000 7f2e01a00640 1 --2- 172.21.15.86:0/712880461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dfc103970 0x7f2dfc19f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.565+0000 7f2e01a00640 1 --2- 172.21.15.86:0/712880461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2dfc102fb0 0x7f2dfc198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.565+0000 7f2e01a00640 1 --2- 172.21.15.86:0/712880461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc101dc0 0x7f2dfc197df0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.565+0000 7f2e01a00640 1 -- 172.21.15.86:0/712880461 >> 172.21.15.86:0/712880461 conn(0x7f2dfc0fd540 msgr2=0x7f2dfc106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:32.567 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.565+0000 7f2e01a00640 1 -- 172.21.15.86:0/712880461 shutdown_connections 2024-09-13T16:10:32.568 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.565+0000 7f2e01a00640 1 -- 172.21.15.86:0/712880461 wait complete. 2024-09-13T16:10:32.580 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:32 smithi086 ceph-mon[30379]: pgmap v370: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T16:10:32.580 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:32 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3167272565' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:10:32.580 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:32 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/965317491' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:10:32.583 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-13T16:08:09.202262+0000', 'modified': '2024-09-13T16:08:32.444959+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24581, 'mds_1': 24544, 'mds_2': 24530}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24503': {'gid': 24503, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6835/1036892520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6834', 'nonce': 1036892520}, {'type': 'v1', 'addr': '172.21.15.139:6835', 'nonce': 1036892520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24511': {'gid': 24511, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6835/1370900762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6834', 'nonce': 1370900762}, {'type': 'v1', 'addr': '172.21.15.194:6835', 'nonce': 1370900762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24523': {'gid': 24523, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6837/2460451799', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6836', 'nonce': 2460451799}, {'type': 'v1', 'addr': '172.21.15.194:6837', 'nonce': 2460451799}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24530': {'gid': 24530, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.139:6837/2399531832', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6836', 'nonce': 2399531832}, {'type': 'v1', 'addr': '172.21.15.139:6837', 'nonce': 2399531832}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24544': {'gid': 24544, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.194:6839/3799859182', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6838', 'nonce': 3799859182}, {'type': 'v1', 'addr': '172.21.15.194:6839', 'nonce': 3799859182}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24581': {'gid': 24581, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.139:6839/3370280063', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6838', 'nonce': 3370280063}, {'type': 'v1', 'addr': '172.21.15.139:6839', 'nonce': 3370280063}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T16:10:32.583 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-13T16:10:32.583 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-09-13T16:10:32.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.736+0000 7fee32200640 1 -- 172.21.15.86:0/3564022543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee2c103b40 msgr2=0x7fee2c10a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.736+0000 7fee32200640 1 --2- 172.21.15.86:0/3564022543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee2c103b40 0x7fee2c10a3d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fee24009ca0 tx=0x7fee2402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.736+0000 7fee32200640 1 -- 172.21.15.86:0/3564022543 shutdown_connections 2024-09-13T16:10:32.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.736+0000 7fee32200640 1 --2- 172.21.15.86:0/3564022543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee2c103b40 0x7fee2c10a3d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.736+0000 7fee32200640 1 --2- 172.21.15.86:0/3564022543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee2c103180 0x7fee2c103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.736+0000 7fee32200640 1 --2- 172.21.15.86:0/3564022543 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee2c101f90 0x7fee2c102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.736+0000 7fee32200640 1 -- 172.21.15.86:0/3564022543 >> 172.21.15.86:0/3564022543 conn(0x7fee2c0fd6d0 msgr2=0x7fee2c0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:32.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.736+0000 7fee32200640 1 -- 172.21.15.86:0/3564022543 shutdown_connections 2024-09-13T16:10:32.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.736+0000 7fee32200640 1 -- 172.21.15.86:0/3564022543 wait complete. 2024-09-13T16:10:32.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.737+0000 7fee32200640 1 Processor -- start 2024-09-13T16:10:32.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.737+0000 7fee32200640 1 -- start start 2024-09-13T16:10:32.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.737+0000 7fee32200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee2c101f90 0x7fee2c197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.737+0000 7fee32200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee2c103180 0x7fee2c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.738+0000 7fee32200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee2c103b40 0x7fee2c19f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.738+0000 7fee32200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c19fac0 con 0x7fee2c103180 2024-09-13T16:10:32.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.738+0000 7fee32200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c19fc30 con 0x7fee2c103b40 2024-09-13T16:10:32.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.738+0000 7fee32200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c19fdf0 con 0x7fee2c101f90 2024-09-13T16:10:32.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.738+0000 7fee2aa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee2c103180 0x7fee2c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.738+0000 7fee2aa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee2c103180 0x7fee2c198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43374/0 (socket says 172.21.15.86:43374) 2024-09-13T16:10:32.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.738+0000 7fee2aa00640 1 -- 172.21.15.86:0/1818087142 learned_addr learned my addr 172.21.15.86:0/1818087142 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:32.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.738+0000 7fee2b400640 1 --2- 172.21.15.86:0/1818087142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee2c101f90 0x7fee2c197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.738+0000 7fee2be00640 1 --2- 172.21.15.86:0/1818087142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee2c103b40 0x7fee2c19f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.738+0000 7fee2aa00640 1 -- 172.21.15.86:0/1818087142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee2c101f90 msgr2=0x7fee2c197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.738+0000 7fee2aa00640 1 --2- 172.21.15.86:0/1818087142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee2c101f90 0x7fee2c197fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.738+0000 7fee2aa00640 1 -- 172.21.15.86:0/1818087142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee2c103b40 msgr2=0x7fee2c19f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.738+0000 7fee2aa00640 1 --2- 172.21.15.86:0/1818087142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee2c103b40 0x7fee2c19f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.738+0000 7fee2aa00640 1 -- 172.21.15.86:0/1818087142 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee24009900 con 0x7fee2c103180 2024-09-13T16:10:32.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.738+0000 7fee2b400640 1 --2- 172.21.15.86:0/1818087142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee2c101f90 0x7fee2c197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:10:32.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.738+0000 7fee2aa00640 1 --2- 172.21.15.86:0/1818087142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee2c103180 0x7fee2c198510 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fee1800e9f0 tx=0x7fee1800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:32.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.739+0000 7fee23e00640 1 -- 172.21.15.86:0/1818087142 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee18009700 con 0x7fee2c103180 2024-09-13T16:10:32.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.739+0000 7fee23e00640 1 -- 172.21.15.86:0/1818087142 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fee1800cd80 con 0x7fee2c103180 2024-09-13T16:10:32.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.739+0000 7fee23e00640 1 -- 172.21.15.86:0/1818087142 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee18018920 con 0x7fee2c103180 2024-09-13T16:10:32.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.739+0000 7fee32200640 1 -- 172.21.15.86:0/1818087142 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2c1a00d0 con 0x7fee2c103180 2024-09-13T16:10:32.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.739+0000 7fee32200640 1 -- 172.21.15.86:0/1818087142 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2c1a0590 con 0x7fee2c103180 2024-09-13T16:10:32.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.742+0000 7fee350cd740 1 Processor -- start 2024-09-13T16:10:32.743 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.742+0000 7fee350cd740 1 -- start start 2024-09-13T16:10:32.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.742+0000 7fee350cd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c82b30 0x559063c82f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.742+0000 7fee350cd740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c83470 0x559063c87f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.742+0000 7fee350cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c88500 0x559063c8a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.742+0000 7fee350cd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x559063becab0 con 0x559063c82b30 2024-09-13T16:10:32.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.742+0000 7fee350cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x559063bea240 con 0x559063c88500 2024-09-13T16:10:32.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.742+0000 7fee350cd740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559063be5b30 con 0x559063c83470 2024-09-13T16:10:32.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.742+0000 7fee23e00640 1 -- 172.21.15.86:0/1818087142 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fee18018a80 con 0x7fee2c103180 2024-09-13T16:10:32.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.742+0000 7fee2be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c82b30 0x559063c82f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.742+0000 7fee2be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c82b30 0x559063c82f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43376/0 (socket says 172.21.15.86:43376) 2024-09-13T16:10:32.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.742+0000 7fee2be00640 1 -- 172.21.15.86:0/441428167 learned_addr learned my addr 172.21.15.86:0/441428167 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:32.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.742+0000 7fee2b400640 1 --2- 172.21.15.86:0/441428167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c83470 0x559063c87f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.742+0000 7fee2aa00640 1 --2- 172.21.15.86:0/441428167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c88500 0x559063c8a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.743+0000 7fee2be00640 1 -- 172.21.15.86:0/441428167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c83470 msgr2=0x559063c87f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:32.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.743+0000 7fee2be00640 1 --2- 172.21.15.86:0/441428167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c83470 0x559063c87f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.743+0000 7fee2be00640 1 -- 172.21.15.86:0/441428167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c88500 msgr2=0x559063c8a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:32.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.743+0000 7fee2be00640 1 --2- 172.21.15.86:0/441428167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c88500 0x559063c8a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.743+0000 7fee2be00640 1 -- 172.21.15.86:0/441428167 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559063bb0bd0 con 0x559063c82b30 2024-09-13T16:10:32.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.743+0000 7fee2be00640 1 --2- 172.21.15.86:0/441428167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c82b30 0x559063c82f30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fee24031cf0 tx=0x7fee24009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f3b36f0f44f65c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:32.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.743+0000 7fee20c00640 1 -- 172.21.15.86:0/441428167 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2402f510 con 0x559063c82b30 2024-09-13T16:10:32.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.743+0000 7fee20c00640 1 -- 172.21.15.86:0/441428167 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fee24003e50 con 0x559063c82b30 2024-09-13T16:10:32.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.743+0000 7fee20c00640 1 -- 172.21.15.86:0/441428167 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2402fbb0 con 0x559063c82b30 2024-09-13T16:10:32.746 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.744+0000 7fee23e00640 1 --2- 172.21.15.86:0/1818087142 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fee100a1110 0x7fee100a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.744+0000 7fee23e00640 1 -- 172.21.15.86:0/1818087142 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fee18014070 con 0x7fee2c103180 2024-09-13T16:10:32.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.744+0000 7fee2b400640 1 --2- 172.21.15.86:0/1818087142 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fee100a1110 0x7fee100a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.744+0000 7fee350cd740 1 -- 172.21.15.86:0/441428167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c82b30 msgr2=0x559063c82f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.744+0000 7fee350cd740 1 --2- 172.21.15.86:0/441428167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c82b30 0x559063c82f30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fee24031cf0 tx=0x7fee24009360 comp rx=0 tx=0).stop 2024-09-13T16:10:32.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.744+0000 7fee350cd740 1 -- 172.21.15.86:0/441428167 shutdown_connections 2024-09-13T16:10:32.750 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.744+0000 7fee350cd740 1 --2- 172.21.15.86:0/441428167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c88500 0x559063c8a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.744+0000 7fee350cd740 1 --2- 172.21.15.86:0/441428167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c83470 0x559063c87f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.744+0000 7fee350cd740 1 --2- 172.21.15.86:0/441428167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c82b30 0x559063c82f30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.744+0000 7fee350cd740 1 -- 172.21.15.86:0/441428167 >> 172.21.15.86:0/441428167 conn(0x559063c7e1a0 msgr2=0x559063c7e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:32.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.744+0000 7fee350cd740 1 -- 172.21.15.86:0/441428167 shutdown_connections 2024-09-13T16:10:32.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.744+0000 7fee350cd740 1 -- 172.21.15.86:0/441428167 wait complete. 2024-09-13T16:10:32.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.745+0000 7fee2b400640 1 --2- 172.21.15.86:0/1818087142 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fee100a1110 0x7fee100a35d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x559063c83ea0 tx=0x7fee1c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:32.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.745+0000 7fee350cd740 1 -- start start 2024-09-13T16:10:32.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.745+0000 7fee350cd740 1 Processor -- start 2024-09-13T16:10:32.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.745+0000 7fee350cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c82b30 0x559063c8c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.745+0000 7fee350cd740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c83470 0x559063c8cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.745+0000 7fee350cd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c88500 0x559063c93c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.745+0000 7fee350cd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x559063b87260 con 0x559063c88500 2024-09-13T16:10:32.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.745+0000 7fee350cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x559063b86f00 con 0x559063c82b30 2024-09-13T16:10:32.751 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.745+0000 7fee350cd740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55906394cf20 con 0x559063c83470 2024-09-13T16:10:32.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.746+0000 7fee350cd740 10 client.0 _ll_register_callbacks cb 0x559063bdf1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:32.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.746+0000 7fee2be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c88500 0x559063c93c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.746+0000 7fee2be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c88500 0x559063c93c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43392/0 (socket says 172.21.15.86:43392) 2024-09-13T16:10:32.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.746+0000 7fee2b400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c82b30 0x559063c8c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.746+0000 7fee2be00640 1 -- 172.21.15.86:0/3255027830 learned_addr learned my addr 172.21.15.86:0/3255027830 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:32.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.746+0000 7fee2aa00640 1 --2- 172.21.15.86:0/3255027830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c83470 0x559063c8cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.746+0000 7fee2be00640 1 -- 172.21.15.86:0/3255027830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c83470 msgr2=0x559063c8cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:32.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.746+0000 7fee2be00640 1 --2- 172.21.15.86:0/3255027830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c83470 0x559063c8cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.746+0000 7fee2be00640 1 -- 172.21.15.86:0/3255027830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c82b30 msgr2=0x559063c8c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:32.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.746+0000 7fee2be00640 1 --2- 172.21.15.86:0/3255027830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c82b30 0x559063c8c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.746+0000 7fee2be00640 1 -- 172.21.15.86:0/3255027830 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2c10acd0 con 0x559063c88500 2024-09-13T16:10:32.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.746+0000 7fee2be00640 1 --2- 172.21.15.86:0/3255027830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c88500 0x559063c93c60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fee2402aeb0 tx=0x7fee24003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a38ce45c61176e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:32.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.746+0000 7fee15600640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T16:10:32.752 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.747+0000 7fee15600640 1 -- 172.21.15.86:0/3255027830 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24031660 con 0x559063c88500 2024-09-13T16:10:32.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.747+0000 7fee15600640 1 -- 172.21.15.86:0/3255027830 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fee240317c0 con 0x559063c88500 2024-09-13T16:10:32.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.747+0000 7fee350cd740 1 -- 172.21.15.86:0/3255027830 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559063c0fcd0 con 0x559063c88500 2024-09-13T16:10:32.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.747+0000 7fee15600640 1 -- 172.21.15.86:0/3255027830 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee2402f930 con 0x559063c88500 2024-09-13T16:10:32.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.747+0000 7fee350cd740 10 client.15285 fetch_fsmap learned FSMap version 24 2024-09-13T16:10:32.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.747+0000 7fee350cd740 1 -- 172.21.15.86:0/3255027830 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x559063be41b0 con 0x559063c88500 2024-09-13T16:10:32.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.747+0000 7fee15600640 1 -- 172.21.15.86:0/3255027830 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x559063c0fcd0 con 0x559063c88500 2024-09-13T16:10:32.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.747+0000 7fee15600640 1 -- 172.21.15.86:0/3255027830 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fee24003fc0 con 0x559063c88500 2024-09-13T16:10:32.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.747+0000 7fee350cd740 10 client.15285 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:10:32.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.748+0000 7fee350cd740 10 client.15285 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-13T16:10:32.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.748+0000 7fee350cd740 20 client.15285 populate_metadata read hostname 'smithi086' 2024-09-13T16:10:32.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.748+0000 7fee350cd740 1 --2- 172.21.15.86:0/3255027830 >> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] conn(0x559063c989a0 0x559063c9cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.748+0000 7fee350cd740 4 client.15285 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:10:32.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.748+0000 7fee350cd740 1 -- 172.21.15.86:0/3255027830 --> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5590638d93c0 con 0x559063c989a0 2024-09-13T16:10:32.753 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.748+0000 7fee2b400640 1 --2- 172.21.15.86:0/3255027830 >> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] conn(0x559063c989a0 0x559063c9cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.748+0000 7fee2b400640 1 --2- 172.21.15.86:0/3255027830 >> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] conn(0x559063c989a0 0x559063c9cb00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2a0b4876ed5885d3 server_cookie=52a5b6dd307b4e41 in_seq=0 out_seq=0 2024-09-13T16:10:32.754 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.748+0000 7fee15600640 10 client.15285 ms_handle_connect on v2:172.21.15.139:6836/2399531832 2024-09-13T16:10:32.754 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:32 smithi139 ceph-mon[35320]: pgmap v370: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T16:10:32.754 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:32 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3167272565' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:10:32.754 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:32 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/965317491' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:10:32.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.749+0000 7fee15600640 1 -- 172.21.15.86:0/3255027830 <== mds.2 v2:172.21.15.139:6836/2399531832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5590638d93c0 con 0x559063c989a0 2024-09-13T16:10:32.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.749+0000 7fee15600640 10 client.15285 handle_command_reply: tid=0 2024-09-13T16:10:32.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.749+0000 7fee350cd740 1 client.15285 shutdown 2024-09-13T16:10:32.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.749+0000 7fee350cd740 1 -- 172.21.15.86:0/3255027830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c88500 msgr2=0x559063c93c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.755 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.749+0000 7fee350cd740 1 --2- 172.21.15.86:0/3255027830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c88500 0x559063c93c60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fee2402aeb0 tx=0x7fee24003c20 comp rx=0 tx=0).stop 2024-09-13T16:10:32.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.749+0000 7fee350cd740 1 -- 172.21.15.86:0/3255027830 shutdown_connections 2024-09-13T16:10:32.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.749+0000 7fee350cd740 1 --2- 172.21.15.86:0/3255027830 >> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] conn(0x559063c989a0 0x559063c9cb00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.749+0000 7fee350cd740 1 --2- 172.21.15.86:0/3255027830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c88500 0x559063c93c60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.749+0000 7fee350cd740 1 --2- 172.21.15.86:0/3255027830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c83470 0x559063c8cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.749+0000 7fee350cd740 1 --2- 172.21.15.86:0/3255027830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c82b30 0x559063c8c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.749+0000 7fee15600640 0 client.15285 ms_handle_reset on v2:172.21.15.139:6836/2399531832 2024-09-13T16:10:32.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.749+0000 7fee350cd740 1 -- 172.21.15.86:0/3255027830 >> 172.21.15.86:0/3255027830 conn(0x559063c7e1a0 msgr2=0x559063c7f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:32.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.750+0000 7fee350cd740 1 -- 172.21.15.86:0/3255027830 shutdown_connections 2024-09-13T16:10:32.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.750+0000 7fee350cd740 1 -- 172.21.15.86:0/3255027830 wait complete. 2024-09-13T16:10:32.756 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.750+0000 7fee350cd740 20 client.15285 trim_cache size 0 max 16384 2024-09-13T16:10:32.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:32 smithi194 ceph-mon[35694]: pgmap v370: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T16:10:32.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:32 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3167272565' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:10:32.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:32 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/965317491' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:10:32.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.765+0000 7fee350cd740 1 Processor -- start 2024-09-13T16:10:32.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.765+0000 7fee350cd740 1 -- start start 2024-09-13T16:10:32.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.765+0000 7fee350cd740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c82b30 0x559063c842f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.765+0000 7fee350cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c83470 0x559063c84830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.765+0000 7fee350cd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c88500 0x559063c93b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.765+0000 7fee350cd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x559063c72d80 con 0x559063c88500 2024-09-13T16:10:32.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.765+0000 7fee350cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x559063c940c0 con 0x559063c83470 2024-09-13T16:10:32.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.765+0000 7fee350cd740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559063c8d750 con 0x559063c82b30 2024-09-13T16:10:32.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.765+0000 7fee2be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c88500 0x559063c93b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.765+0000 7fee2be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c88500 0x559063c93b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43402/0 (socket says 172.21.15.86:43402) 2024-09-13T16:10:32.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.765+0000 7fee2be00640 1 -- 172.21.15.86:0/4143121524 learned_addr learned my addr 172.21.15.86:0/4143121524 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:32.767 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.765+0000 7fee2b400640 1 --2- 172.21.15.86:0/4143121524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c82b30 0x559063c842f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.768 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.765+0000 7fee2aa00640 1 --2- 172.21.15.86:0/4143121524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c83470 0x559063c84830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.766+0000 7fee2be00640 1 -- 172.21.15.86:0/4143121524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c82b30 msgr2=0x559063c842f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:32.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.766+0000 7fee2be00640 1 --2- 172.21.15.86:0/4143121524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c82b30 0x559063c842f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.766+0000 7fee2be00640 1 -- 172.21.15.86:0/4143121524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c83470 msgr2=0x559063c84830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:32.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.766+0000 7fee2be00640 1 --2- 172.21.15.86:0/4143121524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c83470 0x559063c84830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.766+0000 7fee2be00640 1 -- 172.21.15.86:0/4143121524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559063b86470 con 0x559063c88500 2024-09-13T16:10:32.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.766+0000 7fee2aa00640 1 --2- 172.21.15.86:0/4143121524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c83470 0x559063c84830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:32.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.766+0000 7fee2b400640 1 --2- 172.21.15.86:0/4143121524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c82b30 0x559063c842f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:32.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.766+0000 7fee2be00640 1 --2- 172.21.15.86:0/4143121524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c88500 0x559063c93b80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fee24004af0 tx=0x7fee240093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa2a2f9be6c2e17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:32.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.766+0000 7fee21600640 1 -- 172.21.15.86:0/4143121524 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24003c90 con 0x559063c88500 2024-09-13T16:10:32.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.766+0000 7fee21600640 1 -- 172.21.15.86:0/4143121524 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fee24005c70 con 0x559063c88500 2024-09-13T16:10:32.771 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.766+0000 7fee21600640 1 -- 172.21.15.86:0/4143121524 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24031790 con 0x559063c88500 2024-09-13T16:10:32.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.767+0000 7fee350cd740 1 -- 172.21.15.86:0/4143121524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c88500 msgr2=0x559063c93b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.767+0000 7fee350cd740 1 --2- 172.21.15.86:0/4143121524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c88500 0x559063c93b80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fee24004af0 tx=0x7fee240093e0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.767+0000 7fee350cd740 1 -- 172.21.15.86:0/4143121524 shutdown_connections 2024-09-13T16:10:32.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.767+0000 7fee350cd740 1 --2- 172.21.15.86:0/4143121524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c88500 0x559063c93b80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.767+0000 7fee350cd740 1 --2- 172.21.15.86:0/4143121524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c83470 0x559063c84830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.767+0000 7fee350cd740 1 --2- 172.21.15.86:0/4143121524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c82b30 0x559063c842f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.767+0000 7fee350cd740 1 -- 172.21.15.86:0/4143121524 >> 172.21.15.86:0/4143121524 conn(0x559063c7e1a0 msgr2=0x559063c8bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:32.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.767+0000 7fee350cd740 1 -- 172.21.15.86:0/4143121524 shutdown_connections 2024-09-13T16:10:32.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.767+0000 7fee350cd740 1 -- 172.21.15.86:0/4143121524 wait complete. 2024-09-13T16:10:32.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.767+0000 7fee350cd740 1 -- start start 2024-09-13T16:10:32.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.768+0000 7fee350cd740 1 Processor -- start 2024-09-13T16:10:32.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.768+0000 7fee350cd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c82b30 0x559063c8fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.772 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.768+0000 7fee350cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c83470 0x559063c902c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.768+0000 7fee350cd740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c88500 0x559063c93240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.768+0000 7fee350cd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x559063c93780 con 0x559063c82b30 2024-09-13T16:10:32.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.768+0000 7fee350cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x559063c938f0 con 0x559063c83470 2024-09-13T16:10:32.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.768+0000 7fee350cd740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559063c93ab0 con 0x559063c88500 2024-09-13T16:10:32.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.768+0000 7fee350cd740 10 client.0 _ll_register_callbacks cb 0x7fee180d08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:32.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.768+0000 7fee2b400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c82b30 0x559063c8fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.768+0000 7fee2b400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c82b30 0x559063c8fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43410/0 (socket says 172.21.15.86:43410) 2024-09-13T16:10:32.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.768+0000 7fee2b400640 1 -- 172.21.15.86:0/1553787205 learned_addr learned my addr 172.21.15.86:0/1553787205 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:32.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.768+0000 7fee2be00640 1 --2- 172.21.15.86:0/1553787205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c88500 0x559063c93240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.768+0000 7fee2aa00640 1 --2- 172.21.15.86:0/1553787205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c83470 0x559063c902c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.769+0000 7fee2b400640 1 -- 172.21.15.86:0/1553787205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c88500 msgr2=0x559063c93240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:32.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.769+0000 7fee2b400640 1 --2- 172.21.15.86:0/1553787205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c88500 0x559063c93240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.773 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.769+0000 7fee2b400640 1 -- 172.21.15.86:0/1553787205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c83470 msgr2=0x559063c902c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:32.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.769+0000 7fee2b400640 1 --2- 172.21.15.86:0/1553787205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c83470 0x559063c902c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.769+0000 7fee2b400640 1 -- 172.21.15.86:0/1553787205 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1c004270 con 0x559063c82b30 2024-09-13T16:10:32.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.769+0000 7fee2b400640 1 --2- 172.21.15.86:0/1553787205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c82b30 0x559063c8fd80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x559063c7f020 tx=0x7fee1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1e0016d0ba46b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:32.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.769+0000 7fee15600640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T16:10:32.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.769+0000 7fee15600640 1 -- 172.21.15.86:0/1553787205 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c025040 con 0x559063c82b30 2024-09-13T16:10:32.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.769+0000 7fee350cd740 1 -- 172.21.15.86:0/1553787205 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fee24003e50 con 0x559063c82b30 2024-09-13T16:10:32.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.769+0000 7fee15600640 1 -- 172.21.15.86:0/1553787205 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fee1c003a40 con 0x559063c82b30 2024-09-13T16:10:32.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.769+0000 7fee15600640 1 -- 172.21.15.86:0/1553787205 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee1c017070 con 0x559063c82b30 2024-09-13T16:10:32.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.769+0000 7fee350cd740 10 client.15291 fetch_fsmap learned FSMap version 24 2024-09-13T16:10:32.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.769+0000 7fee350cd740 1 -- 172.21.15.86:0/1553787205 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fee2c1a0590 con 0x559063c82b30 2024-09-13T16:10:32.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.770+0000 7fee15600640 1 -- 172.21.15.86:0/1553787205 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fee24003e50 con 0x559063c82b30 2024-09-13T16:10:32.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.770+0000 7fee15600640 1 -- 172.21.15.86:0/1553787205 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fee1c0048c0 con 0x559063c82b30 2024-09-13T16:10:32.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.770+0000 7fee350cd740 10 client.15291 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:10:32.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.770+0000 7fee350cd740 10 client.15291 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-13T16:10:32.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.770+0000 7fee350cd740 20 client.15291 populate_metadata read hostname 'smithi086' 2024-09-13T16:10:32.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.770+0000 7fee350cd740 1 --2- 172.21.15.86:0/1553787205 >> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] conn(0x559063cf2fe0 0x559063cef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.770+0000 7fee350cd740 4 client.15291 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T16:10:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.770+0000 7fee350cd740 1 -- 172.21.15.86:0/1553787205 --> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5590638ea6c0 con 0x559063cf2fe0 2024-09-13T16:10:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.770+0000 7fee2aa00640 1 --2- 172.21.15.86:0/1553787205 >> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] conn(0x559063cf2fe0 0x559063cef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.771+0000 7fee2aa00640 1 --2- 172.21.15.86:0/1553787205 >> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] conn(0x559063cf2fe0 0x559063cef8f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ebe2ba8ab5028fa1 server_cookie=fd31b8ad21e40081 in_seq=0 out_seq=0 2024-09-13T16:10:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.771+0000 7fee15600640 10 client.15291 ms_handle_connect on v2:172.21.15.139:6836/2399531832 2024-09-13T16:10:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.771+0000 7fee15600640 1 -- 172.21.15.86:0/1553787205 <== mds.2 v2:172.21.15.139:6836/2399531832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x5590638ea6c0 con 0x559063cf2fe0 2024-09-13T16:10:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.771+0000 7fee15600640 10 client.15291 handle_command_reply: tid=0 2024-09-13T16:10:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.771+0000 7fee350cd740 1 client.15291 shutdown 2024-09-13T16:10:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.771+0000 7fee350cd740 1 -- 172.21.15.86:0/1553787205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c82b30 msgr2=0x559063c8fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.771+0000 7fee350cd740 1 --2- 172.21.15.86:0/1553787205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c82b30 0x559063c8fd80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x559063c7f020 tx=0x7fee1c004730 comp rx=0 tx=0).stop 2024-09-13T16:10:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.771+0000 7fee350cd740 1 -- 172.21.15.86:0/1553787205 shutdown_connections 2024-09-13T16:10:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.771+0000 7fee350cd740 1 --2- 172.21.15.86:0/1553787205 >> [v2:172.21.15.139:6836/2399531832,v1:172.21.15.139:6837/2399531832] conn(0x559063cf2fe0 0x559063cef8f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.771+0000 7fee350cd740 1 --2- 172.21.15.86:0/1553787205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559063c88500 0x559063c93240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.771+0000 7fee350cd740 1 --2- 172.21.15.86:0/1553787205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559063c83470 0x559063c902c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.771+0000 7fee350cd740 1 --2- 172.21.15.86:0/1553787205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559063c82b30 0x559063c8fd80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.771+0000 7fee15600640 0 client.15291 ms_handle_reset on v2:172.21.15.139:6836/2399531832 2024-09-13T16:10:32.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.771+0000 7fee350cd740 1 -- 172.21.15.86:0/1553787205 >> 172.21.15.86:0/1553787205 conn(0x559063c7e1a0 msgr2=0x559063c842f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:32.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.771+0000 7fee350cd740 1 -- 172.21.15.86:0/1553787205 shutdown_connections 2024-09-13T16:10:32.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.771+0000 7fee350cd740 1 -- 172.21.15.86:0/1553787205 wait complete. 2024-09-13T16:10:32.780 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.772+0000 7fee350cd740 20 client.15291 trim_cache size 0 max 16384 2024-09-13T16:10:32.780 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T16:10:32.780 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "1ecdfbda-71e9-11ef-bceb-c7b262605968", 2024-09-13T16:10:32.781 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 2, 2024-09-13T16:10:32.781 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24530, 2024-09-13T16:10:32.781 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-09-13T16:10:32.781 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-09-13T16:10:32.781 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-09-13T16:10:32.781 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 121.330693272, 2024-09-13T16:10:32.781 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 24, 2024-09-13T16:10:32.781 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 94, 2024-09-13T16:10:32.781 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 90, 2024-09-13T16:10:32.781 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 160.841305011 2024-09-13T16:10:32.781 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T16:10:32.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.772+0000 7fee32200640 1 -- 172.21.15.86:0/1818087142 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fee100a1110 msgr2=0x7fee100a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.772+0000 7fee32200640 1 --2- 172.21.15.86:0/1818087142 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fee100a1110 0x7fee100a35d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x559063c83ea0 tx=0x7fee1c005f90 comp rx=0 tx=0).stop 2024-09-13T16:10:32.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.772+0000 7fee32200640 1 -- 172.21.15.86:0/1818087142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee2c103180 msgr2=0x7fee2c198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.772+0000 7fee32200640 1 --2- 172.21.15.86:0/1818087142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee2c103180 0x7fee2c198510 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fee1800e9f0 tx=0x7fee1800eeb0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.772+0000 7fee32200640 1 -- 172.21.15.86:0/1818087142 shutdown_connections 2024-09-13T16:10:32.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.772+0000 7fee32200640 1 --2- 172.21.15.86:0/1818087142 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fee100a1110 0x7fee100a35d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.772+0000 7fee32200640 1 --2- 172.21.15.86:0/1818087142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee2c103b40 0x7fee2c19f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.772+0000 7fee32200640 1 --2- 172.21.15.86:0/1818087142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee2c103180 0x7fee2c198510 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.772+0000 7fee32200640 1 --2- 172.21.15.86:0/1818087142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee2c101f90 0x7fee2c197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.772+0000 7fee32200640 1 -- 172.21.15.86:0/1818087142 >> 172.21.15.86:0/1818087142 conn(0x7fee2c0fd6d0 msgr2=0x7fee2c106550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:32.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.772+0000 7fee32200640 1 -- 172.21.15.86:0/1818087142 shutdown_connections 2024-09-13T16:10:32.783 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.772+0000 7fee32200640 1 -- 172.21.15.86:0/1818087142 wait complete. 2024-09-13T16:10:32.789 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-09-13T16:10:32.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.943+0000 7fcbc7200640 1 -- 172.21.15.86:0/2600890022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc0103b40 msgr2=0x7fcbc010a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.943+0000 7fcbc7200640 1 --2- 172.21.15.86:0/2600890022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc0103b40 0x7fcbc010a3d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8009ca0 tx=0x7fcbb802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.943+0000 7fcbc7200640 1 -- 172.21.15.86:0/2600890022 shutdown_connections 2024-09-13T16:10:32.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.943+0000 7fcbc7200640 1 --2- 172.21.15.86:0/2600890022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc0103b40 0x7fcbc010a3d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.943+0000 7fcbc7200640 1 --2- 172.21.15.86:0/2600890022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbc0103180 0x7fcbc0103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.943+0000 7fcbc7200640 1 --2- 172.21.15.86:0/2600890022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbc0101f90 0x7fcbc0102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.943+0000 7fcbc7200640 1 -- 172.21.15.86:0/2600890022 >> 172.21.15.86:0/2600890022 conn(0x7fcbc00fd6d0 msgr2=0x7fcbc00ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:32.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.943+0000 7fcbc7200640 1 -- 172.21.15.86:0/2600890022 shutdown_connections 2024-09-13T16:10:32.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.943+0000 7fcbc7200640 1 -- 172.21.15.86:0/2600890022 wait complete. 2024-09-13T16:10:32.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.944+0000 7fcbc7200640 1 Processor -- start 2024-09-13T16:10:32.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.944+0000 7fcbc7200640 1 -- start start 2024-09-13T16:10:32.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.945+0000 7fcbc7200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbc0101f90 0x7fcbc0197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.945+0000 7fcbc7200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbc0103180 0x7fcbc0198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.945+0000 7fcbc7200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc0103b40 0x7fcbc019f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.945+0000 7fcbc7200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc019fac0 con 0x7fcbc0103b40 2024-09-13T16:10:32.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.945+0000 7fcbc7200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc019fc30 con 0x7fcbc0103180 2024-09-13T16:10:32.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.945+0000 7fcbc7200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc019fdf0 con 0x7fcbc0101f90 2024-09-13T16:10:32.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.945+0000 7fcbc5200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc0103b40 0x7fcbc019f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.945+0000 7fcbbfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbc0101f90 0x7fcbc0197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.945+0000 7fcbc5200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc0103b40 0x7fcbc019f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35692/0 (socket says 172.21.15.86:35692) 2024-09-13T16:10:32.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.945+0000 7fcbc5200640 1 -- 172.21.15.86:0/1193885838 learned_addr learned my addr 172.21.15.86:0/1193885838 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:32.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.945+0000 7fcbbf400640 1 --2- 172.21.15.86:0/1193885838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbc0103180 0x7fcbc0198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.945+0000 7fcbc5200640 1 -- 172.21.15.86:0/1193885838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbc0101f90 msgr2=0x7fcbc0197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.945+0000 7fcbc5200640 1 --2- 172.21.15.86:0/1193885838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbc0101f90 0x7fcbc0197fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.945+0000 7fcbc5200640 1 -- 172.21.15.86:0/1193885838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbc0103180 msgr2=0x7fcbc0198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.945+0000 7fcbc5200640 1 --2- 172.21.15.86:0/1193885838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbc0103180 0x7fcbc0198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.945+0000 7fcbc5200640 1 -- 172.21.15.86:0/1193885838 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb0009490 con 0x7fcbc0103b40 2024-09-13T16:10:32.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.945+0000 7fcbbfe00640 1 --2- 172.21.15.86:0/1193885838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbc0101f90 0x7fcbc0197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:32.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.946+0000 7fcbc5200640 1 --2- 172.21.15.86:0/1193885838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc0103b40 0x7fcbc019f580 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80098d0 tx=0x7fcbb8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:32.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.946+0000 7fcbbcc00640 1 -- 172.21.15.86:0/1193885838 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8031450 con 0x7fcbc0103b40 2024-09-13T16:10:32.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.946+0000 7fcbbcc00640 1 -- 172.21.15.86:0/1193885838 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcbb8040070 con 0x7fcbc0103b40 2024-09-13T16:10:32.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.946+0000 7fcbbcc00640 1 -- 172.21.15.86:0/1193885838 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8030820 con 0x7fcbc0103b40 2024-09-13T16:10:32.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.946+0000 7fcbc7200640 1 -- 172.21.15.86:0/1193885838 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb8009900 con 0x7fcbc0103b40 2024-09-13T16:10:32.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.946+0000 7fcbc7200640 1 -- 172.21.15.86:0/1193885838 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc01a03f0 con 0x7fcbc0103b40 2024-09-13T16:10:32.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.949+0000 7fcbca05e740 1 Processor -- start 2024-09-13T16:10:32.950 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.949+0000 7fcbbcc00640 1 -- 172.21.15.86:0/1193885838 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcbb8042030 con 0x7fcbc0103b40 2024-09-13T16:10:32.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.949+0000 7fcbca05e740 1 -- start start 2024-09-13T16:10:32.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.949+0000 7fcbca05e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c15365b30 0x560c15365f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.949+0000 7fcbca05e740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c15366470 0x560c1536af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.949+0000 7fcbca05e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c1536b500 0x560c1536d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.949+0000 7fcbca05e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c152cfab0 con 0x560c1536b500 2024-09-13T16:10:32.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.949+0000 7fcbca05e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c152cd240 con 0x560c15365b30 2024-09-13T16:10:32.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.950+0000 7fcbca05e740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c152c8b30 con 0x560c15366470 2024-09-13T16:10:32.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.950+0000 7fcbbf400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c1536b500 0x560c1536d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.950+0000 7fcbbfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c15366470 0x560c1536af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.950+0000 7fcbbf400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c1536b500 0x560c1536d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35694/0 (socket says 172.21.15.86:35694) 2024-09-13T16:10:32.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.950+0000 7fcbbf400640 1 -- 172.21.15.86:0/3247233058 learned_addr learned my addr 172.21.15.86:0/3247233058 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:32.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.950+0000 7fcbbf400640 1 --2- 172.21.15.86:0/3247233058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c15365b30 0x560c15365f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.950+0000 7fcbbfe00640 1 -- 172.21.15.86:0/3247233058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c15365b30 msgr2=0x560c15365f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:32.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.950+0000 7fcbbfe00640 1 --2- 172.21.15.86:0/3247233058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c15365b30 0x560c15365f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.950+0000 7fcbbfe00640 1 -- 172.21.15.86:0/3247233058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c1536b500 msgr2=0x560c1536d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:32.958 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.950+0000 7fcbbfe00640 1 --2- 172.21.15.86:0/3247233058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c1536b500 0x560c1536d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.950+0000 7fcbbfe00640 1 -- 172.21.15.86:0/3247233058 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c15293bd0 con 0x560c15366470 2024-09-13T16:10:32.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.950+0000 7fcbbf400640 1 --2- 172.21.15.86:0/3247233058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c1536b500 0x560c1536d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:32.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.951+0000 7fcbbfe00640 1 --2- 172.21.15.86:0/3247233058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c15366470 0x560c1536af30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0011570 tx=0x7fcbb0011a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c40b956e18d3d561 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:32.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.951+0000 7fcbbcc00640 1 --2- 172.21.15.86:0/1193885838 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fcba40a1110 0x7fcba40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.951+0000 7fcbbcc00640 1 -- 172.21.15.86:0/1193885838 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fcbb80ee0e0 con 0x7fcbc0103b40 2024-09-13T16:10:32.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.951+0000 7fcbb5600640 1 -- 172.21.15.86:0/3247233058 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb000f700 con 0x560c15366470 2024-09-13T16:10:32.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.951+0000 7fcbbf400640 1 --2- 172.21.15.86:0/1193885838 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fcba40a1110 0x7fcba40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.951+0000 7fcbb5600640 1 -- 172.21.15.86:0/3247233058 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcbb000fd40 con 0x560c15366470 2024-09-13T16:10:32.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.951+0000 7fcbb5600640 1 -- 172.21.15.86:0/3247233058 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0019d50 con 0x560c15366470 2024-09-13T16:10:32.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.952+0000 7fcbbf400640 1 --2- 172.21.15.86:0/1193885838 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fcba40a1110 0x7fcba40a35d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009fd0 tx=0x7fcbac005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:32.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.952+0000 7fcbca05e740 1 -- 172.21.15.86:0/3247233058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c15366470 msgr2=0x560c1536af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.952+0000 7fcbca05e740 1 --2- 172.21.15.86:0/3247233058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c15366470 0x560c1536af30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0011570 tx=0x7fcbb0011a30 comp rx=0 tx=0).stop 2024-09-13T16:10:32.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.952+0000 7fcbca05e740 1 -- 172.21.15.86:0/3247233058 shutdown_connections 2024-09-13T16:10:32.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.952+0000 7fcbca05e740 1 --2- 172.21.15.86:0/3247233058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c1536b500 0x560c1536d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.952+0000 7fcbca05e740 1 --2- 172.21.15.86:0/3247233058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c15366470 0x560c1536af30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.952+0000 7fcbca05e740 1 --2- 172.21.15.86:0/3247233058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c15365b30 0x560c15365f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.952+0000 7fcbca05e740 1 -- 172.21.15.86:0/3247233058 >> 172.21.15.86:0/3247233058 conn(0x560c153611a0 msgr2=0x560c153615a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:32.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.952+0000 7fcbca05e740 1 -- 172.21.15.86:0/3247233058 shutdown_connections 2024-09-13T16:10:32.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.952+0000 7fcbca05e740 1 -- 172.21.15.86:0/3247233058 wait complete. 2024-09-13T16:10:32.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.952+0000 7fcbca05e740 1 -- start start 2024-09-13T16:10:32.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.952+0000 7fcbca05e740 1 Processor -- start 2024-09-13T16:10:32.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.953+0000 7fcbca05e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c15365b30 0x560c1536f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.953+0000 7fcbca05e740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c15366470 0x560c1536fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.953+0000 7fcbca05e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c1536b500 0x560c15376cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.953+0000 7fcbca05e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c1526a260 con 0x560c15365b30 2024-09-13T16:10:32.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.953+0000 7fcbca05e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c15269f00 con 0x560c1536b500 2024-09-13T16:10:32.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.953+0000 7fcbca05e740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c1502ff20 con 0x560c15366470 2024-09-13T16:10:32.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.953+0000 7fcbca05e740 10 client.0 _ll_register_callbacks cb 0x560c152c21a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:32.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.953+0000 7fcbbfe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c15365b30 0x560c1536f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.953+0000 7fcbbfe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c15365b30 0x560c1536f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35704/0 (socket says 172.21.15.86:35704) 2024-09-13T16:10:32.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.953+0000 7fcbbfe00640 1 -- 172.21.15.86:0/1596043707 learned_addr learned my addr 172.21.15.86:0/1596043707 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:32.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.953+0000 7fcbbf400640 1 --2- 172.21.15.86:0/1596043707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c15366470 0x560c1536fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.953+0000 7fcbc5200640 1 --2- 172.21.15.86:0/1596043707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c1536b500 0x560c15376cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.953+0000 7fcbbfe00640 1 -- 172.21.15.86:0/1596043707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c15366470 msgr2=0x560c1536fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:32.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.953+0000 7fcbbfe00640 1 --2- 172.21.15.86:0/1596043707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c15366470 0x560c1536fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.953+0000 7fcbbfe00640 1 -- 172.21.15.86:0/1596043707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c1536b500 msgr2=0x560c15376cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:32.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.953+0000 7fcbbfe00640 1 --2- 172.21.15.86:0/1596043707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c1536b500 0x560c15376cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.953+0000 7fcbbfe00640 1 -- 172.21.15.86:0/1596043707 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb0009d90 con 0x560c15365b30 2024-09-13T16:10:32.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.954+0000 7fcbbfe00640 1 --2- 172.21.15.86:0/1596043707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c15365b30 0x560c1536f770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcbb001c040 tx=0x7fcbb000ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85efb826628901e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:32.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.954+0000 7fcbaa000640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T16:10:32.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.954+0000 7fcbaa000640 1 -- 172.21.15.86:0/1596043707 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0004250 con 0x560c15365b30 2024-09-13T16:10:32.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.954+0000 7fcbca05e740 1 -- 172.21.15.86:0/1596043707 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560c152f2cd0 con 0x560c15365b30 2024-09-13T16:10:32.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.954+0000 7fcbaa000640 1 -- 172.21.15.86:0/1596043707 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fcbb00043b0 con 0x560c15365b30 2024-09-13T16:10:32.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.954+0000 7fcbaa000640 1 -- 172.21.15.86:0/1596043707 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbb000f700 con 0x560c15365b30 2024-09-13T16:10:32.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.954+0000 7fcbca05e740 10 client.15303 fetch_fsmap learned FSMap version 24 2024-09-13T16:10:32.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.954+0000 7fcbca05e740 1 -- 172.21.15.86:0/1596043707 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x560c152c71b0 con 0x560c15365b30 2024-09-13T16:10:32.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.954+0000 7fcbaa000640 1 -- 172.21.15.86:0/1596043707 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x560c152f2cd0 con 0x560c15365b30 2024-09-13T16:10:32.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.955+0000 7fcbaa000640 1 -- 172.21.15.86:0/1596043707 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcbb00046e0 con 0x560c15365b30 2024-09-13T16:10:32.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.955+0000 7fcbca05e740 10 client.15303 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:10:32.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.955+0000 7fcbca05e740 10 client.15303 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T16:10:32.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.955+0000 7fcbca05e740 20 client.15303 populate_metadata read hostname 'smithi086' 2024-09-13T16:10:32.962 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.955+0000 7fcbca05e740 1 --2- 172.21.15.86:0/1596043707 >> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] conn(0x560c1537bb80 0x560c1537fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.955+0000 7fcbca05e740 4 client.15303 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:10:32.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.955+0000 7fcbca05e740 1 -- 172.21.15.86:0/1596043707 --> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560c14fbc3c0 con 0x560c1537bb80 2024-09-13T16:10:32.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.955+0000 7fcbbf400640 1 --2- 172.21.15.86:0/1596043707 >> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] conn(0x560c1537bb80 0x560c1537fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.956+0000 7fcbbf400640 1 --2- 172.21.15.86:0/1596043707 >> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] conn(0x560c1537bb80 0x560c1537fd20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=519f06bf786d4c2d server_cookie=726c62d389e88940 in_seq=0 out_seq=0 2024-09-13T16:10:32.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.956+0000 7fcbaa000640 10 client.15303 ms_handle_connect on v2:172.21.15.194:6838/3799859182 2024-09-13T16:10:32.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.956+0000 7fcbaa000640 1 -- 172.21.15.86:0/1596043707 <== mds.1 v2:172.21.15.194:6838/3799859182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560c14fbc3c0 con 0x560c1537bb80 2024-09-13T16:10:32.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.956+0000 7fcbaa000640 10 client.15303 handle_command_reply: tid=0 2024-09-13T16:10:32.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.956+0000 7fcbca05e740 1 client.15303 shutdown 2024-09-13T16:10:32.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.956+0000 7fcbca05e740 1 -- 172.21.15.86:0/1596043707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c15365b30 msgr2=0x560c1536f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.956+0000 7fcbca05e740 1 --2- 172.21.15.86:0/1596043707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c15365b30 0x560c1536f770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcbb001c040 tx=0x7fcbb000ff70 comp rx=0 tx=0).stop 2024-09-13T16:10:32.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.957+0000 7fcbca05e740 1 -- 172.21.15.86:0/1596043707 shutdown_connections 2024-09-13T16:10:32.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.957+0000 7fcbca05e740 1 --2- 172.21.15.86:0/1596043707 >> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] conn(0x560c1537bb80 0x560c1537fd20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.957+0000 7fcbca05e740 1 --2- 172.21.15.86:0/1596043707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c1536b500 0x560c15376cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.957+0000 7fcbca05e740 1 --2- 172.21.15.86:0/1596043707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c15366470 0x560c1536fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.957+0000 7fcbaa000640 0 client.15303 ms_handle_reset on v2:172.21.15.194:6838/3799859182 2024-09-13T16:10:32.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.957+0000 7fcbca05e740 1 --2- 172.21.15.86:0/1596043707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c15365b30 0x560c1536f770 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.957+0000 7fcbca05e740 1 -- 172.21.15.86:0/1596043707 >> 172.21.15.86:0/1596043707 conn(0x560c153611a0 msgr2=0x560c153629b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:32.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.957+0000 7fcbca05e740 1 -- 172.21.15.86:0/1596043707 shutdown_connections 2024-09-13T16:10:32.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.957+0000 7fcbca05e740 1 -- 172.21.15.86:0/1596043707 wait complete. 2024-09-13T16:10:32.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.957+0000 7fcbca05e740 20 client.15303 trim_cache size 0 max 16384 2024-09-13T16:10:32.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.972+0000 7fcbca05e740 1 Processor -- start 2024-09-13T16:10:32.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.972+0000 7fcbca05e740 1 -- start start 2024-09-13T16:10:32.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.972+0000 7fcbca05e740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c153611a0 0x560c1536f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.972+0000 7fcbca05e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c15365b30 0x560c15376c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.972+0000 7fcbca05e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c15366470 0x560c1536fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.972+0000 7fcbca05e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c15361000 con 0x560c15366470 2024-09-13T16:10:32.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.972+0000 7fcbca05e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c15370990 con 0x560c15365b30 2024-09-13T16:10:32.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.972+0000 7fcbca05e740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c152c5790 con 0x560c153611a0 2024-09-13T16:10:32.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.972+0000 7fcbc5200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c15366470 0x560c1536fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.973+0000 7fcbc5200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c15366470 0x560c1536fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35710/0 (socket says 172.21.15.86:35710) 2024-09-13T16:10:32.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.973+0000 7fcbc5200640 1 -- 172.21.15.86:0/3574792139 learned_addr learned my addr 172.21.15.86:0/3574792139 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:32.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.973+0000 7fcbbfe00640 1 --2- 172.21.15.86:0/3574792139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c153611a0 0x560c1536f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.973+0000 7fcbbf400640 1 --2- 172.21.15.86:0/3574792139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c15365b30 0x560c15376c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.973+0000 7fcbc5200640 1 -- 172.21.15.86:0/3574792139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c153611a0 msgr2=0x560c1536f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:32.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.973+0000 7fcbc5200640 1 --2- 172.21.15.86:0/3574792139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c153611a0 0x560c1536f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.973+0000 7fcbc5200640 1 -- 172.21.15.86:0/3574792139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c15365b30 msgr2=0x560c15376c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:32.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.973+0000 7fcbc5200640 1 --2- 172.21.15.86:0/3574792139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c15365b30 0x560c15376c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.973+0000 7fcbc5200640 1 -- 172.21.15.86:0/3574792139 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c15269470 con 0x560c15366470 2024-09-13T16:10:32.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.973+0000 7fcbc5200640 1 --2- 172.21.15.86:0/3574792139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c15366470 0x560c1536fa60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80bae10 tx=0x7fcbb8003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e9a2158f7ca073 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:32.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.973+0000 7fcbb6000640 1 -- 172.21.15.86:0/3574792139 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb80bb110 con 0x560c15366470 2024-09-13T16:10:32.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.973+0000 7fcbb6000640 1 -- 172.21.15.86:0/3574792139 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcbb80bef40 con 0x560c15366470 2024-09-13T16:10:32.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.973+0000 7fcbb6000640 1 -- 172.21.15.86:0/3574792139 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb80bb570 con 0x560c15366470 2024-09-13T16:10:32.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.974+0000 7fcbca05e740 1 -- 172.21.15.86:0/3574792139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c15366470 msgr2=0x560c1536fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.974+0000 7fcbca05e740 1 --2- 172.21.15.86:0/3574792139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c15366470 0x560c1536fa60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80bae10 tx=0x7fcbb8003f90 comp rx=0 tx=0).stop 2024-09-13T16:10:32.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.974+0000 7fcbca05e740 1 -- 172.21.15.86:0/3574792139 shutdown_connections 2024-09-13T16:10:32.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.974+0000 7fcbca05e740 1 --2- 172.21.15.86:0/3574792139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c15366470 0x560c1536fa60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.974+0000 7fcbca05e740 1 --2- 172.21.15.86:0/3574792139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c15365b30 0x560c15376c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.981 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.974+0000 7fcbca05e740 1 --2- 172.21.15.86:0/3574792139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c153611a0 0x560c1536f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.974+0000 7fcbca05e740 1 -- 172.21.15.86:0/3574792139 >> 172.21.15.86:0/3574792139 conn(0x560c1536dc60 msgr2=0x560c15367330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.974+0000 7fcbca05e740 1 -- 172.21.15.86:0/3574792139 shutdown_connections 2024-09-13T16:10:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.974+0000 7fcbca05e740 1 -- 172.21.15.86:0/3574792139 wait complete. 2024-09-13T16:10:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.974+0000 7fcbca05e740 1 -- start start 2024-09-13T16:10:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.975+0000 7fcbca05e740 1 Processor -- start 2024-09-13T16:10:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.975+0000 7fcbca05e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c153611a0 0x560c15373a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.975+0000 7fcbca05e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c15365b30 0x560c15373f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.975+0000 7fcbca05e740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c15366470 0x560c153d19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.975+0000 7fcbca05e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c15376f60 con 0x560c153611a0 2024-09-13T16:10:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.975+0000 7fcbca05e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c153770d0 con 0x560c15365b30 2024-09-13T16:10:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.975+0000 7fcbca05e740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c153d1f20 con 0x560c15366470 2024-09-13T16:10:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.975+0000 7fcbca05e740 10 client.0 _ll_register_callbacks cb 0x7fcbb001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.975+0000 7fcbbfe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c153611a0 0x560c15373a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.982 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.975+0000 7fcbbfe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c153611a0 0x560c15373a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35714/0 (socket says 172.21.15.86:35714) 2024-09-13T16:10:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.975+0000 7fcbbfe00640 1 -- 172.21.15.86:0/983883299 learned_addr learned my addr 172.21.15.86:0/983883299 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.975+0000 7fcbbf400640 1 --2- 172.21.15.86:0/983883299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c15365b30 0x560c15373f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.975+0000 7fcbc5200640 1 --2- 172.21.15.86:0/983883299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c15366470 0x560c153d19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.975+0000 7fcbbfe00640 1 -- 172.21.15.86:0/983883299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c15366470 msgr2=0x560c153d19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.976+0000 7fcbbfe00640 1 --2- 172.21.15.86:0/983883299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c15366470 0x560c153d19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.976+0000 7fcbbfe00640 1 -- 172.21.15.86:0/983883299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c15365b30 msgr2=0x560c15373f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.976+0000 7fcbbfe00640 1 --2- 172.21.15.86:0/983883299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c15365b30 0x560c15373f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.976+0000 7fcbbfe00640 1 -- 172.21.15.86:0/983883299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc01a03f0 con 0x560c153611a0 2024-09-13T16:10:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.976+0000 7fcbbfe00640 1 --2- 172.21.15.86:0/983883299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c153611a0 0x560c15373a50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0004ac0 tx=0x7fcbb0004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abecd79f64cfb026 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.976+0000 7fcbaa000640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T16:10:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.976+0000 7fcbaa000640 1 -- 172.21.15.86:0/983883299 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb000fb10 con 0x560c153611a0 2024-09-13T16:10:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.976+0000 7fcbaa000640 1 -- 172.21.15.86:0/983883299 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fcbb0000e40 con 0x560c153611a0 2024-09-13T16:10:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.976+0000 7fcbca05e740 1 -- 172.21.15.86:0/983883299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcbb000fd40 con 0x560c153611a0 2024-09-13T16:10:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.976+0000 7fcbaa000640 1 -- 172.21.15.86:0/983883299 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbb0004d30 con 0x560c153611a0 2024-09-13T16:10:32.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.976+0000 7fcbca05e740 10 client.15309 fetch_fsmap learned FSMap version 24 2024-09-13T16:10:32.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.976+0000 7fcbca05e740 1 -- 172.21.15.86:0/983883299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x560c1528e980 con 0x560c153611a0 2024-09-13T16:10:32.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.977+0000 7fcbaa000640 1 -- 172.21.15.86:0/983883299 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcbb000fd40 con 0x560c153611a0 2024-09-13T16:10:32.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.977+0000 7fcbaa000640 1 -- 172.21.15.86:0/983883299 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcbb00053b0 con 0x560c153611a0 2024-09-13T16:10:32.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.977+0000 7fcbca05e740 10 client.15309 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:10:32.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.977+0000 7fcbca05e740 10 client.15309 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T16:10:32.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.977+0000 7fcbca05e740 20 client.15309 populate_metadata read hostname 'smithi086' 2024-09-13T16:10:32.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.977+0000 7fcbca05e740 1 --2- 172.21.15.86:0/983883299 >> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] conn(0x560c1536b500 0x560c153d3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:32.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.977+0000 7fcbca05e740 4 client.15309 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T16:10:32.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.977+0000 7fcbca05e740 1 -- 172.21.15.86:0/983883299 --> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560c14fcd6c0 con 0x560c1536b500 2024-09-13T16:10:32.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.977+0000 7fcbbf400640 1 --2- 172.21.15.86:0/983883299 >> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] conn(0x560c1536b500 0x560c153d3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:32.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.978+0000 7fcbaa000640 10 client.15309 ms_handle_connect on v2:172.21.15.194:6838/3799859182 2024-09-13T16:10:32.984 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.978+0000 7fcbbf400640 1 --2- 172.21.15.86:0/983883299 >> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] conn(0x560c1536b500 0x560c153d3350 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9fdd3018658ee01b server_cookie=4db70afda18a3c17 in_seq=0 out_seq=0 2024-09-13T16:10:32.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.978+0000 7fcbaa000640 1 -- 172.21.15.86:0/983883299 <== mds.1 v2:172.21.15.194:6838/3799859182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x560c14fcd6c0 con 0x560c1536b500 2024-09-13T16:10:32.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.978+0000 7fcbaa000640 10 client.15309 handle_command_reply: tid=0 2024-09-13T16:10:32.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.978+0000 7fcbca05e740 1 client.15309 shutdown 2024-09-13T16:10:32.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.978+0000 7fcbca05e740 1 -- 172.21.15.86:0/983883299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c153611a0 msgr2=0x560c15373a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.978+0000 7fcbca05e740 1 --2- 172.21.15.86:0/983883299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c153611a0 0x560c15373a50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0004ac0 tx=0x7fcbb0004be0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.978+0000 7fcbca05e740 1 -- 172.21.15.86:0/983883299 shutdown_connections 2024-09-13T16:10:32.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.978+0000 7fcbca05e740 1 --2- 172.21.15.86:0/983883299 >> [v2:172.21.15.194:6838/3799859182,v1:172.21.15.194:6839/3799859182] conn(0x560c1536b500 0x560c153d3350 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.978+0000 7fcbca05e740 1 --2- 172.21.15.86:0/983883299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c15366470 0x560c153d19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.978+0000 7fcbca05e740 1 --2- 172.21.15.86:0/983883299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c15365b30 0x560c15373f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.978+0000 7fcbaa000640 0 client.15309 ms_handle_reset on v2:172.21.15.194:6838/3799859182 2024-09-13T16:10:32.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.978+0000 7fcbca05e740 1 --2- 172.21.15.86:0/983883299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560c153611a0 0x560c15373a50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.978+0000 7fcbca05e740 1 -- 172.21.15.86:0/983883299 >> 172.21.15.86:0/983883299 conn(0x560c1536dc60 msgr2=0x560c1536f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:32.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.978+0000 7fcbca05e740 1 -- 172.21.15.86:0/983883299 shutdown_connections 2024-09-13T16:10:32.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.979+0000 7fcbca05e740 1 -- 172.21.15.86:0/983883299 wait complete. 2024-09-13T16:10:32.990 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.979+0000 7fcbca05e740 20 client.15309 trim_cache size 0 max 16384 2024-09-13T16:10:32.990 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T16:10:32.990 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "1ecdfbda-71e9-11ef-bceb-c7b262605968", 2024-09-13T16:10:32.990 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 1, 2024-09-13T16:10:32.990 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24544, 2024-09-13T16:10:32.990 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-09-13T16:10:32.990 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-09-13T16:10:32.991 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-09-13T16:10:32.991 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 122.553127418, 2024-09-13T16:10:32.991 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 24, 2024-09-13T16:10:32.991 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 94, 2024-09-13T16:10:32.991 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 90, 2024-09-13T16:10:32.991 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 158.508794639 2024-09-13T16:10:32.991 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T16:10:32.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.979+0000 7fcbc7200640 1 -- 172.21.15.86:0/1193885838 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fcba40a1110 msgr2=0x7fcba40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.979+0000 7fcbc7200640 1 --2- 172.21.15.86:0/1193885838 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fcba40a1110 0x7fcba40a35d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009fd0 tx=0x7fcbac005850 comp rx=0 tx=0).stop 2024-09-13T16:10:32.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.979+0000 7fcbc7200640 1 -- 172.21.15.86:0/1193885838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc0103b40 msgr2=0x7fcbc019f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:32.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.979+0000 7fcbc7200640 1 --2- 172.21.15.86:0/1193885838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc0103b40 0x7fcbc019f580 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80098d0 tx=0x7fcbb8003ba0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.979+0000 7fcbc7200640 1 -- 172.21.15.86:0/1193885838 shutdown_connections 2024-09-13T16:10:32.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.979+0000 7fcbc7200640 1 --2- 172.21.15.86:0/1193885838 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fcba40a1110 0x7fcba40a35d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.979+0000 7fcbc7200640 1 --2- 172.21.15.86:0/1193885838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc0103b40 0x7fcbc019f580 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.979+0000 7fcbc7200640 1 --2- 172.21.15.86:0/1193885838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbc0103180 0x7fcbc0198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.979+0000 7fcbc7200640 1 --2- 172.21.15.86:0/1193885838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbc0101f90 0x7fcbc0197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:32.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.979+0000 7fcbc7200640 1 -- 172.21.15.86:0/1193885838 >> 172.21.15.86:0/1193885838 conn(0x7fcbc00fd6d0 msgr2=0x7fcbc0106550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:32.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.979+0000 7fcbc7200640 1 -- 172.21.15.86:0/1193885838 shutdown_connections 2024-09-13T16:10:32.992 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:32.979+0000 7fcbc7200640 1 -- 172.21.15.86:0/1193885838 wait complete. 2024-09-13T16:10:32.997 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T16:10:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.149+0000 7f44bda00640 1 -- 172.21.15.86:0/2580822703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b8103930 msgr2=0x7f44b810a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.149+0000 7f44bda00640 1 --2- 172.21.15.86:0/2580822703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b8103930 0x7f44b810a1c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f44b0009900 tx=0x7f44b002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.150+0000 7f44bda00640 1 -- 172.21.15.86:0/2580822703 shutdown_connections 2024-09-13T16:10:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.150+0000 7f44bda00640 1 --2- 172.21.15.86:0/2580822703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b8103930 0x7f44b810a1c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.150+0000 7f44bda00640 1 --2- 172.21.15.86:0/2580822703 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44b8102f70 0x7f44b81033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.150+0000 7f44bda00640 1 --2- 172.21.15.86:0/2580822703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44b8101d80 0x7f44b8102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.150+0000 7f44bda00640 1 -- 172.21.15.86:0/2580822703 >> 172.21.15.86:0/2580822703 conn(0x7f44b80fd500 msgr2=0x7f44b80ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.150+0000 7f44bda00640 1 -- 172.21.15.86:0/2580822703 shutdown_connections 2024-09-13T16:10:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.150+0000 7f44bda00640 1 -- 172.21.15.86:0/2580822703 wait complete. 2024-09-13T16:10:33.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.151+0000 7f44bda00640 1 Processor -- start 2024-09-13T16:10:33.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.151+0000 7f44bda00640 1 -- start start 2024-09-13T16:10:33.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.151+0000 7f44bda00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44b8101d80 0x7f44b8197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.151+0000 7f44bda00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b8102f70 0x7f44b8198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.151+0000 7f44bda00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44b8103930 0x7f44b819f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.151+0000 7f44bda00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b819f930 con 0x7f44b8102f70 2024-09-13T16:10:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.151+0000 7f44bda00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b819faa0 con 0x7f44b8101d80 2024-09-13T16:10:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.151+0000 7f44bda00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b819fc60 con 0x7f44b8103930 2024-09-13T16:10:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.151+0000 7f44af400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b8102f70 0x7f44b8198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.151+0000 7f44af400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b8102f70 0x7f44b8198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35736/0 (socket says 172.21.15.86:35736) 2024-09-13T16:10:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.151+0000 7f44af400640 1 -- 172.21.15.86:0/4010377793 learned_addr learned my addr 172.21.15.86:0/4010377793 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.151+0000 7f44b7e00640 1 --2- 172.21.15.86:0/4010377793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44b8101d80 0x7f44b8197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.152+0000 7f44bd000640 1 --2- 172.21.15.86:0/4010377793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44b8103930 0x7f44b819f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.152+0000 7f44af400640 1 -- 172.21.15.86:0/4010377793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44b8103930 msgr2=0x7f44b819f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.152+0000 7f44af400640 1 --2- 172.21.15.86:0/4010377793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44b8103930 0x7f44b819f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.152+0000 7f44af400640 1 -- 172.21.15.86:0/4010377793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44b8101d80 msgr2=0x7f44b8197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:33.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.152+0000 7f44af400640 1 --2- 172.21.15.86:0/4010377793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44b8101d80 0x7f44b8197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.152+0000 7f44af400640 1 -- 172.21.15.86:0/4010377793 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b0009560 con 0x7f44b8102f70 2024-09-13T16:10:33.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.152+0000 7f44af400640 1 --2- 172.21.15.86:0/4010377793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b8102f70 0x7f44b8198380 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f44a000e9f0 tx=0x7f44a000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:33.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.152+0000 7f44b5600640 1 -- 172.21.15.86:0/4010377793 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0009700 con 0x7f44b8102f70 2024-09-13T16:10:33.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.152+0000 7f44b5600640 1 -- 172.21.15.86:0/4010377793 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f44a000cd80 con 0x7f44b8102f70 2024-09-13T16:10:33.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.152+0000 7f44bda00640 1 -- 172.21.15.86:0/4010377793 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b819ff40 con 0x7f44b8102f70 2024-09-13T16:10:33.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.152+0000 7f44b5600640 1 -- 172.21.15.86:0/4010377793 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0018920 con 0x7f44b8102f70 2024-09-13T16:10:33.156 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.152+0000 7f44bda00640 1 -- 172.21.15.86:0/4010377793 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b81a03c0 con 0x7f44b8102f70 2024-09-13T16:10:33.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.155+0000 7f44c1ea2740 1 Processor -- start 2024-09-13T16:10:33.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.155+0000 7f44c1ea2740 1 -- start start 2024-09-13T16:10:33.157 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.155+0000 7f44b5600640 1 -- 172.21.15.86:0/4010377793 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f44a0018a80 con 0x7f44b8102f70 2024-09-13T16:10:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.156+0000 7f44c1ea2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d066dca0 0x5610d066e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.156+0000 7f44c1ea2740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066e5e0 0x5610d06730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.156+0000 7f44c1ea2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d0673670 0x5610d0675b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.156+0000 7f44c1ea2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d05d7ab0 con 0x5610d0673670 2024-09-13T16:10:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.156+0000 7f44c1ea2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d05d5240 con 0x5610d066dca0 2024-09-13T16:10:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.156+0000 7f44c1ea2740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d05d0b30 con 0x5610d066e5e0 2024-09-13T16:10:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.156+0000 7f44af400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d0673670 0x5610d0675b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.156+0000 7f44af400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d0673670 0x5610d0675b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35748/0 (socket says 172.21.15.86:35748) 2024-09-13T16:10:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.156+0000 7f44af400640 1 -- 172.21.15.86:0/4250775944 learned_addr learned my addr 172.21.15.86:0/4250775944 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:33.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.156+0000 7f44bd000640 1 --2- 172.21.15.86:0/4250775944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d066dca0 0x5610d066e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:33.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.156+0000 7f44b7e00640 1 --2- 172.21.15.86:0/4250775944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066e5e0 0x5610d06730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:33.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.156+0000 7f44af400640 1 -- 172.21.15.86:0/4250775944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066e5e0 msgr2=0x5610d06730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:33.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.156+0000 7f44af400640 1 --2- 172.21.15.86:0/4250775944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066e5e0 0x5610d06730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.156+0000 7f44af400640 1 -- 172.21.15.86:0/4250775944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d066dca0 msgr2=0x5610d066e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:33.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.156+0000 7f44af400640 1 --2- 172.21.15.86:0/4250775944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d066dca0 0x5610d066e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.156+0000 7f44af400640 1 -- 172.21.15.86:0/4250775944 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610d059bbd0 con 0x5610d0673670 2024-09-13T16:10:33.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.156+0000 7f44b7e00640 1 --2- 172.21.15.86:0/4250775944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066e5e0 0x5610d06730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:10:33.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.157+0000 7f44af400640 1 --2- 172.21.15.86:0/4250775944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d0673670 0x5610d0675b30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f44a00d0e50 tx=0x7f44a00d54b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207a8ab79868a428 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:33.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.157+0000 7f44b5600640 1 --2- 172.21.15.86:0/4010377793 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f449c0a1090 0x7f449c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:33.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.157+0000 7f44ad600640 1 -- 172.21.15.86:0/4250775944 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a00db600 con 0x5610d0673670 2024-09-13T16:10:33.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.157+0000 7f44ad600640 1 -- 172.21.15.86:0/4250775944 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f44a00964b0 con 0x5610d0673670 2024-09-13T16:10:33.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.157+0000 7f44ad600640 1 -- 172.21.15.86:0/4250775944 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a00c4510 con 0x5610d0673670 2024-09-13T16:10:33.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.157+0000 7f44b5600640 1 -- 172.21.15.86:0/4010377793 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f44a0014070 con 0x7f44b8102f70 2024-09-13T16:10:33.161 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.157+0000 7f44bd000640 1 --2- 172.21.15.86:0/4010377793 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f449c0a1090 0x7f449c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.158+0000 7f44c1ea2740 1 -- 172.21.15.86:0/4250775944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d0673670 msgr2=0x5610d0675b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.158+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/4250775944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d0673670 0x5610d0675b30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f44a00d0e50 tx=0x7f44a00d54b0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.158+0000 7f44c1ea2740 1 -- 172.21.15.86:0/4250775944 shutdown_connections 2024-09-13T16:10:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.158+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/4250775944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d0673670 0x5610d0675b30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.158+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/4250775944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066e5e0 0x5610d06730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.158+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/4250775944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d066dca0 0x5610d066e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.158+0000 7f44c1ea2740 1 -- 172.21.15.86:0/4250775944 >> 172.21.15.86:0/4250775944 conn(0x5610d0669310 msgr2=0x5610d0669710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.158+0000 7f44bd000640 1 --2- 172.21.15.86:0/4010377793 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f449c0a1090 0x7f449c0a3550 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f44b0006010 tx=0x7f44b00314d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.158+0000 7f44c1ea2740 1 -- 172.21.15.86:0/4250775944 shutdown_connections 2024-09-13T16:10:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.158+0000 7f44c1ea2740 1 -- 172.21.15.86:0/4250775944 wait complete. 2024-09-13T16:10:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.159+0000 7f44c1ea2740 1 -- start start 2024-09-13T16:10:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.159+0000 7f44c1ea2740 1 Processor -- start 2024-09-13T16:10:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.159+0000 7f44c1ea2740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066dca0 0x5610d0677900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.159+0000 7f44c1ea2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d066e5e0 0x5610d0677e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.159+0000 7f44c1ea2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d0673670 0x5610d067ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.159+0000 7f44c1ea2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d0572260 con 0x5610d0673670 2024-09-13T16:10:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.159+0000 7f44c1ea2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d0571f00 con 0x5610d066e5e0 2024-09-13T16:10:33.165 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.159+0000 7f44c1ea2740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d0337f20 con 0x5610d066dca0 2024-09-13T16:10:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.159+0000 7f44c1ea2740 10 client.0 _ll_register_callbacks cb 0x5610d05ca1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.159+0000 7f44bd000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d0673670 0x5610d067ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.159+0000 7f44bd000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d0673670 0x5610d067ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35764/0 (socket says 172.21.15.86:35764) 2024-09-13T16:10:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.159+0000 7f44bd000640 1 -- 172.21.15.86:0/1407313396 learned_addr learned my addr 172.21.15.86:0/1407313396 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.160+0000 7f44af400640 1 --2- 172.21.15.86:0/1407313396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d066e5e0 0x5610d0677e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.160+0000 7f44b7e00640 1 --2- 172.21.15.86:0/1407313396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066dca0 0x5610d0677900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.160+0000 7f44bd000640 1 -- 172.21.15.86:0/1407313396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066dca0 msgr2=0x5610d0677900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.160+0000 7f44bd000640 1 --2- 172.21.15.86:0/1407313396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066dca0 0x5610d0677900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.160+0000 7f44bd000640 1 -- 172.21.15.86:0/1407313396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d066e5e0 msgr2=0x5610d0677e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.160+0000 7f44bd000640 1 --2- 172.21.15.86:0/1407313396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d066e5e0 0x5610d0677e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.160+0000 7f44bd000640 1 -- 172.21.15.86:0/1407313396 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b81a03c0 con 0x5610d0673670 2024-09-13T16:10:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.160+0000 7f44b7e00640 1 --2- 172.21.15.86:0/1407313396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066dca0 0x5610d0677900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:10:33.166 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.160+0000 7f44bd000640 1 --2- 172.21.15.86:0/1407313396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d0673670 0x5610d067ee80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f44b0005c40 tx=0x7f44b0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a02f47847f51323 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:33.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.160+0000 7f44a6000640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T16:10:33.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.160+0000 7f44a6000640 1 -- 172.21.15.86:0/1407313396 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0004d10 con 0x5610d0673670 2024-09-13T16:10:33.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.160+0000 7f44a6000640 1 -- 172.21.15.86:0/1407313396 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f44b0043070 con 0x5610d0673670 2024-09-13T16:10:33.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.160+0000 7f44c1ea2740 1 -- 172.21.15.86:0/1407313396 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610d05facd0 con 0x5610d0673670 2024-09-13T16:10:33.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.161+0000 7f44a6000640 1 -- 172.21.15.86:0/1407313396 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44b0004e70 con 0x5610d0673670 2024-09-13T16:10:33.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.161+0000 7f44c1ea2740 10 client.15321 fetch_fsmap learned FSMap version 24 2024-09-13T16:10:33.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.161+0000 7f44c1ea2740 1 -- 172.21.15.86:0/1407313396 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5610d05cf1b0 con 0x5610d0673670 2024-09-13T16:10:33.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.161+0000 7f44a6000640 1 -- 172.21.15.86:0/1407313396 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5610d05facd0 con 0x5610d0673670 2024-09-13T16:10:33.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.161+0000 7f44a6000640 1 -- 172.21.15.86:0/1407313396 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f44b00039d0 con 0x5610d0673670 2024-09-13T16:10:33.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.161+0000 7f44c1ea2740 10 client.15321 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:10:33.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.161+0000 7f44c1ea2740 10 client.15321 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T16:10:33.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.161+0000 7f44c1ea2740 20 client.15321 populate_metadata read hostname 'smithi086' 2024-09-13T16:10:33.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.161+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/1407313396 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5610d0683300 0x5610d0687fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:33.167 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.161+0000 7f44c1ea2740 4 client.15321 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:10:33.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.161+0000 7f44c1ea2740 1 -- 172.21.15.86:0/1407313396 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610d02c43c0 con 0x5610d0683300 2024-09-13T16:10:33.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.162+0000 7f44b7e00640 1 --2- 172.21.15.86:0/1407313396 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5610d0683300 0x5610d0687fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:33.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.162+0000 7f44b7e00640 1 --2- 172.21.15.86:0/1407313396 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5610d0683300 0x5610d0687fe0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=353384353d8c51d6 server_cookie=d488f0e002dbab3f in_seq=0 out_seq=0 2024-09-13T16:10:33.168 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.162+0000 7f44a6000640 10 client.15321 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:10:33.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.163+0000 7f44a6000640 1 -- 172.21.15.86:0/1407313396 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5610d02c43c0 con 0x5610d0683300 2024-09-13T16:10:33.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.163+0000 7f44a6000640 10 client.15321 handle_command_reply: tid=0 2024-09-13T16:10:33.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.163+0000 7f44c1ea2740 1 client.15321 shutdown 2024-09-13T16:10:33.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.163+0000 7f44c1ea2740 1 -- 172.21.15.86:0/1407313396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d0673670 msgr2=0x5610d067ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:33.169 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.163+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/1407313396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d0673670 0x5610d067ee80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f44b0005c40 tx=0x7f44b0009260 comp rx=0 tx=0).stop 2024-09-13T16:10:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.163+0000 7f44c1ea2740 1 -- 172.21.15.86:0/1407313396 shutdown_connections 2024-09-13T16:10:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.163+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/1407313396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d0673670 0x5610d067ee80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.163+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/1407313396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d066e5e0 0x5610d0677e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.163+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/1407313396 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5610d0683300 0x5610d0687fe0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.163+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/1407313396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066dca0 0x5610d0677900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.163+0000 7f44a6000640 0 client.15321 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:10:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.163+0000 7f44c1ea2740 1 -- 172.21.15.86:0/1407313396 >> 172.21.15.86:0/1407313396 conn(0x5610d0669310 msgr2=0x5610d0668650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.164+0000 7f44c1ea2740 1 -- 172.21.15.86:0/1407313396 shutdown_connections 2024-09-13T16:10:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.164+0000 7f44c1ea2740 1 -- 172.21.15.86:0/1407313396 wait complete. 2024-09-13T16:10:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.164+0000 7f44c1ea2740 20 client.15321 trim_cache size 0 max 16384 2024-09-13T16:10:33.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.179+0000 7f44c1ea2740 1 Processor -- start 2024-09-13T16:10:33.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.179+0000 7f44c1ea2740 1 -- start start 2024-09-13T16:10:33.181 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.179+0000 7f44c1ea2740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066dca0 0x5610d06776b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:33.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.179+0000 7f44c1ea2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d066e5e0 0x5610d067eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:33.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.179+0000 7f44c1ea2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d0673670 0x5610d0677bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:33.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.179+0000 7f44c1ea2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d065dd80 con 0x5610d066e5e0 2024-09-13T16:10:33.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.179+0000 7f44c1ea2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d066f040 con 0x5610d0673670 2024-09-13T16:10:33.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.179+0000 7f44c1ea2740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d02c43c0 con 0x5610d066dca0 2024-09-13T16:10:33.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.179+0000 7f44af400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d066e5e0 0x5610d067eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:33.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.179+0000 7f44af400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d066e5e0 0x5610d067eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35766/0 (socket says 172.21.15.86:35766) 2024-09-13T16:10:33.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.179+0000 7f44af400640 1 -- 172.21.15.86:0/1787534787 learned_addr learned my addr 172.21.15.86:0/1787534787 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:33.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.179+0000 7f44b7e00640 1 --2- 172.21.15.86:0/1787534787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066dca0 0x5610d06776b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:33.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.179+0000 7f44bd000640 1 --2- 172.21.15.86:0/1787534787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d0673670 0x5610d0677bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:33.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.180+0000 7f44af400640 1 -- 172.21.15.86:0/1787534787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066dca0 msgr2=0x5610d06776b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:33.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.180+0000 7f44af400640 1 --2- 172.21.15.86:0/1787534787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066dca0 0x5610d06776b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.182 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.180+0000 7f44af400640 1 -- 172.21.15.86:0/1787534787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d0673670 msgr2=0x5610d0677bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:33.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.180+0000 7f44af400640 1 --2- 172.21.15.86:0/1787534787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d0673670 0x5610d0677bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.180+0000 7f44af400640 1 -- 172.21.15.86:0/1787534787 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610d0571470 con 0x5610d066e5e0 2024-09-13T16:10:33.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.180+0000 7f44af400640 1 --2- 172.21.15.86:0/1787534787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d066e5e0 0x5610d067eda0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f44a00d58f0 tx=0x7f44a0010f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ef8e67d921cbf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:33.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.180+0000 7f44ae000640 1 -- 172.21.15.86:0/1787534787 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0099f40 con 0x5610d066e5e0 2024-09-13T16:10:33.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.180+0000 7f44ae000640 1 -- 172.21.15.86:0/1787534787 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f44a0099cb0 con 0x5610d066e5e0 2024-09-13T16:10:33.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.180+0000 7f44ae000640 1 -- 172.21.15.86:0/1787534787 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a00a25f0 con 0x5610d066e5e0 2024-09-13T16:10:33.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.181+0000 7f44c1ea2740 1 -- 172.21.15.86:0/1787534787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d066e5e0 msgr2=0x5610d067eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:33.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.181+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/1787534787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d066e5e0 0x5610d067eda0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f44a00d58f0 tx=0x7f44a0010f50 comp rx=0 tx=0).stop 2024-09-13T16:10:33.187 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.181+0000 7f44c1ea2740 1 -- 172.21.15.86:0/1787534787 shutdown_connections 2024-09-13T16:10:33.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.181+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/1787534787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d0673670 0x5610d0677bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.181+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/1787534787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d066e5e0 0x5610d067eda0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.181+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/1787534787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066dca0 0x5610d06776b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.181+0000 7f44c1ea2740 1 -- 172.21.15.86:0/1787534787 >> 172.21.15.86:0/1787534787 conn(0x5610d0669310 msgr2=0x5610d066f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:33.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.181+0000 7f44c1ea2740 1 -- 172.21.15.86:0/1787534787 shutdown_connections 2024-09-13T16:10:33.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.181+0000 7f44c1ea2740 1 -- 172.21.15.86:0/1787534787 wait complete. 2024-09-13T16:10:33.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.181+0000 7f44c1ea2740 1 -- start start 2024-09-13T16:10:33.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.181+0000 7f44c1ea2740 1 Processor -- start 2024-09-13T16:10:33.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.182+0000 7f44c1ea2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d066dca0 0x5610d067a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:33.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.182+0000 7f44c1ea2740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066e5e0 0x5610d067a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:33.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.182+0000 7f44c1ea2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d0673670 0x5610d06d9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:33.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.182+0000 7f44c1ea2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d067aac0 con 0x5610d066dca0 2024-09-13T16:10:33.188 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.182+0000 7f44c1ea2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d067ac30 con 0x5610d0673670 2024-09-13T16:10:33.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.182+0000 7f44c1ea2740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d06da210 con 0x5610d066e5e0 2024-09-13T16:10:33.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.182+0000 7f44c1ea2740 10 client.0 _ll_register_callbacks cb 0x7f44a80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:33.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.182+0000 7f44b7e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d066dca0 0x5610d067a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:33.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.182+0000 7f44b7e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d066dca0 0x5610d067a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35770/0 (socket says 172.21.15.86:35770) 2024-09-13T16:10:33.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.182+0000 7f44b7e00640 1 -- 172.21.15.86:0/2860201826 learned_addr learned my addr 172.21.15.86:0/2860201826 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:33.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.182+0000 7f44bd000640 1 --2- 172.21.15.86:0/2860201826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d0673670 0x5610d06d9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:33.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.182+0000 7f44af400640 1 --2- 172.21.15.86:0/2860201826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066e5e0 0x5610d067a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:33.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.182+0000 7f44b7e00640 1 -- 172.21.15.86:0/2860201826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066e5e0 msgr2=0x5610d067a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:33.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.182+0000 7f44b7e00640 1 --2- 172.21.15.86:0/2860201826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066e5e0 0x5610d067a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.182+0000 7f44b7e00640 1 -- 172.21.15.86:0/2860201826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d0673670 msgr2=0x5610d06d9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:33.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.182+0000 7f44b7e00640 1 --2- 172.21.15.86:0/2860201826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d0673670 0x5610d06d9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.182+0000 7f44b7e00640 1 -- 172.21.15.86:0/2860201826 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610d059bbd0 con 0x5610d066dca0 2024-09-13T16:10:33.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.183+0000 7f44b7e00640 1 --2- 172.21.15.86:0/2860201826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d066dca0 0x5610d067a010 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f44b8102dd0 tx=0x7f44a80096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cacf93fad8bd982 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:33.189 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.183+0000 7f44a6000640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T16:10:33.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.183+0000 7f44a6000640 1 -- 172.21.15.86:0/2860201826 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8015040 con 0x5610d066dca0 2024-09-13T16:10:33.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.183+0000 7f44a6000640 1 -- 172.21.15.86:0/2860201826 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f44a8004b20 con 0x5610d066dca0 2024-09-13T16:10:33.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.183+0000 7f44c1ea2740 1 -- 172.21.15.86:0/2860201826 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f44a00964b0 con 0x5610d066dca0 2024-09-13T16:10:33.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.183+0000 7f44a6000640 1 -- 172.21.15.86:0/2860201826 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44a8004ce0 con 0x5610d066dca0 2024-09-13T16:10:33.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.183+0000 7f44c1ea2740 10 client.15327 fetch_fsmap learned FSMap version 24 2024-09-13T16:10:33.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.183+0000 7f44c1ea2740 1 -- 172.21.15.86:0/2860201826 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5610d0596980 con 0x5610d066dca0 2024-09-13T16:10:33.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.184+0000 7f44a6000640 1 -- 172.21.15.86:0/2860201826 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f44a00964b0 con 0x5610d066dca0 2024-09-13T16:10:33.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.184+0000 7f44a6000640 1 -- 172.21.15.86:0/2860201826 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f44a8026540 con 0x5610d066dca0 2024-09-13T16:10:33.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.184+0000 7f44c1ea2740 10 client.15327 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:10:33.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.184+0000 7f44c1ea2740 10 client.15327 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T16:10:33.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.184+0000 7f44c1ea2740 20 client.15327 populate_metadata read hostname 'smithi086' 2024-09-13T16:10:33.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.184+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/2860201826 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5610d06df150 0x5610d06dba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:33.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.184+0000 7f44c1ea2740 4 client.15327 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T16:10:33.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.184+0000 7f44c1ea2740 1 -- 172.21.15.86:0/2860201826 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5610d02d56c0 con 0x5610d06df150 2024-09-13T16:10:33.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.184+0000 7f44af400640 1 --2- 172.21.15.86:0/2860201826 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5610d06df150 0x5610d06dba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:33.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.185+0000 7f44af400640 1 --2- 172.21.15.86:0/2860201826 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5610d06df150 0x5610d06dba90 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29cfbfe565409707 server_cookie=de38bd8bc568e2e7 in_seq=0 out_seq=0 2024-09-13T16:10:33.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.185+0000 7f44a6000640 10 client.15327 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:10:33.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.185+0000 7f44a6000640 1 -- 172.21.15.86:0/2860201826 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5610d02d56c0 con 0x5610d06df150 2024-09-13T16:10:33.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.185+0000 7f44a6000640 10 client.15327 handle_command_reply: tid=0 2024-09-13T16:10:33.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.185+0000 7f44c1ea2740 1 client.15327 shutdown 2024-09-13T16:10:33.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.185+0000 7f44c1ea2740 1 -- 172.21.15.86:0/2860201826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d066dca0 msgr2=0x5610d067a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:33.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.185+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/2860201826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d066dca0 0x5610d067a010 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f44b8102dd0 tx=0x7f44a80096c0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.185+0000 7f44c1ea2740 1 -- 172.21.15.86:0/2860201826 shutdown_connections 2024-09-13T16:10:33.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.185+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/2860201826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5610d0673670 0x5610d06d9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.185+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/2860201826 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5610d06df150 0x5610d06dba90 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.185+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/2860201826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610d066e5e0 0x5610d067a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.185+0000 7f44c1ea2740 1 --2- 172.21.15.86:0/2860201826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610d066dca0 0x5610d067a010 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.185+0000 7f44a6000640 0 client.15327 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:10:33.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.185+0000 7f44c1ea2740 1 -- 172.21.15.86:0/2860201826 >> 172.21.15.86:0/2860201826 conn(0x5610d0669310 msgr2=0x5610d06776b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:33.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.185+0000 7f44c1ea2740 1 -- 172.21.15.86:0/2860201826 shutdown_connections 2024-09-13T16:10:33.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.185+0000 7f44c1ea2740 1 -- 172.21.15.86:0/2860201826 wait complete. 2024-09-13T16:10:33.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.185+0000 7f44c1ea2740 20 client.15327 trim_cache size 0 max 16384 2024-09-13T16:10:33.193 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T16:10:33.196 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "1ecdfbda-71e9-11ef-bceb-c7b262605968", 2024-09-13T16:10:33.196 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2024-09-13T16:10:33.196 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24581, 2024-09-13T16:10:33.196 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2024-09-13T16:10:33.196 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2024-09-13T16:10:33.196 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2024-09-13T16:10:33.197 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 143.98031121099999, 2024-09-13T16:10:33.197 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 24, 2024-09-13T16:10:33.197 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 94, 2024-09-13T16:10:33.197 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 90, 2024-09-13T16:10:33.197 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 149.268068325 2024-09-13T16:10:33.197 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T16:10:33.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.186+0000 7f44bda00640 1 -- 172.21.15.86:0/4010377793 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f449c0a1090 msgr2=0x7f449c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:33.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.186+0000 7f44bda00640 1 --2- 172.21.15.86:0/4010377793 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f449c0a1090 0x7f449c0a3550 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f44b0006010 tx=0x7f44b00314d0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.186+0000 7f44bda00640 1 -- 172.21.15.86:0/4010377793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b8102f70 msgr2=0x7f44b8198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:33.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.186+0000 7f44bda00640 1 --2- 172.21.15.86:0/4010377793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b8102f70 0x7f44b8198380 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f44a000e9f0 tx=0x7f44a000eeb0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.186+0000 7f44bda00640 1 -- 172.21.15.86:0/4010377793 shutdown_connections 2024-09-13T16:10:33.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.186+0000 7f44bda00640 1 --2- 172.21.15.86:0/4010377793 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f449c0a1090 0x7f449c0a3550 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.186+0000 7f44bda00640 1 --2- 172.21.15.86:0/4010377793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44b8103930 0x7f44b819f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.186+0000 7f44bda00640 1 --2- 172.21.15.86:0/4010377793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b8102f70 0x7f44b8198380 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.186+0000 7f44bda00640 1 --2- 172.21.15.86:0/4010377793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44b8101d80 0x7f44b8197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:33.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.186+0000 7f44bda00640 1 -- 172.21.15.86:0/4010377793 >> 172.21.15.86:0/4010377793 conn(0x7f44b80fd500 msgr2=0x7f44b81063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:33.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.186+0000 7f44bda00640 1 -- 172.21.15.86:0/4010377793 shutdown_connections 2024-09-13T16:10:33.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:33.186+0000 7f44bda00640 1 -- 172.21.15.86:0/4010377793 wait complete. 2024-09-13T16:10:33.203 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T16:10:33.213 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T16:10:33.213 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T16:10:33.214 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T16:10:33.214 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T16:10:33.227 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T16:10:33.227 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-13T16:10:33.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:33.227 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-09-13T16:10:33.264 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-13T16:10:33.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:33.265 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T16:10:33.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:33.362 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2024-09-13T16:10:33.698 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync'], 'rbytes': False, 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-13T16:10:33.698 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T16:10:33.698 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T16:10:33.698 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T16:10:33.746 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:33 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/712880461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:10:33.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:33 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/712880461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:10:33.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:33 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/712880461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:10:34.014 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:10:34.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:34 smithi139 ceph-mon[35320]: pgmap v371: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:10:34.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:34 smithi194 ceph-mon[35694]: pgmap v371: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:10:34.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:34 smithi086 ceph-mon[30379]: pgmap v371: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T16:10:36.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.119+0000 7fb02e400640 1 -- 172.21.15.86:0/584696887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb028102200 msgr2=0x7fb0281025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:36.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.119+0000 7fb02e400640 1 --2- 172.21.15.86:0/584696887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb028102200 0x7fb0281025e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb018009930 tx=0x7fb01802a420 comp rx=0 tx=0).stop 2024-09-13T16:10:36.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.119+0000 7fb02e400640 1 -- 172.21.15.86:0/584696887 shutdown_connections 2024-09-13T16:10:36.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.119+0000 7fb02e400640 1 --2- 172.21.15.86:0/584696887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb028107330 0x7fb02810eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:36.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.119+0000 7fb02e400640 1 --2- 172.21.15.86:0/584696887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb028102bb0 0x7fb028106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:36.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.119+0000 7fb02e400640 1 --2- 172.21.15.86:0/584696887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb028102200 0x7fb0281025e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:36.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.119+0000 7fb02e400640 1 -- 172.21.15.86:0/584696887 >> 172.21.15.86:0/584696887 conn(0x7fb0280fdc60 msgr2=0x7fb028100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:36.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.120+0000 7fb02e400640 1 -- 172.21.15.86:0/584696887 shutdown_connections 2024-09-13T16:10:36.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.120+0000 7fb02e400640 1 -- 172.21.15.86:0/584696887 wait complete. 2024-09-13T16:10:36.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.120+0000 7fb02e400640 1 Processor -- start 2024-09-13T16:10:36.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.121+0000 7fb02e400640 1 -- start start 2024-09-13T16:10:36.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.121+0000 7fb02e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb028102200 0x7fb0281985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:36.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.121+0000 7fb02e400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb028102bb0 0x7fb028198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:36.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.121+0000 7fb02e400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb028107330 0x7fb02819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:36.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.121+0000 7fb02e400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02819d4f0 con 0x7fb028107330 2024-09-13T16:10:36.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.121+0000 7fb02e400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02819d660 con 0x7fb028102bb0 2024-09-13T16:10:36.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.121+0000 7fb02e400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02819d7d0 con 0x7fb028102200 2024-09-13T16:10:36.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.121+0000 7fb027e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb028107330 0x7fb02819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:36.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.121+0000 7fb027e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb028107330 0x7fb02819cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35782/0 (socket says 172.21.15.86:35782) 2024-09-13T16:10:36.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.121+0000 7fb027e00640 1 -- 172.21.15.86:0/1954298876 learned_addr learned my addr 172.21.15.86:0/1954298876 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:36.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.121+0000 7fb027400640 1 --2- 172.21.15.86:0/1954298876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb028102200 0x7fb0281985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:36.124 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.121+0000 7fb026a00640 1 --2- 172.21.15.86:0/1954298876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb028102bb0 0x7fb028198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:36.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.122+0000 7fb027e00640 1 -- 172.21.15.86:0/1954298876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb028102200 msgr2=0x7fb0281985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:36.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.122+0000 7fb027e00640 1 --2- 172.21.15.86:0/1954298876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb028102200 0x7fb0281985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:36.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.122+0000 7fb027e00640 1 -- 172.21.15.86:0/1954298876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb028102bb0 msgr2=0x7fb028198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:36.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.122+0000 7fb027e00640 1 --2- 172.21.15.86:0/1954298876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb028102bb0 0x7fb028198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:36.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.122+0000 7fb027e00640 1 -- 172.21.15.86:0/1954298876 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb018009560 con 0x7fb028107330 2024-09-13T16:10:36.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.122+0000 7fb027e00640 1 --2- 172.21.15.86:0/1954298876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb028107330 0x7fb02819cef0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb020009fd0 tx=0x7fb02000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:36.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.122+0000 7fb01fe00640 1 -- 172.21.15.86:0/1954298876 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02000bea0 con 0x7fb028107330 2024-09-13T16:10:36.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.122+0000 7fb01fe00640 1 -- 172.21.15.86:0/1954298876 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb020009940 con 0x7fb028107330 2024-09-13T16:10:36.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.122+0000 7fb01fe00640 1 -- 172.21.15.86:0/1954298876 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200106c0 con 0x7fb028107330 2024-09-13T16:10:36.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.123+0000 7fb02e400640 1 -- 172.21.15.86:0/1954298876 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02819dab0 con 0x7fb028107330 2024-09-13T16:10:36.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.123+0000 7fb02e400640 1 -- 172.21.15.86:0/1954298876 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0281a5370 con 0x7fb028107330 2024-09-13T16:10:36.125 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.124+0000 7fb02e400640 1 -- 172.21.15.86:0/1954298876 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0281036e0 con 0x7fb028107330 2024-09-13T16:10:36.126 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.125+0000 7fb01fe00640 1 -- 172.21.15.86:0/1954298876 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb020004220 con 0x7fb028107330 2024-09-13T16:10:36.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.127+0000 7fb01fe00640 1 --2- 172.21.15.86:0/1954298876 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb00c0a1080 0x7fb00c0a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:36.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.127+0000 7fb01fe00640 1 -- 172.21.15.86:0/1954298876 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fb0200cc8e0 con 0x7fb028107330 2024-09-13T16:10:36.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.127+0000 7fb027400640 1 --2- 172.21.15.86:0/1954298876 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb00c0a1080 0x7fb00c0a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:36.128 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.128+0000 7fb027400640 1 --2- 172.21.15.86:0/1954298876 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb00c0a1080 0x7fb00c0a3540 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb018009900 tx=0x7fb0180058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:36.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.131+0000 7fb01fe00640 1 -- 172.21.15.86:0/1954298876 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb020095d00 con 0x7fb028107330 2024-09-13T16:10:36.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.334+0000 7fb02e400640 1 -- 172.21.15.86:0/1954298876 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb0281025e0 con 0x7fb028107330 2024-09-13T16:10:36.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.335+0000 7fb01fe00640 1 -- 172.21.15.86:0/1954298876 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb020099320 con 0x7fb028107330 2024-09-13T16:10:36.336 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T16:10:36.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.338+0000 7fb02e400640 1 -- 172.21.15.86:0/1954298876 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb00c0a1080 msgr2=0x7fb00c0a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:36.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.338+0000 7fb02e400640 1 --2- 172.21.15.86:0/1954298876 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb00c0a1080 0x7fb00c0a3540 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb018009900 tx=0x7fb0180058d0 comp rx=0 tx=0).stop 2024-09-13T16:10:36.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.338+0000 7fb02e400640 1 -- 172.21.15.86:0/1954298876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb028107330 msgr2=0x7fb02819cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:36.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.338+0000 7fb02e400640 1 --2- 172.21.15.86:0/1954298876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb028107330 0x7fb02819cef0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb020009fd0 tx=0x7fb02000b260 comp rx=0 tx=0).stop 2024-09-13T16:10:36.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.338+0000 7fb02e400640 1 -- 172.21.15.86:0/1954298876 shutdown_connections 2024-09-13T16:10:36.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.338+0000 7fb02e400640 1 --2- 172.21.15.86:0/1954298876 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb00c0a1080 0x7fb00c0a3540 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:36.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.338+0000 7fb02e400640 1 --2- 172.21.15.86:0/1954298876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb028107330 0x7fb02819cef0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:36.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.338+0000 7fb02e400640 1 --2- 172.21.15.86:0/1954298876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb028102bb0 0x7fb028198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:36.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.338+0000 7fb02e400640 1 --2- 172.21.15.86:0/1954298876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb028102200 0x7fb0281985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:36.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.338+0000 7fb02e400640 1 -- 172.21.15.86:0/1954298876 >> 172.21.15.86:0/1954298876 conn(0x7fb0280fdc60 msgr2=0x7fb0280ff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:36.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.338+0000 7fb02e400640 1 -- 172.21.15.86:0/1954298876 shutdown_connections 2024-09-13T16:10:36.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:36.338+0000 7fb02e400640 1 -- 172.21.15.86:0/1954298876 wait complete. 2024-09-13T16:10:36.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:36 smithi086 ceph-mon[30379]: pgmap v372: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:10:36.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:36 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1954298876' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T16:10:36.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:36 smithi139 ceph-mon[35320]: pgmap v372: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:10:36.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:36 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1954298876' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T16:10:36.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:36 smithi194 ceph-mon[35694]: pgmap v372: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:10:36.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:36 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1954298876' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T16:10:37.140 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T16:10:37.140 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T16:10:37.140 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2024-09-13T16:10:37.140 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T16:10:37.140 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T16:10:37.140 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T16:10:37.140 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T16:10:37.140 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T16:10:37.141 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T16:10:37.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:37.141 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2024-09-13T16:10:37.177 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T16:10:37.178 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T16:10:37.178 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T16:10:37.178 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:10:37.178 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2024-09-13T16:10:37.178 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:10:37.178 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:10:37.178 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:10:37.178 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2024-09-13T16:10:37.178 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:10:37.178 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:10:37.178 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2024-09-13T16:10:37.179 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:10:37.179 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:10:37.179 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T16:10:37.179 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:10:37.179 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T16:10:37.179 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42124sec preferred_lft 42124sec 2024-09-13T16:10:37.179 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link noprefixroute 2024-09-13T16:10:37.179 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:10:37.179 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T16:10:37.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:37.180 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2024-09-13T16:10:37.180 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-13T16:10:37.180 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add name ceph-brx type bridge 2024-09-13T16:10:37.180 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr flush dev ceph-brx 2024-09-13T16:10:37.180 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set ceph-brx up 2024-09-13T16:10:37.180 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T16:10:37.180 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-13T16:10:37.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:37.356 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T16:10:37.416 INFO:teuthology.orchestra.run.smithi086.stdout:1 2024-09-13T16:10:37.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:37.419 DEBUG:teuthology.orchestra.run.smithi086:> route 2024-09-13T16:10:37.456 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2024-09-13T16:10:37.456 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T16:10:37.456 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T16:10:37.457 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T16:10:37.457 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T16:10:37.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:37.457 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2024-09-13T16:10:37.457 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-13T16:10:37.457 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T16:10:37.457 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T16:10:37.457 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T16:10:37.457 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-13T16:10:37.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:37.605 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-09-13T16:10:37.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:37.642 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list-id 2024-09-13T16:10:37.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:37.719 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2024-09-13T16:10:37.719 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-13T16:10:37.719 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T16:10:37.720 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T16:10:37.720 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-13T16:10:37.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:37 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:10:37.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:37 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:10:37.817 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:37 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:10:37.856 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T16:10:37.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:37.857 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2024-09-13T16:10:37.857 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-13T16:10:37.857 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T16:10:37.857 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T16:10:37.857 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T16:10:37.857 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T16:10:37.857 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T16:10:37.857 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-13T16:10:38.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:38.026 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2024-09-13T16:10:38.026 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-13T16:10:38.027 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2024-09-13T16:10:38.027 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T16:10:38.027 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-13T16:10:38.142 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T16:10:38.142 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T16:10:38.178 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T16:10:38.179 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T16:10:38.179 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T16:10:38.254 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-13T16:10:38.255 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-13T16:10:38.255 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/e4490c8e-5d1d-4d4e-bc70-d003b6b499a3 2024-09-13T16:10:38.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:38.255 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/e4490c8e-5d1d-4d4e-bc70-d003b6b499a3 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-09-13T16:10:38.385 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-09-13T16:10:38.385 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2024-09-13T16:10:38.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:38 smithi086 ceph-mon[30379]: pgmap v373: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:10:38.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:38 smithi139 ceph-mon[35320]: pgmap v373: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:10:38.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:38 smithi194 ceph-mon[35694]: pgmap v373: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:10:39.337 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-09-13T16:10:39.337 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2024-09-13T16:10:39.337 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:6789,172.21.15.139:6789,172.21.15.194:6789" 2024-09-13T16:10:39.337 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 0@1ecdfbda-71e9-11ef-bceb-c7b262605968.cephfs=/volumes/qa/sv_1/e4490c8e-5d1d-4d4e-bc70-d003b6b499a3 2024-09-13T16:10:39.337 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync,name=0,key=0,mon_addr=172.21.15.86:6789/172.21.15.139:6789/172.21.15.194:6789" will pass to kernel 2024-09-13T16:10:39.340 INFO:teuthology.orchestra.run.smithi086.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T16:10:39.340 INFO:teuthology.orchestra.run.smithi086.stdout: You just mounted a file system that supports labels which does not 2024-09-13T16:10:39.340 INFO:teuthology.orchestra.run.smithi086.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T16:10:39.341 INFO:teuthology.orchestra.run.smithi086.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T16:10:39.341 INFO:teuthology.orchestra.run.smithi086.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T16:10:39.345 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T16:10:39.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:39.345 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T16:10:39.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:39.409 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:10:39.452 INFO:teuthology.orchestra.run.smithi086.stdout:client25378 2024-09-13T16:10:39.452 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T16:10:39.453 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:10:39.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:39.532 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:10:39.615 INFO:teuthology.orchestra.run.smithi086.stdout:client25378 2024-09-13T16:10:39.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:39.616 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:10:39.695 INFO:teuthology.orchestra.run.smithi086.stdout:client25378 2024-09-13T16:10:39.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:10:39.696 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968.client25378/status') 2024-09-13T16:10:39.794 INFO:teuthology.orchestra.run.smithi086.stdout:instance: client.25378 (3)172.21.15.86:0/1315387455 2024-09-13T16:10:39.794 INFO:teuthology.orchestra.run.smithi086.stdout:blocklisted: false 2024-09-13T16:10:39.795 INFO:teuthology.orchestra.run.smithi086.stderr:0+1 records in 2024-09-13T16:10:39.795 INFO:teuthology.orchestra.run.smithi086.stderr:0+1 records out 2024-09-13T16:10:39.795 INFO:teuthology.orchestra.run.smithi086.stderr:71 bytes copied, 7.914e-05 s, 897 kB/s 2024-09-13T16:10:39.798 INFO:teuthology.run_tasks:Running task exec... 2024-09-13T16:10:39.808 INFO:teuthology.task.exec:Executing custom commands... 2024-09-13T16:10:39.808 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T16:10:39.808 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-13T16:10:39.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.969+0000 7f143d400640 1 -- 172.21.15.86:0/3549996837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1438101f30 msgr2=0x7f1438102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:39.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.969+0000 7f143d400640 1 --2- 172.21.15.86:0/3549996837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1438101f30 0x7f1438102330 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1428009900 tx=0x7f142802a400 comp rx=0 tx=0).stop 2024-09-13T16:10:39.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.969+0000 7f143d400640 1 -- 172.21.15.86:0/3549996837 shutdown_connections 2024-09-13T16:10:39.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.969+0000 7f143d400640 1 --2- 172.21.15.86:0/3549996837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1438103a40 0x7f143810a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:39.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.969+0000 7f143d400640 1 --2- 172.21.15.86:0/3549996837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1438103080 0x7f1438103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:39.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.969+0000 7f143d400640 1 --2- 172.21.15.86:0/3549996837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1438101f30 0x7f1438102330 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:39.970 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.969+0000 7f143d400640 1 -- 172.21.15.86:0/3549996837 >> 172.21.15.86:0/3549996837 conn(0x7f14380fd6b0 msgr2=0x7f14380ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:39.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.969+0000 7f143d400640 1 -- 172.21.15.86:0/3549996837 shutdown_connections 2024-09-13T16:10:39.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.969+0000 7f143d400640 1 -- 172.21.15.86:0/3549996837 wait complete. 2024-09-13T16:10:39.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.971+0000 7f143d400640 1 Processor -- start 2024-09-13T16:10:39.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.971+0000 7f143d400640 1 -- start start 2024-09-13T16:10:39.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.971+0000 7f143d400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1438101f30 0x7f1438198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:39.972 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.971+0000 7f143d400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1438103080 0x7f1438198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:39.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.971+0000 7f143d400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1438103a40 0x7f143819f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:39.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.971+0000 7f143d400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143819fb00 con 0x7f1438103a40 2024-09-13T16:10:39.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.971+0000 7f143d400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143819fc70 con 0x7f1438103080 2024-09-13T16:10:39.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.971+0000 7f143d400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143819fe30 con 0x7f1438101f30 2024-09-13T16:10:39.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.972+0000 7f1436800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1438101f30 0x7f1438198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:39.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.972+0000 7f1435e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1438103080 0x7f1438198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:39.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.972+0000 7f1436800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1438101f30 0x7f1438198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:39818/0 (socket says 172.21.15.86:39818) 2024-09-13T16:10:39.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.972+0000 7f1436800640 1 -- 172.21.15.86:0/3748368270 learned_addr learned my addr 172.21.15.86:0/3748368270 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:39.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.972+0000 7f1437200640 1 --2- 172.21.15.86:0/3748368270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1438103a40 0x7f143819f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:39.973 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.972+0000 7f1435e00640 1 -- 172.21.15.86:0/3748368270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1438101f30 msgr2=0x7f1438198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:39.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.972+0000 7f1435e00640 1 --2- 172.21.15.86:0/3748368270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1438101f30 0x7f1438198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:39.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.972+0000 7f1435e00640 1 -- 172.21.15.86:0/3748368270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1438103a40 msgr2=0x7f143819f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:39.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.972+0000 7f1435e00640 1 --2- 172.21.15.86:0/3748368270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1438103a40 0x7f143819f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:39.974 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.972+0000 7f1435e00640 1 -- 172.21.15.86:0/3748368270 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430009840 con 0x7f1438103080 2024-09-13T16:10:39.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.972+0000 7f1435e00640 1 --2- 172.21.15.86:0/3748368270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1438103080 0x7f1438198550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f142400e9c0 tx=0x7f142400edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:39.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.972+0000 7f142f400640 1 -- 172.21.15.86:0/3748368270 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142400ccc0 con 0x7f1438103080 2024-09-13T16:10:39.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.973+0000 7f142f400640 1 -- 172.21.15.86:0/3748368270 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f142400ce20 con 0x7f1438103080 2024-09-13T16:10:39.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.973+0000 7f142f400640 1 -- 172.21.15.86:0/3748368270 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424010430 con 0x7f1438103080 2024-09-13T16:10:39.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.973+0000 7f143d400640 1 -- 172.21.15.86:0/3748368270 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1428009560 con 0x7f1438103080 2024-09-13T16:10:39.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.973+0000 7f143d400640 1 -- 172.21.15.86:0/3748368270 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14381a0440 con 0x7f1438103080 2024-09-13T16:10:39.975 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.974+0000 7f143d400640 1 -- 172.21.15.86:0/3748368270 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14381093b0 con 0x7f1438103080 2024-09-13T16:10:39.977 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.977+0000 7f142f400640 1 -- 172.21.15.86:0/3748368270 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1424003f20 con 0x7f1438103080 2024-09-13T16:10:39.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.978+0000 7f142f400640 1 --2- 172.21.15.86:0/3748368270 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f141c0a1110 0x7f141c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:39.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.978+0000 7f142f400640 1 -- 172.21.15.86:0/3748368270 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f1424014070 con 0x7f1438103080 2024-09-13T16:10:39.979 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.979+0000 7f1436800640 1 --2- 172.21.15.86:0/3748368270 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f141c0a1110 0x7f141c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:39.980 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.979+0000 7f1436800640 1 --2- 172.21.15.86:0/3748368270 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f141c0a1110 0x7f141c0a35d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1428005ec0 tx=0x7f14280058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:39.983 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:39.982+0000 7f142f400640 1 -- 172.21.15.86:0/3748368270 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f14240963b0 con 0x7f1438103080 2024-09-13T16:10:39.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:39 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:39.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:39 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:39.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:39 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:39.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:39 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:39.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:39 smithi139 ceph-mon[35320]: pgmap v374: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:10:39.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:39 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:39.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:39 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:40.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:39 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:40.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:39 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:40.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:39 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:40.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:39 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:40.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:39 smithi194 ceph-mon[35694]: pgmap v374: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:10:40.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:39 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:40.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:39 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:40.019 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:39 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:40.019 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:39 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:40.019 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:39 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:40.019 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:39 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:40.019 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:39 smithi086 ceph-mon[30379]: pgmap v374: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:10:40.019 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:39 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:40.019 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:39 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:40.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:40.215+0000 7f143d400640 1 -- 172.21.15.86:0/3748368270 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) v1 -- 0x7f143802c410 con 0x7f1438103080 2024-09-13T16:10:40.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:40.945+0000 7f142f400640 1 -- 172.21.15.86:0/3748368270 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7f14240999d0 con 0x7f1438103080 2024-09-13T16:10:40.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:40.947+0000 7f143d400640 1 -- 172.21.15.86:0/3748368270 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f141c0a1110 msgr2=0x7f141c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:40.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:40.947+0000 7f143d400640 1 --2- 172.21.15.86:0/3748368270 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f141c0a1110 0x7f141c0a35d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1428005ec0 tx=0x7f14280058d0 comp rx=0 tx=0).stop 2024-09-13T16:10:40.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:40.947+0000 7f143d400640 1 -- 172.21.15.86:0/3748368270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1438103080 msgr2=0x7f1438198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:40.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:40.947+0000 7f143d400640 1 --2- 172.21.15.86:0/3748368270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1438103080 0x7f1438198550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f142400e9c0 tx=0x7f142400edc0 comp rx=0 tx=0).stop 2024-09-13T16:10:40.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:40.947+0000 7f143d400640 1 -- 172.21.15.86:0/3748368270 shutdown_connections 2024-09-13T16:10:40.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:40.947+0000 7f143d400640 1 --2- 172.21.15.86:0/3748368270 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f141c0a1110 0x7f141c0a35d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:40.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:40.947+0000 7f143d400640 1 --2- 172.21.15.86:0/3748368270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1438103a40 0x7f143819f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:40.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:40.947+0000 7f143d400640 1 --2- 172.21.15.86:0/3748368270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1438103080 0x7f1438198550 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:40.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:40.947+0000 7f143d400640 1 --2- 172.21.15.86:0/3748368270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1438101f30 0x7f1438198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:40.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:40.947+0000 7f143d400640 1 -- 172.21.15.86:0/3748368270 >> 172.21.15.86:0/3748368270 conn(0x7f14380fd6b0 msgr2=0x7f1438106580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:40.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:40.947+0000 7f143d400640 1 -- 172.21.15.86:0/3748368270 shutdown_connections 2024-09-13T16:10:40.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:40.947+0000 7f143d400640 1 -- 172.21.15.86:0/3748368270 wait complete. 2024-09-13T16:10:40.964 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-13T16:10:41.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.115+0000 7f6ebb200640 1 -- 172.21.15.86:0/519108257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6eb41059e0 msgr2=0x7f6eb4107e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:41.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.115+0000 7f6ebb200640 1 --2- 172.21.15.86:0/519108257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6eb41059e0 0x7f6eb4107e50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6eac009ca0 tx=0x7f6eac02a8c0 comp rx=0 tx=0).stop 2024-09-13T16:10:41.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.115+0000 7f6ebb200640 1 -- 172.21.15.86:0/519108257 shutdown_connections 2024-09-13T16:10:41.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.115+0000 7f6ebb200640 1 --2- 172.21.15.86:0/519108257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6eb41059e0 0x7f6eb4107e50 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:41.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.115+0000 7f6ebb200640 1 --2- 172.21.15.86:0/519108257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb41030b0 0x7f6eb41054a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:41.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.115+0000 7f6ebb200640 1 --2- 172.21.15.86:0/519108257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6eb4100780 0x7f6eb4102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:41.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.115+0000 7f6ebb200640 1 -- 172.21.15.86:0/519108257 >> 172.21.15.86:0/519108257 conn(0x7f6eb40fa360 msgr2=0x7f6eb40fc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:41.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.115+0000 7f6ebb200640 1 -- 172.21.15.86:0/519108257 shutdown_connections 2024-09-13T16:10:41.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.115+0000 7f6ebb200640 1 -- 172.21.15.86:0/519108257 wait complete. 2024-09-13T16:10:41.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.116+0000 7f6ebb200640 1 Processor -- start 2024-09-13T16:10:41.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.116+0000 7f6ebb200640 1 -- start start 2024-09-13T16:10:41.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.117+0000 7f6ebb200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6eb4100780 0x7f6eb4195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:41.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.117+0000 7f6ebb200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb41030b0 0x7f6eb4196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:41.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.117+0000 7f6ebb200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6eb41059e0 0x7f6eb419d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:41.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.117+0000 7f6ebb200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb419d920 con 0x7f6eb4100780 2024-09-13T16:10:41.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.117+0000 7f6ebb200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb419da90 con 0x7f6eb41059e0 2024-09-13T16:10:41.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.117+0000 7f6ebb200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb419dc50 con 0x7f6eb41030b0 2024-09-13T16:10:41.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.117+0000 7f6eb3e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6eb4100780 0x7f6eb4195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:41.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.117+0000 7f6eb3e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6eb4100780 0x7f6eb4195e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35802/0 (socket says 172.21.15.86:35802) 2024-09-13T16:10:41.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.117+0000 7f6eb3e00640 1 -- 172.21.15.86:0/1111905072 learned_addr learned my addr 172.21.15.86:0/1111905072 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:41.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.117+0000 7f6eb9200640 1 --2- 172.21.15.86:0/1111905072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6eb41059e0 0x7f6eb419d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:41.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.117+0000 7f6eb3400640 1 --2- 172.21.15.86:0/1111905072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb41030b0 0x7f6eb4196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:41.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.117+0000 7f6eb3e00640 1 -- 172.21.15.86:0/1111905072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb41030b0 msgr2=0x7f6eb4196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:41.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.117+0000 7f6eb3e00640 1 --2- 172.21.15.86:0/1111905072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb41030b0 0x7f6eb4196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:41.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.117+0000 7f6eb3e00640 1 -- 172.21.15.86:0/1111905072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6eb41059e0 msgr2=0x7f6eb419d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:41.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.117+0000 7f6eb3e00640 1 --2- 172.21.15.86:0/1111905072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6eb41059e0 0x7f6eb419d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:41.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.117+0000 7f6eb3e00640 1 -- 172.21.15.86:0/1111905072 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac009900 con 0x7f6eb4100780 2024-09-13T16:10:41.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.118+0000 7f6eb9200640 1 --2- 172.21.15.86:0/1111905072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6eb41059e0 0x7f6eb419d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:41.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.118+0000 7f6eb3e00640 1 --2- 172.21.15.86:0/1111905072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6eb4100780 0x7f6eb4195e30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400e9f0 tx=0x7f6ea400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:41.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.118+0000 7f6eb0c00640 1 -- 172.21.15.86:0/1111905072 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4009700 con 0x7f6eb4100780 2024-09-13T16:10:41.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.118+0000 7f6eb0c00640 1 -- 172.21.15.86:0/1111905072 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6ea400cd80 con 0x7f6eb4100780 2024-09-13T16:10:41.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.118+0000 7f6eb0c00640 1 -- 172.21.15.86:0/1111905072 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4018920 con 0x7f6eb4100780 2024-09-13T16:10:41.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.118+0000 7f6ebb200640 1 -- 172.21.15.86:0/1111905072 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb419df30 con 0x7f6eb4100780 2024-09-13T16:10:41.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.118+0000 7f6ebb200640 1 -- 172.21.15.86:0/1111905072 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb419e350 con 0x7f6eb4100780 2024-09-13T16:10:41.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.119+0000 7f6ebb200640 1 -- 172.21.15.86:0/1111905072 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb40fbe50 con 0x7f6eb4100780 2024-09-13T16:10:41.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.121+0000 7f6eb0c00640 1 -- 172.21.15.86:0/1111905072 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6ea4018a80 con 0x7f6eb4100780 2024-09-13T16:10:41.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.122+0000 7f6eb0c00640 1 --2- 172.21.15.86:0/1111905072 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6e980a1090 0x7f6e980a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:41.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.122+0000 7f6eb0c00640 1 -- 172.21.15.86:0/1111905072 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f6ea4014070 con 0x7f6eb4100780 2024-09-13T16:10:41.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.122+0000 7f6eb3400640 1 --2- 172.21.15.86:0/1111905072 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6e980a1090 0x7f6e980a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:41.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.123+0000 7f6eb3400640 1 --2- 172.21.15.86:0/1111905072 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6e980a1090 0x7f6e980a3550 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4197340 tx=0x7f6ea0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:41.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.126+0000 7f6eb0c00640 1 -- 172.21.15.86:0/1111905072 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6ea4052e20 con 0x7f6eb4100780 2024-09-13T16:10:41.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:40 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3748368270' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-13T16:10:41.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:40 smithi139 ceph-mon[35320]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-13T16:10:41.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:40 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:10:41.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:40 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:10:41.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:40 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:41.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:40 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3748368270' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-13T16:10:41.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:40 smithi194 ceph-mon[35694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-13T16:10:41.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:40 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:10:41.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:40 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:10:41.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:40 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:41.327 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.326+0000 7f6ebb200640 1 -- 172.21.15.86:0/1111905072 --> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) v1 -- 0x7f6eb402c560 con 0x7f6e980a1090 2024-09-13T16:10:41.333 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:40 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3748368270' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-13T16:10:41.334 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:40 smithi086 ceph-mon[30379]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-13T16:10:41.334 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:40 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:10:41.334 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:40 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:10:41.334 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:40 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:10:41.346 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.345+0000 7f6eb0c00640 1 -- 172.21.15.86:0/1111905072 <== mgr.14150 v2:172.21.15.86:6800/1239909622 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7f6eb402c560 con 0x7f6e980a1090 2024-09-13T16:10:41.346 INFO:teuthology.orchestra.run.smithi086.stdout:{} 2024-09-13T16:10:41.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.347+0000 7f6ebb200640 1 -- 172.21.15.86:0/1111905072 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6e980a1090 msgr2=0x7f6e980a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:41.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.347+0000 7f6ebb200640 1 --2- 172.21.15.86:0/1111905072 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6e980a1090 0x7f6e980a3550 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4197340 tx=0x7f6ea0005f90 comp rx=0 tx=0).stop 2024-09-13T16:10:41.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.347+0000 7f6ebb200640 1 -- 172.21.15.86:0/1111905072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6eb4100780 msgr2=0x7f6eb4195e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:41.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.347+0000 7f6ebb200640 1 --2- 172.21.15.86:0/1111905072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6eb4100780 0x7f6eb4195e30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400e9f0 tx=0x7f6ea400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:10:41.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.348+0000 7f6ebb200640 1 -- 172.21.15.86:0/1111905072 shutdown_connections 2024-09-13T16:10:41.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.348+0000 7f6ebb200640 1 --2- 172.21.15.86:0/1111905072 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f6e980a1090 0x7f6e980a3550 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:41.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.348+0000 7f6ebb200640 1 --2- 172.21.15.86:0/1111905072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6eb41059e0 0x7f6eb419d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:41.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.348+0000 7f6ebb200640 1 --2- 172.21.15.86:0/1111905072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb41030b0 0x7f6eb4196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:41.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.348+0000 7f6ebb200640 1 --2- 172.21.15.86:0/1111905072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6eb4100780 0x7f6eb4195e30 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:41.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.348+0000 7f6ebb200640 1 -- 172.21.15.86:0/1111905072 >> 172.21.15.86:0/1111905072 conn(0x7f6eb40fa360 msgr2=0x7f6eb4101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:41.349 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.348+0000 7f6ebb200640 1 -- 172.21.15.86:0/1111905072 shutdown_connections 2024-09-13T16:10:41.350 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:10:41.348+0000 7f6ebb200640 1 -- 172.21.15.86:0/1111905072 wait complete. 2024-09-13T16:10:41.363 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-13T16:10:41.376 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-13T16:10:41.385 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T16:10:41.385 DEBUG:teuthology.orchestra.run.smithi086:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-13T16:10:41.389 INFO:teuthology.run_tasks:Running task workunit... 2024-09-13T16:10:41.402 INFO:tasks.workunit:Pulling workunits from ref 50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:10:41.402 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T16:10:41.402 INFO:tasks.workunit:timeout=3h 2024-09-13T16:10:41.402 INFO:tasks.workunit:cleanup=True 2024-09-13T16:10:41.403 DEBUG:teuthology.orchestra.run.smithi086:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T16:10:41.438 INFO:teuthology.orchestra.run.smithi086.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T16:10:41.438 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-13T16:10:41.438 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-13T16:10:41.438 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:10:41.438 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-13T16:10:41.439 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-13 16:08:34.059068898 +0000 2024-09-13T16:10:41.439 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-13 16:08:34.059068898 +0000 2024-09-13T16:10:41.439 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-13 16:10:39.403083727 +0000 2024-09-13T16:10:41.439 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-13 16:08:34.059068898 +0000 2024-09-13T16:10:41.439 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T16:10:41.441 DEBUG:teuthology.orchestra.run.smithi086:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T16:10:41.544 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:10:41.582 INFO:tasks.workunit.client.0.smithi086.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T16:10:41.615 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:10:41 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:10:41.332+0000 7f4b6ce00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T16:10:41.615 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:10:41 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:10:41.332+0000 7f4b6ce00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T16:10:41.615 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:10:41 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:10:41.332+0000 7f4b6ce00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T16:10:41.615 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:10:41 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:10:41.332+0000 7f4b6ce00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T16:10:41.615 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:10:41 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:10:41.332+0000 7f4b6ce00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T16:10:42.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:41 smithi139 ceph-mon[35320]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-13T16:10:42.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:41 smithi139 ceph-mon[35320]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:10:42.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:41 smithi139 ceph-mon[35320]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:10:42.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:41 smithi139 ceph-mon[35320]: pgmap v375: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-13T16:10:42.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:41 smithi194 ceph-mon[35694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-13T16:10:42.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:41 smithi194 ceph-mon[35694]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:10:42.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:41 smithi194 ceph-mon[35694]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:10:42.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:41 smithi194 ceph-mon[35694]: pgmap v375: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-13T16:10:42.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:41 smithi086 ceph-mon[30379]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-13T16:10:42.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:41 smithi086 ceph-mon[30379]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:10:42.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:41 smithi086 ceph-mon[30379]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:10:42.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:41 smithi086 ceph-mon[30379]: pgmap v375: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-13T16:10:43.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:42 smithi139 ceph-mon[35320]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-13T16:10:43.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:42 smithi194 ceph-mon[35694]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-13T16:10:43.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:42 smithi086 ceph-mon[30379]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-13T16:10:44.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:43 smithi139 ceph-mon[35320]: pgmap v376: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T16:10:44.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:43 smithi194 ceph-mon[35694]: pgmap v376: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T16:10:44.266 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:43 smithi086 ceph-mon[30379]: pgmap v376: 129 pgs: 129 active+clean; 642 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T16:10:46.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:46 smithi139 ceph-mon[35320]: pgmap v377: 129 pgs: 129 active+clean; 643 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-13T16:10:46.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:46 smithi194 ceph-mon[35694]: pgmap v377: 129 pgs: 129 active+clean; 643 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-13T16:10:46.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:46 smithi086 ceph-mon[30379]: pgmap v377: 129 pgs: 129 active+clean; 643 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-13T16:10:48.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:48 smithi139 ceph-mon[35320]: pgmap v378: 129 pgs: 129 active+clean; 655 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-09-13T16:10:48.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:48 smithi194 ceph-mon[35694]: pgmap v378: 129 pgs: 129 active+clean; 655 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-09-13T16:10:48.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:48 smithi086 ceph-mon[30379]: pgmap v378: 129 pgs: 129 active+clean; 655 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-09-13T16:10:50.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:50 smithi139 ceph-mon[35320]: pgmap v379: 129 pgs: 129 active+clean; 655 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-13T16:10:50.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:50 smithi194 ceph-mon[35694]: pgmap v379: 129 pgs: 129 active+clean; 655 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-13T16:10:50.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:50 smithi086 ceph-mon[30379]: pgmap v379: 129 pgs: 129 active+clean; 655 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-13T16:10:52.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:52 smithi139 ceph-mon[35320]: pgmap v380: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-13T16:10:52.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:52 smithi194 ceph-mon[35694]: pgmap v380: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-13T16:10:52.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:52 smithi086 ceph-mon[30379]: pgmap v380: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-13T16:10:54.587 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.585+0000 7f0087200640 1 -- 172.21.15.86:0/2120734579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0080103070 msgr2=0x7f00801034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:54.587 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.585+0000 7f0087200640 1 --2- 172.21.15.86:0/2120734579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0080103070 0x7f00801034f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f006c009860 tx=0x7f006c02a330 comp rx=0 tx=0).stop 2024-09-13T16:10:54.587 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.585+0000 7f0087200640 1 -- 172.21.15.86:0/2120734579 shutdown_connections 2024-09-13T16:10:54.587 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.585+0000 7f0087200640 1 --2- 172.21.15.86:0/2120734579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0080103a30 0x7f008010a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.587 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.585+0000 7f0087200640 1 --2- 172.21.15.86:0/2120734579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0080103070 0x7f00801034f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.588 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.585+0000 7f0087200640 1 --2- 172.21.15.86:0/2120734579 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0080101f20 0x7f0080102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.588 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.585+0000 7f0087200640 1 -- 172.21.15.86:0/2120734579 >> 172.21.15.86:0/2120734579 conn(0x7f00800fd680 msgr2=0x7f00800ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:54.588 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.585+0000 7f0087200640 1 -- 172.21.15.86:0/2120734579 shutdown_connections 2024-09-13T16:10:54.588 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.585+0000 7f0087200640 1 -- 172.21.15.86:0/2120734579 wait complete. 2024-09-13T16:10:54.589 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.586+0000 7f0087200640 1 Processor -- start 2024-09-13T16:10:54.589 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.587+0000 7f0087200640 1 -- start start 2024-09-13T16:10:54.589 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.587+0000 7f0087200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0080101f20 0x7f008019c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.587+0000 7f0087200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0080103070 0x7f008019c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.587+0000 7f0087200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0080103a30 0x7f00801a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.587+0000 7f0087200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00801a3f60 con 0x7f0080101f20 2024-09-13T16:10:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.587+0000 7f0087200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00801a40d0 con 0x7f0080103a30 2024-09-13T16:10:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.587+0000 7f0087200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00801a4290 con 0x7f0080103070 2024-09-13T16:10:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.587+0000 7f007fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0080101f20 0x7f008019c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.587+0000 7f007fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0080101f20 0x7f008019c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54756/0 (socket says 172.21.15.86:54756) 2024-09-13T16:10:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.587+0000 7f007fe00640 1 -- 172.21.15.86:0/642934978 learned_addr learned my addr 172.21.15.86:0/642934978 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.587+0000 7f007f400640 1 --2- 172.21.15.86:0/642934978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0080103070 0x7f008019c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.587+0000 7f0085200640 1 --2- 172.21.15.86:0/642934978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0080103a30 0x7f00801a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.588+0000 7f007fe00640 1 -- 172.21.15.86:0/642934978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0080103070 msgr2=0x7f008019c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.588+0000 7f007fe00640 1 --2- 172.21.15.86:0/642934978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0080103070 0x7f008019c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.588+0000 7f007fe00640 1 -- 172.21.15.86:0/642934978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0080103a30 msgr2=0x7f00801a3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.588+0000 7f007fe00640 1 --2- 172.21.15.86:0/642934978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0080103a30 0x7f00801a3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.588+0000 7f007fe00640 1 -- 172.21.15.86:0/642934978 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0070009560 con 0x7f0080101f20 2024-09-13T16:10:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.588+0000 7f007fe00640 1 --2- 172.21.15.86:0/642934978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0080101f20 0x7f008019c470 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f007000e9c0 tx=0x7f007000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.588+0000 7f007cc00640 1 -- 172.21.15.86:0/642934978 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007000cde0 con 0x7f0080101f20 2024-09-13T16:10:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.588+0000 7f0087200640 1 -- 172.21.15.86:0/642934978 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006c009490 con 0x7f0080101f20 2024-09-13T16:10:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.588+0000 7f007cc00640 1 -- 172.21.15.86:0/642934978 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f00700035f0 con 0x7f0080101f20 2024-09-13T16:10:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.588+0000 7f007cc00640 1 -- 172.21.15.86:0/642934978 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0070010650 con 0x7f0080101f20 2024-09-13T16:10:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.589+0000 7f0087200640 1 -- 172.21.15.86:0/642934978 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00801a4910 con 0x7f0080101f20 2024-09-13T16:10:54.593 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.592+0000 7f008a066740 1 Processor -- start 2024-09-13T16:10:54.593 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.592+0000 7f007cc00640 1 -- 172.21.15.86:0/642934978 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0070003ad0 con 0x7f0080101f20 2024-09-13T16:10:54.594 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.592+0000 7f008a066740 1 -- start start 2024-09-13T16:10:54.594 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.592+0000 7f008a066740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c60978a70 0x561c60978e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:54.594 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.592+0000 7f008a066740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c609793b0 0x561c6097de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:54.594 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.592+0000 7f008a066740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c6097e440 0x561c60980900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:54.594 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.592+0000 7f008a066740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c60884bb0 con 0x561c6097e440 2024-09-13T16:10:54.594 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.592+0000 7f008a066740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c608e2a70 con 0x561c609793b0 2024-09-13T16:10:54.594 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.592+0000 7f008a066740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c608e0200 con 0x561c60978a70 2024-09-13T16:10:54.595 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.593+0000 7f0085200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c60978a70 0x561c60978e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:54.595 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.593+0000 7f007f400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c6097e440 0x561c60980900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:54.595 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.593+0000 7f007fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c609793b0 0x561c6097de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:54.595 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.593+0000 7f0085200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c60978a70 0x561c60978e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:60326/0 (socket says 172.21.15.86:60326) 2024-09-13T16:10:54.595 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.593+0000 7f0085200640 1 -- 172.21.15.86:0/3322948132 learned_addr learned my addr 172.21.15.86:0/3322948132 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.593+0000 7f0085200640 1 -- 172.21.15.86:0/3322948132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c609793b0 msgr2=0x561c6097de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.593+0000 7f0085200640 1 --2- 172.21.15.86:0/3322948132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c609793b0 0x561c6097de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.593+0000 7f0085200640 1 -- 172.21.15.86:0/3322948132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c6097e440 msgr2=0x561c60980900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.593+0000 7f0085200640 1 --2- 172.21.15.86:0/3322948132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c6097e440 0x561c60980900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.593+0000 7f0085200640 1 -- 172.21.15.86:0/3322948132 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c6087d940 con 0x561c60978a70 2024-09-13T16:10:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.593+0000 7f007f400640 1 --2- 172.21.15.86:0/3322948132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c6097e440 0x561c60980900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.593+0000 7f007cc00640 1 --2- 172.21.15.86:0/642934978 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f00640a1120 0x7f00640a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.593+0000 7f0085200640 1 --2- 172.21.15.86:0/3322948132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c60978a70 0x561c60978e70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0078009fd0 tx=0x7f00780118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8958eddcb56eefaa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.594+0000 7f0075600640 1 -- 172.21.15.86:0/3322948132 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078004d20 con 0x561c60978a70 2024-09-13T16:10:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.594+0000 7f007fe00640 1 --2- 172.21.15.86:0/642934978 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f00640a1120 0x7f00640a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.594+0000 7f0075600640 1 -- 172.21.15.86:0/3322948132 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0078004e80 con 0x561c60978a70 2024-09-13T16:10:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.594+0000 7f007cc00640 1 -- 172.21.15.86:0/642934978 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f0070014070 con 0x7f0080101f20 2024-09-13T16:10:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.594+0000 7f0075600640 1 -- 172.21.15.86:0/3322948132 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078005280 con 0x561c60978a70 2024-09-13T16:10:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.594+0000 7f008a066740 1 -- 172.21.15.86:0/3322948132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c60978a70 msgr2=0x561c60978e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.594+0000 7f008a066740 1 --2- 172.21.15.86:0/3322948132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c60978a70 0x561c60978e70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0078009fd0 tx=0x7f00780118d0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.594+0000 7f007fe00640 1 --2- 172.21.15.86:0/642934978 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f00640a1120 0x7f00640a35e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0070099eb0 tx=0x7f00700d0b90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.595+0000 7f008a066740 1 -- 172.21.15.86:0/3322948132 shutdown_connections 2024-09-13T16:10:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.595+0000 7f008a066740 1 --2- 172.21.15.86:0/3322948132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c6097e440 0x561c60980900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.595+0000 7f008a066740 1 --2- 172.21.15.86:0/3322948132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c609793b0 0x561c6097de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.595+0000 7f008a066740 1 --2- 172.21.15.86:0/3322948132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c60978a70 0x561c60978e70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.595+0000 7f008a066740 1 -- 172.21.15.86:0/3322948132 >> 172.21.15.86:0/3322948132 conn(0x561c609740e0 msgr2=0x561c609744e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.595+0000 7f008a066740 1 -- 172.21.15.86:0/3322948132 shutdown_connections 2024-09-13T16:10:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.595+0000 7f008a066740 1 -- 172.21.15.86:0/3322948132 wait complete. 2024-09-13T16:10:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.595+0000 7f008a066740 1 -- start start 2024-09-13T16:10:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.595+0000 7f008a066740 1 Processor -- start 2024-09-13T16:10:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.596+0000 7f008a066740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c60978a70 0x561c60982760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.596+0000 7f008a066740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c609793b0 0x561c60982ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.596+0000 7f008a066740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c6097e440 0x561c60989c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.596+0000 7f008a066740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c608dbaf0 con 0x561c6097e440 2024-09-13T16:10:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.596+0000 7f008a066740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c60899f20 con 0x561c60978a70 2024-09-13T16:10:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.596+0000 7f008a066740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c60899bc0 con 0x561c609793b0 2024-09-13T16:10:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.596+0000 7f008a066740 10 client.0 _ll_register_callbacks cb 0x561c608cba70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.596+0000 7f007f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c609793b0 0x561c60982ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.596+0000 7f007f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c609793b0 0x561c60982ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:60340/0 (socket says 172.21.15.86:60340) 2024-09-13T16:10:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.596+0000 7f007f400640 1 -- 172.21.15.86:0/3924652324 learned_addr learned my addr 172.21.15.86:0/3924652324 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.596+0000 7f0085200640 1 --2- 172.21.15.86:0/3924652324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c60978a70 0x561c60982760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.596+0000 7f0085200640 1 --2- 172.21.15.86:0/3924652324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c6097e440 0x561c60989c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.596+0000 7f007f400640 1 -- 172.21.15.86:0/3924652324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c60978a70 msgr2=0x561c60982760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.596+0000 7f007f400640 1 --2- 172.21.15.86:0/3924652324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c60978a70 0x561c60982760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.596+0000 7f007f400640 1 -- 172.21.15.86:0/3924652324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c6097e440 msgr2=0x561c60989c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.596+0000 7f007f400640 1 --2- 172.21.15.86:0/3924652324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c6097e440 0x561c60989c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.596+0000 7f007f400640 1 -- 172.21.15.86:0/3924652324 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0078009c80 con 0x561c609793b0 2024-09-13T16:10:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.596+0000 7f0085200640 1 --2- 172.21.15.86:0/3924652324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c6097e440 0x561c60989c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:10:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.597+0000 7f007f400640 1 --2- 172.21.15.86:0/3924652324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c609793b0 0x561c60982ca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f006c009860 tx=0x7f006c0326e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50b4d6c3de2ec0b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.597+0000 7f006a000640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-13T16:10:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.597+0000 7f006a000640 1 -- 172.21.15.86:0/3924652324 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c032a90 con 0x561c609793b0 2024-09-13T16:10:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.597+0000 7f008a066740 1 -- 172.21.15.86:0/3924652324 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c608ce7d0 con 0x561c609793b0 2024-09-13T16:10:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.597+0000 7f006a000640 1 -- 172.21.15.86:0/3924652324 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f006c032bf0 con 0x561c609793b0 2024-09-13T16:10:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.597+0000 7f006a000640 1 -- 172.21.15.86:0/3924652324 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f006c032db0 con 0x561c609793b0 2024-09-13T16:10:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.597+0000 7f008a066740 10 client.25408 fetch_fsmap learned FSMap version 25 2024-09-13T16:10:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.597+0000 7f008a066740 1 -- 172.21.15.86:0/3924652324 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x561c608da170 con 0x561c609793b0 2024-09-13T16:10:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.597+0000 7f006a000640 1 -- 172.21.15.86:0/3924652324 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x561c608ce7d0 con 0x561c609793b0 2024-09-13T16:10:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.598+0000 7f006a000640 1 -- 172.21.15.86:0/3924652324 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f006c043020 con 0x561c609793b0 2024-09-13T16:10:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.598+0000 7f008a066740 10 client.25408 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:10:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.598+0000 7f008a066740 10 client.25408 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:10:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.598+0000 7f008a066740 20 client.25408 populate_metadata read hostname 'smithi086' 2024-09-13T16:10:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.598+0000 7f008a066740 1 --2- 172.21.15.86:0/3924652324 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x561c6098e350 0x561c60990770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.598+0000 7f008a066740 4 client.25408 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:10:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.598+0000 7f008a066740 1 -- 172.21.15.86:0/3924652324 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c605cf300 con 0x561c6098e350 2024-09-13T16:10:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.598+0000 7f0085200640 1 --2- 172.21.15.86:0/3924652324 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x561c6098e350 0x561c60990770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.599+0000 7f0085200640 1 --2- 172.21.15.86:0/3924652324 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x561c6098e350 0x561c60990770 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f1bebe047c87f25 server_cookie=3b4d27761f7fcbe2 in_seq=0 out_seq=0 2024-09-13T16:10:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.599+0000 7f006a000640 10 client.25408 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:10:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.600+0000 7f006a000640 1 -- 172.21.15.86:0/3924652324 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561c605cf300 con 0x561c6098e350 2024-09-13T16:10:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.600+0000 7f006a000640 10 client.25408 handle_command_reply: tid=0 2024-09-13T16:10:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.600+0000 7f008a066740 1 client.25408 shutdown 2024-09-13T16:10:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.600+0000 7f008a066740 1 -- 172.21.15.86:0/3924652324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c609793b0 msgr2=0x561c60982ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.600+0000 7f008a066740 1 --2- 172.21.15.86:0/3924652324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c609793b0 0x561c60982ca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f006c009860 tx=0x7f006c0326e0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.600+0000 7f008a066740 1 -- 172.21.15.86:0/3924652324 shutdown_connections 2024-09-13T16:10:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.600+0000 7f008a066740 1 --2- 172.21.15.86:0/3924652324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c6097e440 0x561c60989c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.600+0000 7f008a066740 1 --2- 172.21.15.86:0/3924652324 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x561c6098e350 0x561c60990770 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.600+0000 7f008a066740 1 --2- 172.21.15.86:0/3924652324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c609793b0 0x561c60982ca0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.600+0000 7f008a066740 1 --2- 172.21.15.86:0/3924652324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c60978a70 0x561c60982760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.600+0000 7f008a066740 1 -- 172.21.15.86:0/3924652324 >> 172.21.15.86:0/3924652324 conn(0x561c609740e0 msgr2=0x561c609758f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.600+0000 7f006a000640 0 client.25408 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:10:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.600+0000 7f008a066740 1 -- 172.21.15.86:0/3924652324 shutdown_connections 2024-09-13T16:10:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.600+0000 7f008a066740 1 -- 172.21.15.86:0/3924652324 wait complete. 2024-09-13T16:10:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.600+0000 7f008a066740 20 client.25408 trim_cache size 0 max 16384 2024-09-13T16:10:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.613+0000 7f008a066740 1 Processor -- start 2024-09-13T16:10:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.613+0000 7f008a066740 1 -- start start 2024-09-13T16:10:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.613+0000 7f008a066740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c60978a70 0x561c6097a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.613+0000 7f008a066740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c609793b0 0x561c60989c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.613+0000 7f008a066740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c6097e440 0x561c6097a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.613+0000 7f008a066740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c60642e60 con 0x561c609793b0 2024-09-13T16:10:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.613+0000 7f008a066740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c608ce7d0 con 0x561c6097e440 2024-09-13T16:10:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.613+0000 7f008a066740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c60983610 con 0x561c60978a70 2024-09-13T16:10:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.614+0000 7f007f400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c609793b0 0x561c60989c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.614+0000 7f0085200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c60978a70 0x561c6097a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.614+0000 7f007f400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c609793b0 0x561c60989c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54784/0 (socket says 172.21.15.86:54784) 2024-09-13T16:10:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.614+0000 7f0085200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c60978a70 0x561c6097a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:60346/0 (socket says 172.21.15.86:60346) 2024-09-13T16:10:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.614+0000 7f007f400640 1 -- 172.21.15.86:0/4158503045 learned_addr learned my addr 172.21.15.86:0/4158503045 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.614+0000 7f0085200640 1 --2- 172.21.15.86:0/4158503045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c6097e440 0x561c6097a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.614+0000 7f007f400640 1 -- 172.21.15.86:0/4158503045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c60978a70 msgr2=0x561c6097a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.614+0000 7f007f400640 1 --2- 172.21.15.86:0/4158503045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c60978a70 0x561c6097a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.614+0000 7f007f400640 1 -- 172.21.15.86:0/4158503045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c6097e440 msgr2=0x561c6097a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.614+0000 7f007f400640 1 --2- 172.21.15.86:0/4158503045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c6097e440 0x561c6097a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.614+0000 7f007f400640 1 -- 172.21.15.86:0/4158503045 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c6087c180 con 0x561c609793b0 2024-09-13T16:10:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.614+0000 7f007f400640 1 --2- 172.21.15.86:0/4158503045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c609793b0 0x561c60989c00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f006c031000 tx=0x7f006c02a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689fda280b0516 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.615+0000 7f0076000640 1 -- 172.21.15.86:0/4158503045 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c03d450 con 0x561c609793b0 2024-09-13T16:10:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.615+0000 7f0076000640 1 -- 172.21.15.86:0/4158503045 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f006c032750 con 0x561c609793b0 2024-09-13T16:10:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.615+0000 7f0076000640 1 -- 172.21.15.86:0/4158503045 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c003850 con 0x561c609793b0 2024-09-13T16:10:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.615+0000 7f008a066740 1 -- 172.21.15.86:0/4158503045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c609793b0 msgr2=0x561c60989c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.615+0000 7f008a066740 1 --2- 172.21.15.86:0/4158503045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c609793b0 0x561c60989c00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f006c031000 tx=0x7f006c02a330 comp rx=0 tx=0).stop 2024-09-13T16:10:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.615+0000 7f008a066740 1 -- 172.21.15.86:0/4158503045 shutdown_connections 2024-09-13T16:10:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.615+0000 7f008a066740 1 --2- 172.21.15.86:0/4158503045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c6097e440 0x561c6097a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.615+0000 7f008a066740 1 --2- 172.21.15.86:0/4158503045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c609793b0 0x561c60989c00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.615+0000 7f008a066740 1 --2- 172.21.15.86:0/4158503045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c60978a70 0x561c6097a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.615+0000 7f008a066740 1 -- 172.21.15.86:0/4158503045 >> 172.21.15.86:0/4158503045 conn(0x561c609740e0 msgr2=0x561c60982760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.615+0000 7f008a066740 1 -- 172.21.15.86:0/4158503045 shutdown_connections 2024-09-13T16:10:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.615+0000 7f008a066740 1 -- 172.21.15.86:0/4158503045 wait complete. 2024-09-13T16:10:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.616+0000 7f008a066740 1 -- start start 2024-09-13T16:10:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.616+0000 7f008a066740 1 Processor -- start 2024-09-13T16:10:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.616+0000 7f008a066740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c60978a70 0x561c60989b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.616+0000 7f008a066740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c609793b0 0x561c609866b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.616+0000 7f008a066740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c6097e440 0x561c60986c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.616+0000 7f008a066740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c609e4840 con 0x561c60978a70 2024-09-13T16:10:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.616+0000 7f008a066740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c609e4980 con 0x561c609793b0 2024-09-13T16:10:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.616+0000 7f008a066740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c609e4ac0 con 0x561c6097e440 2024-09-13T16:10:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.616+0000 7f008a066740 10 client.0 _ll_register_callbacks cb 0x7f0078009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.616+0000 7f0085200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c60978a70 0x561c60989b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.617+0000 7f0085200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c60978a70 0x561c60989b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54796/0 (socket says 172.21.15.86:54796) 2024-09-13T16:10:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.617+0000 7f0085200640 1 -- 172.21.15.86:0/2846216776 learned_addr learned my addr 172.21.15.86:0/2846216776 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:10:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.617+0000 7f007f400640 1 --2- 172.21.15.86:0/2846216776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c609793b0 0x561c609866b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.617+0000 7f0085200640 1 --2- 172.21.15.86:0/2846216776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c6097e440 0x561c60986c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.617+0000 7f0085200640 1 -- 172.21.15.86:0/2846216776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c6097e440 msgr2=0x561c60986c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.617+0000 7f0085200640 1 --2- 172.21.15.86:0/2846216776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c6097e440 0x561c60986c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.617+0000 7f0085200640 1 -- 172.21.15.86:0/2846216776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c609793b0 msgr2=0x561c609866b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.617+0000 7f0085200640 1 --2- 172.21.15.86:0/2846216776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c609793b0 0x561c609866b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.617+0000 7f0085200640 1 -- 172.21.15.86:0/2846216776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561c608da170 con 0x561c60978a70 2024-09-13T16:10:54.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.617+0000 7f0085200640 1 --2- 172.21.15.86:0/2846216776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c60978a70 0x561c60989b70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0078009fd0 tx=0x7f0078005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73227b856d2ec36f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:54.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.617+0000 7f006a000640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T16:10:54.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.617+0000 7f006a000640 1 -- 172.21.15.86:0/2846216776 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007802dea0 con 0x561c60978a70 2024-09-13T16:10:54.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.617+0000 7f008a066740 1 -- 172.21.15.86:0/2846216776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c60905c90 con 0x561c60978a70 2024-09-13T16:10:54.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.617+0000 7f006a000640 1 -- 172.21.15.86:0/2846216776 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f0078003a30 con 0x561c60978a70 2024-09-13T16:10:54.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.618+0000 7f006a000640 1 -- 172.21.15.86:0/2846216776 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0078004cd0 con 0x561c60978a70 2024-09-13T16:10:54.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.618+0000 7f008a066740 10 client.15369 fetch_fsmap learned FSMap version 25 2024-09-13T16:10:54.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.618+0000 7f008a066740 1 -- 172.21.15.86:0/2846216776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x561c608a1560 con 0x561c60978a70 2024-09-13T16:10:54.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.618+0000 7f006a000640 1 -- 172.21.15.86:0/2846216776 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x561c60905c90 con 0x561c60978a70 2024-09-13T16:10:54.625 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.618+0000 7f006a000640 1 -- 172.21.15.86:0/2846216776 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0078021040 con 0x561c60978a70 2024-09-13T16:10:54.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.618+0000 7f008a066740 10 client.15369 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:10:54.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.618+0000 7f008a066740 10 client.15369 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:10:54.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.618+0000 7f008a066740 20 client.15369 populate_metadata read hostname 'smithi086' 2024-09-13T16:10:54.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.618+0000 7f008a066740 1 --2- 172.21.15.86:0/2846216776 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x561c609e6350 0x561c609e8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:54.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.618+0000 7f008a066740 4 client.15369 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:10:54.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.618+0000 7f008a066740 1 -- 172.21.15.86:0/2846216776 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561c605e0600 con 0x561c609e6350 2024-09-13T16:10:54.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.618+0000 7f007f400640 1 --2- 172.21.15.86:0/2846216776 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x561c609e6350 0x561c609e8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:54.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.619+0000 7f007f400640 1 --2- 172.21.15.86:0/2846216776 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x561c609e6350 0x561c609e8770 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f12dc41822b8dbc server_cookie=e263447a3cc0355 in_seq=0 out_seq=0 2024-09-13T16:10:54.626 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.619+0000 7f006a000640 10 client.15369 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:10:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.631+0000 7f006a000640 1 -- 172.21.15.86:0/2846216776 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561c605e0600 con 0x561c609e6350 2024-09-13T16:10:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.631+0000 7f006a000640 10 client.15369 handle_command_reply: tid=0 2024-09-13T16:10:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.631+0000 7f008a066740 1 client.15369 shutdown 2024-09-13T16:10:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.631+0000 7f008a066740 1 -- 172.21.15.86:0/2846216776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c60978a70 msgr2=0x561c60989b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.631+0000 7f008a066740 1 --2- 172.21.15.86:0/2846216776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c60978a70 0x561c60989b70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0078009fd0 tx=0x7f0078005fd0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.631+0000 7f008a066740 1 -- 172.21.15.86:0/2846216776 shutdown_connections 2024-09-13T16:10:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.631+0000 7f008a066740 1 --2- 172.21.15.86:0/2846216776 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x561c609e6350 0x561c609e8770 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.631+0000 7f008a066740 1 --2- 172.21.15.86:0/2846216776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c6097e440 0x561c60986c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.631+0000 7f008a066740 1 --2- 172.21.15.86:0/2846216776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c609793b0 0x561c609866b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.631+0000 7f008a066740 1 --2- 172.21.15.86:0/2846216776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c60978a70 0x561c60989b70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.631+0000 7f006a000640 0 client.15369 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:10:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.631+0000 7f008a066740 1 -- 172.21.15.86:0/2846216776 >> 172.21.15.86:0/2846216776 conn(0x561c609740e0 msgr2=0x561c60982700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.632+0000 7f008a066740 1 -- 172.21.15.86:0/2846216776 shutdown_connections 2024-09-13T16:10:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.632+0000 7f008a066740 1 -- 172.21.15.86:0/2846216776 wait complete. 2024-09-13T16:10:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.632+0000 7f008a066740 20 client.15369 trim_cache size 0 max 16384 2024-09-13T16:10:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-09-13T16:10:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-09-13T16:10:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-09-13T16:10:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-09-13T16:10:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.632+0000 7f0087200640 1 -- 172.21.15.86:0/642934978 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f00640a1120 msgr2=0x7f00640a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.632+0000 7f0087200640 1 --2- 172.21.15.86:0/642934978 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f00640a1120 0x7f00640a35e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0070099eb0 tx=0x7f00700d0b90 comp rx=0 tx=0).stop 2024-09-13T16:10:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.632+0000 7f0087200640 1 -- 172.21.15.86:0/642934978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0080101f20 msgr2=0x7f008019c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.632+0000 7f0087200640 1 --2- 172.21.15.86:0/642934978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0080101f20 0x7f008019c470 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f007000e9c0 tx=0x7f007000ee80 comp rx=0 tx=0).stop 2024-09-13T16:10:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.632+0000 7f0087200640 1 -- 172.21.15.86:0/642934978 shutdown_connections 2024-09-13T16:10:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.632+0000 7f0087200640 1 --2- 172.21.15.86:0/642934978 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f00640a1120 0x7f00640a35e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.632+0000 7f0087200640 1 --2- 172.21.15.86:0/642934978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0080103a30 0x7f00801a3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.632+0000 7f0087200640 1 --2- 172.21.15.86:0/642934978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0080103070 0x7f008019c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.632+0000 7f0087200640 1 --2- 172.21.15.86:0/642934978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0080101f20 0x7f008019c470 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.632+0000 7f0087200640 1 -- 172.21.15.86:0/642934978 >> 172.21.15.86:0/642934978 conn(0x7f00800fd680 msgr2=0x7f0080076900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.633+0000 7f0087200640 1 -- 172.21.15.86:0/642934978 shutdown_connections 2024-09-13T16:10:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:10:54.633+0000 7f0087200640 1 -- 172.21.15.86:0/642934978 wait complete. 2024-09-13T16:10:54.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:54 smithi139 ceph-mon[35320]: pgmap v381: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-13T16:10:54.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:54 smithi194 ceph-mon[35694]: pgmap v381: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-13T16:10:54.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:54 smithi086 ceph-mon[30379]: pgmap v381: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-13T16:10:56.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:56 smithi139 ceph-mon[35320]: pgmap v382: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-13T16:10:56.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:56 smithi194 ceph-mon[35694]: pgmap v382: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-13T16:10:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:56 smithi086 ceph-mon[30379]: pgmap v382: 129 pgs: 129 active+clean; 657 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-13T16:10:58.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:10:58 smithi139 ceph-mon[35320]: pgmap v383: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-09-13T16:10:58.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:10:58 smithi194 ceph-mon[35694]: pgmap v383: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-09-13T16:10:58.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:10:58 smithi086 ceph-mon[30379]: pgmap v383: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-09-13T16:11:00.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:00 smithi139 ceph-mon[35320]: pgmap v384: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-09-13T16:11:00.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:00 smithi194 ceph-mon[35694]: pgmap v384: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-09-13T16:11:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:00 smithi086 ceph-mon[30379]: pgmap v384: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-09-13T16:11:02.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:02 smithi139 ceph-mon[35320]: pgmap v385: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-09-13T16:11:02.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:02 smithi194 ceph-mon[35694]: pgmap v385: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-09-13T16:11:02.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:02 smithi086 ceph-mon[30379]: pgmap v385: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-09-13T16:11:04.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:04 smithi139 ceph-mon[35320]: pgmap v386: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-13T16:11:04.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:04 smithi194 ceph-mon[35694]: pgmap v386: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-13T16:11:04.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:04 smithi086 ceph-mon[30379]: pgmap v386: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-13T16:11:06.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:06 smithi139 ceph-mon[35320]: pgmap v387: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-13T16:11:06.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:06 smithi194 ceph-mon[35694]: pgmap v387: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-13T16:11:06.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:06 smithi086 ceph-mon[30379]: pgmap v387: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-13T16:11:07.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.748+0000 7fb552200640 1 -- 172.21.15.86:0/1005336262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb54c100790 msgr2=0x7fb54c102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:07.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.748+0000 7fb552200640 1 --2- 172.21.15.86:0/1005336262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb54c100790 0x7fb54c102b80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb53c009900 tx=0x7fb53c02a410 comp rx=0 tx=0).stop 2024-09-13T16:11:07.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.748+0000 7fb552200640 1 -- 172.21.15.86:0/1005336262 shutdown_connections 2024-09-13T16:11:07.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.748+0000 7fb552200640 1 --2- 172.21.15.86:0/1005336262 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb54c1059f0 0x7fb54c107e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.748+0000 7fb552200640 1 --2- 172.21.15.86:0/1005336262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb54c1030c0 0x7fb54c1054b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.750 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.748+0000 7fb552200640 1 --2- 172.21.15.86:0/1005336262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb54c100790 0x7fb54c102b80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.748+0000 7fb552200640 1 -- 172.21.15.86:0/1005336262 >> 172.21.15.86:0/1005336262 conn(0x7fb54c0fa370 msgr2=0x7fb54c0fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.748+0000 7fb552200640 1 -- 172.21.15.86:0/1005336262 shutdown_connections 2024-09-13T16:11:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.748+0000 7fb552200640 1 -- 172.21.15.86:0/1005336262 wait complete. 2024-09-13T16:11:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.749+0000 7fb552200640 1 Processor -- start 2024-09-13T16:11:07.752 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.749+0000 7fb552200640 1 -- start start 2024-09-13T16:11:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.749+0000 7fb552200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb54c100790 0x7fb54c100100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.749+0000 7fb552200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb54c1030c0 0x7fb54c0fe740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.749+0000 7fb552200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb54c1059f0 0x7fb54c0fec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.749+0000 7fb552200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0ff3e0 con 0x7fb54c100790 2024-09-13T16:11:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.749+0000 7fb552200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0ff550 con 0x7fb54c1030c0 2024-09-13T16:11:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.749+0000 7fb552200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c19fed0 con 0x7fb54c1059f0 2024-09-13T16:11:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.749+0000 7fb54b400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb54c100790 0x7fb54c100100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.749+0000 7fb54b400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb54c100790 0x7fb54c100100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47392/0 (socket says 172.21.15.86:47392) 2024-09-13T16:11:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.749+0000 7fb54b400640 1 -- 172.21.15.86:0/3022057147 learned_addr learned my addr 172.21.15.86:0/3022057147 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.750+0000 7fb54aa00640 1 --2- 172.21.15.86:0/3022057147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb54c1030c0 0x7fb54c0fe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.750+0000 7fb54be00640 1 --2- 172.21.15.86:0/3022057147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb54c1059f0 0x7fb54c0fec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.750+0000 7fb54b400640 1 -- 172.21.15.86:0/3022057147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb54c1059f0 msgr2=0x7fb54c0fec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.750+0000 7fb54b400640 1 --2- 172.21.15.86:0/3022057147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb54c1059f0 0x7fb54c0fec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.750+0000 7fb54b400640 1 -- 172.21.15.86:0/3022057147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb54c1030c0 msgr2=0x7fb54c0fe740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.750+0000 7fb54b400640 1 --2- 172.21.15.86:0/3022057147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb54c1030c0 0x7fb54c0fe740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.750+0000 7fb54b400640 1 -- 172.21.15.86:0/3022057147 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c009560 con 0x7fb54c100790 2024-09-13T16:11:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.750+0000 7fb54b400640 1 --2- 172.21.15.86:0/3022057147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb54c100790 0x7fb54c100100 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb53c005ab0 tx=0x7fb53c005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.750+0000 7fb543e00640 1 -- 172.21.15.86:0/3022057147 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c004c50 con 0x7fb54c100790 2024-09-13T16:11:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.751+0000 7fb543e00640 1 -- 172.21.15.86:0/3022057147 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb53c004db0 con 0x7fb54c100790 2024-09-13T16:11:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.751+0000 7fb552200640 1 -- 172.21.15.86:0/3022057147 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c1a0120 con 0x7fb54c100790 2024-09-13T16:11:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.751+0000 7fb543e00640 1 -- 172.21.15.86:0/3022057147 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c003d30 con 0x7fb54c100790 2024-09-13T16:11:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.751+0000 7fb552200640 1 -- 172.21.15.86:0/3022057147 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c1a05d0 con 0x7fb54c100790 2024-09-13T16:11:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.754+0000 7fb55505c740 1 Processor -- start 2024-09-13T16:11:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.754+0000 7fb55505c740 1 -- start start 2024-09-13T16:11:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.754+0000 7fb55505c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d173a70 0x55656d173e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.754+0000 7fb55505c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d1743b0 0x55656d178e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.754+0000 7fb55505c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d179440 0x55656d17b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.754+0000 7fb55505c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656d07fbb0 con 0x55656d173a70 2024-09-13T16:11:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.754+0000 7fb55505c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656d0dda70 con 0x55656d179440 2024-09-13T16:11:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.754+0000 7fb55505c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656d0db200 con 0x55656d1743b0 2024-09-13T16:11:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.754+0000 7fb54be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d173a70 0x55656d173e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.754+0000 7fb54be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d173a70 0x55656d173e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47394/0 (socket says 172.21.15.86:47394) 2024-09-13T16:11:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.754+0000 7fb54be00640 1 -- 172.21.15.86:0/3068462225 learned_addr learned my addr 172.21.15.86:0/3068462225 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.755+0000 7fb54aa00640 1 --2- 172.21.15.86:0/3068462225 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d179440 0x55656d17b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.755+0000 7fb54be00640 1 -- 172.21.15.86:0/3068462225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d1743b0 msgr2=0x55656d178e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:11:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.755+0000 7fb54be00640 1 --2- 172.21.15.86:0/3068462225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d1743b0 0x55656d178e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.755+0000 7fb54be00640 1 -- 172.21.15.86:0/3068462225 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d179440 msgr2=0x55656d17b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.755+0000 7fb54be00640 1 --2- 172.21.15.86:0/3068462225 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d179440 0x55656d17b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.755+0000 7fb54be00640 1 -- 172.21.15.86:0/3068462225 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55656d078940 con 0x55656d173a70 2024-09-13T16:11:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.755+0000 7fb543e00640 1 -- 172.21.15.86:0/3022057147 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb53c0315b0 con 0x7fb54c100790 2024-09-13T16:11:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.755+0000 7fb54be00640 1 --2- 172.21.15.86:0/3068462225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d173a70 0x55656d173e70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb544009f90 tx=0x7fb5440118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c406154046a53e0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.755+0000 7fb540c00640 1 -- 172.21.15.86:0/3068462225 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544004b20 con 0x55656d173a70 2024-09-13T16:11:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.755+0000 7fb540c00640 1 -- 172.21.15.86:0/3068462225 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb544004c80 con 0x55656d173a70 2024-09-13T16:11:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.755+0000 7fb540c00640 1 -- 172.21.15.86:0/3068462225 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544005020 con 0x55656d173a70 2024-09-13T16:11:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.756+0000 7fb55505c740 1 -- 172.21.15.86:0/3068462225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d173a70 msgr2=0x55656d173e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.756+0000 7fb55505c740 1 --2- 172.21.15.86:0/3068462225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d173a70 0x55656d173e70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb544009f90 tx=0x7fb5440118d0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.756+0000 7fb55505c740 1 -- 172.21.15.86:0/3068462225 shutdown_connections 2024-09-13T16:11:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.756+0000 7fb55505c740 1 --2- 172.21.15.86:0/3068462225 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d179440 0x55656d17b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.756+0000 7fb55505c740 1 --2- 172.21.15.86:0/3068462225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d1743b0 0x55656d178e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.756+0000 7fb55505c740 1 --2- 172.21.15.86:0/3068462225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d173a70 0x55656d173e70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.756+0000 7fb55505c740 1 -- 172.21.15.86:0/3068462225 >> 172.21.15.86:0/3068462225 conn(0x55656d16f0e0 msgr2=0x55656d16f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.756+0000 7fb55505c740 1 -- 172.21.15.86:0/3068462225 shutdown_connections 2024-09-13T16:11:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.756+0000 7fb55505c740 1 -- 172.21.15.86:0/3068462225 wait complete. 2024-09-13T16:11:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.757+0000 7fb543e00640 1 --2- 172.21.15.86:0/3022057147 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb5300a1030 0x7fb5300a34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.757+0000 7fb55505c740 1 -- start start 2024-09-13T16:11:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.757+0000 7fb543e00640 1 -- 172.21.15.86:0/3022057147 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fb53c0edd30 con 0x7fb54c100790 2024-09-13T16:11:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.757+0000 7fb54be00640 1 --2- 172.21.15.86:0/3022057147 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb5300a1030 0x7fb5300a34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.757+0000 7fb55505c740 1 Processor -- start 2024-09-13T16:11:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.757+0000 7fb55505c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d173a70 0x55656d17d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.757+0000 7fb55505c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d1743b0 0x55656d17dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.757+0000 7fb55505c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d179440 0x55656d184cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.757+0000 7fb55505c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656d0d6af0 con 0x55656d1743b0 2024-09-13T16:11:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.757+0000 7fb55505c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656d094f20 con 0x55656d173a70 2024-09-13T16:11:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.757+0000 7fb55505c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656d094bc0 con 0x55656d179440 2024-09-13T16:11:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.758+0000 7fb55505c740 10 client.0 _ll_register_callbacks cb 0x55656d0c6a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:11:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.758+0000 7fb54aa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d1743b0 0x55656d17dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.758+0000 7fb54be00640 1 --2- 172.21.15.86:0/3022057147 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb5300a1030 0x7fb5300a34f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb544011dd0 tx=0x7fb544005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.758+0000 7fb54aa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d1743b0 0x55656d17dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47402/0 (socket says 172.21.15.86:47402) 2024-09-13T16:11:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.758+0000 7fb54aa00640 1 -- 172.21.15.86:0/1839123038 learned_addr learned my addr 172.21.15.86:0/1839123038 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.758+0000 7fb54b400640 1 --2- 172.21.15.86:0/1839123038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d173a70 0x55656d17d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.758+0000 7fb54be00640 1 --2- 172.21.15.86:0/1839123038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d179440 0x55656d184cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.758+0000 7fb54aa00640 1 -- 172.21.15.86:0/1839123038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d179440 msgr2=0x55656d184cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.758+0000 7fb54aa00640 1 --2- 172.21.15.86:0/1839123038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d179440 0x55656d184cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.758+0000 7fb54aa00640 1 -- 172.21.15.86:0/1839123038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d173a70 msgr2=0x55656d17d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.758+0000 7fb54aa00640 1 --2- 172.21.15.86:0/1839123038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d173a70 0x55656d17d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.758+0000 7fb54aa00640 1 -- 172.21.15.86:0/1839123038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb544009c40 con 0x55656d1743b0 2024-09-13T16:11:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.759+0000 7fb54aa00640 1 --2- 172.21.15.86:0/1839123038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d1743b0 0x55656d17dcb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb53800b920 tx=0x7fb53800bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673e46d536412ab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.759+0000 7fb535600640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T16:11:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.759+0000 7fb535600640 1 -- 172.21.15.86:0/1839123038 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53801b440 con 0x55656d1743b0 2024-09-13T16:11:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.759+0000 7fb55505c740 1 -- 172.21.15.86:0/1839123038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55656d100c90 con 0x55656d1743b0 2024-09-13T16:11:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.759+0000 7fb535600640 1 -- 172.21.15.86:0/1839123038 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fb53801b5a0 con 0x55656d1743b0 2024-09-13T16:11:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.759+0000 7fb535600640 1 -- 172.21.15.86:0/1839123038 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb53801b7a0 con 0x55656d1743b0 2024-09-13T16:11:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.759+0000 7fb55505c740 10 client.15381 fetch_fsmap learned FSMap version 25 2024-09-13T16:11:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.759+0000 7fb55505c740 1 -- 172.21.15.86:0/1839123038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55656d0d5170 con 0x55656d1743b0 2024-09-13T16:11:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.759+0000 7fb535600640 1 -- 172.21.15.86:0/1839123038 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55656d100c90 con 0x55656d1743b0 2024-09-13T16:11:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.760+0000 7fb535600640 1 -- 172.21.15.86:0/1839123038 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb538011b30 con 0x55656d1743b0 2024-09-13T16:11:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.760+0000 7fb55505c740 10 client.15381 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:11:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.760+0000 7fb55505c740 10 client.15381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:11:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.760+0000 7fb55505c740 20 client.15381 populate_metadata read hostname 'smithi086' 2024-09-13T16:11:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.760+0000 7fb55505c740 1 --2- 172.21.15.86:0/1839123038 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55656d189390 0x55656d18b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.760+0000 7fb55505c740 4 client.15381 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:11:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.760+0000 7fb55505c740 1 -- 172.21.15.86:0/1839123038 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55656d0c97d0 con 0x55656d189390 2024-09-13T16:11:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.760+0000 7fb54b400640 1 --2- 172.21.15.86:0/1839123038 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55656d189390 0x55656d18b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.761+0000 7fb54b400640 1 --2- 172.21.15.86:0/1839123038 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55656d189390 0x55656d18b7b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=223dd8db0bd966ba server_cookie=d3aba5f1858bf5eb in_seq=0 out_seq=0 2024-09-13T16:11:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.761+0000 7fb535600640 10 client.15381 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:11:07.767 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.761+0000 7fb535600640 1 -- 172.21.15.86:0/1839123038 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55656d0c97d0 con 0x55656d189390 2024-09-13T16:11:07.768 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.761+0000 7fb535600640 10 client.15381 handle_command_reply: tid=0 2024-09-13T16:11:07.768 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.761+0000 7fb55505c740 1 client.15381 shutdown 2024-09-13T16:11:07.768 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.762+0000 7fb55505c740 1 -- 172.21.15.86:0/1839123038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d1743b0 msgr2=0x55656d17dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:07.768 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.762+0000 7fb55505c740 1 --2- 172.21.15.86:0/1839123038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d1743b0 0x55656d17dcb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb53800b920 tx=0x7fb53800bd20 comp rx=0 tx=0).stop 2024-09-13T16:11:07.768 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.762+0000 7fb55505c740 1 -- 172.21.15.86:0/1839123038 shutdown_connections 2024-09-13T16:11:07.768 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.762+0000 7fb55505c740 1 --2- 172.21.15.86:0/1839123038 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55656d189390 0x55656d18b7b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.768 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.762+0000 7fb55505c740 1 --2- 172.21.15.86:0/1839123038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d179440 0x55656d184cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.768 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.762+0000 7fb55505c740 1 --2- 172.21.15.86:0/1839123038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d1743b0 0x55656d17dcb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.768 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.762+0000 7fb535600640 0 client.15381 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:11:07.768 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.762+0000 7fb55505c740 1 --2- 172.21.15.86:0/1839123038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d173a70 0x55656d17d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.768 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.762+0000 7fb55505c740 1 -- 172.21.15.86:0/1839123038 >> 172.21.15.86:0/1839123038 conn(0x55656d16f0e0 msgr2=0x55656d1708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.762+0000 7fb55505c740 1 -- 172.21.15.86:0/1839123038 shutdown_connections 2024-09-13T16:11:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.762+0000 7fb55505c740 1 -- 172.21.15.86:0/1839123038 wait complete. 2024-09-13T16:11:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.762+0000 7fb55505c740 20 client.15381 trim_cache size 0 max 16384 2024-09-13T16:11:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.775+0000 7fb55505c740 1 Processor -- start 2024-09-13T16:11:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.775+0000 7fb55505c740 1 -- start start 2024-09-13T16:11:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.775+0000 7fb55505c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d173a70 0x55656d16ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.775+0000 7fb55505c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d1743b0 0x55656d184cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.775+0000 7fb55505c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d179440 0x55656d175310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.775+0000 7fb55505c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656ce3de60 con 0x55656d173a70 2024-09-13T16:11:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.775+0000 7fb55505c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656d174890 con 0x55656d179440 2024-09-13T16:11:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.775+0000 7fb55505c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656d185e50 con 0x55656d1743b0 2024-09-13T16:11:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.776+0000 7fb54be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d179440 0x55656d175310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.776+0000 7fb54b400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d173a70 0x55656d16ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.776+0000 7fb54be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d179440 0x55656d175310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:54502/0 (socket says 172.21.15.86:54502) 2024-09-13T16:11:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.776+0000 7fb54be00640 1 -- 172.21.15.86:0/275404302 learned_addr learned my addr 172.21.15.86:0/275404302 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.776+0000 7fb54aa00640 1 --2- 172.21.15.86:0/275404302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d1743b0 0x55656d184cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.776+0000 7fb54be00640 1 -- 172.21.15.86:0/275404302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d1743b0 msgr2=0x55656d184cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.776+0000 7fb54be00640 1 --2- 172.21.15.86:0/275404302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d1743b0 0x55656d184cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.776+0000 7fb54be00640 1 -- 172.21.15.86:0/275404302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d173a70 msgr2=0x55656d16ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.776+0000 7fb54be00640 1 --2- 172.21.15.86:0/275404302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d173a70 0x55656d16ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.779 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.776+0000 7fb54be00640 1 -- 172.21.15.86:0/275404302 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55656d077180 con 0x55656d179440 2024-09-13T16:11:07.779 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.776+0000 7fb54b400640 1 --2- 172.21.15.86:0/275404302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d173a70 0x55656d16ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:11:07.780 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.776+0000 7fb54be00640 1 --2- 172.21.15.86:0/275404302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d179440 0x55656d175310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb544009f90 tx=0x7fb544009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf26be413491a6c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:07.780 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.777+0000 7fb541600640 1 -- 172.21.15.86:0/275404302 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54400f660 con 0x55656d179440 2024-09-13T16:11:07.780 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.777+0000 7fb541600640 1 -- 172.21.15.86:0/275404302 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb54400fca0 con 0x55656d179440 2024-09-13T16:11:07.780 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.777+0000 7fb541600640 1 -- 172.21.15.86:0/275404302 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544031d20 con 0x55656d179440 2024-09-13T16:11:07.780 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.778+0000 7fb55505c740 1 -- 172.21.15.86:0/275404302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d179440 msgr2=0x55656d175310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:07.780 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.778+0000 7fb55505c740 1 --2- 172.21.15.86:0/275404302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d179440 0x55656d175310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb544009f90 tx=0x7fb544009500 comp rx=0 tx=0).stop 2024-09-13T16:11:07.781 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.778+0000 7fb55505c740 1 -- 172.21.15.86:0/275404302 shutdown_connections 2024-09-13T16:11:07.781 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.778+0000 7fb55505c740 1 --2- 172.21.15.86:0/275404302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d179440 0x55656d175310 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.781 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.778+0000 7fb55505c740 1 --2- 172.21.15.86:0/275404302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d1743b0 0x55656d184cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.781 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.778+0000 7fb55505c740 1 --2- 172.21.15.86:0/275404302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d173a70 0x55656d16ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.781 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.778+0000 7fb55505c740 1 -- 172.21.15.86:0/275404302 >> 172.21.15.86:0/275404302 conn(0x55656d16f0e0 msgr2=0x55656d17d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:07.781 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.778+0000 7fb55505c740 1 -- 172.21.15.86:0/275404302 shutdown_connections 2024-09-13T16:11:07.781 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.778+0000 7fb55505c740 1 -- 172.21.15.86:0/275404302 wait complete. 2024-09-13T16:11:07.781 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.778+0000 7fb55505c740 1 -- start start 2024-09-13T16:11:07.781 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.779+0000 7fb55505c740 1 Processor -- start 2024-09-13T16:11:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.779+0000 7fb55505c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d173a70 0x55656d1846f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.779+0000 7fb55505c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d1743b0 0x55656d184c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.779+0000 7fb55505c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d179440 0x55656d182d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.779+0000 7fb55505c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656d1834d0 con 0x55656d179440 2024-09-13T16:11:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.779+0000 7fb55505c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656d183640 con 0x55656d1743b0 2024-09-13T16:11:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.779+0000 7fb55505c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656d183800 con 0x55656d173a70 2024-09-13T16:11:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.779+0000 7fb55505c740 10 client.0 _ll_register_callbacks cb 0x7fb544009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:11:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.779+0000 7fb54be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d179440 0x55656d182d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.780+0000 7fb54aa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d1743b0 0x55656d184c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.780+0000 7fb54be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d179440 0x55656d182d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:47414/0 (socket says 172.21.15.86:47414) 2024-09-13T16:11:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.780+0000 7fb54b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d173a70 0x55656d1846f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.780+0000 7fb54be00640 1 -- 172.21.15.86:0/1649554620 learned_addr learned my addr 172.21.15.86:0/1649554620 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.780+0000 7fb54be00640 1 -- 172.21.15.86:0/1649554620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d173a70 msgr2=0x55656d1846f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.780+0000 7fb54be00640 1 --2- 172.21.15.86:0/1649554620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d173a70 0x55656d1846f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.780+0000 7fb54be00640 1 -- 172.21.15.86:0/1649554620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d1743b0 msgr2=0x55656d184c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.780+0000 7fb54be00640 1 --2- 172.21.15.86:0/1649554620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d1743b0 0x55656d184c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.780+0000 7fb54be00640 1 -- 172.21.15.86:0/1649554620 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c1a05d0 con 0x55656d179440 2024-09-13T16:11:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.780+0000 7fb54be00640 1 --2- 172.21.15.86:0/1649554620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d179440 0x55656d182d80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb544005c10 tx=0x7fb544004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4bd42f59810c94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.780+0000 7fb535600640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T16:11:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.780+0000 7fb535600640 1 -- 172.21.15.86:0/1649554620 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54400f9f0 con 0x55656d179440 2024-09-13T16:11:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.780+0000 7fb535600640 1 -- 172.21.15.86:0/1649554620 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fb54402a040 con 0x55656d179440 2024-09-13T16:11:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.780+0000 7fb55505c740 1 -- 172.21.15.86:0/1649554620 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb544004c80 con 0x55656d179440 2024-09-13T16:11:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.781+0000 7fb535600640 1 -- 172.21.15.86:0/1649554620 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb544031a60 con 0x55656d179440 2024-09-13T16:11:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.781+0000 7fb55505c740 10 client.15387 fetch_fsmap learned FSMap version 25 2024-09-13T16:11:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.781+0000 7fb55505c740 1 -- 172.21.15.86:0/1649554620 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55656d078940 con 0x55656d179440 2024-09-13T16:11:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.781+0000 7fb535600640 1 -- 172.21.15.86:0/1649554620 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb544004c80 con 0x55656d179440 2024-09-13T16:11:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.781+0000 7fb535600640 1 -- 172.21.15.86:0/1649554620 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb544021040 con 0x55656d179440 2024-09-13T16:11:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.781+0000 7fb55505c740 10 client.15387 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:11:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.781+0000 7fb55505c740 10 client.15387 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:11:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.781+0000 7fb55505c740 20 client.15387 populate_metadata read hostname 'smithi086' 2024-09-13T16:11:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.781+0000 7fb55505c740 1 --2- 172.21.15.86:0/1649554620 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55656d1e0910 0x55656d1e2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.781+0000 7fb55505c740 4 client.15387 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:11:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.781+0000 7fb55505c740 1 -- 172.21.15.86:0/1649554620 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55656cdca300 con 0x55656d1e0910 2024-09-13T16:11:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.782+0000 7fb54b400640 1 --2- 172.21.15.86:0/1649554620 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55656d1e0910 0x55656d1e2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.782+0000 7fb54b400640 1 --2- 172.21.15.86:0/1649554620 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55656d1e0910 0x55656d1e2d00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a916c15105830f0c server_cookie=f32745a1e1ffd261 in_seq=0 out_seq=0 2024-09-13T16:11:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.782+0000 7fb535600640 10 client.15387 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:11:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.788+0000 7fb535600640 1 -- 172.21.15.86:0/1649554620 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55656cdca300 con 0x55656d1e0910 2024-09-13T16:11:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.788+0000 7fb535600640 10 client.15387 handle_command_reply: tid=0 2024-09-13T16:11:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.788+0000 7fb55505c740 1 client.15387 shutdown 2024-09-13T16:11:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.788+0000 7fb55505c740 1 -- 172.21.15.86:0/1649554620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d179440 msgr2=0x55656d182d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.788+0000 7fb55505c740 1 --2- 172.21.15.86:0/1649554620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d179440 0x55656d182d80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb544005c10 tx=0x7fb544004490 comp rx=0 tx=0).stop 2024-09-13T16:11:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.789+0000 7fb55505c740 1 -- 172.21.15.86:0/1649554620 shutdown_connections 2024-09-13T16:11:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.789+0000 7fb55505c740 1 --2- 172.21.15.86:0/1649554620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55656d179440 0x55656d182d80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.789+0000 7fb55505c740 1 --2- 172.21.15.86:0/1649554620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55656d1743b0 0x55656d184c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.789+0000 7fb55505c740 1 --2- 172.21.15.86:0/1649554620 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55656d1e0910 0x55656d1e2d00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.789+0000 7fb55505c740 1 --2- 172.21.15.86:0/1649554620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656d173a70 0x55656d1846f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.789+0000 7fb55505c740 1 -- 172.21.15.86:0/1649554620 >> 172.21.15.86:0/1649554620 conn(0x55656d16f0e0 msgr2=0x55656d175310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.789+0000 7fb535600640 0 client.15387 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:11:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.789+0000 7fb55505c740 1 -- 172.21.15.86:0/1649554620 shutdown_connections 2024-09-13T16:11:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.789+0000 7fb55505c740 1 -- 172.21.15.86:0/1649554620 wait complete. 2024-09-13T16:11:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.789+0000 7fb55505c740 20 client.15387 trim_cache size 0 max 16384 2024-09-13T16:11:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-09-13T16:11:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-09-13T16:11:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-09-13T16:11:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-09-13T16:11:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.790+0000 7fb552200640 1 -- 172.21.15.86:0/3022057147 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb5300a1030 msgr2=0x7fb5300a34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.790+0000 7fb552200640 1 --2- 172.21.15.86:0/3022057147 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb5300a1030 0x7fb5300a34f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb544011dd0 tx=0x7fb544005fd0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.790+0000 7fb552200640 1 -- 172.21.15.86:0/3022057147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb54c100790 msgr2=0x7fb54c100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.790+0000 7fb552200640 1 --2- 172.21.15.86:0/3022057147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb54c100790 0x7fb54c100100 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb53c005ab0 tx=0x7fb53c005690 comp rx=0 tx=0).stop 2024-09-13T16:11:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.790+0000 7fb552200640 1 -- 172.21.15.86:0/3022057147 shutdown_connections 2024-09-13T16:11:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.790+0000 7fb552200640 1 --2- 172.21.15.86:0/3022057147 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb5300a1030 0x7fb5300a34f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.790+0000 7fb552200640 1 --2- 172.21.15.86:0/3022057147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb54c1059f0 0x7fb54c0fec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.790+0000 7fb552200640 1 --2- 172.21.15.86:0/3022057147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb54c1030c0 0x7fb54c0fe740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.790+0000 7fb552200640 1 --2- 172.21.15.86:0/3022057147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb54c100790 0x7fb54c100100 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:07.794 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.790+0000 7fb552200640 1 -- 172.21.15.86:0/3022057147 >> 172.21.15.86:0/3022057147 conn(0x7fb54c0fa370 msgr2=0x7fb54c101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:07.794 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.790+0000 7fb552200640 1 -- 172.21.15.86:0/3022057147 shutdown_connections 2024-09-13T16:11:07.794 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:07.790+0000 7fb552200640 1 -- 172.21.15.86:0/3022057147 wait complete. 2024-09-13T16:11:08.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:08 smithi139 ceph-mon[35320]: pgmap v388: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-13T16:11:08.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:08 smithi194 ceph-mon[35694]: pgmap v388: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-13T16:11:08.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:08 smithi086 ceph-mon[30379]: pgmap v388: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-13T16:11:10.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:10 smithi139 ceph-mon[35320]: pgmap v389: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-13T16:11:10.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:10 smithi194 ceph-mon[35694]: pgmap v389: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-13T16:11:10.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:10 smithi086 ceph-mon[30379]: pgmap v389: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-13T16:11:12.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:12 smithi139 ceph-mon[35320]: pgmap v390: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-13T16:11:12.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:12 smithi194 ceph-mon[35694]: pgmap v390: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-13T16:11:12.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:12 smithi086 ceph-mon[30379]: pgmap v390: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-13T16:11:14.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:14 smithi139 ceph-mon[35320]: pgmap v391: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-13T16:11:14.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:14 smithi194 ceph-mon[35694]: pgmap v391: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-13T16:11:14.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:14 smithi086 ceph-mon[30379]: pgmap v391: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-13T16:11:16.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:16 smithi139 ceph-mon[35320]: pgmap v392: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-13T16:11:16.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:16 smithi194 ceph-mon[35694]: pgmap v392: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-13T16:11:16.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:16 smithi086 ceph-mon[30379]: pgmap v392: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-13T16:11:18.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:18 smithi139 ceph-mon[35320]: pgmap v393: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-13T16:11:18.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:18 smithi194 ceph-mon[35694]: pgmap v393: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-13T16:11:18.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:18 smithi086 ceph-mon[30379]: pgmap v393: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-13T16:11:20.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:20 smithi139 ceph-mon[35320]: pgmap v394: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-13T16:11:20.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:20 smithi194 ceph-mon[35694]: pgmap v394: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-13T16:11:20.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:20 smithi086 ceph-mon[30379]: pgmap v394: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-13T16:11:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.918+0000 7f0827200640 1 -- 172.21.15.86:0/298474330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08280ffb50 msgr2=0x7f08280fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.918+0000 7f0827200640 1 --2- 172.21.15.86:0/298474330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08280ffb50 0x7f08280fff50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0818009900 tx=0x7f081802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.918+0000 7f0827200640 1 -- 172.21.15.86:0/298474330 shutdown_connections 2024-09-13T16:11:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.918+0000 7f0827200640 1 --2- 172.21.15.86:0/298474330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0828101700 0x7f0828107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.918+0000 7f0827200640 1 --2- 172.21.15.86:0/298474330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0828100d40 0x7f08281011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.918+0000 7f0827200640 1 --2- 172.21.15.86:0/298474330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08280ffb50 0x7f08280fff50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.918+0000 7f0827200640 1 -- 172.21.15.86:0/298474330 >> 172.21.15.86:0/298474330 conn(0x7f08280fb2f0 msgr2=0x7f08280fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.918+0000 7f0827200640 1 -- 172.21.15.86:0/298474330 shutdown_connections 2024-09-13T16:11:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.920+0000 7f0827200640 1 -- 172.21.15.86:0/298474330 wait complete. 2024-09-13T16:11:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.920+0000 7f0827200640 1 Processor -- start 2024-09-13T16:11:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.920+0000 7f0827200640 1 -- start start 2024-09-13T16:11:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.920+0000 7f0827200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08280ffb50 0x7f0828197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.920+0000 7f0827200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0828100d40 0x7f0828198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.922+0000 7f0827200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0828101700 0x7f082819f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.922+0000 7f0827200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082819f8e0 con 0x7f0828100d40 2024-09-13T16:11:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.922+0000 7f0827200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082819fa50 con 0x7f0828101700 2024-09-13T16:11:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.922+0000 7f0827200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082819fc10 con 0x7f08280ffb50 2024-09-13T16:11:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.922+0000 7f0825e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08280ffb50 0x7f0828197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.922+0000 7f0825e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08280ffb50 0x7f0828197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:53950/0 (socket says 172.21.15.86:53950) 2024-09-13T16:11:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.922+0000 7f0825e00640 1 -- 172.21.15.86:0/3812612471 learned_addr learned my addr 172.21.15.86:0/3812612471 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.922+0000 7f0825400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0828100d40 0x7f0828198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.922+0000 7f0826800640 1 --2- 172.21.15.86:0/3812612471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0828101700 0x7f082819f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.922+0000 7f0825e00640 1 -- 172.21.15.86:0/3812612471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0828101700 msgr2=0x7f082819f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.922+0000 7f0825e00640 1 --2- 172.21.15.86:0/3812612471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0828101700 0x7f082819f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.922+0000 7f0825e00640 1 -- 172.21.15.86:0/3812612471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0828100d40 msgr2=0x7f0828198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.922+0000 7f0825e00640 1 --2- 172.21.15.86:0/3812612471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0828100d40 0x7f0828198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.922+0000 7f0825e00640 1 -- 172.21.15.86:0/3812612471 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0820009840 con 0x7f08280ffb50 2024-09-13T16:11:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.923+0000 7f0825e00640 1 --2- 172.21.15.86:0/3812612471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08280ffb50 0x7f0828197df0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0818031510 tx=0x7f0818005690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.923+0000 7f081ea00640 1 -- 172.21.15.86:0/3812612471 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818004c50 con 0x7f08280ffb50 2024-09-13T16:11:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.923+0000 7f081ea00640 1 -- 172.21.15.86:0/3812612471 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0818004db0 con 0x7f08280ffb50 2024-09-13T16:11:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.923+0000 7f081ea00640 1 -- 172.21.15.86:0/3812612471 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818031be0 con 0x7f08280ffb50 2024-09-13T16:11:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.923+0000 7f0827200640 1 -- 172.21.15.86:0/3812612471 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0818009560 con 0x7f08280ffb50 2024-09-13T16:11:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.924+0000 7f0827200640 1 -- 172.21.15.86:0/3812612471 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08281a0160 con 0x7f08280ffb50 2024-09-13T16:11:20.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f08301ba740 1 Processor -- start 2024-09-13T16:11:20.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f08301ba740 1 -- start start 2024-09-13T16:11:20.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f081ea00640 1 -- 172.21.15.86:0/3812612471 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 19) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0818031d40 con 0x7f08280ffb50 2024-09-13T16:11:20.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f08301ba740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdac80 0x55575dfdb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:20.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f08301ba740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdb5c0 0x55575dfe0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:20.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f08301ba740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 0x55575dfe2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:20.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f08301ba740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575dee6bb0 con 0x55575dfdac80 2024-09-13T16:11:20.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f08301ba740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575df44a70 con 0x55575dfe0650 2024-09-13T16:11:20.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f08301ba740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575df42200 con 0x55575dfdb5c0 2024-09-13T16:11:20.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f0825400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 0x55575dfe2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:20.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f0825e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdb5c0 0x55575dfe0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:20.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f0825400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 0x55575dfe2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:51490/0 (socket says 172.21.15.86:51490) 2024-09-13T16:11:20.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f0825400640 1 -- 172.21.15.86:0/993412657 learned_addr learned my addr 172.21.15.86:0/993412657 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:20.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f0826800640 1 --2- 172.21.15.86:0/993412657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdac80 0x55575dfdb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:20.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f0825400640 1 -- 172.21.15.86:0/993412657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdb5c0 msgr2=0x55575dfe0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:20.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f0825400640 1 --2- 172.21.15.86:0/993412657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdb5c0 0x55575dfe0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f0825400640 1 -- 172.21.15.86:0/993412657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdac80 msgr2=0x55575dfdb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:20.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f0825400640 1 --2- 172.21.15.86:0/993412657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdac80 0x55575dfdb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.928+0000 7f0825400640 1 -- 172.21.15.86:0/993412657 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55575dedf940 con 0x55575dfe0650 2024-09-13T16:11:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.929+0000 7f0825400640 1 --2- 172.21.15.86:0/993412657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 0x55575dfe2b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f081400bd10 tx=0x7f08140107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ce3a951b974fb86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.929+0000 7f0813400640 1 -- 172.21.15.86:0/993412657 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0814005220 con 0x55575dfe0650 2024-09-13T16:11:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.929+0000 7f081ea00640 1 --2- 172.21.15.86:0/3812612471 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f080c0a1250 0x7f080c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.929+0000 7f0813400640 1 -- 172.21.15.86:0/993412657 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0814015070 con 0x55575dfe0650 2024-09-13T16:11:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.929+0000 7f0813400640 1 -- 172.21.15.86:0/993412657 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08140116a0 con 0x55575dfe0650 2024-09-13T16:11:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.929+0000 7f081ea00640 1 -- 172.21.15.86:0/3812612471 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f08180edcf0 con 0x7f08280ffb50 2024-09-13T16:11:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.931+0000 7f0826800640 1 --2- 172.21.15.86:0/3812612471 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f080c0a1250 0x7f080c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.931+0000 7f08301ba740 1 -- 172.21.15.86:0/993412657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 msgr2=0x55575dfe2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.931+0000 7f08301ba740 1 --2- 172.21.15.86:0/993412657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 0x55575dfe2b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f081400bd10 tx=0x7f08140107a0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.931+0000 7f08301ba740 1 -- 172.21.15.86:0/993412657 shutdown_connections 2024-09-13T16:11:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.931+0000 7f08301ba740 1 --2- 172.21.15.86:0/993412657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 0x55575dfe2b10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.931+0000 7f08301ba740 1 --2- 172.21.15.86:0/993412657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdb5c0 0x55575dfe0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.931+0000 7f08301ba740 1 --2- 172.21.15.86:0/993412657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdac80 0x55575dfdb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.931+0000 7f08301ba740 1 -- 172.21.15.86:0/993412657 >> 172.21.15.86:0/993412657 conn(0x55575dfd62f0 msgr2=0x55575dfd66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.931+0000 7f08301ba740 1 -- 172.21.15.86:0/993412657 shutdown_connections 2024-09-13T16:11:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.931+0000 7f0826800640 1 --2- 172.21.15.86:0/3812612471 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f080c0a1250 0x7f080c0a3710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0820005fd0 tx=0x7f0820009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.931+0000 7f08301ba740 1 -- 172.21.15.86:0/993412657 wait complete. 2024-09-13T16:11:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.931+0000 7f08301ba740 1 -- start start 2024-09-13T16:11:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.931+0000 7f08301ba740 1 Processor -- start 2024-09-13T16:11:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.933+0000 7f08301ba740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdac80 0x55575dfe48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.933+0000 7f08301ba740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdb5c0 0x55575dfe4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.933+0000 7f08301ba740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 0x55575dfebe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.933+0000 7f08301ba740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575df3daf0 con 0x55575dfdb5c0 2024-09-13T16:11:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.933+0000 7f08301ba740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575defbf20 con 0x55575dfe0650 2024-09-13T16:11:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.933+0000 7f08301ba740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575defbbc0 con 0x55575dfdac80 2024-09-13T16:11:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.933+0000 7f08301ba740 10 client.0 _ll_register_callbacks cb 0x55575df2da70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:11:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.933+0000 7f0825e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdac80 0x55575dfe48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.933+0000 7f0825e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdac80 0x55575dfe48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:53966/0 (socket says 172.21.15.86:53966) 2024-09-13T16:11:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.933+0000 7f0825e00640 1 -- 172.21.15.86:0/4170928314 learned_addr learned my addr 172.21.15.86:0/4170928314 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.934+0000 7f0825400640 1 --2- 172.21.15.86:0/4170928314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdb5c0 0x55575dfe4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.934+0000 7f0826800640 1 --2- 172.21.15.86:0/4170928314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 0x55575dfebe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.934+0000 7f0825e00640 1 -- 172.21.15.86:0/4170928314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 msgr2=0x55575dfebe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.934+0000 7f0825e00640 1 --2- 172.21.15.86:0/4170928314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 0x55575dfebe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.934+0000 7f0825e00640 1 -- 172.21.15.86:0/4170928314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdb5c0 msgr2=0x55575dfe4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.934+0000 7f0825e00640 1 --2- 172.21.15.86:0/4170928314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdb5c0 0x55575dfe4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.934+0000 7f0825e00640 1 -- 172.21.15.86:0/4170928314 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081400b940 con 0x55575dfdac80 2024-09-13T16:11:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.934+0000 7f0825400640 1 --2- 172.21.15.86:0/4170928314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdb5c0 0x55575dfe4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:11:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.934+0000 7f0825e00640 1 --2- 172.21.15.86:0/4170928314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdac80 0x55575dfe48e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f081802a910 tx=0x7f081802a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf0988ab39b46749 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.934+0000 7f0807e00640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-13T16:11:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.934+0000 7f0807e00640 1 -- 172.21.15.86:0/4170928314 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08180ba990 con 0x55575dfdac80 2024-09-13T16:11:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.934+0000 7f08301ba740 1 -- 172.21.15.86:0/4170928314 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55575df67c90 con 0x55575dfdac80 2024-09-13T16:11:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.934+0000 7f0807e00640 1 -- 172.21.15.86:0/4170928314 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f08180bb2c0 con 0x55575dfdac80 2024-09-13T16:11:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.934+0000 7f0807e00640 1 -- 172.21.15.86:0/4170928314 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08180ba700 con 0x55575dfdac80 2024-09-13T16:11:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.934+0000 7f08301ba740 10 client.25441 fetch_fsmap learned FSMap version 25 2024-09-13T16:11:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.934+0000 7f08301ba740 1 -- 172.21.15.86:0/4170928314 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55575df3c170 con 0x55575dfdac80 2024-09-13T16:11:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.934+0000 7f0807e00640 1 -- 172.21.15.86:0/4170928314 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f08180d2070 con 0x55575dfdac80 2024-09-13T16:11:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.936+0000 7f0807e00640 1 -- 172.21.15.86:0/4170928314 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f08180eb4d0 con 0x55575dfdac80 2024-09-13T16:11:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.936+0000 7f08301ba740 10 client.25441 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:11:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.936+0000 7f08301ba740 10 client.25441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:11:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.936+0000 7f08301ba740 20 client.25441 populate_metadata read hostname 'smithi086' 2024-09-13T16:11:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.936+0000 7f08301ba740 1 --2- 172.21.15.86:0/4170928314 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55575dff0200 0x55575dff25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.936+0000 7f08301ba740 4 client.25441 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:11:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.936+0000 7f08301ba740 1 -- 172.21.15.86:0/4170928314 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55575df307d0 con 0x55575dff0200 2024-09-13T16:11:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.936+0000 7f0825400640 1 --2- 172.21.15.86:0/4170928314 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55575dff0200 0x55575dff25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.937+0000 7f0825400640 1 --2- 172.21.15.86:0/4170928314 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55575dff0200 0x55575dff25f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ad84f5d732426b7 server_cookie=918d73b4751b3085 in_seq=0 out_seq=0 2024-09-13T16:11:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.937+0000 7f0807e00640 10 client.25441 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:11:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.938+0000 7f0807e00640 1 -- 172.21.15.86:0/4170928314 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55575df307d0 con 0x55575dff0200 2024-09-13T16:11:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.938+0000 7f0807e00640 10 client.25441 handle_command_reply: tid=0 2024-09-13T16:11:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.938+0000 7f08301ba740 1 client.25441 shutdown 2024-09-13T16:11:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.938+0000 7f08301ba740 1 -- 172.21.15.86:0/4170928314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdac80 msgr2=0x55575dfe48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.938+0000 7f08301ba740 1 --2- 172.21.15.86:0/4170928314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdac80 0x55575dfe48e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f081802a910 tx=0x7f081802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.938+0000 7f08301ba740 1 -- 172.21.15.86:0/4170928314 shutdown_connections 2024-09-13T16:11:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.938+0000 7f08301ba740 1 --2- 172.21.15.86:0/4170928314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 0x55575dfebe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.938+0000 7f08301ba740 1 --2- 172.21.15.86:0/4170928314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdb5c0 0x55575dfe4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.938+0000 7f08301ba740 1 --2- 172.21.15.86:0/4170928314 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55575dff0200 0x55575dff25f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.938+0000 7f08301ba740 1 --2- 172.21.15.86:0/4170928314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdac80 0x55575dfe48e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.938+0000 7f08301ba740 1 -- 172.21.15.86:0/4170928314 >> 172.21.15.86:0/4170928314 conn(0x55575dfd62f0 msgr2=0x55575dfd7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.938+0000 7f0807e00640 0 client.25441 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:11:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.938+0000 7f08301ba740 1 -- 172.21.15.86:0/4170928314 shutdown_connections 2024-09-13T16:11:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.938+0000 7f08301ba740 1 -- 172.21.15.86:0/4170928314 wait complete. 2024-09-13T16:11:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.938+0000 7f08301ba740 20 client.25441 trim_cache size 0 max 16384 2024-09-13T16:11:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.951+0000 7f08301ba740 1 Processor -- start 2024-09-13T16:11:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.951+0000 7f08301ba740 1 -- start start 2024-09-13T16:11:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.951+0000 7f08301ba740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdac80 0x55575dfdfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.951+0000 7f08301ba740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdb5c0 0x55575dfdffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.952+0000 7f08301ba740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 0x55575dfebe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.952+0000 7f08301ba740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575dca4e60 con 0x55575dfdac80 2024-09-13T16:11:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.952+0000 7f08301ba740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575dfd81b0 con 0x55575dfe0650 2024-09-13T16:11:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.952+0000 7f08301ba740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575dfdbaa0 con 0x55575dfdb5c0 2024-09-13T16:11:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.952+0000 7f0825e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdac80 0x55575dfdfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.952+0000 7f0825e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdac80 0x55575dfdfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34066/0 (socket says 172.21.15.86:34066) 2024-09-13T16:11:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.952+0000 7f0825e00640 1 -- 172.21.15.86:0/468746049 learned_addr learned my addr 172.21.15.86:0/468746049 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.952+0000 7f0825400640 1 --2- 172.21.15.86:0/468746049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdb5c0 0x55575dfdffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.952+0000 7f0826800640 1 --2- 172.21.15.86:0/468746049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 0x55575dfebe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.952+0000 7f0825e00640 1 -- 172.21.15.86:0/468746049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdb5c0 msgr2=0x55575dfdffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.952+0000 7f0825e00640 1 --2- 172.21.15.86:0/468746049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdb5c0 0x55575dfdffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.952+0000 7f0825e00640 1 -- 172.21.15.86:0/468746049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 msgr2=0x55575dfebe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.952+0000 7f0825e00640 1 --2- 172.21.15.86:0/468746049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 0x55575dfebe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.952+0000 7f0825e00640 1 -- 172.21.15.86:0/468746049 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55575dede180 con 0x55575dfdac80 2024-09-13T16:11:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.953+0000 7f0825e00640 1 --2- 172.21.15.86:0/468746049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdac80 0x55575dfdfa80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f08180b70c0 tx=0x7f08180eb330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4dd5b720dd71c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.953+0000 7f0813e00640 1 -- 172.21.15.86:0/468746049 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08180ba990 con 0x55575dfdac80 2024-09-13T16:11:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.953+0000 7f0813e00640 1 -- 172.21.15.86:0/468746049 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f08180d2070 con 0x55575dfdac80 2024-09-13T16:11:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.953+0000 7f0813e00640 1 -- 172.21.15.86:0/468746049 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08180bac30 con 0x55575dfdac80 2024-09-13T16:11:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.954+0000 7f08301ba740 1 -- 172.21.15.86:0/468746049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdac80 msgr2=0x55575dfdfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.954+0000 7f08301ba740 1 --2- 172.21.15.86:0/468746049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdac80 0x55575dfdfa80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f08180b70c0 tx=0x7f08180eb330 comp rx=0 tx=0).stop 2024-09-13T16:11:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.954+0000 7f08301ba740 1 -- 172.21.15.86:0/468746049 shutdown_connections 2024-09-13T16:11:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.954+0000 7f08301ba740 1 --2- 172.21.15.86:0/468746049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 0x55575dfebe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.954+0000 7f08301ba740 1 --2- 172.21.15.86:0/468746049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdb5c0 0x55575dfdffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.954+0000 7f08301ba740 1 --2- 172.21.15.86:0/468746049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdac80 0x55575dfdfa80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.954+0000 7f08301ba740 1 -- 172.21.15.86:0/468746049 >> 172.21.15.86:0/468746049 conn(0x55575dfd62f0 msgr2=0x55575dfdc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.954+0000 7f08301ba740 1 -- 172.21.15.86:0/468746049 shutdown_connections 2024-09-13T16:11:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.954+0000 7f08301ba740 1 -- 172.21.15.86:0/468746049 wait complete. 2024-09-13T16:11:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.955+0000 7f08301ba740 1 -- start start 2024-09-13T16:11:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.955+0000 7f08301ba740 1 Processor -- start 2024-09-13T16:11:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.955+0000 7f08301ba740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdac80 0x55575dfeb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.955+0000 7f08301ba740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdb5c0 0x55575dfebb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.955+0000 7f08301ba740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 0x55575dfe8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.955+0000 7f08301ba740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575dfe85c0 con 0x55575dfdac80 2024-09-13T16:11:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.955+0000 7f08301ba740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575dfe8730 con 0x55575dfe0650 2024-09-13T16:11:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.955+0000 7f08301ba740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575dfe88f0 con 0x55575dfdb5c0 2024-09-13T16:11:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.956+0000 7f08301ba740 10 client.0 _ll_register_callbacks cb 0x7f081400b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:11:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.956+0000 7f0825400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdb5c0 0x55575dfebb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.956+0000 7f0825400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdb5c0 0x55575dfebb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:53984/0 (socket says 172.21.15.86:53984) 2024-09-13T16:11:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.956+0000 7f0825400640 1 -- 172.21.15.86:0/3396988276 learned_addr learned my addr 172.21.15.86:0/3396988276 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.956+0000 7f0825e00640 1 --2- 172.21.15.86:0/3396988276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdac80 0x55575dfeb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.956+0000 7f0825400640 1 -- 172.21.15.86:0/3396988276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 msgr2=0x55575dfe8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.956+0000 7f0825400640 1 --2- 172.21.15.86:0/3396988276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 0x55575dfe8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.956+0000 7f0825400640 1 -- 172.21.15.86:0/3396988276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdac80 msgr2=0x55575dfeb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.956+0000 7f0825400640 1 --2- 172.21.15.86:0/3396988276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdac80 0x55575dfeb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.956+0000 7f0825400640 1 -- 172.21.15.86:0/3396988276 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55575df3c170 con 0x55575dfdb5c0 2024-09-13T16:11:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.956+0000 7f0825400640 1 --2- 172.21.15.86:0/3396988276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdb5c0 0x55575dfebb20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f081400bc30 tx=0x7f0814000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2b86ba8e8690c4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.956+0000 7f0807e00640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-13T16:11:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.957+0000 7f0807e00640 1 -- 172.21.15.86:0/3396988276 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081401f040 con 0x55575dfdb5c0 2024-09-13T16:11:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.957+0000 7f0807e00640 1 -- 172.21.15.86:0/3396988276 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f081402ae40 con 0x55575dfdb5c0 2024-09-13T16:11:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.957+0000 7f08301ba740 1 -- 172.21.15.86:0/3396988276 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0814015070 con 0x55575dfdb5c0 2024-09-13T16:11:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.957+0000 7f0807e00640 1 -- 172.21.15.86:0/3396988276 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08140054b0 con 0x55575dfdb5c0 2024-09-13T16:11:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.957+0000 7f08301ba740 10 client.25447 fetch_fsmap learned FSMap version 25 2024-09-13T16:11:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.957+0000 7f08301ba740 1 -- 172.21.15.86:0/3396988276 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55575df03560 con 0x55575dfdb5c0 2024-09-13T16:11:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.958+0000 7f0807e00640 1 -- 172.21.15.86:0/3396988276 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0814015070 con 0x55575dfdb5c0 2024-09-13T16:11:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.958+0000 7f0807e00640 1 -- 172.21.15.86:0/3396988276 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f081402a4c0 con 0x55575dfdb5c0 2024-09-13T16:11:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.958+0000 7f08301ba740 10 client.25447 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:11:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.958+0000 7f08301ba740 10 client.25447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:11:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.958+0000 7f08301ba740 20 client.25447 populate_metadata read hostname 'smithi086' 2024-09-13T16:11:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.958+0000 7f08301ba740 1 --2- 172.21.15.86:0/3396988276 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55575e047b30 0x55575e049f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.958+0000 7f08301ba740 4 client.25447 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:11:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.958+0000 7f08301ba740 1 -- 172.21.15.86:0/3396988276 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55575dc31300 con 0x55575e047b30 2024-09-13T16:11:20.961 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.958+0000 7f0825e00640 1 --2- 172.21.15.86:0/3396988276 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55575e047b30 0x55575e049f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:20.961 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.959+0000 7f0825e00640 1 --2- 172.21.15.86:0/3396988276 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55575e047b30 0x55575e049f50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fc19b55c07551ae server_cookie=9129aa8648507ed3 in_seq=0 out_seq=0 2024-09-13T16:11:20.961 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.959+0000 7f0807e00640 10 client.25447 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:11:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.967+0000 7f0807e00640 1 -- 172.21.15.86:0/3396988276 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55575dc31300 con 0x55575e047b30 2024-09-13T16:11:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.967+0000 7f0807e00640 10 client.25447 handle_command_reply: tid=0 2024-09-13T16:11:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.967+0000 7f08301ba740 1 client.25447 shutdown 2024-09-13T16:11:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.967+0000 7f08301ba740 1 -- 172.21.15.86:0/3396988276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdb5c0 msgr2=0x55575dfebb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.967+0000 7f08301ba740 1 --2- 172.21.15.86:0/3396988276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdb5c0 0x55575dfebb20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f081400bc30 tx=0x7f0814000bc0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.967+0000 7f08301ba740 1 -- 172.21.15.86:0/3396988276 shutdown_connections 2024-09-13T16:11:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.967+0000 7f08301ba740 1 --2- 172.21.15.86:0/3396988276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55575dfe0650 0x55575dfe8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.967+0000 7f08301ba740 1 --2- 172.21.15.86:0/3396988276 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55575e047b30 0x55575e049f50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.967+0000 7f08301ba740 1 --2- 172.21.15.86:0/3396988276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55575dfdb5c0 0x55575dfebb20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.967+0000 7f08301ba740 1 --2- 172.21.15.86:0/3396988276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55575dfdac80 0x55575dfeb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.967+0000 7f08301ba740 1 -- 172.21.15.86:0/3396988276 >> 172.21.15.86:0/3396988276 conn(0x55575dfd62f0 msgr2=0x55575dfdf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.967+0000 7f0807e00640 0 client.25447 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:11:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.968+0000 7f08301ba740 1 -- 172.21.15.86:0/3396988276 shutdown_connections 2024-09-13T16:11:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.968+0000 7f08301ba740 1 -- 172.21.15.86:0/3396988276 wait complete. 2024-09-13T16:11:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.968+0000 7f08301ba740 20 client.25447 trim_cache size 0 max 16384 2024-09-13T16:11:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-09-13T16:11:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-09-13T16:11:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-09-13T16:11:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-09-13T16:11:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.969+0000 7f0827200640 1 -- 172.21.15.86:0/3812612471 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f080c0a1250 msgr2=0x7f080c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.969+0000 7f0827200640 1 --2- 172.21.15.86:0/3812612471 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f080c0a1250 0x7f080c0a3710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0820005fd0 tx=0x7f0820009500 comp rx=0 tx=0).stop 2024-09-13T16:11:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.969+0000 7f0827200640 1 -- 172.21.15.86:0/3812612471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08280ffb50 msgr2=0x7f0828197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.969+0000 7f0827200640 1 --2- 172.21.15.86:0/3812612471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08280ffb50 0x7f0828197df0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0818031510 tx=0x7f0818005690 comp rx=0 tx=0).stop 2024-09-13T16:11:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.969+0000 7f0827200640 1 -- 172.21.15.86:0/3812612471 shutdown_connections 2024-09-13T16:11:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.969+0000 7f0827200640 1 --2- 172.21.15.86:0/3812612471 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f080c0a1250 0x7f080c0a3710 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.969+0000 7f0827200640 1 --2- 172.21.15.86:0/3812612471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0828101700 0x7f082819f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.969+0000 7f0827200640 1 --2- 172.21.15.86:0/3812612471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0828100d40 0x7f0828198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.969+0000 7f0827200640 1 --2- 172.21.15.86:0/3812612471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08280ffb50 0x7f0828197df0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.969+0000 7f0827200640 1 -- 172.21.15.86:0/3812612471 >> 172.21.15.86:0/3812612471 conn(0x7f08280fb2f0 msgr2=0x7f0828106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.969+0000 7f0827200640 1 -- 172.21.15.86:0/3812612471 shutdown_connections 2024-09-13T16:11:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:20.969+0000 7f0827200640 1 -- 172.21.15.86:0/3812612471 wait complete. 2024-09-13T16:11:22.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:22 smithi139 ceph-mon[35320]: pgmap v395: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-13T16:11:22.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:22 smithi194 ceph-mon[35694]: pgmap v395: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-13T16:11:22.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:22 smithi086 ceph-mon[30379]: pgmap v395: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-13T16:11:24.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:24 smithi139 ceph-mon[35320]: pgmap v396: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-13T16:11:24.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:24 smithi194 ceph-mon[35694]: pgmap v396: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-13T16:11:24.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:24 smithi086 ceph-mon[30379]: pgmap v396: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-13T16:11:26.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:26 smithi139 ceph-mon[35320]: pgmap v397: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-13T16:11:26.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:26 smithi194 ceph-mon[35694]: pgmap v397: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-13T16:11:26.869 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:26 smithi086 ceph-mon[30379]: pgmap v397: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-13T16:11:28.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:28 smithi139 ceph-mon[35320]: pgmap v398: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-13T16:11:28.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:28 smithi194 ceph-mon[35694]: pgmap v398: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-13T16:11:28.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:28 smithi086 ceph-mon[30379]: pgmap v398: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-13T16:11:30.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:30 smithi139 ceph-mon[35320]: pgmap v399: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-13T16:11:30.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:30 smithi194 ceph-mon[35694]: pgmap v399: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-13T16:11:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:30 smithi086 ceph-mon[30379]: pgmap v399: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-13T16:11:32.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:32 smithi194 ceph-mon[35694]: pgmap v400: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-13T16:11:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:32 smithi086 ceph-mon[30379]: pgmap v400: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-13T16:11:32.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:32 smithi139 ceph-mon[35320]: pgmap v400: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-13T16:11:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.153+0000 7f7c4b200640 1 -- 172.21.15.86:0/1465299080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c4c102f10 msgr2=0x7f7c4c105300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.153+0000 7f7c4b200640 1 --2- 172.21.15.86:0/1465299080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c4c102f10 0x7f7c4c105300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009900 tx=0x7f7c3802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.153+0000 7f7c4b200640 1 -- 172.21.15.86:0/1465299080 shutdown_connections 2024-09-13T16:11:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.153+0000 7f7c4b200640 1 --2- 172.21.15.86:0/1465299080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c105920 0x7f7c4c107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.153+0000 7f7c4b200640 1 --2- 172.21.15.86:0/1465299080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c4c102f10 0x7f7c4c105300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.153+0000 7f7c4b200640 1 --2- 172.21.15.86:0/1465299080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c4c1005e0 0x7f7c4c1029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.153+0000 7f7c4b200640 1 -- 172.21.15.86:0/1465299080 >> 172.21.15.86:0/1465299080 conn(0x7f7c4c0fa1c0 msgr2=0x7f7c4c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:34.156 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.155+0000 7f7c4b200640 1 -- 172.21.15.86:0/1465299080 shutdown_connections 2024-09-13T16:11:34.156 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.155+0000 7f7c4b200640 1 -- 172.21.15.86:0/1465299080 wait complete. 2024-09-13T16:11:34.157 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.156+0000 7f7c4b200640 1 Processor -- start 2024-09-13T16:11:34.158 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.156+0000 7f7c4b200640 1 -- start start 2024-09-13T16:11:34.158 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.157+0000 7f7c4b200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c4c1005e0 0x7f7c4c197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:34.158 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.157+0000 7f7c4b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c4c102f10 0x7f7c4c198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:34.158 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.157+0000 7f7c4b200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c105920 0x7f7c4c19f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:34.159 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.157+0000 7f7c4b200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c19f7f0 con 0x7f7c4c1005e0 2024-09-13T16:11:34.159 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.157+0000 7f7c4b200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c19f960 con 0x7f7c4c105920 2024-09-13T16:11:34.159 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.157+0000 7f7c4b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c19fb20 con 0x7f7c4c102f10 2024-09-13T16:11:34.159 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.157+0000 7f7c49e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c4c1005e0 0x7f7c4c197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:34.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.157+0000 7f7c49400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c4c102f10 0x7f7c4c198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:34.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.157+0000 7f7c49e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c4c1005e0 0x7f7c4c197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45176/0 (socket says 172.21.15.86:45176) 2024-09-13T16:11:34.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.157+0000 7f7c49e00640 1 -- 172.21.15.86:0/405165316 learned_addr learned my addr 172.21.15.86:0/405165316 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:34.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.158+0000 7f7c4a800640 1 --2- 172.21.15.86:0/405165316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c105920 0x7f7c4c19f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:34.160 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.158+0000 7f7c49e00640 1 -- 172.21.15.86:0/405165316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c4c102f10 msgr2=0x7f7c4c198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.158+0000 7f7c49e00640 1 --2- 172.21.15.86:0/405165316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c4c102f10 0x7f7c4c198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.158+0000 7f7c49e00640 1 -- 172.21.15.86:0/405165316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c105920 msgr2=0x7f7c4c19f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.158+0000 7f7c49e00640 1 --2- 172.21.15.86:0/405165316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c105920 0x7f7c4c19f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.158+0000 7f7c49e00640 1 -- 172.21.15.86:0/405165316 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c38009560 con 0x7f7c4c1005e0 2024-09-13T16:11:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.158+0000 7f7c4a800640 1 --2- 172.21.15.86:0/405165316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c105920 0x7f7c4c19f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:11:34.162 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.159+0000 7f7c49e00640 1 --2- 172.21.15.86:0/405165316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c4c1005e0 0x7f7c4c197d10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00d950 tx=0x7f7c3c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:34.162 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.159+0000 7f7c42a00640 1 -- 172.21.15.86:0/405165316 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c009a30 con 0x7f7c4c1005e0 2024-09-13T16:11:34.162 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.159+0000 7f7c42a00640 1 -- 172.21.15.86:0/405165316 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7c3c009b90 con 0x7f7c4c1005e0 2024-09-13T16:11:34.162 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.159+0000 7f7c42a00640 1 -- 172.21.15.86:0/405165316 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c004a00 con 0x7f7c4c1005e0 2024-09-13T16:11:34.162 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.159+0000 7f7c4b200640 1 -- 172.21.15.86:0/405165316 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4c19fe00 con 0x7f7c4c1005e0 2024-09-13T16:11:34.163 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.159+0000 7f7c4b200640 1 -- 172.21.15.86:0/405165316 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4c1a01d0 con 0x7f7c4c1005e0 2024-09-13T16:11:34.165 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.164+0000 7f7c53c36740 1 Processor -- start 2024-09-13T16:11:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.164+0000 7f7c53c36740 1 -- start start 2024-09-13T16:11:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.164+0000 7f7c53c36740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8ffec80 0x5579c8fff080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.164+0000 7f7c53c36740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8fff5c0 0x5579c9004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.164+0000 7f7c53c36740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c9004650 0x5579c9006b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.164+0000 7f7c53c36740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579c8f0abb0 con 0x5579c8ffec80 2024-09-13T16:11:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.164+0000 7f7c53c36740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579c8f68a70 con 0x5579c9004650 2024-09-13T16:11:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.164+0000 7f7c53c36740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579c8f66200 con 0x5579c8fff5c0 2024-09-13T16:11:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.165+0000 7f7c4a800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8ffec80 0x5579c8fff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.165+0000 7f7c4a800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8ffec80 0x5579c8fff080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45178/0 (socket says 172.21.15.86:45178) 2024-09-13T16:11:34.168 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.165+0000 7f7c4a800640 1 -- 172.21.15.86:0/1745481592 learned_addr learned my addr 172.21.15.86:0/1745481592 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:34.168 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.165+0000 7f7c49400640 1 --2- 172.21.15.86:0/1745481592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c9004650 0x5579c9006b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:34.168 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.165+0000 7f7c42a00640 1 -- 172.21.15.86:0/405165316 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f7c3c009d00 con 0x7f7c4c1005e0 2024-09-13T16:11:34.168 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.165+0000 7f7c4a800640 1 -- 172.21.15.86:0/1745481592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8fff5c0 msgr2=0x5579c9004080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:11:34.168 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.165+0000 7f7c4a800640 1 --2- 172.21.15.86:0/1745481592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8fff5c0 0x5579c9004080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.168 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.165+0000 7f7c4a800640 1 -- 172.21.15.86:0/1745481592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c9004650 msgr2=0x5579c9006b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:34.168 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.165+0000 7f7c4a800640 1 --2- 172.21.15.86:0/1745481592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c9004650 0x5579c9006b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.169 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.165+0000 7f7c4a800640 1 -- 172.21.15.86:0/1745481592 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579c8f03940 con 0x5579c8ffec80 2024-09-13T16:11:34.169 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.166+0000 7f7c4a800640 1 --2- 172.21.15.86:0/1745481592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8ffec80 0x5579c8fff080 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009e40 tx=0x7f7c4400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7911553b5da1da21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.166+0000 7f7c37400640 1 -- 172.21.15.86:0/1745481592 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44004d20 con 0x5579c8ffec80 2024-09-13T16:11:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.166+0000 7f7c37400640 1 -- 172.21.15.86:0/1745481592 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7c44004e80 con 0x5579c8ffec80 2024-09-13T16:11:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.166+0000 7f7c37400640 1 -- 172.21.15.86:0/1745481592 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44011830 con 0x5579c8ffec80 2024-09-13T16:11:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.167+0000 7f7c42a00640 1 --2- 172.21.15.86:0/405165316 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7c300a1250 0x7f7c300a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.167+0000 7f7c53c36740 1 -- 172.21.15.86:0/1745481592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8ffec80 msgr2=0x5579c8fff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.167+0000 7f7c53c36740 1 --2- 172.21.15.86:0/1745481592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8ffec80 0x5579c8fff080 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009e40 tx=0x7f7c4400f730 comp rx=0 tx=0).stop 2024-09-13T16:11:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.167+0000 7f7c42a00640 1 -- 172.21.15.86:0/405165316 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f7c3c0cbe30 con 0x7f7c4c1005e0 2024-09-13T16:11:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.168+0000 7f7c53c36740 1 -- 172.21.15.86:0/1745481592 shutdown_connections 2024-09-13T16:11:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.168+0000 7f7c53c36740 1 --2- 172.21.15.86:0/1745481592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c9004650 0x5579c9006b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.168+0000 7f7c53c36740 1 --2- 172.21.15.86:0/1745481592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8fff5c0 0x5579c9004080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.168+0000 7f7c53c36740 1 --2- 172.21.15.86:0/1745481592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8ffec80 0x5579c8fff080 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.168+0000 7f7c53c36740 1 -- 172.21.15.86:0/1745481592 >> 172.21.15.86:0/1745481592 conn(0x5579c8ffa2f0 msgr2=0x5579c8ffa6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.168+0000 7f7c53c36740 1 -- 172.21.15.86:0/1745481592 shutdown_connections 2024-09-13T16:11:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.168+0000 7f7c49e00640 1 --2- 172.21.15.86:0/405165316 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7c300a1250 0x7f7c300a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.168+0000 7f7c53c36740 1 -- 172.21.15.86:0/1745481592 wait complete. 2024-09-13T16:11:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.168+0000 7f7c53c36740 1 -- start start 2024-09-13T16:11:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.169+0000 7f7c53c36740 1 Processor -- start 2024-09-13T16:11:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.169+0000 7f7c49e00640 1 --2- 172.21.15.86:0/405165316 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7c300a1250 0x7f7c300a3710 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x5579c8fffff0 tx=0x7f7c3c096e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.169+0000 7f7c53c36740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c8ffec80 0x5579c90110f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.169+0000 7f7c53c36740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8fff5c0 0x5579c9011630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.169+0000 7f7c53c36740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c9004650 0x5579c9018670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.169+0000 7f7c53c36740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579c8f61af0 con 0x5579c9004650 2024-09-13T16:11:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.169+0000 7f7c53c36740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579c8f1ff20 con 0x5579c8ffec80 2024-09-13T16:11:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.169+0000 7f7c53c36740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579c8f1fbc0 con 0x5579c8fff5c0 2024-09-13T16:11:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.170+0000 7f7c49400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8fff5c0 0x5579c9011630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.170+0000 7f7c49400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8fff5c0 0x5579c9011630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:55186/0 (socket says 172.21.15.86:55186) 2024-09-13T16:11:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.170+0000 7f7c49400640 1 -- 172.21.15.86:0/3048186139 learned_addr learned my addr 172.21.15.86:0/3048186139 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.170+0000 7f7c53c36740 10 client.0 _ll_register_callbacks cb 0x5579c8f51a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:11:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.170+0000 7f7c4a800640 1 --2- 172.21.15.86:0/3048186139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c9004650 0x5579c9018670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.170+0000 7f7c49400640 1 -- 172.21.15.86:0/3048186139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c8ffec80 msgr2=0x5579c90110f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.170+0000 7f7c4a800640 1 --2- 172.21.15.86:0/3048186139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c8ffec80 0x5579c90110f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.171+0000 7f7c49400640 1 --2- 172.21.15.86:0/3048186139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c8ffec80 0x5579c90110f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.171+0000 7f7c49400640 1 -- 172.21.15.86:0/3048186139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c9004650 msgr2=0x5579c9018670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.171+0000 7f7c49400640 1 --2- 172.21.15.86:0/3048186139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c9004650 0x5579c9018670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.171+0000 7f7c49400640 1 -- 172.21.15.86:0/3048186139 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c44009aa0 con 0x5579c8fff5c0 2024-09-13T16:11:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.171+0000 7f7c4a800640 1 --2- 172.21.15.86:0/3048186139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c9004650 0x5579c9018670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:11:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.171+0000 7f7c49400640 1 --2- 172.21.15.86:0/3048186139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8fff5c0 0x5579c9011630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c068490 tx=0x7f7c38003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c123f15a38e8289e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.171+0000 7f7c2be00640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-13T16:11:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.171+0000 7f7c2be00640 1 -- 172.21.15.86:0/3048186139 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38031740 con 0x5579c8fff5c0 2024-09-13T16:11:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.171+0000 7f7c53c36740 1 -- 172.21.15.86:0/3048186139 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5579c8f547d0 con 0x5579c8fff5c0 2024-09-13T16:11:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.172+0000 7f7c2be00640 1 -- 172.21.15.86:0/3048186139 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f7c380044b0 con 0x5579c8fff5c0 2024-09-13T16:11:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.172+0000 7f7c2be00640 1 -- 172.21.15.86:0/3048186139 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c380318a0 con 0x5579c8fff5c0 2024-09-13T16:11:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.172+0000 7f7c53c36740 10 client.25456 fetch_fsmap learned FSMap version 25 2024-09-13T16:11:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.172+0000 7f7c53c36740 1 -- 172.21.15.86:0/3048186139 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5579c8f60170 con 0x5579c8fff5c0 2024-09-13T16:11:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.172+0000 7f7c2be00640 1 -- 172.21.15.86:0/3048186139 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5579c8f547d0 con 0x5579c8fff5c0 2024-09-13T16:11:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.172+0000 7f7c2be00640 1 -- 172.21.15.86:0/3048186139 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7c3803db30 con 0x5579c8fff5c0 2024-09-13T16:11:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.172+0000 7f7c53c36740 10 client.25456 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:11:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.172+0000 7f7c53c36740 10 client.25456 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:11:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.173+0000 7f7c53c36740 20 client.25456 populate_metadata read hostname 'smithi086' 2024-09-13T16:11:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.173+0000 7f7c53c36740 1 --2- 172.21.15.86:0/3048186139 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5579c901cdb0 0x5579c901f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.173+0000 7f7c53c36740 4 client.25456 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:11:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.173+0000 7f7c53c36740 1 -- 172.21.15.86:0/3048186139 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5579c8c55300 con 0x5579c901cdb0 2024-09-13T16:11:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.173+0000 7f7c4a800640 1 --2- 172.21.15.86:0/3048186139 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5579c901cdb0 0x5579c901f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.174+0000 7f7c4a800640 1 --2- 172.21.15.86:0/3048186139 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5579c901cdb0 0x5579c901f1d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fc3a3bf2b596aa0 server_cookie=a13bd4753905fb65 in_seq=0 out_seq=0 2024-09-13T16:11:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.174+0000 7f7c2be00640 10 client.25456 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:11:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.175+0000 7f7c2be00640 1 -- 172.21.15.86:0/3048186139 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5579c8c55300 con 0x5579c901cdb0 2024-09-13T16:11:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.175+0000 7f7c2be00640 10 client.25456 handle_command_reply: tid=0 2024-09-13T16:11:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.175+0000 7f7c53c36740 1 client.25456 shutdown 2024-09-13T16:11:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.175+0000 7f7c53c36740 1 -- 172.21.15.86:0/3048186139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8fff5c0 msgr2=0x5579c9011630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.175+0000 7f7c53c36740 1 --2- 172.21.15.86:0/3048186139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8fff5c0 0x5579c9011630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c068490 tx=0x7f7c38003b90 comp rx=0 tx=0).stop 2024-09-13T16:11:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.175+0000 7f7c53c36740 1 -- 172.21.15.86:0/3048186139 shutdown_connections 2024-09-13T16:11:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.175+0000 7f7c53c36740 1 --2- 172.21.15.86:0/3048186139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c9004650 0x5579c9018670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.175+0000 7f7c53c36740 1 --2- 172.21.15.86:0/3048186139 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5579c901cdb0 0x5579c901f1d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.175+0000 7f7c53c36740 1 --2- 172.21.15.86:0/3048186139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8fff5c0 0x5579c9011630 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.175+0000 7f7c2be00640 0 client.25456 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:11:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.175+0000 7f7c53c36740 1 --2- 172.21.15.86:0/3048186139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c8ffec80 0x5579c90110f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.175+0000 7f7c53c36740 1 -- 172.21.15.86:0/3048186139 >> 172.21.15.86:0/3048186139 conn(0x5579c8ffa2f0 msgr2=0x5579c8ffbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.175+0000 7f7c53c36740 1 -- 172.21.15.86:0/3048186139 shutdown_connections 2024-09-13T16:11:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.176+0000 7f7c53c36740 1 -- 172.21.15.86:0/3048186139 wait complete. 2024-09-13T16:11:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.176+0000 7f7c53c36740 20 client.25456 trim_cache size 0 max 16384 2024-09-13T16:11:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.201+0000 7f7c53c36740 1 Processor -- start 2024-09-13T16:11:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.201+0000 7f7c53c36740 1 -- start start 2024-09-13T16:11:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.202+0000 7f7c53c36740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8ffec80 0x5579c8ff9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.202+0000 7f7c53c36740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8fff5c0 0x5579c9018630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.202+0000 7f7c53c36740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c9004650 0x5579c8ffa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.202+0000 7f7c53c36740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579c8cc8e60 con 0x5579c8ffec80 2024-09-13T16:11:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.202+0000 7f7c53c36740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579c8f547d0 con 0x5579c9004650 2024-09-13T16:11:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.202+0000 7f7c53c36740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579c9011e50 con 0x5579c8fff5c0 2024-09-13T16:11:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.202+0000 7f7c4a800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8ffec80 0x5579c8ff9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.202+0000 7f7c4a800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8ffec80 0x5579c8ff9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45202/0 (socket says 172.21.15.86:45202) 2024-09-13T16:11:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.202+0000 7f7c4a800640 1 -- 172.21.15.86:0/3440838913 learned_addr learned my addr 172.21.15.86:0/3440838913 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.202+0000 7f7c49400640 1 --2- 172.21.15.86:0/3440838913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8fff5c0 0x5579c9018630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.203+0000 7f7c4a800640 1 --2- 172.21.15.86:0/3440838913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c9004650 0x5579c8ffa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.203+0000 7f7c49400640 1 -- 172.21.15.86:0/3440838913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c9004650 msgr2=0x5579c8ffa6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.203+0000 7f7c49400640 1 --2- 172.21.15.86:0/3440838913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c9004650 0x5579c8ffa6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.203+0000 7f7c49400640 1 -- 172.21.15.86:0/3440838913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8ffec80 msgr2=0x5579c8ff9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.203+0000 7f7c49400640 1 --2- 172.21.15.86:0/3440838913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8ffec80 0x5579c8ff9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.203+0000 7f7c49400640 1 -- 172.21.15.86:0/3440838913 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579c8f02180 con 0x5579c8fff5c0 2024-09-13T16:11:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.203+0000 7f7c4a800640 1 --2- 172.21.15.86:0/3440838913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8ffec80 0x5579c8ff9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:11:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.203+0000 7f7c49400640 1 --2- 172.21.15.86:0/3440838913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8fff5c0 0x5579c9018630 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009900 tx=0x7f7c3802a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b623accde7c02591 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.203+0000 7f7c37e00640 1 -- 172.21.15.86:0/3440838913 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38003c00 con 0x5579c8fff5c0 2024-09-13T16:11:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.204+0000 7f7c37e00640 1 -- 172.21.15.86:0/3440838913 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7c38047630 con 0x5579c8fff5c0 2024-09-13T16:11:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.204+0000 7f7c37e00640 1 -- 172.21.15.86:0/3440838913 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38005350 con 0x5579c8fff5c0 2024-09-13T16:11:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.205+0000 7f7c53c36740 1 -- 172.21.15.86:0/3440838913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8fff5c0 msgr2=0x5579c9018630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.205+0000 7f7c53c36740 1 --2- 172.21.15.86:0/3440838913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8fff5c0 0x5579c9018630 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009900 tx=0x7f7c3802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.205+0000 7f7c53c36740 1 -- 172.21.15.86:0/3440838913 shutdown_connections 2024-09-13T16:11:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.205+0000 7f7c53c36740 1 --2- 172.21.15.86:0/3440838913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c9004650 0x5579c8ffa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.205+0000 7f7c53c36740 1 --2- 172.21.15.86:0/3440838913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8fff5c0 0x5579c9018630 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.205+0000 7f7c53c36740 1 --2- 172.21.15.86:0/3440838913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8ffec80 0x5579c8ff9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.205+0000 7f7c53c36740 1 -- 172.21.15.86:0/3440838913 >> 172.21.15.86:0/3440838913 conn(0x5579c8ffa2f0 msgr2=0x5579c9000520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.205+0000 7f7c53c36740 1 -- 172.21.15.86:0/3440838913 shutdown_connections 2024-09-13T16:11:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.205+0000 7f7c53c36740 1 -- 172.21.15.86:0/3440838913 wait complete. 2024-09-13T16:11:34.211 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.205+0000 7f7c53c36740 1 -- start start 2024-09-13T16:11:34.211 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.206+0000 7f7c53c36740 1 Processor -- start 2024-09-13T16:11:34.211 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.206+0000 7f7c53c36740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8ffec80 0x5579c9017fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.206+0000 7f7c53c36740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8fff5c0 0x5579c9018520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.206+0000 7f7c53c36740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c9004650 0x5579c9014aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.206+0000 7f7c53c36740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579c90151a0 con 0x5579c8fff5c0 2024-09-13T16:11:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.206+0000 7f7c53c36740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579c9015310 con 0x5579c9004650 2024-09-13T16:11:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.206+0000 7f7c53c36740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579c90154d0 con 0x5579c8ffec80 2024-09-13T16:11:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.206+0000 7f7c53c36740 10 client.0 _ll_register_callbacks cb 0x7f7c440095c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:11:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.207+0000 7f7c49400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8fff5c0 0x5579c9018520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.207+0000 7f7c4a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8ffec80 0x5579c9017fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.207+0000 7f7c4a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8ffec80 0x5579c9017fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:55212/0 (socket says 172.21.15.86:55212) 2024-09-13T16:11:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.207+0000 7f7c4a800640 1 -- 172.21.15.86:0/310296516 learned_addr learned my addr 172.21.15.86:0/310296516 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.207+0000 7f7c4a800640 1 --2- 172.21.15.86:0/310296516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c9004650 0x5579c9014aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.207+0000 7f7c4a800640 1 -- 172.21.15.86:0/310296516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c9004650 msgr2=0x5579c9014aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.207+0000 7f7c4a800640 1 --2- 172.21.15.86:0/310296516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c9004650 0x5579c9014aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.207+0000 7f7c4a800640 1 -- 172.21.15.86:0/310296516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8fff5c0 msgr2=0x5579c9018520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.207+0000 7f7c4a800640 1 --2- 172.21.15.86:0/310296516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8fff5c0 0x5579c9018520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.207+0000 7f7c4a800640 1 -- 172.21.15.86:0/310296516 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5579c8f03940 con 0x5579c8ffec80 2024-09-13T16:11:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.207+0000 7f7c4a800640 1 --2- 172.21.15.86:0/310296516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8ffec80 0x5579c9017fe0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7c44018000 tx=0x7f7c44009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d340e69d46c8ab36 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.207+0000 7f7c2be00640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-13T16:11:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.208+0000 7f7c2be00640 1 -- 172.21.15.86:0/310296516 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440052c0 con 0x5579c8ffec80 2024-09-13T16:11:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.208+0000 7f7c2be00640 1 -- 172.21.15.86:0/310296516 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f7c44015070 con 0x5579c8ffec80 2024-09-13T16:11:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.208+0000 7f7c53c36740 1 -- 172.21.15.86:0/310296516 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5579c8f8bc90 con 0x5579c8ffec80 2024-09-13T16:11:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.208+0000 7f7c2be00640 1 -- 172.21.15.86:0/310296516 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c44005420 con 0x5579c8ffec80 2024-09-13T16:11:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.208+0000 7f7c53c36740 10 client.25462 fetch_fsmap learned FSMap version 25 2024-09-13T16:11:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.208+0000 7f7c53c36740 1 -- 172.21.15.86:0/310296516 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5579c8f60170 con 0x5579c8ffec80 2024-09-13T16:11:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.209+0000 7f7c2be00640 1 -- 172.21.15.86:0/310296516 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5579c8f8bc90 con 0x5579c8ffec80 2024-09-13T16:11:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.209+0000 7f7c2be00640 1 -- 172.21.15.86:0/310296516 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7c44023040 con 0x5579c8ffec80 2024-09-13T16:11:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.209+0000 7f7c53c36740 10 client.25462 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:11:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.209+0000 7f7c53c36740 10 client.25462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:11:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.209+0000 7f7c53c36740 20 client.25462 populate_metadata read hostname 'smithi086' 2024-09-13T16:11:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.209+0000 7f7c53c36740 1 --2- 172.21.15.86:0/310296516 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5579c9074950 0x5579c9076d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.209+0000 7f7c53c36740 4 client.25462 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:11:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.209+0000 7f7c53c36740 1 -- 172.21.15.86:0/310296516 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5579c8c66600 con 0x5579c9074950 2024-09-13T16:11:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.210+0000 7f7c49400640 1 --2- 172.21.15.86:0/310296516 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5579c9074950 0x5579c9076d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.210+0000 7f7c49400640 1 --2- 172.21.15.86:0/310296516 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5579c9074950 0x5579c9076d70 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17f8bc84365ea60b server_cookie=9acba32b735ed766 in_seq=0 out_seq=0 2024-09-13T16:11:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.210+0000 7f7c2be00640 10 client.25462 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:11:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.214+0000 7f7c2be00640 1 -- 172.21.15.86:0/310296516 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5579c8c66600 con 0x5579c9074950 2024-09-13T16:11:34.216 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.214+0000 7f7c2be00640 10 client.25462 handle_command_reply: tid=0 2024-09-13T16:11:34.216 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.214+0000 7f7c53c36740 1 client.25462 shutdown 2024-09-13T16:11:34.216 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.214+0000 7f7c53c36740 1 -- 172.21.15.86:0/310296516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8ffec80 msgr2=0x5579c9017fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:34.216 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.214+0000 7f7c53c36740 1 --2- 172.21.15.86:0/310296516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8ffec80 0x5579c9017fe0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7c44018000 tx=0x7f7c44009f90 comp rx=0 tx=0).stop 2024-09-13T16:11:34.217 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.214+0000 7f7c53c36740 1 -- 172.21.15.86:0/310296516 shutdown_connections 2024-09-13T16:11:34.217 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.214+0000 7f7c53c36740 1 --2- 172.21.15.86:0/310296516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c9004650 0x5579c9014aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.217 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.214+0000 7f7c53c36740 1 --2- 172.21.15.86:0/310296516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579c8fff5c0 0x5579c9018520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.217 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.214+0000 7f7c53c36740 1 --2- 172.21.15.86:0/310296516 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5579c9074950 0x5579c9076d70 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.217 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.215+0000 7f7c53c36740 1 --2- 172.21.15.86:0/310296516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579c8ffec80 0x5579c9017fe0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.217 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.215+0000 7f7c53c36740 1 -- 172.21.15.86:0/310296516 >> 172.21.15.86:0/310296516 conn(0x5579c8ffa2f0 msgr2=0x5579c8ff8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:34.217 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.215+0000 7f7c2be00640 0 client.25462 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:11:34.217 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.215+0000 7f7c53c36740 1 -- 172.21.15.86:0/310296516 shutdown_connections 2024-09-13T16:11:34.217 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.215+0000 7f7c53c36740 1 -- 172.21.15.86:0/310296516 wait complete. 2024-09-13T16:11:34.217 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.215+0000 7f7c53c36740 20 client.25462 trim_cache size 0 max 16384 2024-09-13T16:11:34.218 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-09-13T16:11:34.218 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-09-13T16:11:34.218 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-09-13T16:11:34.218 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-09-13T16:11:34.218 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.216+0000 7f7c4b200640 1 -- 172.21.15.86:0/405165316 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7c300a1250 msgr2=0x7f7c300a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.216+0000 7f7c4b200640 1 --2- 172.21.15.86:0/405165316 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7c300a1250 0x7f7c300a3710 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x5579c8fffff0 tx=0x7f7c3c096e10 comp rx=0 tx=0).stop 2024-09-13T16:11:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.216+0000 7f7c4b200640 1 -- 172.21.15.86:0/405165316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c4c1005e0 msgr2=0x7f7c4c197d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.216+0000 7f7c4b200640 1 --2- 172.21.15.86:0/405165316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c4c1005e0 0x7f7c4c197d10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00d950 tx=0x7f7c3c00de10 comp rx=0 tx=0).stop 2024-09-13T16:11:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.216+0000 7f7c4b200640 1 -- 172.21.15.86:0/405165316 shutdown_connections 2024-09-13T16:11:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.216+0000 7f7c4b200640 1 --2- 172.21.15.86:0/405165316 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f7c300a1250 0x7f7c300a3710 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.216+0000 7f7c4b200640 1 --2- 172.21.15.86:0/405165316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c4c105920 0x7f7c4c19f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.216+0000 7f7c4b200640 1 --2- 172.21.15.86:0/405165316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c4c102f10 0x7f7c4c198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.216+0000 7f7c4b200640 1 --2- 172.21.15.86:0/405165316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c4c1005e0 0x7f7c4c197d10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.216+0000 7f7c4b200640 1 -- 172.21.15.86:0/405165316 >> 172.21.15.86:0/405165316 conn(0x7f7c4c0fa1c0 msgr2=0x7f7c4c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.216+0000 7f7c4b200640 1 -- 172.21.15.86:0/405165316 shutdown_connections 2024-09-13T16:11:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:34.217+0000 7f7c4b200640 1 -- 172.21.15.86:0/405165316 wait complete. 2024-09-13T16:11:34.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:34 smithi086 ceph-mon[30379]: pgmap v401: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-13T16:11:34.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:34 smithi139 ceph-mon[35320]: pgmap v401: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-13T16:11:35.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:34 smithi194 ceph-mon[35694]: pgmap v401: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-13T16:11:36.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:36 smithi086 ceph-mon[30379]: pgmap v402: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-13T16:11:36.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:36 smithi139 ceph-mon[35320]: pgmap v402: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-13T16:11:37.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:36 smithi194 ceph-mon[35694]: pgmap v402: 129 pgs: 129 active+clean; 672 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-13T16:11:38.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:38 smithi086 ceph-mon[30379]: pgmap v403: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T16:11:38.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:38 smithi139 ceph-mon[35320]: pgmap v403: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T16:11:39.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:38 smithi194 ceph-mon[35694]: pgmap v403: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T16:11:40.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:40 smithi086 ceph-mon[30379]: pgmap v404: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T16:11:40.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:40 smithi139 ceph-mon[35320]: pgmap v404: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T16:11:41.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:40 smithi194 ceph-mon[35694]: pgmap v404: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T16:11:41.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:11:41.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:41.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:41.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:41.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:41.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:41.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:41 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:41.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:11:41.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:41.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:41.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:41.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:41.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:41.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:41 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:42.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:11:42.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:42.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:42.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:42.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:42.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:42.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:41 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:42 smithi086 ceph-mon[30379]: pgmap v405: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T16:11:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:11:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:11:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:42.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:42 smithi139 ceph-mon[35320]: pgmap v405: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T16:11:42.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:42 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:11:42.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:42 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:11:42.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:42 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:43.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:42 smithi194 ceph-mon[35694]: pgmap v405: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T16:11:43.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:42 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:11:43.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:42 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:11:43.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:42 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:11:44.801 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:44 smithi139 ceph-mon[35320]: pgmap v406: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T16:11:44.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:44 smithi086 ceph-mon[30379]: pgmap v406: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T16:11:45.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:44 smithi194 ceph-mon[35694]: pgmap v406: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T16:11:46.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:46 smithi086 ceph-mon[30379]: pgmap v407: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:11:46.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:46 smithi139 ceph-mon[35320]: pgmap v407: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:11:47.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:46 smithi194 ceph-mon[35694]: pgmap v407: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:11:47.101 INFO:tasks.workunit.client.0.smithi086.stderr:Updating files: 63% (8021/12697) Updating files: 64% (8127/12697) Updating files: 65% (8254/12697) Updating files: 66% (8381/12697) Updating files: 67% (8507/12697) Updating files: 68% (8634/12697) Updating files: 69% (8761/12697) Updating files: 70% (8888/12697) Updating files: 71% (9015/12697) Updating files: 72% (9142/12697) Updating files: 73% (9269/12697) Updating files: 74% (9396/12697) Updating files: 75% (9523/12697) Updating files: 76% (9650/12697) Updating files: 77% (9777/12697) Updating files: 78% (9904/12697) Updating files: 79% (10031/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-13T16:11:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.338+0000 7f64e3000640 1 -- 172.21.15.86:0/1875998670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64dc0744f0 msgr2=0x7f64dc072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.338+0000 7f64e3000640 1 --2- 172.21.15.86:0/1875998670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64dc0744f0 0x7f64dc072940 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f64d0009900 tx=0x7f64d002a410 comp rx=0 tx=0).stop 2024-09-13T16:11:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.338+0000 7f64e3000640 1 -- 172.21.15.86:0/1875998670 shutdown_connections 2024-09-13T16:11:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.338+0000 7f64e3000640 1 --2- 172.21.15.86:0/1875998670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64dc10c120 0x7f64dc10e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.338+0000 7f64e3000640 1 --2- 172.21.15.86:0/1875998670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64dc072f10 0x7f64dc073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.338+0000 7f64e3000640 1 --2- 172.21.15.86:0/1875998670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64dc0744f0 0x7f64dc072940 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.341 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.338+0000 7f64e3000640 1 -- 172.21.15.86:0/1875998670 >> 172.21.15.86:0/1875998670 conn(0x7f64dc0fb2f0 msgr2=0x7f64dc0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:47.341 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.338+0000 7f64e3000640 1 -- 172.21.15.86:0/1875998670 shutdown_connections 2024-09-13T16:11:47.341 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.338+0000 7f64e3000640 1 -- 172.21.15.86:0/1875998670 wait complete. 2024-09-13T16:11:47.345 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.339+0000 7f64e3000640 1 Processor -- start 2024-09-13T16:11:47.345 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.339+0000 7f64e3000640 1 -- start start 2024-09-13T16:11:47.345 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.339+0000 7f64e3000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64dc072f10 0x7f64dc19c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.339+0000 7f64e3000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64dc0744f0 0x7f64dc19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.340+0000 7f64e3000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64dc10c120 0x7f64dc1a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.340+0000 7f64e3000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc1a3c50 con 0x7f64dc072f10 2024-09-13T16:11:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.340+0000 7f64e3000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc1a3dc0 con 0x7f64dc0744f0 2024-09-13T16:11:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.340+0000 7f64e3000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc1a3f80 con 0x7f64dc10c120 2024-09-13T16:11:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.340+0000 7f64e1c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64dc072f10 0x7f64dc19c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.340+0000 7f64e1c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64dc072f10 0x7f64dc19c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57228/0 (socket says 172.21.15.86:57228) 2024-09-13T16:11:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.340+0000 7f64e1c00640 1 -- 172.21.15.86:0/4185814748 learned_addr learned my addr 172.21.15.86:0/4185814748 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.340+0000 7f64e1200640 1 --2- 172.21.15.86:0/4185814748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64dc0744f0 0x7f64dc19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.340+0000 7f64e2600640 1 --2- 172.21.15.86:0/4185814748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64dc10c120 0x7f64dc1a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.340+0000 7f64e1c00640 1 -- 172.21.15.86:0/4185814748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64dc10c120 msgr2=0x7f64dc1a3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.340+0000 7f64e1c00640 1 --2- 172.21.15.86:0/4185814748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64dc10c120 0x7f64dc1a3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.340+0000 7f64e1c00640 1 -- 172.21.15.86:0/4185814748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64dc0744f0 msgr2=0x7f64dc19c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.340+0000 7f64e1c00640 1 --2- 172.21.15.86:0/4185814748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64dc0744f0 0x7f64dc19c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.340+0000 7f64e1c00640 1 -- 172.21.15.86:0/4185814748 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d0009560 con 0x7f64dc072f10 2024-09-13T16:11:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.340+0000 7f64e1200640 1 --2- 172.21.15.86:0/4185814748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64dc0744f0 0x7f64dc19c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:11:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.341+0000 7f64e1c00640 1 --2- 172.21.15.86:0/4185814748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64dc072f10 0x7f64dc19c160 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f64d0031510 tx=0x7f64d0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.341+0000 7f64da000640 1 -- 172.21.15.86:0/4185814748 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0005000 con 0x7f64dc072f10 2024-09-13T16:11:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.341+0000 7f64da000640 1 -- 172.21.15.86:0/4185814748 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f64d00046c0 con 0x7f64dc072f10 2024-09-13T16:11:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.341+0000 7f64e3000640 1 -- 172.21.15.86:0/4185814748 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64dc1a4200 con 0x7f64dc072f10 2024-09-13T16:11:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.341+0000 7f64da000640 1 -- 172.21.15.86:0/4185814748 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0003a10 con 0x7f64dc072f10 2024-09-13T16:11:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.341+0000 7f64e3000640 1 -- 172.21.15.86:0/4185814748 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64dc1a46b0 con 0x7f64dc072f10 2024-09-13T16:11:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.344+0000 7f64da000640 1 -- 172.21.15.86:0/4185814748 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f64d0004bc0 con 0x7f64dc072f10 2024-09-13T16:11:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.344+0000 7f64e7415740 1 Processor -- start 2024-09-13T16:11:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.344+0000 7f64e7415740 1 -- start start 2024-09-13T16:11:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.345+0000 7f64e7415740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef3c80 0x558f30ef4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.345+0000 7f64e7415740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef45c0 0x558f30ef9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.345+0000 7f64e7415740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef9650 0x558f30efbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.345+0000 7f64e7415740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f30dffbb0 con 0x558f30ef9650 2024-09-13T16:11:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.345+0000 7f64e7415740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f30e5da70 con 0x558f30ef3c80 2024-09-13T16:11:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.345+0000 7f64e7415740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f30e5b200 con 0x558f30ef45c0 2024-09-13T16:11:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.345+0000 7f64e1200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef9650 0x558f30efbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.345+0000 7f64e2600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef3c80 0x558f30ef4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.345+0000 7f64e1200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef9650 0x558f30efbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57234/0 (socket says 172.21.15.86:57234) 2024-09-13T16:11:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.345+0000 7f64e1200640 1 -- 172.21.15.86:0/1592471382 learned_addr learned my addr 172.21.15.86:0/1592471382 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.345+0000 7f64e1c00640 1 --2- 172.21.15.86:0/1592471382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef45c0 0x558f30ef9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.345+0000 7f64e2600640 1 -- 172.21.15.86:0/1592471382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef45c0 msgr2=0x558f30ef9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.345+0000 7f64e2600640 1 --2- 172.21.15.86:0/1592471382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef45c0 0x558f30ef9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.345+0000 7f64e2600640 1 -- 172.21.15.86:0/1592471382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef9650 msgr2=0x558f30efbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.345+0000 7f64e2600640 1 --2- 172.21.15.86:0/1592471382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef9650 0x558f30efbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.345+0000 7f64e2600640 1 -- 172.21.15.86:0/1592471382 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f30df8940 con 0x558f30ef3c80 2024-09-13T16:11:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.346+0000 7f64da000640 1 --2- 172.21.15.86:0/4185814748 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f64c40a11d0 0x7f64c40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.346+0000 7f64e2600640 1 --2- 172.21.15.86:0/1592471382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef3c80 0x558f30ef4080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009f00 tx=0x7f64d4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fd7bebcdaf9a503 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.346+0000 7f64da000640 1 -- 172.21.15.86:0/4185814748 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f64d00edd30 con 0x7f64dc072f10 2024-09-13T16:11:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.346+0000 7f64e1c00640 1 --2- 172.21.15.86:0/4185814748 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f64c40a11d0 0x7f64c40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.346+0000 7f64cea00640 1 -- 172.21.15.86:0/1592471382 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4004d20 con 0x558f30ef3c80 2024-09-13T16:11:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.346+0000 7f64cea00640 1 -- 172.21.15.86:0/1592471382 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f64d4004e80 con 0x558f30ef3c80 2024-09-13T16:11:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.346+0000 7f64cea00640 1 -- 172.21.15.86:0/1592471382 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4005280 con 0x558f30ef3c80 2024-09-13T16:11:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.347+0000 7f64e7415740 1 -- 172.21.15.86:0/1592471382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef3c80 msgr2=0x558f30ef4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.347+0000 7f64e7415740 1 --2- 172.21.15.86:0/1592471382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef3c80 0x558f30ef4080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009f00 tx=0x7f64d4011810 comp rx=0 tx=0).stop 2024-09-13T16:11:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.347+0000 7f64e1c00640 1 --2- 172.21.15.86:0/4185814748 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f64c40a11d0 0x7f64c40a3690 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f64d00ba9b0 tx=0x7f64d00f17a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.347+0000 7f64e7415740 1 -- 172.21.15.86:0/1592471382 shutdown_connections 2024-09-13T16:11:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.347+0000 7f64e7415740 1 --2- 172.21.15.86:0/1592471382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef9650 0x558f30efbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.347+0000 7f64e7415740 1 --2- 172.21.15.86:0/1592471382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef45c0 0x558f30ef9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.347+0000 7f64e7415740 1 --2- 172.21.15.86:0/1592471382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef3c80 0x558f30ef4080 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.347+0000 7f64e7415740 1 -- 172.21.15.86:0/1592471382 >> 172.21.15.86:0/1592471382 conn(0x558f30eef2f0 msgr2=0x558f30eef6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.347+0000 7f64e7415740 1 -- 172.21.15.86:0/1592471382 shutdown_connections 2024-09-13T16:11:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.347+0000 7f64e7415740 1 -- 172.21.15.86:0/1592471382 wait complete. 2024-09-13T16:11:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.348+0000 7f64e7415740 1 -- start start 2024-09-13T16:11:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.348+0000 7f64e7415740 1 Processor -- start 2024-09-13T16:11:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.348+0000 7f64e7415740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef3c80 0x558f30efd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.348+0000 7f64e7415740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef45c0 0x558f30efdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.348+0000 7f64e7415740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef9650 0x558f30f04e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.348+0000 7f64e7415740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f30e56af0 con 0x558f30ef9650 2024-09-13T16:11:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.348+0000 7f64e7415740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f30e14f20 con 0x558f30ef3c80 2024-09-13T16:11:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.348+0000 7f64e7415740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f30e14bc0 con 0x558f30ef45c0 2024-09-13T16:11:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.348+0000 7f64e7415740 10 client.0 _ll_register_callbacks cb 0x558f30e46a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:11:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.348+0000 7f64e1200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef45c0 0x558f30efdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.349+0000 7f64e1200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef45c0 0x558f30efdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:43776/0 (socket says 172.21.15.86:43776) 2024-09-13T16:11:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.349+0000 7f64e1200640 1 -- 172.21.15.86:0/2370833387 learned_addr learned my addr 172.21.15.86:0/2370833387 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.349+0000 7f64e2600640 1 --2- 172.21.15.86:0/2370833387 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef9650 0x558f30f04e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.349+0000 7f64e2600640 1 --2- 172.21.15.86:0/2370833387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef3c80 0x558f30efd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.349+0000 7f64e1200640 1 -- 172.21.15.86:0/2370833387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef3c80 msgr2=0x558f30efd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.349+0000 7f64e1200640 1 --2- 172.21.15.86:0/2370833387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef3c80 0x558f30efd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.349+0000 7f64e1200640 1 -- 172.21.15.86:0/2370833387 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef9650 msgr2=0x558f30f04e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.349+0000 7f64e1200640 1 --2- 172.21.15.86:0/2370833387 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef9650 0x558f30f04e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.349+0000 7f64e1200640 1 -- 172.21.15.86:0/2370833387 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d4009be0 con 0x558f30ef45c0 2024-09-13T16:11:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.349+0000 7f64e1200640 1 --2- 172.21.15.86:0/2370833387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef45c0 0x558f30efdee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f64c8012d20 tx=0x7f64c800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdec72b4650f5c46 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.349+0000 7f64c3400640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-13T16:11:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.349+0000 7f64c3400640 1 -- 172.21.15.86:0/2370833387 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8017070 con 0x558f30ef45c0 2024-09-13T16:11:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.349+0000 7f64e7415740 1 -- 172.21.15.86:0/2370833387 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f30e497d0 con 0x558f30ef45c0 2024-09-13T16:11:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.350+0000 7f64c3400640 1 -- 172.21.15.86:0/2370833387 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f64c8012110 con 0x558f30ef45c0 2024-09-13T16:11:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.350+0000 7f64c3400640 1 -- 172.21.15.86:0/2370833387 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64c80122d0 con 0x558f30ef45c0 2024-09-13T16:11:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.350+0000 7f64e7415740 10 client.25474 fetch_fsmap learned FSMap version 25 2024-09-13T16:11:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.350+0000 7f64e7415740 1 -- 172.21.15.86:0/2370833387 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x558f30e55170 con 0x558f30ef45c0 2024-09-13T16:11:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.350+0000 7f64c3400640 1 -- 172.21.15.86:0/2370833387 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x558f30e497d0 con 0x558f30ef45c0 2024-09-13T16:11:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.350+0000 7f64c3400640 1 -- 172.21.15.86:0/2370833387 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f64c8010430 con 0x558f30ef45c0 2024-09-13T16:11:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.350+0000 7f64e7415740 10 client.25474 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:11:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.350+0000 7f64e7415740 10 client.25474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:11:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.350+0000 7f64e7415740 20 client.25474 populate_metadata read hostname 'smithi086' 2024-09-13T16:11:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.350+0000 7f64e7415740 1 --2- 172.21.15.86:0/2370833387 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x558f30f09620 0x558f30f0ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.350+0000 7f64e7415740 4 client.25474 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:11:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.350+0000 7f64e7415740 1 -- 172.21.15.86:0/2370833387 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558f30b4a300 con 0x558f30f09620 2024-09-13T16:11:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.351+0000 7f64e2600640 1 --2- 172.21.15.86:0/2370833387 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x558f30f09620 0x558f30f0ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.351+0000 7f64e2600640 1 --2- 172.21.15.86:0/2370833387 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x558f30f09620 0x558f30f0ba40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3adb339eaec808a2 server_cookie=3d0c1666d4f5f0c in_seq=0 out_seq=0 2024-09-13T16:11:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.351+0000 7f64c3400640 10 client.25474 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:11:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.352+0000 7f64c3400640 1 -- 172.21.15.86:0/2370833387 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558f30b4a300 con 0x558f30f09620 2024-09-13T16:11:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.352+0000 7f64c3400640 10 client.25474 handle_command_reply: tid=0 2024-09-13T16:11:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.352+0000 7f64e7415740 1 client.25474 shutdown 2024-09-13T16:11:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.352+0000 7f64e7415740 1 -- 172.21.15.86:0/2370833387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef45c0 msgr2=0x558f30efdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.352+0000 7f64e7415740 1 --2- 172.21.15.86:0/2370833387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef45c0 0x558f30efdee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f64c8012d20 tx=0x7f64c800f790 comp rx=0 tx=0).stop 2024-09-13T16:11:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.352+0000 7f64e7415740 1 -- 172.21.15.86:0/2370833387 shutdown_connections 2024-09-13T16:11:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.352+0000 7f64e7415740 1 --2- 172.21.15.86:0/2370833387 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef9650 0x558f30f04e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.360 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.352+0000 7f64e7415740 1 --2- 172.21.15.86:0/2370833387 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x558f30f09620 0x558f30f0ba40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.360 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.352+0000 7f64e7415740 1 --2- 172.21.15.86:0/2370833387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef45c0 0x558f30efdee0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.360 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.352+0000 7f64e7415740 1 --2- 172.21.15.86:0/2370833387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef3c80 0x558f30efd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.360 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.352+0000 7f64c3400640 0 client.25474 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:11:47.360 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.352+0000 7f64e7415740 1 -- 172.21.15.86:0/2370833387 >> 172.21.15.86:0/2370833387 conn(0x558f30eef2f0 msgr2=0x558f30ef0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:47.360 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.352+0000 7f64e7415740 1 -- 172.21.15.86:0/2370833387 shutdown_connections 2024-09-13T16:11:47.360 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.352+0000 7f64e7415740 1 -- 172.21.15.86:0/2370833387 wait complete. 2024-09-13T16:11:47.360 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.353+0000 7f64e7415740 20 client.25474 trim_cache size 0 max 16384 2024-09-13T16:11:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.365+0000 7f64e7415740 1 Processor -- start 2024-09-13T16:11:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.365+0000 7f64e7415740 1 -- start start 2024-09-13T16:11:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.366+0000 7f64e7415740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef3c80 0x558f30efd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.366+0000 7f64e7415740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef45c0 0x558f30f04e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.366+0000 7f64e7415740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef9650 0x558f30efdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.366+0000 7f64e7415740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f30bbde60 con 0x558f30ef3c80 2024-09-13T16:11:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.366+0000 7f64e7415740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f30f07bb0 con 0x558f30ef9650 2024-09-13T16:11:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.366+0000 7f64e7415740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f30eeae10 con 0x558f30ef45c0 2024-09-13T16:11:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.366+0000 7f64e2600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef3c80 0x558f30efd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.366+0000 7f64e2600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef3c80 0x558f30efd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57248/0 (socket says 172.21.15.86:57248) 2024-09-13T16:11:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.366+0000 7f64e2600640 1 -- 172.21.15.86:0/4269328361 learned_addr learned my addr 172.21.15.86:0/4269328361 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.366+0000 7f64e1200640 1 --2- 172.21.15.86:0/4269328361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef45c0 0x558f30f04e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.366+0000 7f64e2600640 1 --2- 172.21.15.86:0/4269328361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef9650 0x558f30efdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.366+0000 7f64e2600640 1 -- 172.21.15.86:0/4269328361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef45c0 msgr2=0x558f30f04e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.366+0000 7f64e2600640 1 --2- 172.21.15.86:0/4269328361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef45c0 0x558f30f04e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.366+0000 7f64e2600640 1 -- 172.21.15.86:0/4269328361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef9650 msgr2=0x558f30efdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.366+0000 7f64e2600640 1 --2- 172.21.15.86:0/4269328361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef9650 0x558f30efdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.366+0000 7f64e2600640 1 -- 172.21.15.86:0/4269328361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f30df7180 con 0x558f30ef3c80 2024-09-13T16:11:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.366+0000 7f64e2600640 1 --2- 172.21.15.86:0/4269328361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef3c80 0x558f30efd9a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f64d4011d10 tx=0x7f64d4009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d9af27698f8ab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.367+0000 7f64cf400640 1 -- 172.21.15.86:0/4269328361 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4003a30 con 0x558f30ef3c80 2024-09-13T16:11:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.367+0000 7f64cf400640 1 -- 172.21.15.86:0/4269328361 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f64d4004070 con 0x558f30ef3c80 2024-09-13T16:11:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.367+0000 7f64cf400640 1 -- 172.21.15.86:0/4269328361 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4005870 con 0x558f30ef3c80 2024-09-13T16:11:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.367+0000 7f64e7415740 1 -- 172.21.15.86:0/4269328361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef3c80 msgr2=0x558f30efd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.367+0000 7f64e7415740 1 --2- 172.21.15.86:0/4269328361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef3c80 0x558f30efd9a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f64d4011d10 tx=0x7f64d4009500 comp rx=0 tx=0).stop 2024-09-13T16:11:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.368+0000 7f64e7415740 1 -- 172.21.15.86:0/4269328361 shutdown_connections 2024-09-13T16:11:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.368+0000 7f64e7415740 1 --2- 172.21.15.86:0/4269328361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef9650 0x558f30efdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.368+0000 7f64e7415740 1 --2- 172.21.15.86:0/4269328361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef45c0 0x558f30f04e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.368+0000 7f64e7415740 1 --2- 172.21.15.86:0/4269328361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef3c80 0x558f30efd9a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.368+0000 7f64e7415740 1 -- 172.21.15.86:0/4269328361 >> 172.21.15.86:0/4269328361 conn(0x558f30eef2f0 msgr2=0x558f30f103a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.368+0000 7f64e7415740 1 -- 172.21.15.86:0/4269328361 shutdown_connections 2024-09-13T16:11:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.368+0000 7f64e7415740 1 -- 172.21.15.86:0/4269328361 wait complete. 2024-09-13T16:11:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.368+0000 7f64e7415740 1 -- start start 2024-09-13T16:11:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.368+0000 7f64e7415740 1 Processor -- start 2024-09-13T16:11:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.369+0000 7f64e7415740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef3c80 0x558f30f04950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:47.374 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.369+0000 7f64e7415740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef45c0 0x558f30f04e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:47.374 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.369+0000 7f64e7415740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef9650 0x558f30f02fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:47.374 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.369+0000 7f64e7415740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f30f036c0 con 0x558f30ef45c0 2024-09-13T16:11:47.374 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.369+0000 7f64e7415740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f30f03830 con 0x558f30ef3c80 2024-09-13T16:11:47.374 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.369+0000 7f64e7415740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f30f039f0 con 0x558f30ef9650 2024-09-13T16:11:47.374 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.369+0000 7f64e7415740 10 client.0 _ll_register_callbacks cb 0x7f64d4009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:11:47.374 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.369+0000 7f64e1200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef45c0 0x558f30f04e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:47.374 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.369+0000 7f64e1200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef45c0 0x558f30f04e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57258/0 (socket says 172.21.15.86:57258) 2024-09-13T16:11:47.374 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.369+0000 7f64e1200640 1 -- 172.21.15.86:0/3187192620 learned_addr learned my addr 172.21.15.86:0/3187192620 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:11:47.374 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.369+0000 7f64e2600640 1 --2- 172.21.15.86:0/3187192620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef3c80 0x558f30f04950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:47.374 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.369+0000 7f64e2600640 1 --2- 172.21.15.86:0/3187192620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef9650 0x558f30f02fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:47.374 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.369+0000 7f64e1200640 1 -- 172.21.15.86:0/3187192620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef9650 msgr2=0x558f30f02fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:47.374 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.369+0000 7f64e1200640 1 --2- 172.21.15.86:0/3187192620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef9650 0x558f30f02fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.369+0000 7f64e1200640 1 -- 172.21.15.86:0/3187192620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef3c80 msgr2=0x558f30f04950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.369+0000 7f64e1200640 1 --2- 172.21.15.86:0/3187192620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef3c80 0x558f30f04950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.369+0000 7f64e1200640 1 -- 172.21.15.86:0/3187192620 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d401d040 con 0x558f30ef45c0 2024-09-13T16:11:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.370+0000 7f64e1200640 1 --2- 172.21.15.86:0/3187192620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef45c0 0x558f30f04e90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f64c8012cf0 tx=0x7f64c8010660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cfd7666b4db5e93 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.370+0000 7f64c3400640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T16:11:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.370+0000 7f64c3400640 1 -- 172.21.15.86:0/3187192620 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8017040 con 0x558f30ef45c0 2024-09-13T16:11:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.370+0000 7f64c3400640 1 -- 172.21.15.86:0/3187192620 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f64c8000e40 con 0x558f30ef45c0 2024-09-13T16:11:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.370+0000 7f64e7415740 1 -- 172.21.15.86:0/3187192620 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f30e80c90 con 0x558f30ef45c0 2024-09-13T16:11:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.370+0000 7f64c3400640 1 -- 172.21.15.86:0/3187192620 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64c8010a30 con 0x558f30ef45c0 2024-09-13T16:11:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.370+0000 7f64e7415740 10 client.15438 fetch_fsmap learned FSMap version 25 2024-09-13T16:11:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.370+0000 7f64e7415740 1 -- 172.21.15.86:0/3187192620 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x558f30e1c560 con 0x558f30ef45c0 2024-09-13T16:11:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.370+0000 7f64c3400640 1 -- 172.21.15.86:0/3187192620 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x558f30e80c90 con 0x558f30ef45c0 2024-09-13T16:11:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.371+0000 7f64c3400640 1 -- 172.21.15.86:0/3187192620 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f64c80047f0 con 0x558f30ef45c0 2024-09-13T16:11:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.371+0000 7f64e7415740 10 client.15438 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:11:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.371+0000 7f64e7415740 10 client.15438 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:11:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.371+0000 7f64e7415740 20 client.15438 populate_metadata read hostname 'smithi086' 2024-09-13T16:11:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.371+0000 7f64e7415740 1 --2- 172.21.15.86:0/3187192620 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x558f30f61080 0x558f30f634a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.371+0000 7f64e7415740 4 client.15438 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:11:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.371+0000 7f64e7415740 1 -- 172.21.15.86:0/3187192620 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558f30b5b600 con 0x558f30f61080 2024-09-13T16:11:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.371+0000 7f64e2600640 1 --2- 172.21.15.86:0/3187192620 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x558f30f61080 0x558f30f634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.371+0000 7f64e2600640 1 --2- 172.21.15.86:0/3187192620 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x558f30f61080 0x558f30f634a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4365aeb083ccee7 server_cookie=aae95da8d26508b5 in_seq=0 out_seq=0 2024-09-13T16:11:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.371+0000 7f64c3400640 10 client.15438 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:11:47.377 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.375+0000 7f64c3400640 1 -- 172.21.15.86:0/3187192620 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558f30b5b600 con 0x558f30f61080 2024-09-13T16:11:47.377 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.375+0000 7f64c3400640 10 client.15438 handle_command_reply: tid=0 2024-09-13T16:11:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.375+0000 7f64e7415740 1 client.15438 shutdown 2024-09-13T16:11:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.375+0000 7f64e7415740 1 -- 172.21.15.86:0/3187192620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef45c0 msgr2=0x558f30f04e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.375+0000 7f64e7415740 1 --2- 172.21.15.86:0/3187192620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef45c0 0x558f30f04e90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f64c8012cf0 tx=0x7f64c8010660 comp rx=0 tx=0).stop 2024-09-13T16:11:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.375+0000 7f64e7415740 1 -- 172.21.15.86:0/3187192620 shutdown_connections 2024-09-13T16:11:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.375+0000 7f64e7415740 1 --2- 172.21.15.86:0/3187192620 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x558f30f61080 0x558f30f634a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.375+0000 7f64e7415740 1 --2- 172.21.15.86:0/3187192620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558f30ef9650 0x558f30f02fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.375+0000 7f64e7415740 1 --2- 172.21.15.86:0/3187192620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f30ef45c0 0x558f30f04e90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.375+0000 7f64c3400640 0 client.15438 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:11:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.375+0000 7f64e7415740 1 --2- 172.21.15.86:0/3187192620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f30ef3c80 0x558f30f04950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.375+0000 7f64e7415740 1 -- 172.21.15.86:0/3187192620 >> 172.21.15.86:0/3187192620 conn(0x558f30eef2f0 msgr2=0x558f30ef5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.375+0000 7f64e7415740 1 -- 172.21.15.86:0/3187192620 shutdown_connections 2024-09-13T16:11:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.375+0000 7f64e7415740 1 -- 172.21.15.86:0/3187192620 wait complete. 2024-09-13T16:11:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.376+0000 7f64e7415740 20 client.15438 trim_cache size 0 max 16384 2024-09-13T16:11:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-09-13T16:11:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-09-13T16:11:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-09-13T16:11:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-09-13T16:11:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.376+0000 7f64e3000640 1 -- 172.21.15.86:0/4185814748 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f64c40a11d0 msgr2=0x7f64c40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.376+0000 7f64e3000640 1 --2- 172.21.15.86:0/4185814748 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f64c40a11d0 0x7f64c40a3690 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f64d00ba9b0 tx=0x7f64d00f17a0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.376+0000 7f64e3000640 1 -- 172.21.15.86:0/4185814748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64dc072f10 msgr2=0x7f64dc19c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.376+0000 7f64e3000640 1 --2- 172.21.15.86:0/4185814748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64dc072f10 0x7f64dc19c160 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f64d0031510 tx=0x7f64d0004270 comp rx=0 tx=0).stop 2024-09-13T16:11:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.376+0000 7f64e3000640 1 -- 172.21.15.86:0/4185814748 shutdown_connections 2024-09-13T16:11:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.376+0000 7f64e3000640 1 --2- 172.21.15.86:0/4185814748 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f64c40a11d0 0x7f64c40a3690 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.376+0000 7f64e3000640 1 --2- 172.21.15.86:0/4185814748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64dc10c120 0x7f64dc1a3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.376+0000 7f64e3000640 1 --2- 172.21.15.86:0/4185814748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64dc0744f0 0x7f64dc19c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.376+0000 7f64e3000640 1 --2- 172.21.15.86:0/4185814748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64dc072f10 0x7f64dc19c160 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.376+0000 7f64e3000640 1 -- 172.21.15.86:0/4185814748 >> 172.21.15.86:0/4185814748 conn(0x7f64dc0fb2f0 msgr2=0x7f64dc0fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.376+0000 7f64e3000640 1 -- 172.21.15.86:0/4185814748 shutdown_connections 2024-09-13T16:11:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:11:47.376+0000 7f64e3000640 1 -- 172.21.15.86:0/4185814748 wait complete. 2024-09-13T16:11:47.994 INFO:tasks.workunit.client.0.smithi086.stderr:Note: switching to '50bbe7f395997dcd871813949c49addbbf630361'. 2024-09-13T16:11:47.994 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-09-13T16:11:47.994 INFO:tasks.workunit.client.0.smithi086.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T16:11:47.994 INFO:tasks.workunit.client.0.smithi086.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T16:11:47.994 INFO:tasks.workunit.client.0.smithi086.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T16:11:47.994 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-09-13T16:11:47.994 INFO:tasks.workunit.client.0.smithi086.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T16:11:47.994 INFO:tasks.workunit.client.0.smithi086.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T16:11:47.994 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-09-13T16:11:47.995 INFO:tasks.workunit.client.0.smithi086.stderr: git switch -c 2024-09-13T16:11:47.995 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-09-13T16:11:47.995 INFO:tasks.workunit.client.0.smithi086.stderr:Or undo this operation with: 2024-09-13T16:11:47.995 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-09-13T16:11:47.995 INFO:tasks.workunit.client.0.smithi086.stderr: git switch - 2024-09-13T16:11:47.995 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-09-13T16:11:47.995 INFO:tasks.workunit.client.0.smithi086.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T16:11:47.995 INFO:tasks.workunit.client.0.smithi086.stderr: 2024-09-13T16:11:47.995 INFO:tasks.workunit.client.0.smithi086.stderr:HEAD is now at 50bbe7f3959 Merge PR #58789 into wip-rishabh-testing-20240910.095512-reef 2024-09-13T16:11:48.011 DEBUG:teuthology.orchestra.run.smithi086:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T16:11:48.099 INFO:tasks.workunit.client.0.smithi086.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T16:11:48.103 INFO:tasks.workunit.client.0.smithi086.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T16:11:48.103 INFO:tasks.workunit.client.0.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T16:11:48.817 INFO:tasks.workunit.client.0.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T16:11:48.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:48 smithi086 ceph-mon[30379]: pgmap v408: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T16:11:48.912 INFO:tasks.workunit.client.0.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T16:11:48.978 INFO:tasks.workunit.client.0.smithi086.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T16:11:48.981 INFO:tasks.workunit.client.0.smithi086.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T16:11:48.982 INFO:tasks.workunit.client.0.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T16:11:48.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:48 smithi139 ceph-mon[35320]: pgmap v408: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T16:11:49.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:48 smithi194 ceph-mon[35694]: pgmap v408: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T16:11:49.046 INFO:tasks.workunit.client.0.smithi086.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T16:11:49.053 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T16:11:49.053 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T16:11:49.088 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-09-13T16:11:49.090 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-09-13T16:11:49.090 DEBUG:teuthology.orchestra.run.smithi086:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=50bbe7f395997dcd871813949c49addbbf630361 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-09-13T16:11:50.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:50 smithi086 ceph-mon[30379]: pgmap v409: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:11:50.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:50 smithi139 ceph-mon[35320]: pgmap v409: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:11:51.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:50 smithi194 ceph-mon[35694]: pgmap v409: 129 pgs: 129 active+clean; 673 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:11:52.617 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ 2024-09-13T16:11:52.621 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/00-INDEX 2024-09-13T16:11:52.622 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/ 2024-09-13T16:11:52.624 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/README 2024-09-13T16:11:52.625 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-09-13T16:11:52.627 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-09-13T16:11:52.629 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-09-13T16:11:52.631 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-09-13T16:11:52.632 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-09-13T16:11:52.634 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-09-13T16:11:52.635 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-09-13T16:11:52.637 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-09-13T16:11:52.638 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-09-13T16:11:52.641 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-09-13T16:11:52.642 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-09-13T16:11:52.643 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-09-13T16:11:52.644 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-09-13T16:11:52.646 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-09-13T16:11:52.647 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-09-13T16:11:52.649 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-09-13T16:11:52.650 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-09-13T16:11:52.652 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-09-13T16:11:52.653 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-09-13T16:11:52.654 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-09-13T16:11:52.656 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-09-13T16:11:52.657 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-09-13T16:11:52.659 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-09-13T16:11:52.660 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-09-13T16:11:52.661 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-09-13T16:11:52.663 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-09-13T16:11:52.664 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-09-13T16:11:52.665 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-09-13T16:11:52.666 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-09-13T16:11:52.668 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-09-13T16:11:52.669 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-09-13T16:11:52.670 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-09-13T16:11:52.671 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-09-13T16:11:52.673 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-09-13T16:11:52.674 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-09-13T16:11:52.675 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-09-13T16:11:52.676 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-09-13T16:11:52.677 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-09-13T16:11:52.679 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-09-13T16:11:52.680 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-09-13T16:11:52.682 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-09-13T16:11:52.683 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-09-13T16:11:52.684 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-09-13T16:11:52.686 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-09-13T16:11:52.687 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-09-13T16:11:52.688 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-09-13T16:11:52.690 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-09-13T16:11:52.691 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-09-13T16:11:52.692 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-09-13T16:11:52.694 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-09-13T16:11:52.695 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-09-13T16:11:52.696 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-09-13T16:11:52.698 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-09-13T16:11:52.699 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-09-13T16:11:52.700 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-09-13T16:11:52.701 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-09-13T16:11:52.703 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-09-13T16:11:52.704 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-09-13T16:11:52.705 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-09-13T16:11:52.706 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-09-13T16:11:52.708 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-09-13T16:11:52.709 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-09-13T16:11:52.711 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-09-13T16:11:52.712 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-09-13T16:11:52.713 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-09-13T16:11:52.715 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-09-13T16:11:52.716 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-09-13T16:11:52.717 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-09-13T16:11:52.719 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-09-13T16:11:52.720 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-09-13T16:11:52.721 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-09-13T16:11:52.722 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-09-13T16:11:52.723 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-09-13T16:11:52.725 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-09-13T16:11:52.726 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-09-13T16:11:52.727 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-09-13T16:11:52.729 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-09-13T16:11:52.730 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-09-13T16:11:52.731 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-09-13T16:11:52.732 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-09-13T16:11:52.734 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-09-13T16:11:52.735 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-09-13T16:11:52.736 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-09-13T16:11:52.737 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-09-13T16:11:52.738 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-09-13T16:11:52.740 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-09-13T16:11:52.741 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-09-13T16:11:52.742 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-09-13T16:11:52.744 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-09-13T16:11:52.745 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-09-13T16:11:52.746 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-09-13T16:11:52.747 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-09-13T16:11:52.748 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-09-13T16:11:52.750 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-09-13T16:11:52.751 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-09-13T16:11:52.752 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-09-13T16:11:52.753 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-09-13T16:11:52.754 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-09-13T16:11:52.755 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-09-13T16:11:52.756 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-09-13T16:11:52.757 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-09-13T16:11:52.758 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-09-13T16:11:52.759 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-09-13T16:11:52.760 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-09-13T16:11:52.761 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-09-13T16:11:52.762 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-09-13T16:11:52.763 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-09-13T16:11:52.764 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-09-13T16:11:52.765 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-09-13T16:11:52.766 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-09-13T16:11:52.767 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-09-13T16:11:52.769 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-09-13T16:11:52.770 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-09-13T16:11:52.770 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-09-13T16:11:52.772 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-09-13T16:11:52.773 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-09-13T16:11:52.774 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-09-13T16:11:52.775 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-09-13T16:11:52.776 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-09-13T16:11:52.776 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-09-13T16:11:52.777 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-09-13T16:11:52.778 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-09-13T16:11:52.780 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-09-13T16:11:52.780 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-09-13T16:11:52.781 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-09-13T16:11:52.782 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-09-13T16:11:52.783 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-09-13T16:11:52.784 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-09-13T16:11:52.785 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-09-13T16:11:52.786 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-09-13T16:11:52.787 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-09-13T16:11:52.789 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-09-13T16:11:52.789 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-09-13T16:11:52.791 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-09-13T16:11:52.791 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-09-13T16:11:52.792 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-09-13T16:11:52.793 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-09-13T16:11:52.794 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-09-13T16:11:52.795 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-09-13T16:11:52.796 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-09-13T16:11:52.797 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-09-13T16:11:52.798 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-09-13T16:11:52.799 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-09-13T16:11:52.800 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-09-13T16:11:52.801 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-09-13T16:11:52.802 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-09-13T16:11:52.803 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-09-13T16:11:52.805 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-09-13T16:11:52.806 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-09-13T16:11:52.807 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-09-13T16:11:52.807 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-09-13T16:11:52.809 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-09-13T16:11:52.810 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-09-13T16:11:52.811 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-09-13T16:11:52.812 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-09-13T16:11:52.813 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-09-13T16:11:52.814 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-09-13T16:11:52.814 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-09-13T16:11:52.815 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-09-13T16:11:52.816 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-09-13T16:11:52.817 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-09-13T16:11:52.818 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-09-13T16:11:52.818 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-09-13T16:11:52.819 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-09-13T16:11:52.820 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-09-13T16:11:52.821 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-09-13T16:11:52.822 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-09-13T16:11:52.823 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-09-13T16:11:52.824 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-09-13T16:11:52.825 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-09-13T16:11:52.826 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-09-13T16:11:52.827 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-09-13T16:11:52.828 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-09-13T16:11:52.829 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-09-13T16:11:52.830 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-09-13T16:11:52.831 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-09-13T16:11:52.832 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-09-13T16:11:52.833 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-09-13T16:11:52.834 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-09-13T16:11:52.835 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-09-13T16:11:52.836 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-09-13T16:11:52.837 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-09-13T16:11:52.838 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-09-13T16:11:52.838 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-09-13T16:11:52.839 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-09-13T16:11:52.840 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-09-13T16:11:52.841 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-09-13T16:11:52.842 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-09-13T16:11:52.843 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-09-13T16:11:52.844 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-09-13T16:11:52.845 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-09-13T16:11:52.846 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-09-13T16:11:52.847 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-09-13T16:11:52.848 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-09-13T16:11:52.849 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-09-13T16:11:52.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:52 smithi086 ceph-mon[30379]: pgmap v410: 129 pgs: 129 active+clean; 699 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-13T16:11:52.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:52 smithi139 ceph-mon[35320]: pgmap v410: 129 pgs: 129 active+clean; 699 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-13T16:11:53.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:52 smithi194 ceph-mon[35694]: pgmap v410: 129 pgs: 129 active+clean; 699 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-13T16:11:53.993 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-09-13T16:11:53.994 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-09-13T16:11:53.995 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-09-13T16:11:53.996 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-09-13T16:11:53.997 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-09-13T16:11:53.998 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-09-13T16:11:53.999 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-09-13T16:11:54.000 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-09-13T16:11:54.001 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-09-13T16:11:54.002 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-09-13T16:11:54.004 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-09-13T16:11:54.005 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-09-13T16:11:54.006 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-09-13T16:11:54.007 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-09-13T16:11:54.008 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-09-13T16:11:54.009 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-09-13T16:11:54.010 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-09-13T16:11:54.011 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-09-13T16:11:54.012 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-09-13T16:11:54.016 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-09-13T16:11:54.016 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-09-13T16:11:54.016 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-09-13T16:11:54.017 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-09-13T16:11:54.017 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-09-13T16:11:54.018 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-09-13T16:11:54.019 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-09-13T16:11:54.020 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-09-13T16:11:54.021 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-09-13T16:11:54.022 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-09-13T16:11:54.023 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-09-13T16:11:54.024 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-09-13T16:11:54.025 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-09-13T16:11:54.026 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-09-13T16:11:54.027 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-09-13T16:11:54.028 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-09-13T16:11:54.029 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-09-13T16:11:54.030 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-09-13T16:11:54.031 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-09-13T16:11:54.033 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-09-13T16:11:54.034 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-09-13T16:11:54.035 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-09-13T16:11:54.036 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-09-13T16:11:54.037 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-09-13T16:11:54.038 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-09-13T16:11:54.039 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-09-13T16:11:54.040 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-09-13T16:11:54.041 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-09-13T16:11:54.041 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-09-13T16:11:54.043 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-09-13T16:11:54.043 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-09-13T16:11:54.045 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-09-13T16:11:54.045 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-09-13T16:11:54.046 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-09-13T16:11:54.048 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-09-13T16:11:54.048 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-09-13T16:11:54.049 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-09-13T16:11:54.050 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-09-13T16:11:54.051 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-09-13T16:11:54.052 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-09-13T16:11:54.053 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-09-13T16:11:54.054 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-09-13T16:11:54.055 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-09-13T16:11:54.056 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-09-13T16:11:54.057 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/Changes 2024-09-13T16:11:54.058 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-09-13T16:11:54.059 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/CodingStyle 2024-09-13T16:11:54.061 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-09-13T16:11:54.063 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-09-13T16:11:54.065 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-09-13T16:11:54.065 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-09-13T16:11:54.066 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/ 2024-09-13T16:11:54.067 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-09-13T16:11:54.068 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-09-13T16:11:54.069 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-09-13T16:11:54.070 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-09-13T16:11:54.071 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-09-13T16:11:54.072 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-09-13T16:11:54.073 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-09-13T16:11:54.074 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-09-13T16:11:54.075 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-09-13T16:11:54.078 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-09-13T16:11:54.078 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-09-13T16:11:54.080 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-09-13T16:11:54.081 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-09-13T16:11:54.082 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-09-13T16:11:54.082 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-09-13T16:11:54.083 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-09-13T16:11:54.084 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-09-13T16:11:54.085 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-09-13T16:11:54.086 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-09-13T16:11:54.087 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-09-13T16:11:54.088 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-09-13T16:11:54.089 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-09-13T16:11:54.090 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-09-13T16:11:54.091 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-09-13T16:11:54.092 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-09-13T16:11:54.093 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-09-13T16:11:54.094 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-09-13T16:11:54.095 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-09-13T16:11:54.096 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-09-13T16:11:54.097 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-09-13T16:11:54.098 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-09-13T16:11:54.099 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-09-13T16:11:54.100 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-09-13T16:11:54.100 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-09-13T16:11:54.101 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-09-13T16:11:54.102 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-09-13T16:11:54.103 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-09-13T16:11:54.104 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-09-13T16:11:54.105 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-09-13T16:11:54.106 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-09-13T16:11:54.108 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-09-13T16:11:54.109 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-09-13T16:11:54.110 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-09-13T16:11:54.111 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-09-13T16:11:54.112 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-09-13T16:11:54.113 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-09-13T16:11:54.114 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-09-13T16:11:54.115 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-09-13T16:11:54.116 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-09-13T16:11:54.117 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-09-13T16:11:54.118 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-09-13T16:11:54.120 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-09-13T16:11:54.122 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-09-13T16:11:54.123 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-09-13T16:11:54.124 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-09-13T16:11:54.124 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-09-13T16:11:54.125 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-09-13T16:11:54.126 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-09-13T16:11:54.127 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-09-13T16:11:54.127 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-09-13T16:11:54.128 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-09-13T16:11:54.129 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-09-13T16:11:54.130 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-09-13T16:11:54.131 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-09-13T16:11:54.131 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-09-13T16:11:54.132 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-09-13T16:11:54.133 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-09-13T16:11:54.134 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-09-13T16:11:54.135 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-09-13T16:11:54.136 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-09-13T16:11:54.137 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-09-13T16:11:54.138 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-09-13T16:11:54.139 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-09-13T16:11:54.140 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-09-13T16:11:54.141 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-09-13T16:11:54.142 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-09-13T16:11:54.143 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-09-13T16:11:54.144 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-09-13T16:11:54.145 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-09-13T16:11:54.146 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-09-13T16:11:54.147 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-09-13T16:11:54.148 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-09-13T16:11:54.149 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-09-13T16:11:54.150 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-09-13T16:11:54.151 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-09-13T16:11:54.152 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-09-13T16:11:54.153 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-09-13T16:11:54.154 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-09-13T16:11:54.155 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-09-13T16:11:54.156 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-09-13T16:11:54.157 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-09-13T16:11:54.158 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-09-13T16:11:54.159 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-09-13T16:11:54.160 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-09-13T16:11:54.161 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-09-13T16:11:54.162 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-09-13T16:11:54.163 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-09-13T16:11:54.163 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-09-13T16:11:54.164 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-09-13T16:11:54.166 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-09-13T16:11:54.166 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-09-13T16:11:54.168 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-09-13T16:11:54.168 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-09-13T16:11:54.170 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-09-13T16:11:54.171 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-09-13T16:11:54.172 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-09-13T16:11:54.173 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-09-13T16:11:54.174 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-09-13T16:11:54.175 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-09-13T16:11:54.176 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-09-13T16:11:54.177 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-09-13T16:11:54.177 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-09-13T16:11:54.178 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-09-13T16:11:54.179 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-09-13T16:11:54.180 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-09-13T16:11:54.181 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-09-13T16:11:54.182 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-09-13T16:11:54.183 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-09-13T16:11:54.183 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-09-13T16:11:54.184 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-09-13T16:11:54.185 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-09-13T16:11:54.186 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-09-13T16:11:54.187 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-09-13T16:11:54.188 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-09-13T16:11:54.189 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-09-13T16:11:54.189 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-09-13T16:11:54.190 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-09-13T16:11:54.191 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-09-13T16:11:54.192 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-09-13T16:11:54.193 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-09-13T16:11:54.194 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-09-13T16:11:54.194 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-09-13T16:11:54.195 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-09-13T16:11:54.196 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-09-13T16:11:54.197 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-09-13T16:11:54.199 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-09-13T16:11:54.200 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-09-13T16:11:54.200 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-09-13T16:11:54.201 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-09-13T16:11:54.202 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-09-13T16:11:54.203 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-09-13T16:11:54.204 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-09-13T16:11:54.205 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-09-13T16:11:54.206 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-09-13T16:11:54.207 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-09-13T16:11:54.208 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-09-13T16:11:54.209 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-09-13T16:11:54.210 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-09-13T16:11:54.211 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-09-13T16:11:54.212 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-09-13T16:11:54.213 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-09-13T16:11:54.213 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-09-13T16:11:54.214 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-09-13T16:11:54.215 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-09-13T16:11:54.216 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-09-13T16:11:54.217 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-09-13T16:11:54.218 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-09-13T16:11:54.219 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-09-13T16:11:54.220 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-09-13T16:11:54.221 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-09-13T16:11:54.222 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-09-13T16:11:54.222 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-09-13T16:11:54.224 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-09-13T16:11:54.225 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-09-13T16:11:54.226 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-09-13T16:11:54.227 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-09-13T16:11:54.228 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-09-13T16:11:54.229 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-09-13T16:11:54.230 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-09-13T16:11:54.231 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-09-13T16:11:54.232 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-09-13T16:11:54.233 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-09-13T16:11:54.234 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-09-13T16:11:54.235 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-09-13T16:11:54.236 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-09-13T16:11:54.237 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-09-13T16:11:54.238 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-09-13T16:11:54.239 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-09-13T16:11:54.240 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-09-13T16:11:54.241 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-09-13T16:11:54.242 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-09-13T16:11:54.243 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-09-13T16:11:54.244 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-09-13T16:11:54.245 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-09-13T16:11:54.246 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-09-13T16:11:54.247 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-09-13T16:11:54.247 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-09-13T16:11:54.249 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-09-13T16:11:54.249 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-09-13T16:11:54.250 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-09-13T16:11:54.252 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-09-13T16:11:54.253 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-09-13T16:11:54.254 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-09-13T16:11:54.256 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-09-13T16:11:54.256 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-09-13T16:11:54.257 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-09-13T16:11:54.258 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-09-13T16:11:54.259 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-09-13T16:11:54.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:54 smithi086 ceph-mon[30379]: pgmap v411: 129 pgs: 129 active+clean; 699 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-09-13T16:11:54.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:54 smithi139 ceph-mon[35320]: pgmap v411: 129 pgs: 129 active+clean; 699 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-09-13T16:11:55.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:54 smithi194 ceph-mon[35694]: pgmap v411: 129 pgs: 129 active+clean; 699 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-09-13T16:11:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:56 smithi086 ceph-mon[30379]: pgmap v412: 129 pgs: 129 active+clean; 4.7 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 344 KiB/s wr, 7 op/s 2024-09-13T16:11:56.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:56 smithi139 ceph-mon[35320]: pgmap v412: 129 pgs: 129 active+clean; 4.7 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 344 KiB/s wr, 7 op/s 2024-09-13T16:11:57.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:56 smithi194 ceph-mon[35694]: pgmap v412: 129 pgs: 129 active+clean; 4.7 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 344 KiB/s wr, 7 op/s 2024-09-13T16:11:58.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:11:58 smithi086 ceph-mon[30379]: pgmap v413: 129 pgs: 129 active+clean; 29 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.4 MiB/s wr, 9 op/s 2024-09-13T16:11:58.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:11:58 smithi139 ceph-mon[35320]: pgmap v413: 129 pgs: 129 active+clean; 29 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.4 MiB/s wr, 9 op/s 2024-09-13T16:11:59.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:11:58 smithi194 ceph-mon[35694]: pgmap v413: 129 pgs: 129 active+clean; 29 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.4 MiB/s wr, 9 op/s 2024-09-13T16:11:59.015 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-09-13T16:11:59.016 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-09-13T16:11:59.017 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-09-13T16:11:59.020 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-09-13T16:11:59.020 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-09-13T16:11:59.022 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-09-13T16:11:59.023 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-09-13T16:11:59.024 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-09-13T16:11:59.025 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-09-13T16:11:59.026 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-09-13T16:11:59.027 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-09-13T16:11:59.028 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-09-13T16:11:59.029 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-09-13T16:11:59.031 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-09-13T16:11:59.032 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-09-13T16:11:59.033 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-09-13T16:11:59.034 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-09-13T16:11:59.035 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-09-13T16:11:59.037 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-09-13T16:11:59.038 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-09-13T16:11:59.039 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-09-13T16:11:59.040 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-09-13T16:11:59.041 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-09-13T16:11:59.042 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-09-13T16:11:59.044 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-09-13T16:11:59.046 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-09-13T16:11:59.046 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-09-13T16:11:59.047 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-09-13T16:11:59.048 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-09-13T16:11:59.050 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-09-13T16:11:59.051 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-09-13T16:11:59.054 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-09-13T16:11:59.055 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-09-13T16:11:59.056 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-09-13T16:11:59.057 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/EDID/ 2024-09-13T16:11:59.058 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-09-13T16:11:59.059 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-09-13T16:11:59.060 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-09-13T16:11:59.061 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-09-13T16:11:59.062 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-09-13T16:11:59.063 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-09-13T16:11:59.064 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-09-13T16:11:59.065 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-09-13T16:11:59.066 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-09-13T16:11:59.067 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/EDID/hex 2024-09-13T16:11:59.068 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/HOWTO 2024-09-13T16:11:59.069 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-09-13T16:11:59.070 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-09-13T16:11:59.071 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-09-13T16:11:59.073 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-09-13T16:11:59.074 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-09-13T16:11:59.075 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/Makefile 2024-09-13T16:11:59.076 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-09-13T16:11:59.077 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/PCI/ 2024-09-13T16:11:59.078 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-09-13T16:11:59.080 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-09-13T16:11:59.081 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-09-13T16:11:59.082 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-09-13T16:11:59.083 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-09-13T16:11:59.084 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-09-13T16:11:59.085 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-09-13T16:11:59.087 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/ 2024-09-13T16:11:59.088 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-09-13T16:11:59.089 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-09-13T16:11:59.090 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-09-13T16:11:59.091 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-09-13T16:11:59.092 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-09-13T16:11:59.093 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-09-13T16:11:59.094 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-09-13T16:11:59.095 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-09-13T16:11:59.096 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-09-13T16:11:59.097 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-09-13T16:11:59.098 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-09-13T16:11:59.099 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-09-13T16:11:59.100 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-09-13T16:11:59.101 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-09-13T16:11:59.102 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-09-13T16:11:59.103 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-09-13T16:11:59.104 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-09-13T16:11:59.105 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-09-13T16:11:59.106 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/SAK.txt 2024-09-13T16:11:59.107 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/SM501.txt 2024-09-13T16:11:59.108 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-09-13T16:11:59.110 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-09-13T16:11:59.111 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-09-13T16:11:59.112 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-09-13T16:11:59.113 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-09-13T16:11:59.114 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/accounting/ 2024-09-13T16:11:59.115 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-09-13T16:11:59.117 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-09-13T16:11:59.118 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-09-13T16:11:59.119 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-09-13T16:11:59.120 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-09-13T16:11:59.121 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-09-13T16:11:59.122 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-09-13T16:11:59.123 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/acpi/ 2024-09-13T16:11:59.125 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-09-13T16:11:59.126 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-09-13T16:11:59.127 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-09-13T16:11:59.128 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-09-13T16:11:59.129 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-09-13T16:11:59.130 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-09-13T16:11:59.131 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-09-13T16:11:59.132 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-09-13T16:11:59.133 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-09-13T16:11:59.135 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-09-13T16:11:59.135 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-09-13T16:11:59.136 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-09-13T16:11:59.137 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-09-13T16:11:59.138 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/aoe/ 2024-09-13T16:11:59.139 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-09-13T16:11:59.140 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-09-13T16:11:59.141 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-09-13T16:11:59.142 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-09-13T16:11:59.143 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-09-13T16:11:59.144 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-09-13T16:11:59.145 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-09-13T16:11:59.146 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/ 2024-09-13T16:11:59.147 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-09-13T16:11:59.148 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-09-13T16:11:59.150 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-09-13T16:11:59.150 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Booting 2024-09-13T16:11:59.151 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-09-13T16:11:59.152 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-09-13T16:11:59.153 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-09-13T16:11:59.154 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-09-13T16:11:59.155 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-09-13T16:11:59.156 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-09-13T16:11:59.157 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-09-13T16:11:59.158 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-09-13T16:11:59.159 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-09-13T16:11:59.160 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-09-13T16:11:59.161 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Porting 2024-09-13T16:11:59.163 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/README 2024-09-13T16:11:59.163 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-09-13T16:11:59.164 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-09-13T16:11:59.165 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-09-13T16:11:59.166 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-09-13T16:11:59.167 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-09-13T16:11:59.168 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-09-13T16:11:59.169 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-09-13T16:11:59.170 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-09-13T16:11:59.171 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-09-13T16:11:59.172 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-09-13T16:11:59.173 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-09-13T16:11:59.174 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-09-13T16:11:59.175 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-09-13T16:11:59.175 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-09-13T16:11:59.176 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-09-13T16:11:59.177 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-09-13T16:11:59.178 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-09-13T16:11:59.179 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-09-13T16:11:59.180 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-09-13T16:11:59.181 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-09-13T16:11:59.182 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-09-13T16:11:59.183 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-09-13T16:11:59.184 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-09-13T16:11:59.185 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-09-13T16:11:59.186 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-09-13T16:11:59.187 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-09-13T16:11:59.188 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-09-13T16:11:59.189 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-09-13T16:11:59.190 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-09-13T16:11:59.191 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-09-13T16:11:59.193 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-09-13T16:11:59.193 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-09-13T16:11:59.194 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-09-13T16:11:59.196 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-09-13T16:11:59.196 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-09-13T16:11:59.197 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-09-13T16:11:59.198 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-09-13T16:11:59.199 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-09-13T16:11:59.200 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-09-13T16:11:59.201 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-09-13T16:11:59.202 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-09-13T16:11:59.203 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-09-13T16:11:59.204 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-09-13T16:11:59.206 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/Setup 2024-09-13T16:11:59.207 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-09-13T16:11:59.208 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-09-13T16:11:59.209 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-09-13T16:11:59.210 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-09-13T16:11:59.211 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-09-13T16:11:59.212 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-09-13T16:11:59.213 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-09-13T16:11:59.215 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-09-13T16:11:59.215 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-09-13T16:11:59.216 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-09-13T16:11:59.217 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-09-13T16:11:59.218 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-09-13T16:11:59.219 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-09-13T16:11:59.220 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-09-13T16:11:59.221 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-09-13T16:11:59.222 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-09-13T16:11:59.223 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-09-13T16:11:59.224 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-09-13T16:11:59.229 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-09-13T16:11:59.229 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-09-13T16:11:59.229 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-09-13T16:11:59.230 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-09-13T16:11:59.230 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-09-13T16:11:59.230 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-09-13T16:11:59.231 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-09-13T16:11:59.232 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-09-13T16:11:59.233 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-09-13T16:11:59.234 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-09-13T16:11:59.235 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-09-13T16:11:59.236 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-09-13T16:11:59.237 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm64/ 2024-09-13T16:11:59.239 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-09-13T16:11:59.240 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-09-13T16:11:59.241 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-09-13T16:11:59.241 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-09-13T16:11:59.242 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-09-13T16:11:59.243 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-09-13T16:11:59.245 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-09-13T16:11:59.246 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-09-13T16:11:59.247 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-09-13T16:11:59.248 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-09-13T16:11:59.249 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-09-13T16:11:59.250 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-09-13T16:11:59.251 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/backlight/ 2024-09-13T16:11:59.252 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-09-13T16:11:59.253 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-09-13T16:11:59.254 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-09-13T16:11:59.255 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/bcache.txt 2024-09-13T16:11:59.256 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-09-13T16:11:59.257 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blackfin/ 2024-09-13T16:11:59.258 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-09-13T16:11:59.259 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-09-13T16:11:59.260 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-09-13T16:11:59.261 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-09-13T16:11:59.262 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-09-13T16:11:59.263 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/block/ 2024-09-13T16:11:59.264 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-09-13T16:11:59.265 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-09-13T16:11:59.266 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-09-13T16:11:59.267 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-09-13T16:11:59.268 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-09-13T16:11:59.269 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-09-13T16:11:59.270 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-09-13T16:11:59.271 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-09-13T16:11:59.272 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-09-13T16:11:59.273 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-09-13T16:11:59.275 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-09-13T16:11:59.275 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/block/request.txt 2024-09-13T16:11:59.276 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-09-13T16:11:59.277 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-09-13T16:11:59.278 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-09-13T16:11:59.279 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/ 2024-09-13T16:11:59.280 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-09-13T16:11:59.281 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-09-13T16:11:59.282 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-09-13T16:11:59.283 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-09-13T16:11:59.284 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-09-13T16:11:59.285 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-09-13T16:11:59.286 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-09-13T16:11:59.287 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-09-13T16:11:59.288 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-09-13T16:11:59.289 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-09-13T16:11:59.290 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-09-13T16:11:59.291 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-09-13T16:11:59.292 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-09-13T16:11:59.293 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-09-13T16:11:59.294 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-09-13T16:11:59.295 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-09-13T16:11:59.296 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-09-13T16:11:59.296 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-09-13T16:11:59.297 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-09-13T16:11:59.298 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-09-13T16:11:59.299 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-09-13T16:11:59.300 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-09-13T16:11:59.301 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-09-13T16:11:59.302 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-09-13T16:11:59.303 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-09-13T16:11:59.304 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-09-13T16:11:59.305 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cdrom/ 2024-09-13T16:11:59.307 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-09-13T16:11:59.309 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-09-13T16:11:59.310 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-09-13T16:11:59.310 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-09-13T16:11:59.311 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-09-13T16:11:59.312 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cgroups/ 2024-09-13T16:11:59.314 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-09-13T16:11:59.315 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-09-13T16:11:59.316 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-09-13T16:11:59.317 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-09-13T16:11:59.318 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-09-13T16:11:59.318 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-09-13T16:11:59.319 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-09-13T16:11:59.321 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-09-13T16:11:59.322 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-09-13T16:11:59.323 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-09-13T16:11:59.324 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-09-13T16:11:59.325 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-09-13T16:11:59.326 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-09-13T16:11:59.327 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-09-13T16:11:59.328 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/clk.txt 2024-09-13T16:11:59.329 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-09-13T16:11:59.330 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/connector/ 2024-09-13T16:11:59.331 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-09-13T16:11:59.332 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-09-13T16:11:59.334 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-09-13T16:11:59.334 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-09-13T16:11:59.335 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-09-13T16:11:59.336 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/console/ 2024-09-13T16:11:59.337 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/console/console.txt 2024-09-13T16:11:59.338 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-09-13T16:11:59.339 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-09-13T16:11:59.340 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-09-13T16:11:59.341 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-09-13T16:11:59.342 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-09-13T16:11:59.342 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-09-13T16:11:59.343 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-09-13T16:11:59.345 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-09-13T16:11:59.346 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-09-13T16:11:59.347 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-09-13T16:11:59.348 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-09-13T16:11:59.349 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-09-13T16:11:59.350 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-09-13T16:11:59.351 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-09-13T16:11:59.351 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-09-13T16:11:59.353 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-09-13T16:11:59.353 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-09-13T16:11:59.355 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-09-13T16:11:59.355 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-09-13T16:11:59.356 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-09-13T16:11:59.357 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/crc32.txt 2024-09-13T16:11:59.358 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cris/ 2024-09-13T16:11:59.360 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/cris/README 2024-09-13T16:11:59.361 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/crypto/ 2024-09-13T16:11:59.362 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-09-13T16:11:59.363 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-09-13T16:11:59.364 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-09-13T16:11:59.364 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-09-13T16:11:59.365 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-09-13T16:11:59.366 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-09-13T16:11:59.367 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-09-13T16:11:59.368 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-09-13T16:11:59.369 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-09-13T16:11:59.371 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/development-process/ 2024-09-13T16:11:59.372 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-09-13T16:11:59.373 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-09-13T16:11:59.374 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-09-13T16:11:59.375 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-09-13T16:11:59.376 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-09-13T16:11:59.377 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-09-13T16:11:59.378 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-09-13T16:11:59.379 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-09-13T16:11:59.380 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-09-13T16:11:59.381 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-09-13T16:11:59.382 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-09-13T16:11:59.383 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-09-13T16:11:59.385 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-09-13T16:11:59.386 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-09-13T16:11:59.387 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-09-13T16:11:59.388 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-09-13T16:11:59.389 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-09-13T16:11:59.390 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-09-13T16:11:59.391 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-09-13T16:11:59.392 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-09-13T16:11:59.393 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-09-13T16:11:59.394 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-09-13T16:11:59.395 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-09-13T16:11:59.396 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-09-13T16:11:59.397 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-09-13T16:11:59.398 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-09-13T16:11:59.399 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-09-13T16:11:59.400 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-09-13T16:11:59.401 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-09-13T16:11:59.402 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-09-13T16:11:59.403 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-09-13T16:11:59.404 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devices.txt 2024-09-13T16:11:59.406 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/ 2024-09-13T16:11:59.407 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-09-13T16:11:59.408 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-09-13T16:11:59.409 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-09-13T16:11:59.410 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-09-13T16:11:59.411 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-09-13T16:11:59.412 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-09-13T16:11:59.413 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-09-13T16:11:59.415 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-09-13T16:11:59.417 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-09-13T16:11:59.418 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-09-13T16:11:59.419 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-09-13T16:11:59.420 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-09-13T16:11:59.421 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-09-13T16:11:59.422 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-09-13T16:11:59.423 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-09-13T16:11:59.423 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-09-13T16:11:59.424 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-09-13T16:11:59.426 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-09-13T16:11:59.427 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-09-13T16:11:59.428 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-09-13T16:11:59.429 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-09-13T16:11:59.430 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-09-13T16:11:59.430 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-09-13T16:11:59.431 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-09-13T16:11:59.432 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-09-13T16:11:59.436 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-09-13T16:11:59.437 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-09-13T16:11:59.437 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-09-13T16:11:59.437 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-09-13T16:11:59.438 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-09-13T16:11:59.439 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-09-13T16:11:59.440 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-09-13T16:11:59.441 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-09-13T16:11:59.442 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-09-13T16:11:59.443 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-09-13T16:11:59.444 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-09-13T16:11:59.445 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-09-13T16:11:59.446 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-09-13T16:11:59.447 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-09-13T16:11:59.448 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-09-13T16:11:59.449 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-09-13T16:11:59.450 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-09-13T16:11:59.451 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-09-13T16:11:59.452 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-09-13T16:11:59.453 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-09-13T16:11:59.454 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-09-13T16:11:59.455 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-09-13T16:11:59.456 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-09-13T16:11:59.457 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-09-13T16:11:59.458 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-09-13T16:11:59.459 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-09-13T16:11:59.460 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-09-13T16:11:59.461 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-09-13T16:11:59.462 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-09-13T16:11:59.463 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-09-13T16:11:59.464 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-09-13T16:11:59.465 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-09-13T16:11:59.466 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-09-13T16:11:59.467 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-09-13T16:11:59.468 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-09-13T16:11:59.468 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-09-13T16:11:59.469 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-09-13T16:11:59.470 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-09-13T16:11:59.471 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-09-13T16:11:59.472 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-09-13T16:11:59.473 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-09-13T16:11:59.474 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-09-13T16:11:59.475 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-09-13T16:11:59.476 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-09-13T16:11:59.477 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-09-13T16:11:59.478 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-09-13T16:11:59.479 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-09-13T16:11:59.480 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-09-13T16:11:59.481 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-09-13T16:11:59.482 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-09-13T16:11:59.483 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-09-13T16:11:59.484 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-09-13T16:11:59.484 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-09-13T16:11:59.485 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-09-13T16:11:59.487 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-09-13T16:11:59.488 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-09-13T16:11:59.489 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-09-13T16:11:59.490 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-09-13T16:11:59.491 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-09-13T16:11:59.492 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-09-13T16:11:59.493 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-09-13T16:11:59.494 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-09-13T16:11:59.495 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-09-13T16:11:59.496 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-09-13T16:11:59.497 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-09-13T16:11:59.498 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-09-13T16:11:59.499 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-09-13T16:11:59.500 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-09-13T16:11:59.501 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-09-13T16:11:59.502 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-09-13T16:11:59.503 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-09-13T16:11:59.504 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-09-13T16:11:59.505 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-09-13T16:11:59.506 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-09-13T16:11:59.507 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-09-13T16:11:59.508 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-09-13T16:11:59.509 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-09-13T16:11:59.510 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-09-13T16:11:59.511 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-09-13T16:11:59.512 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-09-13T16:11:59.513 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-09-13T16:11:59.514 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-09-13T16:11:59.515 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-09-13T16:11:59.516 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-09-13T16:11:59.517 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-09-13T16:11:59.518 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-09-13T16:11:59.519 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-09-13T16:11:59.520 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-09-13T16:11:59.521 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-09-13T16:11:59.522 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-09-13T16:11:59.523 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-09-13T16:11:59.524 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-09-13T16:11:59.525 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-09-13T16:11:59.526 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-09-13T16:11:59.526 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-09-13T16:11:59.527 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-09-13T16:11:59.528 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-09-13T16:11:59.529 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-09-13T16:11:59.530 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-09-13T16:11:59.531 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-09-13T16:11:59.533 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-09-13T16:11:59.534 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-09-13T16:11:59.534 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-09-13T16:11:59.535 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-09-13T16:11:59.536 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-09-13T16:11:59.537 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-09-13T16:11:59.538 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-09-13T16:11:59.539 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-09-13T16:11:59.540 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-09-13T16:11:59.541 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-09-13T16:11:59.542 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-09-13T16:11:59.543 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-09-13T16:11:59.544 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-09-13T16:11:59.545 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-09-13T16:11:59.546 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-09-13T16:11:59.546 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-09-13T16:11:59.547 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-09-13T16:11:59.548 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-09-13T16:11:59.549 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-09-13T16:11:59.549 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-09-13T16:11:59.550 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-09-13T16:11:59.551 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-09-13T16:11:59.552 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-09-13T16:11:59.553 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-09-13T16:11:59.554 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-09-13T16:11:59.558 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-09-13T16:11:59.561 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-09-13T16:11:59.562 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-09-13T16:11:59.563 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-09-13T16:11:59.564 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-09-13T16:11:59.565 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-09-13T16:11:59.566 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-09-13T16:11:59.567 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-09-13T16:11:59.568 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-09-13T16:11:59.569 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-09-13T16:11:59.570 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-09-13T16:11:59.571 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-09-13T16:11:59.571 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-09-13T16:11:59.573 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-09-13T16:11:59.574 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-09-13T16:11:59.575 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-09-13T16:11:59.576 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-09-13T16:11:59.576 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-09-13T16:11:59.577 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-09-13T16:11:59.578 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-09-13T16:11:59.579 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-09-13T16:11:59.580 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-09-13T16:11:59.581 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-09-13T16:11:59.582 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-09-13T16:11:59.582 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-09-13T16:11:59.583 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-09-13T16:11:59.584 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-09-13T16:11:59.585 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-09-13T16:11:59.586 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-09-13T16:11:59.587 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-09-13T16:11:59.588 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-09-13T16:11:59.589 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-09-13T16:11:59.590 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-09-13T16:11:59.591 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-09-13T16:11:59.592 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-09-13T16:11:59.593 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-09-13T16:11:59.593 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-09-13T16:11:59.594 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-09-13T16:11:59.595 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-09-13T16:11:59.596 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-09-13T16:11:59.597 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-09-13T16:11:59.598 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-09-13T16:11:59.599 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-09-13T16:11:59.600 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-09-13T16:11:59.601 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-09-13T16:11:59.602 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-09-13T16:11:59.603 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-09-13T16:11:59.605 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-09-13T16:11:59.606 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-09-13T16:11:59.607 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-09-13T16:11:59.607 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-09-13T16:11:59.608 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-09-13T16:11:59.609 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-09-13T16:11:59.610 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-09-13T16:11:59.611 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-09-13T16:11:59.611 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-09-13T16:11:59.612 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-09-13T16:11:59.613 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-09-13T16:11:59.613 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-09-13T16:11:59.614 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-09-13T16:11:59.615 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-09-13T16:11:59.616 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-09-13T16:11:59.618 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-09-13T16:11:59.618 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-09-13T16:11:59.619 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-09-13T16:11:59.620 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-09-13T16:11:59.621 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-09-13T16:11:59.622 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-09-13T16:11:59.623 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-09-13T16:11:59.624 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-09-13T16:11:59.625 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-09-13T16:11:59.626 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-09-13T16:11:59.627 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-09-13T16:11:59.628 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-09-13T16:11:59.629 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-09-13T16:11:59.630 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-09-13T16:11:59.631 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-09-13T16:11:59.632 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-09-13T16:11:59.633 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-09-13T16:11:59.634 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-09-13T16:11:59.635 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-09-13T16:11:59.636 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-09-13T16:11:59.637 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-09-13T16:11:59.638 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-09-13T16:11:59.639 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-09-13T16:11:59.640 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-09-13T16:11:59.641 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-09-13T16:11:59.642 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-09-13T16:11:59.643 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-09-13T16:11:59.644 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-09-13T16:11:59.645 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-09-13T16:11:59.646 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-09-13T16:11:59.647 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-09-13T16:11:59.648 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-09-13T16:11:59.649 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-09-13T16:11:59.650 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-09-13T16:11:59.651 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-09-13T16:11:59.652 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-09-13T16:11:59.653 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-09-13T16:11:59.654 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-09-13T16:11:59.655 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-09-13T16:11:59.656 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-09-13T16:11:59.657 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-09-13T16:11:59.658 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-09-13T16:11:59.659 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-09-13T16:11:59.660 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-09-13T16:11:59.661 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-09-13T16:11:59.662 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-09-13T16:11:59.663 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-09-13T16:11:59.664 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-09-13T16:11:59.665 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-09-13T16:11:59.665 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-09-13T16:11:59.667 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-09-13T16:11:59.667 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-09-13T16:11:59.669 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-09-13T16:11:59.670 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-09-13T16:11:59.671 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-09-13T16:11:59.672 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-09-13T16:11:59.673 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-09-13T16:11:59.674 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-09-13T16:11:59.675 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-09-13T16:11:59.676 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-09-13T16:11:59.676 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-09-13T16:11:59.677 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-09-13T16:11:59.678 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-09-13T16:11:59.679 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-09-13T16:11:59.680 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-09-13T16:11:59.681 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-09-13T16:11:59.682 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-09-13T16:11:59.682 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-09-13T16:11:59.683 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-09-13T16:11:59.685 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-09-13T16:11:59.685 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-09-13T16:11:59.686 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-09-13T16:11:59.687 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-09-13T16:11:59.688 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-09-13T16:11:59.689 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-09-13T16:11:59.690 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-09-13T16:11:59.691 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-09-13T16:11:59.692 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-09-13T16:11:59.693 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-09-13T16:11:59.694 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-09-13T16:11:59.695 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-09-13T16:11:59.696 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-09-13T16:11:59.697 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-09-13T16:11:59.698 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-09-13T16:11:59.699 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-09-13T16:11:59.700 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-09-13T16:11:59.701 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-09-13T16:11:59.702 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-09-13T16:11:59.703 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-09-13T16:11:59.704 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-09-13T16:11:59.705 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-09-13T16:11:59.706 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-09-13T16:11:59.707 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-09-13T16:11:59.708 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-09-13T16:11:59.709 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-09-13T16:11:59.710 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-09-13T16:11:59.711 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-09-13T16:11:59.712 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-09-13T16:11:59.713 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-09-13T16:11:59.714 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-09-13T16:11:59.715 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-09-13T16:11:59.715 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-09-13T16:11:59.717 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-09-13T16:11:59.718 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-09-13T16:11:59.719 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-09-13T16:11:59.720 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-09-13T16:11:59.721 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-09-13T16:11:59.721 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-09-13T16:11:59.722 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-09-13T16:11:59.723 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-09-13T16:11:59.724 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-09-13T16:11:59.724 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-09-13T16:11:59.726 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-09-13T16:11:59.727 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-09-13T16:11:59.728 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-09-13T16:11:59.729 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-09-13T16:11:59.730 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-09-13T16:11:59.731 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-09-13T16:11:59.732 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-09-13T16:11:59.733 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-09-13T16:11:59.734 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-09-13T16:11:59.735 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-09-13T16:11:59.736 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-09-13T16:11:59.737 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-09-13T16:11:59.738 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-09-13T16:11:59.739 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-09-13T16:11:59.740 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-09-13T16:11:59.741 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-09-13T16:11:59.741 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-09-13T16:11:59.742 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-09-13T16:11:59.743 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-09-13T16:11:59.744 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-09-13T16:11:59.745 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-09-13T16:11:59.746 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-09-13T16:11:59.747 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-09-13T16:11:59.748 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-09-13T16:11:59.748 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-09-13T16:11:59.750 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-09-13T16:11:59.751 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-09-13T16:11:59.752 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-09-13T16:11:59.752 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-09-13T16:11:59.754 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-09-13T16:11:59.755 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-09-13T16:11:59.756 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-09-13T16:11:59.758 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-09-13T16:11:59.759 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-09-13T16:11:59.761 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-09-13T16:11:59.762 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-09-13T16:11:59.763 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-09-13T16:11:59.767 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-09-13T16:11:59.773 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-09-13T16:11:59.778 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-09-13T16:11:59.784 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-09-13T16:11:59.791 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-09-13T16:11:59.796 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-09-13T16:11:59.812 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-09-13T16:11:59.826 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-09-13T16:11:59.877 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-09-13T16:11:59.953 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-09-13T16:11:59.999 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-09-13T16:11:59.999 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-09-13T16:12:00.000 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-09-13T16:12:00.001 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-09-13T16:12:00.003 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-09-13T16:12:00.004 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-09-13T16:12:00.005 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-09-13T16:12:00.006 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-09-13T16:12:00.007 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-09-13T16:12:00.008 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-09-13T16:12:00.009 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-09-13T16:12:00.010 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-09-13T16:12:00.011 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-09-13T16:12:00.012 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-09-13T16:12:00.013 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-09-13T16:12:00.014 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-09-13T16:12:00.015 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-09-13T16:12:00.017 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-09-13T16:12:00.018 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-09-13T16:12:00.019 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-09-13T16:12:00.019 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-09-13T16:12:00.021 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-09-13T16:12:00.021 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-09-13T16:12:00.022 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-09-13T16:12:00.023 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-09-13T16:12:00.024 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-09-13T16:12:00.025 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-09-13T16:12:00.026 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-09-13T16:12:00.028 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-09-13T16:12:00.029 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-09-13T16:12:00.030 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-09-13T16:12:00.031 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-09-13T16:12:00.032 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-09-13T16:12:00.033 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-09-13T16:12:00.034 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-09-13T16:12:00.035 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-09-13T16:12:00.036 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-09-13T16:12:00.037 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-09-13T16:12:00.038 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-09-13T16:12:00.039 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-09-13T16:12:00.040 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-09-13T16:12:00.041 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-09-13T16:12:00.042 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-09-13T16:12:00.043 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-09-13T16:12:00.043 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-09-13T16:12:00.044 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-09-13T16:12:00.045 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-09-13T16:12:00.047 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-09-13T16:12:00.047 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-09-13T16:12:00.048 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-09-13T16:12:00.053 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-09-13T16:12:00.053 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-09-13T16:12:00.053 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-09-13T16:12:00.053 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-09-13T16:12:00.053 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-09-13T16:12:00.054 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-09-13T16:12:00.055 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-09-13T16:12:00.056 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-09-13T16:12:00.057 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-09-13T16:12:00.058 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-09-13T16:12:00.059 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-09-13T16:12:00.060 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-09-13T16:12:00.061 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-09-13T16:12:00.062 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-09-13T16:12:00.063 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-09-13T16:12:00.064 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-09-13T16:12:00.065 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-09-13T16:12:00.065 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-09-13T16:12:00.066 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-09-13T16:12:00.067 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-09-13T16:12:00.068 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-09-13T16:12:00.069 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-09-13T16:12:00.070 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-09-13T16:12:00.071 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-09-13T16:12:00.072 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-09-13T16:12:00.073 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-09-13T16:12:00.074 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-09-13T16:12:00.075 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-09-13T16:12:00.076 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-09-13T16:12:00.077 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-09-13T16:12:00.077 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-09-13T16:12:00.079 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-09-13T16:12:00.080 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-09-13T16:12:00.081 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-09-13T16:12:00.082 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-09-13T16:12:00.083 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-09-13T16:12:00.083 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-09-13T16:12:00.085 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-09-13T16:12:00.086 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-09-13T16:12:00.087 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-09-13T16:12:00.089 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-09-13T16:12:00.090 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-09-13T16:12:00.091 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-09-13T16:12:00.092 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-09-13T16:12:00.093 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-09-13T16:12:00.094 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-09-13T16:12:00.095 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-09-13T16:12:00.096 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-09-13T16:12:00.097 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-09-13T16:12:00.098 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-09-13T16:12:00.099 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-09-13T16:12:00.100 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-09-13T16:12:00.102 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-09-13T16:12:00.102 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-09-13T16:12:00.104 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-09-13T16:12:00.105 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-09-13T16:12:00.106 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-09-13T16:12:00.107 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-09-13T16:12:00.108 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-09-13T16:12:00.109 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-09-13T16:12:00.110 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-09-13T16:12:00.111 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-09-13T16:12:00.111 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-09-13T16:12:00.112 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-09-13T16:12:00.113 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-09-13T16:12:00.114 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-09-13T16:12:00.115 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-09-13T16:12:00.116 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-09-13T16:12:00.117 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-09-13T16:12:00.118 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-09-13T16:12:00.119 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-09-13T16:12:00.119 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-09-13T16:12:00.120 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-09-13T16:12:00.121 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-09-13T16:12:00.122 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-09-13T16:12:00.123 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-09-13T16:12:00.124 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-09-13T16:12:00.125 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-09-13T16:12:00.126 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-09-13T16:12:00.127 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-09-13T16:12:00.128 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-09-13T16:12:00.128 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-09-13T16:12:00.129 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-09-13T16:12:00.130 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-09-13T16:12:00.131 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-09-13T16:12:00.132 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-09-13T16:12:00.133 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-09-13T16:12:00.134 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-09-13T16:12:00.135 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-09-13T16:12:00.136 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-09-13T16:12:00.137 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-09-13T16:12:00.138 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-09-13T16:12:00.139 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-09-13T16:12:00.140 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-09-13T16:12:00.141 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-09-13T16:12:00.141 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-09-13T16:12:00.143 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-09-13T16:12:00.143 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-09-13T16:12:00.144 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-09-13T16:12:00.145 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-09-13T16:12:00.146 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-09-13T16:12:00.147 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-09-13T16:12:00.148 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-09-13T16:12:00.150 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-09-13T16:12:00.150 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-09-13T16:12:00.151 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-09-13T16:12:00.152 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-09-13T16:12:00.153 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-09-13T16:12:00.154 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-09-13T16:12:00.155 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-09-13T16:12:00.156 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-09-13T16:12:00.157 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-09-13T16:12:00.158 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-09-13T16:12:00.159 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-09-13T16:12:00.160 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-09-13T16:12:00.161 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-09-13T16:12:00.162 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-09-13T16:12:00.163 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-09-13T16:12:00.164 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-09-13T16:12:00.165 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-09-13T16:12:00.166 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-09-13T16:12:00.167 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-09-13T16:12:00.168 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-09-13T16:12:00.169 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-09-13T16:12:00.170 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-09-13T16:12:00.171 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-09-13T16:12:00.172 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-09-13T16:12:00.173 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-09-13T16:12:00.174 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-09-13T16:12:00.175 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-09-13T16:12:00.176 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-09-13T16:12:00.177 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-09-13T16:12:00.179 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-09-13T16:12:00.180 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-09-13T16:12:00.181 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-09-13T16:12:00.182 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-09-13T16:12:00.183 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-09-13T16:12:00.184 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-09-13T16:12:00.185 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-09-13T16:12:00.186 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-09-13T16:12:00.187 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-09-13T16:12:00.188 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-09-13T16:12:00.189 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-09-13T16:12:00.190 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-09-13T16:12:00.191 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-09-13T16:12:00.192 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-09-13T16:12:00.193 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-09-13T16:12:00.194 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-09-13T16:12:00.195 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-09-13T16:12:00.196 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-09-13T16:12:00.197 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-09-13T16:12:00.198 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-09-13T16:12:00.199 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-09-13T16:12:00.200 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-09-13T16:12:00.201 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-09-13T16:12:00.202 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-09-13T16:12:00.203 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-09-13T16:12:00.204 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-09-13T16:12:00.205 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-09-13T16:12:00.206 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-09-13T16:12:00.207 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-09-13T16:12:00.208 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-09-13T16:12:00.209 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-09-13T16:12:00.210 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-09-13T16:12:00.210 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-09-13T16:12:00.211 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-09-13T16:12:00.212 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-09-13T16:12:00.213 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-09-13T16:12:00.214 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-09-13T16:12:00.216 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-09-13T16:12:00.217 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-09-13T16:12:00.217 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-09-13T16:12:00.219 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-09-13T16:12:00.220 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-09-13T16:12:00.221 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-09-13T16:12:00.222 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-09-13T16:12:00.223 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-09-13T16:12:00.224 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-09-13T16:12:00.225 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-09-13T16:12:00.225 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-09-13T16:12:00.227 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-09-13T16:12:00.228 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-09-13T16:12:00.229 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-09-13T16:12:00.230 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-09-13T16:12:00.231 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-09-13T16:12:00.233 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-09-13T16:12:00.233 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-09-13T16:12:00.234 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-09-13T16:12:00.235 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-09-13T16:12:00.236 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-09-13T16:12:00.237 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-09-13T16:12:00.238 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-09-13T16:12:00.239 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-09-13T16:12:00.240 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-09-13T16:12:00.241 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-09-13T16:12:00.242 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-09-13T16:12:00.243 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-09-13T16:12:00.244 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-09-13T16:12:00.244 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-09-13T16:12:00.245 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-09-13T16:12:00.246 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-09-13T16:12:00.247 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-09-13T16:12:00.248 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-09-13T16:12:00.249 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-09-13T16:12:00.250 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-09-13T16:12:00.251 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-09-13T16:12:00.252 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-09-13T16:12:00.257 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-09-13T16:12:00.257 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-09-13T16:12:00.257 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-09-13T16:12:00.257 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-09-13T16:12:00.258 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-09-13T16:12:00.259 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-09-13T16:12:00.260 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-09-13T16:12:00.261 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-09-13T16:12:00.262 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-09-13T16:12:00.263 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-09-13T16:12:00.265 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-09-13T16:12:00.266 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-09-13T16:12:00.266 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-09-13T16:12:00.267 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-09-13T16:12:00.268 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-09-13T16:12:00.269 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-09-13T16:12:00.270 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-09-13T16:12:00.271 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-09-13T16:12:00.272 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-09-13T16:12:00.273 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-09-13T16:12:00.275 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-09-13T16:12:00.276 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-09-13T16:12:00.277 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-09-13T16:12:00.278 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-09-13T16:12:00.279 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-09-13T16:12:00.280 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-09-13T16:12:00.281 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-09-13T16:12:00.282 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-09-13T16:12:00.283 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-09-13T16:12:00.284 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-09-13T16:12:00.285 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-09-13T16:12:00.471 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-09-13T16:12:00.472 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-09-13T16:12:00.473 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-09-13T16:12:00.474 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-09-13T16:12:00.474 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-09-13T16:12:00.475 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-09-13T16:12:00.476 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-09-13T16:12:00.477 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-09-13T16:12:00.478 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-09-13T16:12:00.482 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-09-13T16:12:00.483 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-09-13T16:12:00.484 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-09-13T16:12:00.485 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-09-13T16:12:00.485 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-09-13T16:12:00.486 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-09-13T16:12:00.487 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-09-13T16:12:00.488 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-09-13T16:12:00.489 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-09-13T16:12:00.490 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-09-13T16:12:00.490 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-09-13T16:12:00.491 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-09-13T16:12:00.492 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-09-13T16:12:00.493 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-09-13T16:12:00.493 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.491+0000 7f2415000640 1 -- 172.21.15.86:0/547556195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2410101240 msgr2=0x7f2410101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:00.493 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.491+0000 7f2415000640 1 --2- 172.21.15.86:0/547556195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2410101240 0x7f2410101640 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2400009900 tx=0x7f240002a410 comp rx=0 tx=0).stop 2024-09-13T16:12:00.494 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.491+0000 7f2415000640 1 -- 172.21.15.86:0/547556195 shutdown_connections 2024-09-13T16:12:00.494 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.491+0000 7f2415000640 1 --2- 172.21.15.86:0/547556195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2410100130 0x7f2410107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.494 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.491+0000 7f2415000640 1 --2- 172.21.15.86:0/547556195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24100ff770 0x7f24100ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.494 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.491+0000 7f2415000640 1 --2- 172.21.15.86:0/547556195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2410101240 0x7f2410101640 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.494 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.492+0000 7f2415000640 1 -- 172.21.15.86:0/547556195 >> 172.21.15.86:0/547556195 conn(0x7f24100fb2c0 msgr2=0x7f24100fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:00.494 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.492+0000 7f2415000640 1 -- 172.21.15.86:0/547556195 shutdown_connections 2024-09-13T16:12:00.494 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.492+0000 7f2415000640 1 -- 172.21.15.86:0/547556195 wait complete. 2024-09-13T16:12:00.495 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-09-13T16:12:00.495 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.493+0000 7f2415000640 1 Processor -- start 2024-09-13T16:12:00.495 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.493+0000 7f2415000640 1 -- start start 2024-09-13T16:12:00.495 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-09-13T16:12:00.496 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.493+0000 7f2415000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24100ff770 0x7f2410074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:00.497 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.493+0000 7f2415000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2410100130 0x7f24100728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:00.497 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.493+0000 7f2415000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2410101240 0x7f2410072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:00.497 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.493+0000 7f2415000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2410073540 con 0x7f2410100130 2024-09-13T16:12:00.497 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.493+0000 7f2415000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24100736b0 con 0x7f24100ff770 2024-09-13T16:12:00.497 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.493+0000 7f2415000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241019fd40 con 0x7f2410101240 2024-09-13T16:12:00.497 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.493+0000 7f240f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24100ff770 0x7f2410074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:00.497 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.493+0000 7f240f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24100ff770 0x7f2410074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:52850/0 (socket says 172.21.15.86:52850) 2024-09-13T16:12:00.497 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.493+0000 7f240ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2410100130 0x7f24100728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:00.497 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.493+0000 7f240f400640 1 -- 172.21.15.86:0/1212011711 learned_addr learned my addr 172.21.15.86:0/1212011711 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:00.497 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.493+0000 7f240fe00640 1 --2- 172.21.15.86:0/1212011711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2410101240 0x7f2410072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:00.497 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.494+0000 7f240f400640 1 -- 172.21.15.86:0/1212011711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2410101240 msgr2=0x7f2410072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:00.497 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.494+0000 7f240f400640 1 --2- 172.21.15.86:0/1212011711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2410101240 0x7f2410072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.497 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.494+0000 7f240f400640 1 -- 172.21.15.86:0/1212011711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2410100130 msgr2=0x7f24100728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:00.498 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.494+0000 7f240f400640 1 --2- 172.21.15.86:0/1212011711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2410100130 0x7f24100728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.498 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.494+0000 7f240f400640 1 -- 172.21.15.86:0/1212011711 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2400009560 con 0x7f24100ff770 2024-09-13T16:12:00.498 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-09-13T16:12:00.499 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.494+0000 7f240f400640 1 --2- 172.21.15.86:0/1212011711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24100ff770 0x7f2410074260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2400005ab0 tx=0x7f24000055a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:00.499 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.494+0000 7f2407e00640 1 -- 172.21.15.86:0/1212011711 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2400004b50 con 0x7f24100ff770 2024-09-13T16:12:00.499 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.494+0000 7f2407e00640 1 -- 172.21.15.86:0/1212011711 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2400004cb0 con 0x7f24100ff770 2024-09-13T16:12:00.499 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.494+0000 7f2415000640 1 -- 172.21.15.86:0/1212011711 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241019ff90 con 0x7f24100ff770 2024-09-13T16:12:00.499 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.494+0000 7f2407e00640 1 -- 172.21.15.86:0/1212011711 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2400003b50 con 0x7f24100ff770 2024-09-13T16:12:00.499 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.494+0000 7f2415000640 1 -- 172.21.15.86:0/1212011711 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24101a0360 con 0x7f24100ff770 2024-09-13T16:12:00.499 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-09-13T16:12:00.500 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.497+0000 7f24193c3740 1 Processor -- start 2024-09-13T16:12:00.500 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-09-13T16:12:00.501 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.497+0000 7f24193c3740 1 -- start start 2024-09-13T16:12:00.501 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.497+0000 7f2407e00640 1 -- 172.21.15.86:0/1212011711 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2400031c00 con 0x7f24100ff770 2024-09-13T16:12:00.501 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.498+0000 7f24193c3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0b9c80 0x5573cb0ba080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:00.501 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.498+0000 7f24193c3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0ba5c0 0x5573cb0bf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:00.501 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.498+0000 7f24193c3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0bf650 0x5573cb0c1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:00.501 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.498+0000 7f24193c3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573cafc5bb0 con 0x5573cb0bf650 2024-09-13T16:12:00.501 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.498+0000 7f24193c3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573cb023a70 con 0x5573cb0b9c80 2024-09-13T16:12:00.501 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.498+0000 7f24193c3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573cb021200 con 0x5573cb0ba5c0 2024-09-13T16:12:00.502 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.498+0000 7f240fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0b9c80 0x5573cb0ba080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:00.502 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.498+0000 7f240fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0b9c80 0x5573cb0ba080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:52866/0 (socket says 172.21.15.86:52866) 2024-09-13T16:12:00.502 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.498+0000 7f240fe00640 1 -- 172.21.15.86:0/2853667534 learned_addr learned my addr 172.21.15.86:0/2853667534 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:00.502 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.498+0000 7f240f400640 1 --2- 172.21.15.86:0/2853667534 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0ba5c0 0x5573cb0bf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:00.502 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.498+0000 7f240ea00640 1 --2- 172.21.15.86:0/2853667534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0bf650 0x5573cb0c1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:00.502 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-09-13T16:12:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.498+0000 7f240fe00640 1 -- 172.21.15.86:0/2853667534 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0ba5c0 msgr2=0x5573cb0bf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.498+0000 7f240fe00640 1 --2- 172.21.15.86:0/2853667534 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0ba5c0 0x5573cb0bf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.498+0000 7f240fe00640 1 -- 172.21.15.86:0/2853667534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0bf650 msgr2=0x5573cb0c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.498+0000 7f240fe00640 1 --2- 172.21.15.86:0/2853667534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0bf650 0x5573cb0c1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.499+0000 7f240fe00640 1 -- 172.21.15.86:0/2853667534 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573cafbe940 con 0x5573cb0b9c80 2024-09-13T16:12:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.499+0000 7f2407e00640 1 --2- 172.21.15.86:0/1212011711 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f23f40a1130 0x7f23f40a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.499+0000 7f240fe00640 1 --2- 172.21.15.86:0/2853667534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0b9c80 0x5573cb0ba080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2408009fc0 tx=0x7f2408010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b63d49760a51663b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:00.504 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-09-13T16:12:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.499+0000 7f2407e00640 1 -- 172.21.15.86:0/1212011711 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f24000edc30 con 0x7f24100ff770 2024-09-13T16:12:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.499+0000 7f240f400640 1 --2- 172.21.15.86:0/1212011711 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f23f40a1130 0x7f23f40a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.499+0000 7f2404c00640 1 -- 172.21.15.86:0/2853667534 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2408003b70 con 0x5573cb0b9c80 2024-09-13T16:12:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.499+0000 7f2404c00640 1 -- 172.21.15.86:0/2853667534 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2408015070 con 0x5573cb0b9c80 2024-09-13T16:12:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.499+0000 7f2404c00640 1 -- 172.21.15.86:0/2853667534 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2408011900 con 0x5573cb0b9c80 2024-09-13T16:12:00.505 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-09-13T16:12:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.500+0000 7f24193c3740 1 -- 172.21.15.86:0/2853667534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0b9c80 msgr2=0x5573cb0ba080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:00.506 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.500+0000 7f240f400640 1 --2- 172.21.15.86:0/1212011711 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f23f40a1130 0x7f23f40a35f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f24000b7160 tx=0x7f24000f1630 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:00.506 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.500+0000 7f24193c3740 1 --2- 172.21.15.86:0/2853667534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0b9c80 0x5573cb0ba080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2408009fc0 tx=0x7f2408010860 comp rx=0 tx=0).stop 2024-09-13T16:12:00.506 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.500+0000 7f24193c3740 1 -- 172.21.15.86:0/2853667534 shutdown_connections 2024-09-13T16:12:00.506 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.500+0000 7f24193c3740 1 --2- 172.21.15.86:0/2853667534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0bf650 0x5573cb0c1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.506 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.500+0000 7f24193c3740 1 --2- 172.21.15.86:0/2853667534 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0ba5c0 0x5573cb0bf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.506 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.500+0000 7f24193c3740 1 --2- 172.21.15.86:0/2853667534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0b9c80 0x5573cb0ba080 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.506 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.500+0000 7f24193c3740 1 -- 172.21.15.86:0/2853667534 >> 172.21.15.86:0/2853667534 conn(0x5573cb0b52f0 msgr2=0x5573cb0b56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:00.506 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.500+0000 7f24193c3740 1 -- 172.21.15.86:0/2853667534 shutdown_connections 2024-09-13T16:12:00.506 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.500+0000 7f24193c3740 1 -- 172.21.15.86:0/2853667534 wait complete. 2024-09-13T16:12:00.506 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-09-13T16:12:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.501+0000 7f24193c3740 1 -- start start 2024-09-13T16:12:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.501+0000 7f24193c3740 1 Processor -- start 2024-09-13T16:12:00.507 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-09-13T16:12:00.508 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.501+0000 7f24193c3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0b9c80 0x5573cb0c3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:00.508 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.501+0000 7f24193c3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0ba5c0 0x5573cb0c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.501+0000 7f24193c3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0bf650 0x5573cb0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.501+0000 7f24193c3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573cb01caf0 con 0x5573cb0ba5c0 2024-09-13T16:12:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.501+0000 7f24193c3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573cafdaf20 con 0x5573cb0bf650 2024-09-13T16:12:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.501+0000 7f24193c3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573cafdabc0 con 0x5573cb0b9c80 2024-09-13T16:12:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.501+0000 7f24193c3740 10 client.0 _ll_register_callbacks cb 0x5573cb00ca70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:12:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.501+0000 7f240ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0ba5c0 0x5573cb0c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.502+0000 7f240fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0bf650 0x5573cb0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.502+0000 7f240fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0bf650 0x5573cb0caeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:52870/0 (socket says 172.21.15.86:52870) 2024-09-13T16:12:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.502+0000 7f240fe00640 1 -- 172.21.15.86:0/426833791 learned_addr learned my addr 172.21.15.86:0/426833791 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.502+0000 7f240fe00640 1 --2- 172.21.15.86:0/426833791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0b9c80 0x5573cb0c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:00.510 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-09-13T16:12:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.502+0000 7f240ea00640 1 -- 172.21.15.86:0/426833791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0b9c80 msgr2=0x5573cb0c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.502+0000 7f240ea00640 1 --2- 172.21.15.86:0/426833791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0b9c80 0x5573cb0c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.502+0000 7f240ea00640 1 -- 172.21.15.86:0/426833791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0bf650 msgr2=0x5573cb0caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.502+0000 7f240ea00640 1 --2- 172.21.15.86:0/426833791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0bf650 0x5573cb0caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.502+0000 7f240ea00640 1 -- 172.21.15.86:0/426833791 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2408009c70 con 0x5573cb0ba5c0 2024-09-13T16:12:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.502+0000 7f240ea00640 1 --2- 172.21.15.86:0/426833791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0ba5c0 0x5573cb0c3ec0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2410073fd0 tx=0x7f23fc012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe60a4b17c3a46df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.502+0000 7f23f9600640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T16:12:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.502+0000 7f23f9600640 1 -- 172.21.15.86:0/426833791 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc017070 con 0x5573cb0ba5c0 2024-09-13T16:12:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.503+0000 7f23f9600640 1 -- 172.21.15.86:0/426833791 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f23fc004020 con 0x5573cb0ba5c0 2024-09-13T16:12:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.503+0000 7f24193c3740 1 -- 172.21.15.86:0/426833791 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5573cb046c90 con 0x5573cb0ba5c0 2024-09-13T16:12:00.512 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-09-13T16:12:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.503+0000 7f23f9600640 1 -- 172.21.15.86:0/426833791 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23fc0041e0 con 0x5573cb0ba5c0 2024-09-13T16:12:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.503+0000 7f24193c3740 10 client.15450 fetch_fsmap learned FSMap version 25 2024-09-13T16:12:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.503+0000 7f24193c3740 1 -- 172.21.15.86:0/426833791 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5573cb01b170 con 0x5573cb0ba5c0 2024-09-13T16:12:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.503+0000 7f23f9600640 1 -- 172.21.15.86:0/426833791 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5573cb046c90 con 0x5573cb0ba5c0 2024-09-13T16:12:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.503+0000 7f23f9600640 1 -- 172.21.15.86:0/426833791 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f23fc0039f0 con 0x5573cb0ba5c0 2024-09-13T16:12:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.503+0000 7f24193c3740 10 client.15450 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:12:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.503+0000 7f24193c3740 10 client.15450 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:12:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.503+0000 7f24193c3740 20 client.15450 populate_metadata read hostname 'smithi086' 2024-09-13T16:12:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.503+0000 7f24193c3740 1 --2- 172.21.15.86:0/426833791 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5573cb0cf650 0x5573cb0d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:00.513 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-09-13T16:12:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.503+0000 7f24193c3740 4 client.15450 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:12:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.503+0000 7f24193c3740 1 -- 172.21.15.86:0/426833791 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5573cb00f7d0 con 0x5573cb0cf650 2024-09-13T16:12:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.504+0000 7f240fe00640 1 --2- 172.21.15.86:0/426833791 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5573cb0cf650 0x5573cb0d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:00.514 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-09-13T16:12:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.504+0000 7f240fe00640 1 --2- 172.21.15.86:0/426833791 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5573cb0cf650 0x5573cb0d1a70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=570068165b62b84 server_cookie=77677880f6949b03 in_seq=0 out_seq=0 2024-09-13T16:12:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.504+0000 7f23f9600640 10 client.15450 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.505+0000 7f23f9600640 1 -- 172.21.15.86:0/426833791 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5573cb00f7d0 con 0x5573cb0cf650 2024-09-13T16:12:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.505+0000 7f23f9600640 10 client.15450 handle_command_reply: tid=0 2024-09-13T16:12:00.515 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-09-13T16:12:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.505+0000 7f24193c3740 1 client.15450 shutdown 2024-09-13T16:12:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.505+0000 7f24193c3740 1 -- 172.21.15.86:0/426833791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0ba5c0 msgr2=0x5573cb0c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.505+0000 7f24193c3740 1 --2- 172.21.15.86:0/426833791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0ba5c0 0x5573cb0c3ec0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2410073fd0 tx=0x7f23fc012b60 comp rx=0 tx=0).stop 2024-09-13T16:12:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.505+0000 7f24193c3740 1 -- 172.21.15.86:0/426833791 shutdown_connections 2024-09-13T16:12:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.505+0000 7f24193c3740 1 --2- 172.21.15.86:0/426833791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0bf650 0x5573cb0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.505+0000 7f24193c3740 1 --2- 172.21.15.86:0/426833791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0ba5c0 0x5573cb0c3ec0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.505+0000 7f24193c3740 1 --2- 172.21.15.86:0/426833791 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5573cb0cf650 0x5573cb0d1a70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.505+0000 7f24193c3740 1 --2- 172.21.15.86:0/426833791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0b9c80 0x5573cb0c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.505+0000 7f23f9600640 0 client.15450 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.505+0000 7f24193c3740 1 -- 172.21.15.86:0/426833791 >> 172.21.15.86:0/426833791 conn(0x5573cb0b52f0 msgr2=0x5573cb0b6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.506+0000 7f24193c3740 1 -- 172.21.15.86:0/426833791 shutdown_connections 2024-09-13T16:12:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.506+0000 7f24193c3740 1 -- 172.21.15.86:0/426833791 wait complete. 2024-09-13T16:12:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.506+0000 7f24193c3740 20 client.15450 trim_cache size 0 max 16384 2024-09-13T16:12:00.518 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-09-13T16:12:00.519 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-09-13T16:12:00.519 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-09-13T16:12:00.519 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-09-13T16:12:00.519 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-09-13T16:12:00.519 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-09-13T16:12:00.519 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-09-13T16:12:00.519 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-09-13T16:12:00.519 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-09-13T16:12:00.519 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-09-13T16:12:00.519 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-09-13T16:12:00.519 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-09-13T16:12:00.519 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-09-13T16:12:00.519 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-09-13T16:12:00.520 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-09-13T16:12:00.520 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-09-13T16:12:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.519+0000 7f24193c3740 1 Processor -- start 2024-09-13T16:12:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.519+0000 7f24193c3740 1 -- start start 2024-09-13T16:12:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.519+0000 7f24193c3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0b9c80 0x5573cb0ba060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.520+0000 7f24193c3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0ba5c0 0x5573cb0cae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.520+0000 7f24193c3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0bf650 0x5573cb0b0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.520+0000 7f24193c3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573cad83e60 con 0x5573cb0bf650 2024-09-13T16:12:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.520+0000 7f24193c3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573cb0c4b50 con 0x5573cb0b9c80 2024-09-13T16:12:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.520+0000 7f24193c3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573cb0cdbe0 con 0x5573cb0ba5c0 2024-09-13T16:12:00.522 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-09-13T16:12:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.520+0000 7f240fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0b9c80 0x5573cb0ba060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.520+0000 7f240fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0bf650 0x5573cb0b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.520+0000 7f240fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0bf650 0x5573cb0b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48648/0 (socket says 172.21.15.86:48648) 2024-09-13T16:12:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.520+0000 7f240fe00640 1 -- 172.21.15.86:0/1371491599 learned_addr learned my addr 172.21.15.86:0/1371491599 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.520+0000 7f240ea00640 1 --2- 172.21.15.86:0/1371491599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0ba5c0 0x5573cb0cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.520+0000 7f240fe00640 1 -- 172.21.15.86:0/1371491599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0ba5c0 msgr2=0x5573cb0cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.520+0000 7f240fe00640 1 --2- 172.21.15.86:0/1371491599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0ba5c0 0x5573cb0cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.520+0000 7f240fe00640 1 -- 172.21.15.86:0/1371491599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0b9c80 msgr2=0x5573cb0ba060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.520+0000 7f240fe00640 1 --2- 172.21.15.86:0/1371491599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0b9c80 0x5573cb0ba060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.520+0000 7f240fe00640 1 -- 172.21.15.86:0/1371491599 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573cafbd180 con 0x5573cb0bf650 2024-09-13T16:12:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.520+0000 7f240fe00640 1 --2- 172.21.15.86:0/1371491599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0bf650 0x5573cb0b0640 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2408009a30 tx=0x7f2408009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1917991d542cb66b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:00.524 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-09-13T16:12:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.521+0000 7f2405600640 1 -- 172.21.15.86:0/1371491599 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240802e110 con 0x5573cb0bf650 2024-09-13T16:12:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.521+0000 7f2405600640 1 -- 172.21.15.86:0/1371491599 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2408034030 con 0x5573cb0bf650 2024-09-13T16:12:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.521+0000 7f2405600640 1 -- 172.21.15.86:0/1371491599 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2408011e80 con 0x5573cb0bf650 2024-09-13T16:12:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.521+0000 7f24193c3740 1 -- 172.21.15.86:0/1371491599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0bf650 msgr2=0x5573cb0b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.521+0000 7f24193c3740 1 --2- 172.21.15.86:0/1371491599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0bf650 0x5573cb0b0640 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2408009a30 tx=0x7f2408009500 comp rx=0 tx=0).stop 2024-09-13T16:12:00.525 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-09-13T16:12:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.521+0000 7f24193c3740 1 -- 172.21.15.86:0/1371491599 shutdown_connections 2024-09-13T16:12:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.521+0000 7f24193c3740 1 --2- 172.21.15.86:0/1371491599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0bf650 0x5573cb0b0640 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.521+0000 7f24193c3740 1 --2- 172.21.15.86:0/1371491599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0ba5c0 0x5573cb0cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.521+0000 7f24193c3740 1 --2- 172.21.15.86:0/1371491599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0b9c80 0x5573cb0ba060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.521+0000 7f24193c3740 1 -- 172.21.15.86:0/1371491599 >> 172.21.15.86:0/1371491599 conn(0x5573cb0b52f0 msgr2=0x5573cb0d63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.521+0000 7f24193c3740 1 -- 172.21.15.86:0/1371491599 shutdown_connections 2024-09-13T16:12:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.522+0000 7f24193c3740 1 -- 172.21.15.86:0/1371491599 wait complete. 2024-09-13T16:12:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.522+0000 7f24193c3740 1 -- start start 2024-09-13T16:12:00.526 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-09-13T16:12:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.522+0000 7f24193c3740 1 Processor -- start 2024-09-13T16:12:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.522+0000 7f24193c3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0b9c80 0x5573cb0c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.522+0000 7f24193c3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0ba5c0 0x5573cb0c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.522+0000 7f24193c3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0bf650 0x5573cb0ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.523+0000 7f24193c3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573cb0ca9e0 con 0x5573cb0ba5c0 2024-09-13T16:12:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.523+0000 7f24193c3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573cb0cab50 con 0x5573cb0b9c80 2024-09-13T16:12:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.523+0000 7f24193c3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573cb0cad10 con 0x5573cb0bf650 2024-09-13T16:12:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.523+0000 7f24193c3740 10 client.0 _ll_register_callbacks cb 0x7f2408009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:12:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.523+0000 7f240ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0ba5c0 0x5573cb0c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.523+0000 7f240fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0b9c80 0x5573cb0c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.523+0000 7f240ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0ba5c0 0x5573cb0c95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48664/0 (socket says 172.21.15.86:48664) 2024-09-13T16:12:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.523+0000 7f240fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0b9c80 0x5573cb0c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:52886/0 (socket says 172.21.15.86:52886) 2024-09-13T16:12:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.523+0000 7f240ea00640 1 -- 172.21.15.86:0/2707846009 learned_addr learned my addr 172.21.15.86:0/2707846009 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:00.528 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-09-13T16:12:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.523+0000 7f240fe00640 1 --2- 172.21.15.86:0/2707846009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0bf650 0x5573cb0ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.523+0000 7f240ea00640 1 -- 172.21.15.86:0/2707846009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0bf650 msgr2=0x5573cb0ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.523+0000 7f240ea00640 1 --2- 172.21.15.86:0/2707846009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0bf650 0x5573cb0ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.523+0000 7f240ea00640 1 -- 172.21.15.86:0/2707846009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0b9c80 msgr2=0x5573cb0c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.523+0000 7f240ea00640 1 --2- 172.21.15.86:0/2707846009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0b9c80 0x5573cb0c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.523+0000 7f240ea00640 1 -- 172.21.15.86:0/2707846009 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2408022040 con 0x5573cb0ba5c0 2024-09-13T16:12:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.523+0000 7f240ea00640 1 --2- 172.21.15.86:0/2707846009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0ba5c0 0x5573cb0c95d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x5573cb0b5f90 tx=0x7f23fc009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1209ecf5cb20b544 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.523+0000 7f23f9600640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T16:12:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.524+0000 7f23f9600640 1 -- 172.21.15.86:0/2707846009 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc017040 con 0x5573cb0ba5c0 2024-09-13T16:12:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.524+0000 7f24193c3740 1 -- 172.21.15.86:0/2707846009 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2408015070 con 0x5573cb0ba5c0 2024-09-13T16:12:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.524+0000 7f23f9600640 1 -- 172.21.15.86:0/2707846009 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f23fc00fdb0 con 0x5573cb0ba5c0 2024-09-13T16:12:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.524+0000 7f23f9600640 1 -- 172.21.15.86:0/2707846009 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23fc0035f0 con 0x5573cb0ba5c0 2024-09-13T16:12:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.524+0000 7f24193c3740 10 client.15456 fetch_fsmap learned FSMap version 25 2024-09-13T16:12:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.524+0000 7f24193c3740 1 -- 172.21.15.86:0/2707846009 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5573cafe2560 con 0x5573cb0ba5c0 2024-09-13T16:12:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.524+0000 7f23f9600640 1 -- 172.21.15.86:0/2707846009 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2408015070 con 0x5573cb0ba5c0 2024-09-13T16:12:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.524+0000 7f23f9600640 1 -- 172.21.15.86:0/2707846009 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f23fc01c6b0 con 0x5573cb0ba5c0 2024-09-13T16:12:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.524+0000 7f24193c3740 10 client.15456 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:12:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.524+0000 7f24193c3740 10 client.15456 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:12:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.524+0000 7f24193c3740 20 client.15456 populate_metadata read hostname 'smithi086' 2024-09-13T16:12:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.524+0000 7f24193c3740 1 --2- 172.21.15.86:0/2707846009 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5573cb12f6a0 0x5573cb131ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.524+0000 7f24193c3740 4 client.15456 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:12:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.524+0000 7f24193c3740 1 -- 172.21.15.86:0/2707846009 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5573cad10300 con 0x5573cb12f6a0 2024-09-13T16:12:00.532 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-09-13T16:12:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.525+0000 7f240fe00640 1 --2- 172.21.15.86:0/2707846009 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5573cb12f6a0 0x5573cb131ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.525+0000 7f240fe00640 1 --2- 172.21.15.86:0/2707846009 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5573cb12f6a0 0x5573cb131ac0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d705ace68f215b2d server_cookie=8be6f3021f1e9fa0 in_seq=0 out_seq=0 2024-09-13T16:12:00.533 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:00.525+0000 7f23f9600640 10 client.15456 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:00.533 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-09-13T16:12:00.533 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-09-13T16:12:00.533 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-09-13T16:12:00.534 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-09-13T16:12:00.534 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-09-13T16:12:00.534 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-09-13T16:12:00.534 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-09-13T16:12:00.534 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-09-13T16:12:00.535 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-09-13T16:12:00.536 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-09-13T16:12:00.538 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-09-13T16:12:00.539 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-09-13T16:12:00.541 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-09-13T16:12:00.542 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-09-13T16:12:00.543 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-09-13T16:12:00.544 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-09-13T16:12:00.545 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-09-13T16:12:00.546 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-09-13T16:12:00.548 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-09-13T16:12:00.549 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-09-13T16:12:00.550 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-09-13T16:12:00.551 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-09-13T16:12:00.552 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-09-13T16:12:00.553 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-09-13T16:12:00.555 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-09-13T16:12:00.556 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-09-13T16:12:00.557 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-09-13T16:12:00.559 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-09-13T16:12:00.559 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-09-13T16:12:00.560 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-09-13T16:12:00.561 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-09-13T16:12:00.562 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-09-13T16:12:00.563 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-09-13T16:12:00.564 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-09-13T16:12:00.565 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-09-13T16:12:00.566 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-09-13T16:12:00.567 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-09-13T16:12:00.568 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-09-13T16:12:00.569 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-09-13T16:12:00.570 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-09-13T16:12:00.571 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-09-13T16:12:00.572 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-09-13T16:12:00.573 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-09-13T16:12:00.575 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-09-13T16:12:00.576 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-09-13T16:12:00.577 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-09-13T16:12:00.578 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-09-13T16:12:00.579 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-09-13T16:12:00.580 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-09-13T16:12:00.581 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-09-13T16:12:00.582 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-09-13T16:12:00.583 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-09-13T16:12:00.584 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-09-13T16:12:00.585 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-09-13T16:12:00.586 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-09-13T16:12:00.587 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-09-13T16:12:00.588 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-09-13T16:12:00.589 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-09-13T16:12:00.590 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-09-13T16:12:00.591 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-09-13T16:12:00.592 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-09-13T16:12:00.593 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-09-13T16:12:00.594 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-09-13T16:12:00.595 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-09-13T16:12:00.595 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-09-13T16:12:00.596 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-09-13T16:12:00.597 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-09-13T16:12:00.598 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-09-13T16:12:00.599 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-09-13T16:12:00.601 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-09-13T16:12:00.602 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-09-13T16:12:00.603 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-09-13T16:12:00.604 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-09-13T16:12:00.604 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-09-13T16:12:00.605 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-09-13T16:12:00.606 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-09-13T16:12:00.607 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-09-13T16:12:00.608 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-09-13T16:12:00.609 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-09-13T16:12:00.610 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-09-13T16:12:00.611 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-09-13T16:12:00.612 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-09-13T16:12:00.613 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-09-13T16:12:00.614 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-09-13T16:12:00.615 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-09-13T16:12:00.616 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-09-13T16:12:00.617 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-09-13T16:12:00.618 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-09-13T16:12:00.619 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-09-13T16:12:00.619 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-09-13T16:12:00.621 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-09-13T16:12:00.622 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-09-13T16:12:00.623 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-09-13T16:12:00.624 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-09-13T16:12:00.625 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-09-13T16:12:00.626 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-09-13T16:12:00.627 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-09-13T16:12:00.627 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-09-13T16:12:00.628 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-09-13T16:12:00.629 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-09-13T16:12:00.630 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-09-13T16:12:00.631 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-09-13T16:12:00.632 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-09-13T16:12:00.633 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-09-13T16:12:00.634 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-09-13T16:12:00.635 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-09-13T16:12:00.636 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-09-13T16:12:00.638 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-09-13T16:12:00.638 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-09-13T16:12:00.639 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-09-13T16:12:00.640 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-09-13T16:12:00.641 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-09-13T16:12:00.641 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-09-13T16:12:00.642 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-09-13T16:12:00.643 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-09-13T16:12:00.644 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-09-13T16:12:00.645 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-09-13T16:12:00.646 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-09-13T16:12:00.646 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-09-13T16:12:00.647 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-09-13T16:12:00.649 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-09-13T16:12:00.650 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-09-13T16:12:00.651 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-09-13T16:12:00.652 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-09-13T16:12:00.653 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-09-13T16:12:00.653 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-09-13T16:12:00.654 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-09-13T16:12:00.655 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-09-13T16:12:00.656 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-09-13T16:12:00.657 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-09-13T16:12:00.658 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-09-13T16:12:00.659 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-09-13T16:12:00.660 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-09-13T16:12:00.664 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-09-13T16:12:00.664 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-09-13T16:12:00.664 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-09-13T16:12:00.664 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-09-13T16:12:00.665 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-09-13T16:12:00.666 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-09-13T16:12:00.667 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-09-13T16:12:00.668 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-09-13T16:12:00.669 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-09-13T16:12:00.670 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-09-13T16:12:00.670 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-09-13T16:12:00.671 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-09-13T16:12:00.672 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-09-13T16:12:00.673 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-09-13T16:12:00.674 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-09-13T16:12:00.675 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-09-13T16:12:00.675 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-09-13T16:12:00.676 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-09-13T16:12:00.677 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-09-13T16:12:00.678 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-09-13T16:12:00.679 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-09-13T16:12:00.680 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-09-13T16:12:00.681 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-09-13T16:12:00.682 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-09-13T16:12:00.683 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-09-13T16:12:00.683 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-09-13T16:12:00.684 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-09-13T16:12:00.685 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-09-13T16:12:00.686 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-09-13T16:12:00.687 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-09-13T16:12:00.688 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-09-13T16:12:00.689 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-09-13T16:12:00.690 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-09-13T16:12:00.691 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-09-13T16:12:00.692 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-09-13T16:12:00.693 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-09-13T16:12:00.694 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-09-13T16:12:00.695 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-09-13T16:12:00.695 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-09-13T16:12:00.696 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-09-13T16:12:00.697 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-09-13T16:12:00.698 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-09-13T16:12:00.699 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-09-13T16:12:00.700 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-09-13T16:12:00.701 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-09-13T16:12:00.701 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-09-13T16:12:00.702 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-09-13T16:12:00.703 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-09-13T16:12:00.704 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-09-13T16:12:00.705 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-09-13T16:12:00.706 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-09-13T16:12:00.706 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-09-13T16:12:00.707 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-09-13T16:12:00.708 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-09-13T16:12:00.709 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-09-13T16:12:00.709 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-09-13T16:12:00.711 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-09-13T16:12:00.712 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-09-13T16:12:00.713 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-09-13T16:12:00.714 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-09-13T16:12:00.715 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-09-13T16:12:00.716 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-09-13T16:12:00.717 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-09-13T16:12:00.718 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-09-13T16:12:00.719 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-09-13T16:12:00.720 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-09-13T16:12:00.721 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-09-13T16:12:00.722 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-09-13T16:12:00.723 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-09-13T16:12:00.724 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-09-13T16:12:00.725 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-09-13T16:12:00.726 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-09-13T16:12:00.727 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-09-13T16:12:00.727 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-09-13T16:12:00.728 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-09-13T16:12:00.729 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-09-13T16:12:00.730 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-09-13T16:12:00.730 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-09-13T16:12:00.731 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-09-13T16:12:00.732 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-09-13T16:12:00.733 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-09-13T16:12:00.734 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-09-13T16:12:00.735 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-09-13T16:12:00.735 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-09-13T16:12:00.736 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-09-13T16:12:00.737 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-09-13T16:12:00.738 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-09-13T16:12:00.739 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-09-13T16:12:00.740 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-09-13T16:12:00.740 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-09-13T16:12:00.741 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-09-13T16:12:00.742 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-09-13T16:12:00.743 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-09-13T16:12:00.744 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-09-13T16:12:00.745 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-09-13T16:12:00.746 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-09-13T16:12:00.746 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-09-13T16:12:00.747 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-09-13T16:12:00.748 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-09-13T16:12:00.749 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-09-13T16:12:00.750 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-09-13T16:12:00.751 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-09-13T16:12:00.752 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-09-13T16:12:00.753 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-09-13T16:12:00.754 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-09-13T16:12:00.755 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-09-13T16:12:00.755 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-09-13T16:12:00.757 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-09-13T16:12:00.757 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-09-13T16:12:00.758 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-09-13T16:12:00.759 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-09-13T16:12:00.760 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-09-13T16:12:00.761 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-09-13T16:12:00.762 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-09-13T16:12:00.763 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-09-13T16:12:00.764 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-09-13T16:12:00.765 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-09-13T16:12:00.765 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-09-13T16:12:00.766 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-09-13T16:12:00.767 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-09-13T16:12:00.768 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-09-13T16:12:00.769 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-09-13T16:12:00.770 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-09-13T16:12:00.771 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-09-13T16:12:00.772 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-09-13T16:12:00.773 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-09-13T16:12:00.774 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-09-13T16:12:00.775 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-09-13T16:12:00.777 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-09-13T16:12:00.778 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-09-13T16:12:00.779 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-09-13T16:12:00.780 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-09-13T16:12:00.782 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-09-13T16:12:00.783 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-09-13T16:12:00.784 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-09-13T16:12:00.785 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-09-13T16:12:00.786 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-09-13T16:12:00.787 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-09-13T16:12:00.788 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-09-13T16:12:00.789 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-09-13T16:12:00.790 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-09-13T16:12:00.792 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-09-13T16:12:00.793 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-09-13T16:12:00.794 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-09-13T16:12:00.795 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-09-13T16:12:00.796 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-09-13T16:12:00.797 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-09-13T16:12:00.798 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-09-13T16:12:00.800 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-09-13T16:12:00.801 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-09-13T16:12:00.803 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-09-13T16:12:00.804 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-09-13T16:12:00.805 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-09-13T16:12:00.806 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:00 smithi194 ceph-mon[35694]: pgmap v414: 129 pgs: 129 active+clean; 53 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.4 MiB/s wr, 10 op/s 2024-09-13T16:12:00.806 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:00 smithi194 ceph-mon[35694]: mgrmap e20: x(active, since 11m), standbys: z, y 2024-09-13T16:12:00.807 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-09-13T16:12:00.807 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-09-13T16:12:00.808 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-09-13T16:12:00.809 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-09-13T16:12:00.810 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-09-13T16:12:00.811 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-09-13T16:12:00.812 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-09-13T16:12:00.813 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-09-13T16:12:00.813 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-09-13T16:12:00.814 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-09-13T16:12:00.815 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-09-13T16:12:00.816 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-09-13T16:12:00.817 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-09-13T16:12:00.817 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-09-13T16:12:00.818 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-09-13T16:12:00.819 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-09-13T16:12:00.820 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-09-13T16:12:00.821 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-09-13T16:12:00.821 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-09-13T16:12:00.822 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-09-13T16:12:00.824 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-09-13T16:12:00.825 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-09-13T16:12:00.826 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-09-13T16:12:00.827 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-09-13T16:12:00.827 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-09-13T16:12:00.828 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-09-13T16:12:00.829 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-09-13T16:12:00.830 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-09-13T16:12:00.831 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-09-13T16:12:00.832 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-09-13T16:12:00.833 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-09-13T16:12:00.834 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-09-13T16:12:00.835 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-09-13T16:12:00.836 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-09-13T16:12:00.837 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-09-13T16:12:00.838 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-09-13T16:12:00.838 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-09-13T16:12:00.839 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-09-13T16:12:00.840 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-09-13T16:12:00.841 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-09-13T16:12:00.842 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-09-13T16:12:00.843 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-09-13T16:12:00.844 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-09-13T16:12:00.845 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-09-13T16:12:00.846 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-09-13T16:12:00.847 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-09-13T16:12:00.848 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-09-13T16:12:00.849 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-09-13T16:12:00.850 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-09-13T16:12:00.850 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-09-13T16:12:00.851 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-09-13T16:12:00.852 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-09-13T16:12:00.853 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-09-13T16:12:00.854 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-09-13T16:12:00.855 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-09-13T16:12:00.856 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-09-13T16:12:00.857 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-09-13T16:12:00.858 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-09-13T16:12:00.859 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-09-13T16:12:00.860 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-09-13T16:12:00.861 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-09-13T16:12:00.861 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-09-13T16:12:00.862 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-09-13T16:12:00.863 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-09-13T16:12:00.864 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-09-13T16:12:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:00 smithi086 ceph-mon[30379]: pgmap v414: 129 pgs: 129 active+clean; 53 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.4 MiB/s wr, 10 op/s 2024-09-13T16:12:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:00 smithi086 ceph-mon[30379]: mgrmap e20: x(active, since 11m), standbys: z, y 2024-09-13T16:12:00.865 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-09-13T16:12:00.866 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-09-13T16:12:00.868 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-09-13T16:12:00.868 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-09-13T16:12:00.868 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-09-13T16:12:00.869 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-09-13T16:12:00.870 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-09-13T16:12:00.871 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-09-13T16:12:00.872 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-09-13T16:12:00.873 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-09-13T16:12:00.874 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-09-13T16:12:00.875 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-09-13T16:12:00.876 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-09-13T16:12:00.877 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-09-13T16:12:00.878 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-09-13T16:12:00.879 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-09-13T16:12:00.880 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-09-13T16:12:00.881 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-09-13T16:12:00.882 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-09-13T16:12:00.883 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-09-13T16:12:00.884 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-09-13T16:12:00.885 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-09-13T16:12:00.886 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-09-13T16:12:00.887 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-09-13T16:12:00.888 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-09-13T16:12:00.889 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-09-13T16:12:00.890 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-09-13T16:12:00.891 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-09-13T16:12:00.892 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-09-13T16:12:00.893 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-09-13T16:12:00.894 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-09-13T16:12:00.895 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-09-13T16:12:00.897 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-09-13T16:12:00.897 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-09-13T16:12:00.898 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-09-13T16:12:00.899 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-09-13T16:12:00.901 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-09-13T16:12:00.901 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-09-13T16:12:00.902 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-09-13T16:12:00.904 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-09-13T16:12:00.905 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-09-13T16:12:00.906 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-09-13T16:12:00.907 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-09-13T16:12:00.908 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-09-13T16:12:00.909 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-09-13T16:12:00.910 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-09-13T16:12:00.911 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-09-13T16:12:00.912 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-09-13T16:12:00.913 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-09-13T16:12:00.914 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-09-13T16:12:00.915 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-09-13T16:12:00.916 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-09-13T16:12:00.917 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-09-13T16:12:00.918 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-09-13T16:12:00.919 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-09-13T16:12:00.920 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-09-13T16:12:00.921 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-09-13T16:12:00.922 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-09-13T16:12:00.923 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-09-13T16:12:00.924 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-09-13T16:12:00.925 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-09-13T16:12:00.926 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-09-13T16:12:00.927 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-09-13T16:12:00.928 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-09-13T16:12:00.929 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-09-13T16:12:00.930 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-09-13T16:12:00.931 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-09-13T16:12:00.932 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-09-13T16:12:00.933 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-09-13T16:12:00.934 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-09-13T16:12:00.935 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-09-13T16:12:00.936 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-09-13T16:12:00.937 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-09-13T16:12:00.938 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-09-13T16:12:00.939 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-09-13T16:12:00.940 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-09-13T16:12:00.941 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-09-13T16:12:00.942 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-09-13T16:12:00.943 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-09-13T16:12:00.944 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-09-13T16:12:00.945 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-09-13T16:12:00.946 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-09-13T16:12:00.947 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-09-13T16:12:00.948 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-09-13T16:12:00.949 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-09-13T16:12:00.950 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-09-13T16:12:00.951 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-09-13T16:12:00.952 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-09-13T16:12:00.953 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-09-13T16:12:00.954 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-09-13T16:12:00.954 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-09-13T16:12:00.955 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-09-13T16:12:00.957 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-09-13T16:12:00.958 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-09-13T16:12:00.959 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-09-13T16:12:00.960 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-09-13T16:12:00.961 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-09-13T16:12:00.962 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-09-13T16:12:00.963 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-09-13T16:12:00.964 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-09-13T16:12:00.965 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-09-13T16:12:00.966 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-09-13T16:12:00.967 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-09-13T16:12:00.968 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-09-13T16:12:00.969 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-09-13T16:12:00.970 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-09-13T16:12:00.970 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-09-13T16:12:00.972 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-09-13T16:12:00.972 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-09-13T16:12:00.974 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-09-13T16:12:00.975 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-09-13T16:12:00.975 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-09-13T16:12:00.977 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-09-13T16:12:00.978 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-09-13T16:12:00.979 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-09-13T16:12:00.980 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-09-13T16:12:00.981 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-09-13T16:12:00.982 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-09-13T16:12:00.983 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-09-13T16:12:00.984 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-09-13T16:12:00.985 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-09-13T16:12:00.987 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-09-13T16:12:00.987 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-09-13T16:12:00.988 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-09-13T16:12:00.989 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-09-13T16:12:00.990 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-09-13T16:12:00.991 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-09-13T16:12:00.992 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-09-13T16:12:00.993 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-09-13T16:12:00.994 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-09-13T16:12:00.995 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-09-13T16:12:00.996 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-09-13T16:12:00.997 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-09-13T16:12:00.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:00 smithi139 ceph-mon[35320]: pgmap v414: 129 pgs: 129 active+clean; 53 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.4 MiB/s wr, 10 op/s 2024-09-13T16:12:00.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:00 smithi139 ceph-mon[35320]: mgrmap e20: x(active, since 11m), standbys: z, y 2024-09-13T16:12:00.998 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-09-13T16:12:00.999 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-09-13T16:12:01.000 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-09-13T16:12:01.001 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-09-13T16:12:01.002 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-09-13T16:12:01.003 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-09-13T16:12:01.003 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-09-13T16:12:01.004 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-09-13T16:12:01.005 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-09-13T16:12:01.006 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-09-13T16:12:01.007 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-09-13T16:12:01.008 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-09-13T16:12:01.009 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-09-13T16:12:01.009 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-09-13T16:12:01.010 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-09-13T16:12:01.011 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-09-13T16:12:01.012 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-09-13T16:12:01.014 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-09-13T16:12:01.015 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-09-13T16:12:01.016 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-09-13T16:12:01.017 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-09-13T16:12:01.018 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-09-13T16:12:01.019 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-09-13T16:12:01.020 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-09-13T16:12:01.021 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-09-13T16:12:01.022 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-09-13T16:12:01.023 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-09-13T16:12:01.024 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-09-13T16:12:01.025 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-09-13T16:12:01.026 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-09-13T16:12:01.027 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-09-13T16:12:01.028 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-09-13T16:12:01.029 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-09-13T16:12:01.030 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-09-13T16:12:01.031 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-09-13T16:12:01.032 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-09-13T16:12:01.033 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-09-13T16:12:01.034 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-09-13T16:12:01.034 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-09-13T16:12:01.035 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-09-13T16:12:01.036 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-09-13T16:12:01.037 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-09-13T16:12:01.038 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-09-13T16:12:01.039 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-09-13T16:12:01.040 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-09-13T16:12:01.041 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-09-13T16:12:01.042 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-09-13T16:12:01.043 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-09-13T16:12:01.044 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-09-13T16:12:01.045 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-09-13T16:12:01.046 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-09-13T16:12:01.047 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-09-13T16:12:01.048 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-09-13T16:12:01.049 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-09-13T16:12:01.050 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-09-13T16:12:01.051 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-09-13T16:12:01.052 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-09-13T16:12:01.053 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-09-13T16:12:01.054 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-09-13T16:12:01.056 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-09-13T16:12:01.057 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-09-13T16:12:01.058 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-09-13T16:12:01.059 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-09-13T16:12:01.060 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-09-13T16:12:01.061 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-09-13T16:12:01.062 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-09-13T16:12:01.063 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-09-13T16:12:01.064 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-09-13T16:12:01.065 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-09-13T16:12:01.066 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-09-13T16:12:01.067 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-09-13T16:12:01.068 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-09-13T16:12:01.069 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-09-13T16:12:01.072 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-09-13T16:12:01.072 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-09-13T16:12:01.072 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-09-13T16:12:01.073 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-09-13T16:12:01.074 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-09-13T16:12:01.075 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-09-13T16:12:01.076 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-09-13T16:12:01.077 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-09-13T16:12:01.078 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-09-13T16:12:01.079 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-09-13T16:12:01.080 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-09-13T16:12:01.081 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-09-13T16:12:01.081 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-09-13T16:12:01.082 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-09-13T16:12:01.083 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-09-13T16:12:01.084 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-09-13T16:12:01.085 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-09-13T16:12:01.086 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-09-13T16:12:01.087 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-09-13T16:12:01.087 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-09-13T16:12:01.088 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-09-13T16:12:01.089 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-09-13T16:12:01.091 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-09-13T16:12:01.092 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-09-13T16:12:01.093 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-09-13T16:12:01.094 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-09-13T16:12:01.095 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-09-13T16:12:01.096 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-09-13T16:12:01.097 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-09-13T16:12:01.098 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-09-13T16:12:01.099 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-09-13T16:12:01.100 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-09-13T16:12:01.101 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-09-13T16:12:01.102 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-09-13T16:12:01.103 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-09-13T16:12:01.105 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-09-13T16:12:01.106 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-09-13T16:12:01.107 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-09-13T16:12:01.108 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-09-13T16:12:01.109 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-09-13T16:12:01.110 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-09-13T16:12:01.111 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-09-13T16:12:01.112 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-09-13T16:12:01.113 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-09-13T16:12:01.114 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-09-13T16:12:01.114 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-09-13T16:12:01.115 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-09-13T16:12:01.117 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-09-13T16:12:01.118 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-09-13T16:12:01.119 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-09-13T16:12:01.120 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-09-13T16:12:01.121 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-09-13T16:12:01.122 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-09-13T16:12:01.123 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-09-13T16:12:01.123 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-09-13T16:12:01.125 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-09-13T16:12:01.126 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-09-13T16:12:01.127 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-09-13T16:12:01.128 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-09-13T16:12:01.129 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-09-13T16:12:01.130 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-09-13T16:12:01.131 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-09-13T16:12:01.132 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-09-13T16:12:01.132 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-09-13T16:12:01.133 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-09-13T16:12:01.134 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-09-13T16:12:01.135 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-09-13T16:12:01.136 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-09-13T16:12:01.137 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-09-13T16:12:01.138 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-09-13T16:12:01.139 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-09-13T16:12:01.140 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-09-13T16:12:01.141 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-09-13T16:12:01.142 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-09-13T16:12:01.143 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-09-13T16:12:01.144 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-09-13T16:12:01.145 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-09-13T16:12:01.146 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-09-13T16:12:01.147 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-09-13T16:12:01.147 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-09-13T16:12:01.148 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-09-13T16:12:01.149 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-09-13T16:12:01.150 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-09-13T16:12:01.151 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-09-13T16:12:01.153 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-09-13T16:12:01.154 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-09-13T16:12:01.155 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-09-13T16:12:01.156 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-09-13T16:12:01.157 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-09-13T16:12:01.158 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-09-13T16:12:01.159 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-09-13T16:12:01.160 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-09-13T16:12:01.160 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-09-13T16:12:01.161 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-09-13T16:12:01.162 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-09-13T16:12:01.163 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-09-13T16:12:01.164 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-09-13T16:12:01.165 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-09-13T16:12:01.166 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-09-13T16:12:01.167 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-09-13T16:12:01.168 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-09-13T16:12:01.169 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-09-13T16:12:01.170 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-09-13T16:12:01.171 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-09-13T16:12:01.172 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-09-13T16:12:01.172 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-09-13T16:12:01.173 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-09-13T16:12:01.174 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-09-13T16:12:01.175 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-09-13T16:12:01.175 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-09-13T16:12:01.177 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-09-13T16:12:01.177 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-09-13T16:12:01.178 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-09-13T16:12:01.179 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-09-13T16:12:01.180 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-09-13T16:12:01.181 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-09-13T16:12:01.182 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-09-13T16:12:01.182 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-09-13T16:12:01.183 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-09-13T16:12:01.184 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-09-13T16:12:01.185 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-09-13T16:12:01.186 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-09-13T16:12:01.187 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-09-13T16:12:01.188 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-09-13T16:12:01.189 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-09-13T16:12:01.190 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-09-13T16:12:01.191 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-09-13T16:12:01.192 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-09-13T16:12:01.192 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-09-13T16:12:01.193 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-09-13T16:12:01.194 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-09-13T16:12:01.195 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-09-13T16:12:01.196 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-09-13T16:12:01.197 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-09-13T16:12:01.198 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-09-13T16:12:01.199 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-09-13T16:12:01.200 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-09-13T16:12:01.201 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-09-13T16:12:01.202 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-09-13T16:12:01.203 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-09-13T16:12:01.204 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-09-13T16:12:01.205 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-09-13T16:12:01.206 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-09-13T16:12:01.207 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-09-13T16:12:01.208 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-09-13T16:12:01.209 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-09-13T16:12:01.210 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-09-13T16:12:01.211 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-09-13T16:12:01.212 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-09-13T16:12:01.213 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-09-13T16:12:01.214 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-09-13T16:12:01.215 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-09-13T16:12:01.216 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-09-13T16:12:01.217 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-09-13T16:12:01.218 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-09-13T16:12:01.219 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-09-13T16:12:01.220 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-09-13T16:12:01.221 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-09-13T16:12:01.222 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-09-13T16:12:01.223 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-09-13T16:12:01.224 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-09-13T16:12:01.225 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-09-13T16:12:01.226 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-09-13T16:12:01.227 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-09-13T16:12:01.228 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-09-13T16:12:01.229 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-09-13T16:12:01.230 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-09-13T16:12:01.230 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-09-13T16:12:01.231 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-09-13T16:12:01.232 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-09-13T16:12:01.233 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-09-13T16:12:01.233 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-09-13T16:12:01.234 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-09-13T16:12:01.235 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-09-13T16:12:01.236 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-09-13T16:12:01.238 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-09-13T16:12:01.239 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-09-13T16:12:01.239 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-09-13T16:12:01.240 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-09-13T16:12:01.242 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-09-13T16:12:01.243 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-09-13T16:12:01.244 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-09-13T16:12:01.245 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-09-13T16:12:01.246 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-09-13T16:12:01.247 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-09-13T16:12:01.248 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-09-13T16:12:01.249 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-09-13T16:12:01.251 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-09-13T16:12:01.252 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-09-13T16:12:01.253 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-09-13T16:12:01.254 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-09-13T16:12:01.255 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-09-13T16:12:01.256 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-09-13T16:12:01.258 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-09-13T16:12:01.258 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-09-13T16:12:01.259 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-09-13T16:12:01.260 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-09-13T16:12:01.261 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-09-13T16:12:01.262 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-09-13T16:12:01.264 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-09-13T16:12:01.265 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-09-13T16:12:01.266 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-09-13T16:12:01.267 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-09-13T16:12:01.268 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-09-13T16:12:01.269 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-09-13T16:12:01.270 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-09-13T16:12:01.271 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-09-13T16:12:01.273 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-09-13T16:12:01.276 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-09-13T16:12:01.276 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-09-13T16:12:01.277 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-09-13T16:12:01.278 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-09-13T16:12:01.279 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-09-13T16:12:01.280 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-09-13T16:12:01.281 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-09-13T16:12:01.282 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-09-13T16:12:01.283 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-09-13T16:12:01.285 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-09-13T16:12:01.286 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-09-13T16:12:01.287 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-09-13T16:12:01.288 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-09-13T16:12:01.290 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-09-13T16:12:01.291 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-09-13T16:12:01.292 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-09-13T16:12:01.293 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-09-13T16:12:01.294 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-09-13T16:12:01.295 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-09-13T16:12:01.296 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-09-13T16:12:01.297 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-09-13T16:12:01.298 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-09-13T16:12:01.299 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-09-13T16:12:01.301 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-09-13T16:12:01.302 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-09-13T16:12:01.303 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-09-13T16:12:01.304 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-09-13T16:12:01.305 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-09-13T16:12:01.306 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-09-13T16:12:01.308 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-09-13T16:12:01.309 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-09-13T16:12:01.310 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-09-13T16:12:01.311 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-09-13T16:12:01.312 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-09-13T16:12:01.314 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-09-13T16:12:01.315 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-09-13T16:12:01.316 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-09-13T16:12:01.317 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-09-13T16:12:01.319 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-09-13T16:12:01.319 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-09-13T16:12:01.321 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-09-13T16:12:01.322 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-09-13T16:12:01.323 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-09-13T16:12:01.324 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-09-13T16:12:01.325 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-09-13T16:12:01.326 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-09-13T16:12:01.328 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-09-13T16:12:01.330 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-09-13T16:12:01.331 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-09-13T16:12:01.332 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-09-13T16:12:01.333 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-09-13T16:12:01.335 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-09-13T16:12:01.336 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-09-13T16:12:01.338 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-09-13T16:12:01.339 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-09-13T16:12:01.340 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-09-13T16:12:01.341 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-09-13T16:12:01.343 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-09-13T16:12:01.344 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-09-13T16:12:01.345 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-09-13T16:12:01.346 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-09-13T16:12:01.348 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-09-13T16:12:01.349 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-09-13T16:12:01.350 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-09-13T16:12:01.351 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-09-13T16:12:01.352 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-09-13T16:12:01.353 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-09-13T16:12:01.354 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-09-13T16:12:01.356 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-09-13T16:12:01.357 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-09-13T16:12:01.359 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-09-13T16:12:01.360 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-09-13T16:12:01.362 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-09-13T16:12:01.363 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-09-13T16:12:01.364 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-09-13T16:12:01.365 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-09-13T16:12:01.367 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-09-13T16:12:01.368 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-09-13T16:12:01.369 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-09-13T16:12:01.370 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-09-13T16:12:01.371 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-09-13T16:12:01.372 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-09-13T16:12:01.374 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-09-13T16:12:01.375 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-09-13T16:12:01.376 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-09-13T16:12:01.377 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-09-13T16:12:01.378 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-09-13T16:12:01.379 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-09-13T16:12:01.381 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-09-13T16:12:01.382 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-09-13T16:12:01.383 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-09-13T16:12:01.384 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-09-13T16:12:01.386 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-09-13T16:12:01.387 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-09-13T16:12:01.388 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-09-13T16:12:01.389 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-09-13T16:12:01.390 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-09-13T16:12:01.391 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-09-13T16:12:01.392 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-09-13T16:12:01.393 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-09-13T16:12:01.394 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-09-13T16:12:01.395 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-09-13T16:12:01.396 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-09-13T16:12:01.397 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-09-13T16:12:01.397 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-09-13T16:12:01.398 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-09-13T16:12:01.399 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-09-13T16:12:01.400 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-09-13T16:12:01.401 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-09-13T16:12:01.402 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-09-13T16:12:01.403 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-09-13T16:12:01.404 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-09-13T16:12:01.405 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-09-13T16:12:01.406 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-09-13T16:12:01.407 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-09-13T16:12:01.407 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-09-13T16:12:01.408 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-09-13T16:12:01.409 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-09-13T16:12:01.410 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-09-13T16:12:01.411 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-09-13T16:12:01.412 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-09-13T16:12:01.413 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-09-13T16:12:01.414 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-09-13T16:12:01.415 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-09-13T16:12:01.416 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-09-13T16:12:01.417 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-09-13T16:12:01.418 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-09-13T16:12:01.419 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-09-13T16:12:01.419 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-09-13T16:12:01.420 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-09-13T16:12:01.421 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-09-13T16:12:01.423 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-09-13T16:12:01.424 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-09-13T16:12:01.425 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-09-13T16:12:01.426 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-09-13T16:12:01.427 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-09-13T16:12:01.428 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-09-13T16:12:01.429 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-09-13T16:12:01.430 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-09-13T16:12:01.431 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-09-13T16:12:01.432 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-09-13T16:12:01.433 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-09-13T16:12:01.434 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-09-13T16:12:01.435 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-09-13T16:12:01.436 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-09-13T16:12:01.437 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-09-13T16:12:01.439 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-09-13T16:12:01.440 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-09-13T16:12:01.441 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-09-13T16:12:01.442 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-09-13T16:12:01.442 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-09-13T16:12:01.443 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-09-13T16:12:01.444 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-09-13T16:12:01.445 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-09-13T16:12:01.446 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-09-13T16:12:01.447 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-09-13T16:12:01.447 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-09-13T16:12:01.448 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-09-13T16:12:01.449 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-09-13T16:12:01.451 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-09-13T16:12:01.452 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-09-13T16:12:01.452 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-09-13T16:12:01.453 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-09-13T16:12:01.454 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-09-13T16:12:01.455 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-09-13T16:12:01.456 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-09-13T16:12:01.457 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-09-13T16:12:01.458 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-09-13T16:12:01.459 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-09-13T16:12:01.460 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-09-13T16:12:01.461 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-09-13T16:12:01.462 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-09-13T16:12:01.463 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-09-13T16:12:01.464 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-09-13T16:12:01.465 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-09-13T16:12:01.465 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-09-13T16:12:01.467 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-09-13T16:12:01.468 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-09-13T16:12:01.728 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-09-13T16:12:01.730 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-09-13T16:12:01.732 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-09-13T16:12:01.736 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-09-13T16:12:01.742 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-09-13T16:12:01.754 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-09-13T16:12:01.761 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-09-13T16:12:01.778 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-09-13T16:12:01.780 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-09-13T16:12:01.782 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-09-13T16:12:01.786 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-09-13T16:12:01.788 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-09-13T16:12:01.789 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-09-13T16:12:01.791 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-09-13T16:12:01.792 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-09-13T16:12:01.794 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-09-13T16:12:01.797 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-09-13T16:12:01.799 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-09-13T16:12:01.803 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-09-13T16:12:01.807 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-09-13T16:12:01.809 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-09-13T16:12:01.814 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-09-13T16:12:01.815 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-09-13T16:12:01.826 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-09-13T16:12:01.827 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-09-13T16:12:01.830 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-09-13T16:12:01.836 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-09-13T16:12:01.848 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-09-13T16:12:01.850 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-09-13T16:12:01.856 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-09-13T16:12:01.861 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-09-13T16:12:01.883 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-09-13T16:12:01.890 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-09-13T16:12:01.892 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-09-13T16:12:01.897 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-09-13T16:12:01.900 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-09-13T16:12:01.904 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-09-13T16:12:01.907 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-09-13T16:12:01.908 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-09-13T16:12:01.914 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-09-13T16:12:01.917 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-09-13T16:12:01.921 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-09-13T16:12:01.923 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-09-13T16:12:01.925 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-09-13T16:12:01.926 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-09-13T16:12:01.931 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-09-13T16:12:01.933 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-09-13T16:12:01.938 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-09-13T16:12:01.939 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-09-13T16:12:01.941 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-09-13T16:12:01.942 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-09-13T16:12:01.946 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-09-13T16:12:01.946 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-09-13T16:12:01.950 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-09-13T16:12:01.951 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-09-13T16:12:01.953 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-09-13T16:12:01.954 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-09-13T16:12:01.957 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-09-13T16:12:01.967 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-09-13T16:12:01.973 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-09-13T16:12:01.976 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-09-13T16:12:01.977 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-09-13T16:12:01.979 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-09-13T16:12:01.982 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-09-13T16:12:01.985 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-09-13T16:12:01.988 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-09-13T16:12:01.988 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-09-13T16:12:01.991 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-09-13T16:12:01.993 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-09-13T16:12:01.995 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-09-13T16:12:01.996 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-09-13T16:12:01.998 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/digsig.txt 2024-09-13T16:12:02.092 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-09-13T16:12:02.093 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-09-13T16:12:02.094 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-09-13T16:12:02.096 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-09-13T16:12:02.098 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-09-13T16:12:02.100 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-09-13T16:12:02.101 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dontdiff 2024-09-13T16:12:02.103 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/driver-model/ 2024-09-13T16:12:02.104 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-09-13T16:12:02.105 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-09-13T16:12:02.107 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-09-13T16:12:02.108 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-09-13T16:12:02.109 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-09-13T16:12:02.110 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-09-13T16:12:02.111 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-09-13T16:12:02.112 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-09-13T16:12:02.113 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-09-13T16:12:02.114 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-09-13T16:12:02.116 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dvb/ 2024-09-13T16:12:02.116 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-09-13T16:12:02.117 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-09-13T16:12:02.118 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-09-13T16:12:02.119 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-09-13T16:12:02.120 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-09-13T16:12:02.121 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-09-13T16:12:02.123 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-09-13T16:12:02.124 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-09-13T16:12:02.125 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-09-13T16:12:02.126 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-09-13T16:12:02.126 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-09-13T16:12:02.127 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-09-13T16:12:02.128 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-09-13T16:12:02.129 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-09-13T16:12:02.130 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-09-13T16:12:02.132 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-09-13T16:12:02.133 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-09-13T16:12:02.134 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-09-13T16:12:02.135 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/edac.txt 2024-09-13T16:12:02.136 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-09-13T16:12:02.137 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/eisa.txt 2024-09-13T16:12:02.138 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-09-13T16:12:02.139 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/extcon/ 2024-09-13T16:12:02.140 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-09-13T16:12:02.159 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-09-13T16:12:02.168 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-09-13T16:12:02.171 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-09-13T16:12:02.172 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-09-13T16:12:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.171+0000 7f23f9600640 1 -- 172.21.15.86:0/2707846009 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5573cad10300 con 0x5573cb12f6a0 2024-09-13T16:12:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.171+0000 7f23f9600640 10 client.15456 handle_command_reply: tid=0 2024-09-13T16:12:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.171+0000 7f24193c3740 1 client.15456 shutdown 2024-09-13T16:12:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.171+0000 7f24193c3740 1 -- 172.21.15.86:0/2707846009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0ba5c0 msgr2=0x5573cb0c95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.171+0000 7f24193c3740 1 --2- 172.21.15.86:0/2707846009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0ba5c0 0x5573cb0c95d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x5573cb0b5f90 tx=0x7f23fc009950 comp rx=0 tx=0).stop 2024-09-13T16:12:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.171+0000 7f24193c3740 1 -- 172.21.15.86:0/2707846009 shutdown_connections 2024-09-13T16:12:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.171+0000 7f24193c3740 1 --2- 172.21.15.86:0/2707846009 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5573cb12f6a0 0x5573cb131ac0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.171+0000 7f24193c3740 1 --2- 172.21.15.86:0/2707846009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573cb0bf650 0x5573cb0ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.171+0000 7f24193c3740 1 --2- 172.21.15.86:0/2707846009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573cb0ba5c0 0x5573cb0c95d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.171+0000 7f24193c3740 1 --2- 172.21.15.86:0/2707846009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573cb0b9c80 0x5573cb0c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.171+0000 7f24193c3740 1 -- 172.21.15.86:0/2707846009 >> 172.21.15.86:0/2707846009 conn(0x5573cb0b52f0 msgr2=0x5573cb0c3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.171+0000 7f23f9600640 0 client.15456 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.171+0000 7f24193c3740 1 -- 172.21.15.86:0/2707846009 shutdown_connections 2024-09-13T16:12:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.171+0000 7f24193c3740 1 -- 172.21.15.86:0/2707846009 wait complete. 2024-09-13T16:12:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.171+0000 7f24193c3740 20 client.15456 trim_cache size 0 max 16384 2024-09-13T16:12:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-09-13T16:12:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-09-13T16:12:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-09-13T16:12:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-09-13T16:12:02.175 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/ 2024-09-13T16:12:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.172+0000 7f2415000640 1 -- 172.21.15.86:0/1212011711 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f23f40a1130 msgr2=0x7f23f40a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.172+0000 7f2415000640 1 --2- 172.21.15.86:0/1212011711 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f23f40a1130 0x7f23f40a35f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f24000b7160 tx=0x7f24000f1630 comp rx=0 tx=0).stop 2024-09-13T16:12:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.172+0000 7f2415000640 1 -- 172.21.15.86:0/1212011711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24100ff770 msgr2=0x7f2410074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.172+0000 7f2415000640 1 --2- 172.21.15.86:0/1212011711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24100ff770 0x7f2410074260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2400005ab0 tx=0x7f24000055a0 comp rx=0 tx=0).stop 2024-09-13T16:12:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.172+0000 7f2415000640 1 -- 172.21.15.86:0/1212011711 shutdown_connections 2024-09-13T16:12:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.172+0000 7f2415000640 1 --2- 172.21.15.86:0/1212011711 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f23f40a1130 0x7f23f40a35f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.172+0000 7f2415000640 1 --2- 172.21.15.86:0/1212011711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2410101240 0x7f2410072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.172+0000 7f2415000640 1 --2- 172.21.15.86:0/1212011711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2410100130 0x7f24100728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.172+0000 7f2415000640 1 --2- 172.21.15.86:0/1212011711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24100ff770 0x7f2410074260 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.172+0000 7f2415000640 1 -- 172.21.15.86:0/1212011711 >> 172.21.15.86:0/1212011711 conn(0x7f24100fb2c0 msgr2=0x7f24101040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.172+0000 7f2415000640 1 -- 172.21.15.86:0/1212011711 shutdown_connections 2024-09-13T16:12:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:02.172+0000 7f2415000640 1 -- 172.21.15.86:0/1212011711 wait complete. 2024-09-13T16:12:02.178 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-09-13T16:12:02.178 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-09-13T16:12:02.178 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-09-13T16:12:02.178 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-09-13T16:12:02.179 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-09-13T16:12:02.179 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-09-13T16:12:02.179 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-09-13T16:12:02.179 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-09-13T16:12:02.180 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-09-13T16:12:02.180 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-09-13T16:12:02.181 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-09-13T16:12:02.182 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-09-13T16:12:02.182 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-09-13T16:12:02.183 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-09-13T16:12:02.184 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-09-13T16:12:02.185 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-09-13T16:12:02.185 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-09-13T16:12:02.186 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-09-13T16:12:02.187 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-09-13T16:12:02.187 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-09-13T16:12:02.188 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-09-13T16:12:02.189 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-09-13T16:12:02.190 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-09-13T16:12:02.191 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-09-13T16:12:02.191 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-09-13T16:12:02.192 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-09-13T16:12:02.193 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-09-13T16:12:02.194 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-09-13T16:12:02.195 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-09-13T16:12:02.195 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-09-13T16:12:02.196 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-09-13T16:12:02.197 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-09-13T16:12:02.198 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-09-13T16:12:02.199 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-09-13T16:12:02.200 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-09-13T16:12:02.200 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/ 2024-09-13T16:12:02.202 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-09-13T16:12:02.203 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-09-13T16:12:02.203 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-09-13T16:12:02.204 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-09-13T16:12:02.205 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-09-13T16:12:02.206 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-09-13T16:12:02.206 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-09-13T16:12:02.207 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-09-13T16:12:02.208 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-09-13T16:12:02.209 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-09-13T16:12:02.210 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-09-13T16:12:02.211 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-09-13T16:12:02.212 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-09-13T16:12:02.213 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-09-13T16:12:02.214 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-09-13T16:12:02.215 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-09-13T16:12:02.216 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-09-13T16:12:02.216 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-09-13T16:12:02.217 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-09-13T16:12:02.218 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-09-13T16:12:02.219 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-09-13T16:12:02.220 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-09-13T16:12:02.221 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-09-13T16:12:02.222 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-09-13T16:12:02.223 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-09-13T16:12:02.225 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-09-13T16:12:02.225 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-09-13T16:12:02.226 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-09-13T16:12:02.227 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-09-13T16:12:02.228 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-09-13T16:12:02.229 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-09-13T16:12:02.230 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-09-13T16:12:02.231 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-09-13T16:12:02.232 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-09-13T16:12:02.233 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-09-13T16:12:02.234 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-09-13T16:12:02.235 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-09-13T16:12:02.236 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-09-13T16:12:02.237 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-09-13T16:12:02.237 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-09-13T16:12:02.238 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-09-13T16:12:02.239 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-09-13T16:12:02.240 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-09-13T16:12:02.241 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-09-13T16:12:02.241 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-09-13T16:12:02.242 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-09-13T16:12:02.243 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-09-13T16:12:02.244 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-09-13T16:12:02.245 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-09-13T16:12:02.246 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-09-13T16:12:02.247 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-09-13T16:12:02.248 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-09-13T16:12:02.249 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-09-13T16:12:02.250 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-09-13T16:12:02.251 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-09-13T16:12:02.252 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-09-13T16:12:02.252 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-09-13T16:12:02.253 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-09-13T16:12:02.254 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-09-13T16:12:02.255 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-09-13T16:12:02.256 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-09-13T16:12:02.257 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-09-13T16:12:02.258 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-09-13T16:12:02.259 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-09-13T16:12:02.260 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-09-13T16:12:02.261 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-09-13T16:12:02.262 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-09-13T16:12:02.263 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-09-13T16:12:02.264 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-09-13T16:12:02.265 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-09-13T16:12:02.266 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-09-13T16:12:02.267 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-09-13T16:12:02.267 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-09-13T16:12:02.268 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-09-13T16:12:02.269 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-09-13T16:12:02.270 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-09-13T16:12:02.271 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-09-13T16:12:02.272 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-09-13T16:12:02.273 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-09-13T16:12:02.274 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-09-13T16:12:02.275 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-09-13T16:12:02.276 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-09-13T16:12:02.277 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-09-13T16:12:02.278 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-09-13T16:12:02.279 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-09-13T16:12:02.280 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-09-13T16:12:02.280 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-09-13T16:12:02.281 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-09-13T16:12:02.282 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-09-13T16:12:02.283 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-09-13T16:12:02.284 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-09-13T16:12:02.285 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-09-13T16:12:02.286 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-09-13T16:12:02.287 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-09-13T16:12:02.288 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-09-13T16:12:02.289 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-09-13T16:12:02.290 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-09-13T16:12:02.291 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-09-13T16:12:02.291 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-09-13T16:12:02.292 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-09-13T16:12:02.293 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-09-13T16:12:02.294 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-09-13T16:12:02.295 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-09-13T16:12:02.296 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-09-13T16:12:02.297 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-09-13T16:12:02.298 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-09-13T16:12:02.298 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-09-13T16:12:02.299 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-09-13T16:12:02.301 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-09-13T16:12:02.301 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-09-13T16:12:02.304 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-09-13T16:12:02.304 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-09-13T16:12:02.305 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-09-13T16:12:02.305 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-09-13T16:12:02.306 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-09-13T16:12:02.307 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-09-13T16:12:02.308 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-09-13T16:12:02.309 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-09-13T16:12:02.310 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-09-13T16:12:02.311 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fmc/ 2024-09-13T16:12:02.312 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-09-13T16:12:02.313 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-09-13T16:12:02.314 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-09-13T16:12:02.315 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-09-13T16:12:02.315 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-09-13T16:12:02.316 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-09-13T16:12:02.317 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-09-13T16:12:02.318 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-09-13T16:12:02.318 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-09-13T16:12:02.319 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-09-13T16:12:02.320 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-09-13T16:12:02.321 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/frv/ 2024-09-13T16:12:02.322 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-09-13T16:12:02.323 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-09-13T16:12:02.324 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-09-13T16:12:02.325 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-09-13T16:12:02.326 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-09-13T16:12:02.326 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-09-13T16:12:02.327 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-09-13T16:12:02.328 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-09-13T16:12:02.329 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-09-13T16:12:02.330 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-09-13T16:12:02.331 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-09-13T16:12:02.332 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/gcov.txt 2024-09-13T16:12:02.333 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-09-13T16:12:02.334 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/gpio/ 2024-09-13T16:12:02.335 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-09-13T16:12:02.336 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-09-13T16:12:02.337 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-09-13T16:12:02.338 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-09-13T16:12:02.338 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-09-13T16:12:02.339 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-09-13T16:12:02.340 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-09-13T16:12:02.341 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hid/ 2024-09-13T16:12:02.342 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-09-13T16:12:02.343 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-09-13T16:12:02.344 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-09-13T16:12:02.345 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-09-13T16:12:02.346 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-09-13T16:12:02.347 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/highuid.txt 2024-09-13T16:12:02.348 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hsi.txt 2024-09-13T16:12:02.349 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-09-13T16:12:02.350 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ 2024-09-13T16:12:02.351 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-09-13T16:12:02.352 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-09-13T16:12:02.353 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-09-13T16:12:02.354 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-09-13T16:12:02.355 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-09-13T16:12:02.355 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-09-13T16:12:02.356 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-09-13T16:12:02.357 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-09-13T16:12:02.358 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-09-13T16:12:02.359 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-09-13T16:12:02.360 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-09-13T16:12:02.361 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-09-13T16:12:02.362 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-09-13T16:12:02.363 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-09-13T16:12:02.363 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-09-13T16:12:02.364 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-09-13T16:12:02.365 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-09-13T16:12:02.366 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-09-13T16:12:02.367 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-09-13T16:12:02.368 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-09-13T16:12:02.369 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-09-13T16:12:02.369 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-09-13T16:12:02.370 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-09-13T16:12:02.371 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-09-13T16:12:02.372 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-09-13T16:12:02.373 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-09-13T16:12:02.374 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-09-13T16:12:02.375 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-09-13T16:12:02.376 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-09-13T16:12:02.377 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-09-13T16:12:02.379 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-09-13T16:12:02.379 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-09-13T16:12:02.379 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-09-13T16:12:02.380 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-09-13T16:12:02.381 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-09-13T16:12:02.382 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-09-13T16:12:02.383 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-09-13T16:12:02.384 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-09-13T16:12:02.385 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-09-13T16:12:02.386 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-09-13T16:12:02.387 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-09-13T16:12:02.387 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-09-13T16:12:02.388 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-09-13T16:12:02.389 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-09-13T16:12:02.390 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-09-13T16:12:02.391 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-09-13T16:12:02.392 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-09-13T16:12:02.393 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-09-13T16:12:02.394 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-09-13T16:12:02.394 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-09-13T16:12:02.395 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-09-13T16:12:02.396 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-09-13T16:12:02.397 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-09-13T16:12:02.398 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-09-13T16:12:02.399 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-09-13T16:12:02.400 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-09-13T16:12:02.401 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-09-13T16:12:02.401 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-09-13T16:12:02.402 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-09-13T16:12:02.403 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-09-13T16:12:02.404 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-09-13T16:12:02.405 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-09-13T16:12:02.406 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-09-13T16:12:02.407 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-09-13T16:12:02.407 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-09-13T16:12:02.409 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-09-13T16:12:02.410 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-09-13T16:12:02.410 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-09-13T16:12:02.411 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-09-13T16:12:02.412 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-09-13T16:12:02.413 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-09-13T16:12:02.414 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-09-13T16:12:02.415 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-09-13T16:12:02.416 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-09-13T16:12:02.417 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-09-13T16:12:02.417 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-09-13T16:12:02.418 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-09-13T16:12:02.419 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-09-13T16:12:02.420 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-09-13T16:12:02.421 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-09-13T16:12:02.422 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-09-13T16:12:02.422 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-09-13T16:12:02.423 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-09-13T16:12:02.424 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-09-13T16:12:02.425 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-09-13T16:12:02.426 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-09-13T16:12:02.427 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-09-13T16:12:02.428 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-09-13T16:12:02.429 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-09-13T16:12:02.430 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-09-13T16:12:02.431 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-09-13T16:12:02.432 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-09-13T16:12:02.432 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-09-13T16:12:02.433 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-09-13T16:12:02.434 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-09-13T16:12:02.435 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-09-13T16:12:02.436 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-09-13T16:12:02.437 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-09-13T16:12:02.437 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-09-13T16:12:02.438 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-09-13T16:12:02.439 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-09-13T16:12:02.440 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-09-13T16:12:02.440 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-09-13T16:12:02.441 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-09-13T16:12:02.442 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-09-13T16:12:02.443 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-09-13T16:12:02.444 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-09-13T16:12:02.445 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-09-13T16:12:02.447 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-09-13T16:12:02.447 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-09-13T16:12:02.448 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-09-13T16:12:02.449 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-09-13T16:12:02.450 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-09-13T16:12:02.451 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-09-13T16:12:02.452 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-09-13T16:12:02.453 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-09-13T16:12:02.454 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-09-13T16:12:02.455 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-09-13T16:12:02.456 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-09-13T16:12:02.457 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-09-13T16:12:02.458 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-09-13T16:12:02.459 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-09-13T16:12:02.460 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-09-13T16:12:02.460 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-09-13T16:12:02.461 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-09-13T16:12:02.463 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-09-13T16:12:02.463 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-09-13T16:12:02.465 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-09-13T16:12:02.465 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-09-13T16:12:02.466 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-09-13T16:12:02.467 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-09-13T16:12:02.468 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-09-13T16:12:02.469 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-09-13T16:12:02.470 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-09-13T16:12:02.471 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-09-13T16:12:02.472 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-09-13T16:12:02.473 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-09-13T16:12:02.474 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/ 2024-09-13T16:12:02.475 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-09-13T16:12:02.476 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-09-13T16:12:02.477 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-09-13T16:12:02.478 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-09-13T16:12:02.478 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-09-13T16:12:02.479 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-09-13T16:12:02.480 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-09-13T16:12:02.481 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-09-13T16:12:02.482 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-09-13T16:12:02.483 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-09-13T16:12:02.484 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-09-13T16:12:02.485 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-09-13T16:12:02.486 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-09-13T16:12:02.487 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-09-13T16:12:02.488 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-09-13T16:12:02.488 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-09-13T16:12:02.489 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-09-13T16:12:02.490 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-09-13T16:12:02.491 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-09-13T16:12:02.492 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-09-13T16:12:02.493 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-09-13T16:12:02.494 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-09-13T16:12:02.495 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-09-13T16:12:02.496 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-09-13T16:12:02.498 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-09-13T16:12:02.498 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-09-13T16:12:02.499 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-09-13T16:12:02.500 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-09-13T16:12:02.501 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-09-13T16:12:02.502 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-09-13T16:12:02.503 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-09-13T16:12:02.504 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-09-13T16:12:02.505 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/summary 2024-09-13T16:12:02.509 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-09-13T16:12:02.509 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-09-13T16:12:02.509 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-09-13T16:12:02.509 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2o/ 2024-09-13T16:12:02.510 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2o/README 2024-09-13T16:12:02.511 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-09-13T16:12:02.512 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ia64/ 2024-09-13T16:12:02.513 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-09-13T16:12:02.514 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-09-13T16:12:02.515 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-09-13T16:12:02.515 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ia64/README 2024-09-13T16:12:02.516 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-09-13T16:12:02.517 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-09-13T16:12:02.518 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-09-13T16:12:02.519 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-09-13T16:12:02.519 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-09-13T16:12:02.520 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-09-13T16:12:02.521 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-09-13T16:12:02.522 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-09-13T16:12:02.523 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ide/ 2024-09-13T16:12:02.524 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-09-13T16:12:02.525 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-09-13T16:12:02.526 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-09-13T16:12:02.527 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-09-13T16:12:02.528 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-09-13T16:12:02.529 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-09-13T16:12:02.529 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-09-13T16:12:02.530 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/infiniband/ 2024-09-13T16:12:02.531 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-09-13T16:12:02.532 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-09-13T16:12:02.533 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-09-13T16:12:02.534 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-09-13T16:12:02.535 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-09-13T16:12:02.536 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/init.txt 2024-09-13T16:12:02.538 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/initrd.txt 2024-09-13T16:12:02.538 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/ 2024-09-13T16:12:02.540 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-09-13T16:12:02.541 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-09-13T16:12:02.542 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-09-13T16:12:02.543 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-09-13T16:12:02.544 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-09-13T16:12:02.544 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-09-13T16:12:02.545 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-09-13T16:12:02.546 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-09-13T16:12:02.547 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-09-13T16:12:02.548 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-09-13T16:12:02.549 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-09-13T16:12:02.550 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-09-13T16:12:02.551 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-09-13T16:12:02.552 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-09-13T16:12:02.553 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-09-13T16:12:02.554 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-09-13T16:12:02.554 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-09-13T16:12:02.555 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/input.txt 2024-09-13T16:12:02.556 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-09-13T16:12:02.557 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-09-13T16:12:02.558 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-09-13T16:12:02.558 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-09-13T16:12:02.559 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-09-13T16:12:02.560 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-09-13T16:12:02.561 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-09-13T16:12:02.562 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-09-13T16:12:02.563 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-09-13T16:12:02.564 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-09-13T16:12:02.565 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-09-13T16:12:02.566 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-09-13T16:12:02.567 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-09-13T16:12:02.567 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-09-13T16:12:02.568 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-09-13T16:12:02.569 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-09-13T16:12:02.571 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ioctl/ 2024-09-13T16:12:02.571 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-09-13T16:12:02.573 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-09-13T16:12:02.573 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-09-13T16:12:02.574 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-09-13T16:12:02.575 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-09-13T16:12:02.576 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-09-13T16:12:02.577 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/iostats.txt 2024-09-13T16:12:02.578 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-09-13T16:12:02.579 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-09-13T16:12:02.580 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/ 2024-09-13T16:12:02.581 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-09-13T16:12:02.582 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-09-13T16:12:02.583 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-09-13T16:12:02.583 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-09-13T16:12:02.584 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-09-13T16:12:02.585 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-09-13T16:12:02.586 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/README 2024-09-13T16:12:02.587 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-09-13T16:12:02.588 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-09-13T16:12:02.589 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-09-13T16:12:02.590 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-09-13T16:12:02.590 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-09-13T16:12:02.591 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-09-13T16:12:02.592 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-09-13T16:12:02.593 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-09-13T16:12:02.594 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-09-13T16:12:02.595 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-09-13T16:12:02.596 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-09-13T16:12:02.597 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-09-13T16:12:02.598 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-09-13T16:12:02.599 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-09-13T16:12:02.599 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-09-13T16:12:02.600 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-09-13T16:12:02.601 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-09-13T16:12:02.602 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-09-13T16:12:02.603 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-09-13T16:12:02.604 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-09-13T16:12:02.605 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-09-13T16:12:02.606 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-09-13T16:12:02.607 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-09-13T16:12:02.608 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-09-13T16:12:02.609 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/java.txt 2024-09-13T16:12:02.610 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kasan.txt 2024-09-13T16:12:02.611 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kbuild/ 2024-09-13T16:12:02.612 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-09-13T16:12:02.613 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-09-13T16:12:02.614 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-09-13T16:12:02.615 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-09-13T16:12:02.616 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-09-13T16:12:02.617 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-09-13T16:12:02.618 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-09-13T16:12:02.619 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kdump/ 2024-09-13T16:12:02.620 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-09-13T16:12:02.621 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-09-13T16:12:02.622 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-09-13T16:12:02.623 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-09-13T16:12:02.624 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-09-13T16:12:02.626 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-09-13T16:12:02.627 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-09-13T16:12:02.628 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-09-13T16:12:02.629 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-09-13T16:12:02.630 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-09-13T16:12:02.631 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-09-13T16:12:02.632 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kobject.txt 2024-09-13T16:12:02.633 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-09-13T16:12:02.634 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kref.txt 2024-09-13T16:12:02.635 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-09-13T16:12:02.636 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/laptops/ 2024-09-13T16:12:02.637 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-09-13T16:12:02.638 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-09-13T16:12:02.639 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-09-13T16:12:02.640 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-09-13T16:12:02.641 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-09-13T16:12:02.641 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-09-13T16:12:02.642 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-09-13T16:12:02.643 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-09-13T16:12:02.644 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-09-13T16:12:02.645 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-09-13T16:12:02.646 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-09-13T16:12:02.647 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-09-13T16:12:02.648 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ldm.txt 2024-09-13T16:12:02.649 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/leds/ 2024-09-13T16:12:02.650 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-09-13T16:12:02.651 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-09-13T16:12:02.652 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-09-13T16:12:02.653 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-09-13T16:12:02.654 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-09-13T16:12:02.655 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-09-13T16:12:02.655 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-09-13T16:12:02.656 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-09-13T16:12:02.657 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-09-13T16:12:02.658 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-09-13T16:12:02.659 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-09-13T16:12:02.660 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-09-13T16:12:02.662 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/locking/ 2024-09-13T16:12:02.663 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-09-13T16:12:02.665 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-09-13T16:12:02.666 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-09-13T16:12:02.667 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-09-13T16:12:02.668 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-09-13T16:12:02.669 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-09-13T16:12:02.670 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-09-13T16:12:02.671 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-09-13T16:12:02.673 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-09-13T16:12:02.674 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-09-13T16:12:02.675 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-09-13T16:12:02.676 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/logo.gif 2024-09-13T16:12:02.678 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/logo.txt 2024-09-13T16:12:02.679 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/lzo.txt 2024-09-13T16:12:02.680 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/m68k/ 2024-09-13T16:12:02.682 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-09-13T16:12:02.683 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-09-13T16:12:02.685 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-09-13T16:12:02.686 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-09-13T16:12:02.688 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-09-13T16:12:02.689 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/md.txt 2024-09-13T16:12:02.690 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-09-13T16:12:02.692 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-09-13T16:12:02.854 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-09-13T16:12:02.855 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-09-13T16:12:02.856 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-09-13T16:12:02.857 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/metag/ 2024-09-13T16:12:02.858 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-09-13T16:12:02.859 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-09-13T16:12:02.860 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mic/ 2024-09-13T16:12:02.861 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-09-13T16:12:02.862 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-09-13T16:12:02.863 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-09-13T16:12:02.864 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-09-13T16:12:02.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:02 smithi086 ceph-mon[30379]: pgmap v415: 129 pgs: 129 active+clean; 68 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 5.7 MiB/s wr, 24 op/s 2024-09-13T16:12:02.865 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-09-13T16:12:02.866 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-09-13T16:12:02.867 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-09-13T16:12:02.868 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-09-13T16:12:02.869 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-09-13T16:12:02.870 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-09-13T16:12:02.871 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mips/ 2024-09-13T16:12:02.872 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-09-13T16:12:02.873 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-09-13T16:12:02.874 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-09-13T16:12:02.875 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-09-13T16:12:02.876 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-09-13T16:12:02.877 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-09-13T16:12:02.878 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-09-13T16:12:02.879 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-09-13T16:12:02.880 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-09-13T16:12:02.881 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-09-13T16:12:02.882 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-09-13T16:12:02.883 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-09-13T16:12:02.884 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-09-13T16:12:02.885 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-09-13T16:12:02.886 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-09-13T16:12:02.887 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-09-13T16:12:02.888 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-09-13T16:12:02.888 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-09-13T16:12:02.889 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-09-13T16:12:02.890 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-09-13T16:12:02.891 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-09-13T16:12:02.892 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mmc/ 2024-09-13T16:12:02.893 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-09-13T16:12:02.894 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-09-13T16:12:02.895 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-09-13T16:12:02.896 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-09-13T16:12:02.896 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mn10300/ 2024-09-13T16:12:02.898 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-09-13T16:12:02.899 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-09-13T16:12:02.900 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-09-13T16:12:02.901 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mono.txt 2024-09-13T16:12:02.902 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mtd/ 2024-09-13T16:12:02.903 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-09-13T16:12:02.904 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-09-13T16:12:02.905 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-09-13T16:12:02.906 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-09-13T16:12:02.907 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/namespaces/ 2024-09-13T16:12:02.908 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-09-13T16:12:02.909 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-09-13T16:12:02.910 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/netlabel/ 2024-09-13T16:12:02.911 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-09-13T16:12:02.913 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-09-13T16:12:02.914 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-09-13T16:12:02.915 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-09-13T16:12:02.915 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-09-13T16:12:02.916 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/ 2024-09-13T16:12:02.917 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-09-13T16:12:02.918 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-09-13T16:12:02.920 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-09-13T16:12:02.921 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-09-13T16:12:02.921 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-09-13T16:12:02.922 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-09-13T16:12:02.923 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-09-13T16:12:02.924 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-09-13T16:12:02.925 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-09-13T16:12:02.926 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-09-13T16:12:02.927 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-09-13T16:12:02.928 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-09-13T16:12:02.929 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-09-13T16:12:02.930 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-09-13T16:12:02.931 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-09-13T16:12:02.932 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-09-13T16:12:02.933 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-09-13T16:12:02.934 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-09-13T16:12:02.935 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-09-13T16:12:02.936 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-09-13T16:12:02.938 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-09-13T16:12:02.938 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-09-13T16:12:02.939 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-09-13T16:12:02.940 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-09-13T16:12:02.941 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-09-13T16:12:02.942 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-09-13T16:12:02.943 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-09-13T16:12:02.944 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-09-13T16:12:02.945 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-09-13T16:12:02.946 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-09-13T16:12:02.947 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-09-13T16:12:02.948 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-09-13T16:12:02.949 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-09-13T16:12:02.950 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-09-13T16:12:02.951 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-09-13T16:12:02.953 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-09-13T16:12:02.954 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-09-13T16:12:02.956 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-09-13T16:12:02.957 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-09-13T16:12:02.958 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-09-13T16:12:02.959 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-09-13T16:12:02.960 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-09-13T16:12:02.961 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-09-13T16:12:02.962 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-09-13T16:12:02.963 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-09-13T16:12:02.965 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-09-13T16:12:02.966 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-09-13T16:12:02.967 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-09-13T16:12:02.968 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-09-13T16:12:02.969 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-09-13T16:12:02.970 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-09-13T16:12:02.972 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-09-13T16:12:02.973 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-09-13T16:12:02.974 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-09-13T16:12:02.976 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-09-13T16:12:02.977 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-09-13T16:12:02.978 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-09-13T16:12:02.979 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-09-13T16:12:02.981 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-09-13T16:12:02.982 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-09-13T16:12:02.983 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-09-13T16:12:02.984 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-09-13T16:12:02.986 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-09-13T16:12:02.987 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-09-13T16:12:02.988 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-09-13T16:12:02.989 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-09-13T16:12:02.990 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-09-13T16:12:02.991 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-09-13T16:12:02.993 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-09-13T16:12:02.994 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-09-13T16:12:02.996 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-09-13T16:12:02.997 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-09-13T16:12:02.998 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-09-13T16:12:02.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:02 smithi139 ceph-mon[35320]: pgmap v415: 129 pgs: 129 active+clean; 68 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 5.7 MiB/s wr, 24 op/s 2024-09-13T16:12:02.999 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-09-13T16:12:03.000 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-09-13T16:12:03.001 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-09-13T16:12:03.002 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-09-13T16:12:03.002 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-09-13T16:12:03.003 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-09-13T16:12:03.004 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-09-13T16:12:03.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:02 smithi194 ceph-mon[35694]: pgmap v415: 129 pgs: 129 active+clean; 68 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 5.7 MiB/s wr, 24 op/s 2024-09-13T16:12:03.005 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-09-13T16:12:03.005 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-09-13T16:12:03.006 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-09-13T16:12:03.007 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-09-13T16:12:03.008 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-09-13T16:12:03.009 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-09-13T16:12:03.010 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-09-13T16:12:03.010 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-09-13T16:12:03.011 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-09-13T16:12:03.012 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-09-13T16:12:03.014 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-09-13T16:12:03.014 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-09-13T16:12:03.016 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-09-13T16:12:03.016 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-09-13T16:12:03.017 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-09-13T16:12:03.018 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-09-13T16:12:03.019 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-09-13T16:12:03.020 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-09-13T16:12:03.021 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-09-13T16:12:03.022 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-09-13T16:12:03.023 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-09-13T16:12:03.024 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-09-13T16:12:03.025 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-09-13T16:12:03.026 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-09-13T16:12:03.028 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-09-13T16:12:03.029 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-09-13T16:12:03.029 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-09-13T16:12:03.031 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-09-13T16:12:03.031 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-09-13T16:12:03.032 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-09-13T16:12:03.033 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-09-13T16:12:03.034 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-09-13T16:12:03.036 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-09-13T16:12:03.036 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-09-13T16:12:03.037 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-09-13T16:12:03.038 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-09-13T16:12:03.040 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-09-13T16:12:03.041 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-09-13T16:12:03.042 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-09-13T16:12:03.043 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-09-13T16:12:03.044 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-09-13T16:12:03.045 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-09-13T16:12:03.046 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-09-13T16:12:03.047 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-09-13T16:12:03.048 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-09-13T16:12:03.049 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-09-13T16:12:03.050 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-09-13T16:12:03.051 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-09-13T16:12:03.052 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-09-13T16:12:03.052 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-09-13T16:12:03.053 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-09-13T16:12:03.054 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-09-13T16:12:03.055 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-09-13T16:12:03.056 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-09-13T16:12:03.058 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-09-13T16:12:03.059 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/nfc/ 2024-09-13T16:12:03.060 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-09-13T16:12:03.061 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-09-13T16:12:03.063 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/nios2/ 2024-09-13T16:12:03.064 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/nios2/README 2024-09-13T16:12:03.065 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-09-13T16:12:03.066 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/numastat.txt 2024-09-13T16:12:03.068 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-09-13T16:12:03.069 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/padata.txt 2024-09-13T16:12:03.070 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/parisc/ 2024-09-13T16:12:03.072 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-09-13T16:12:03.073 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-09-13T16:12:03.074 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/parisc/registers 2024-09-13T16:12:03.076 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-09-13T16:12:03.077 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/parport.txt 2024-09-13T16:12:03.078 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-09-13T16:12:03.079 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-09-13T16:12:03.080 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-09-13T16:12:03.081 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-09-13T16:12:03.082 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-09-13T16:12:03.084 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-09-13T16:12:03.085 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-09-13T16:12:03.086 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-09-13T16:12:03.087 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-09-13T16:12:03.088 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/phy.txt 2024-09-13T16:12:03.089 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/phy/ 2024-09-13T16:12:03.090 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-09-13T16:12:03.092 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-09-13T16:12:03.093 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-09-13T16:12:03.094 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/platform/ 2024-09-13T16:12:03.095 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-09-13T16:12:03.096 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/pnp.txt 2024-09-13T16:12:03.097 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/ 2024-09-13T16:12:03.098 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-09-13T16:12:03.099 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-09-13T16:12:03.100 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-09-13T16:12:03.102 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-09-13T16:12:03.103 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-09-13T16:12:03.104 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-09-13T16:12:03.105 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-09-13T16:12:03.106 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-09-13T16:12:03.107 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-09-13T16:12:03.108 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-09-13T16:12:03.109 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-09-13T16:12:03.110 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-09-13T16:12:03.111 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-09-13T16:12:03.112 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-09-13T16:12:03.113 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-09-13T16:12:03.114 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-09-13T16:12:03.115 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-09-13T16:12:03.116 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-09-13T16:12:03.120 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-09-13T16:12:03.120 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-09-13T16:12:03.121 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-09-13T16:12:03.121 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-09-13T16:12:03.121 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-09-13T16:12:03.122 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/states.txt 2024-09-13T16:12:03.123 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-09-13T16:12:03.124 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-09-13T16:12:03.125 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-09-13T16:12:03.126 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-09-13T16:12:03.127 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-09-13T16:12:03.128 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-09-13T16:12:03.129 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-09-13T16:12:03.130 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/power/video.txt 2024-09-13T16:12:03.131 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/powerpc/ 2024-09-13T16:12:03.132 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-09-13T16:12:03.134 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-09-13T16:12:03.135 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-09-13T16:12:03.136 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-09-13T16:12:03.137 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-09-13T16:12:03.138 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-09-13T16:12:03.139 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-09-13T16:12:03.140 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-09-13T16:12:03.141 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-09-13T16:12:03.142 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-09-13T16:12:03.143 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-09-13T16:12:03.144 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-09-13T16:12:03.145 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-09-13T16:12:03.146 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/pps/ 2024-09-13T16:12:03.147 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-09-13T16:12:03.149 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/prctl/ 2024-09-13T16:12:03.150 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-09-13T16:12:03.151 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-09-13T16:12:03.152 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-09-13T16:12:03.153 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-09-13T16:12:03.154 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-09-13T16:12:03.155 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-09-13T16:12:03.156 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-09-13T16:12:03.157 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-09-13T16:12:03.158 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-09-13T16:12:03.159 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/pti/ 2024-09-13T16:12:03.161 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-09-13T16:12:03.162 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ptp/ 2024-09-13T16:12:03.163 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-09-13T16:12:03.164 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-09-13T16:12:03.165 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-09-13T16:12:03.166 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-09-13T16:12:03.167 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-09-13T16:12:03.168 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/pwm.txt 2024-09-13T16:12:03.169 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-09-13T16:12:03.170 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/rapidio/ 2024-09-13T16:12:03.172 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-09-13T16:12:03.173 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-09-13T16:12:03.173 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-09-13T16:12:03.174 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-09-13T16:12:03.176 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-09-13T16:12:03.177 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-09-13T16:12:03.178 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-09-13T16:12:03.179 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-09-13T16:12:03.180 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-09-13T16:12:03.181 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/rtc.txt 2024-09-13T16:12:03.182 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/s390/ 2024-09-13T16:12:03.183 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-09-13T16:12:03.185 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-09-13T16:12:03.186 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-09-13T16:12:03.187 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-09-13T16:12:03.188 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/s390/DASD 2024-09-13T16:12:03.189 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-09-13T16:12:03.191 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-09-13T16:12:03.192 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-09-13T16:12:03.193 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-09-13T16:12:03.194 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-09-13T16:12:03.195 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-09-13T16:12:03.196 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-09-13T16:12:03.197 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-09-13T16:12:03.198 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-09-13T16:12:03.199 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scheduler/ 2024-09-13T16:12:03.200 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-09-13T16:12:03.201 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-09-13T16:12:03.202 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-09-13T16:12:03.203 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-09-13T16:12:03.204 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-09-13T16:12:03.205 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-09-13T16:12:03.206 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-09-13T16:12:03.207 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-09-13T16:12:03.208 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-09-13T16:12:03.209 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-09-13T16:12:03.210 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/ 2024-09-13T16:12:03.211 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-09-13T16:12:03.212 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-09-13T16:12:03.213 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-09-13T16:12:03.215 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-09-13T16:12:03.216 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-09-13T16:12:03.217 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-09-13T16:12:03.218 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-09-13T16:12:03.219 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-09-13T16:12:03.220 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-09-13T16:12:03.221 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-09-13T16:12:03.222 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-09-13T16:12:03.223 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-09-13T16:12:03.224 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-09-13T16:12:03.225 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-09-13T16:12:03.226 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-09-13T16:12:03.227 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-09-13T16:12:03.229 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-09-13T16:12:03.230 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-09-13T16:12:03.231 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-09-13T16:12:03.232 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-09-13T16:12:03.233 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-09-13T16:12:03.234 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-09-13T16:12:03.235 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-09-13T16:12:03.236 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-09-13T16:12:03.237 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-09-13T16:12:03.237 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-09-13T16:12:03.238 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-09-13T16:12:03.239 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-09-13T16:12:03.240 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-09-13T16:12:03.241 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-09-13T16:12:03.242 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-09-13T16:12:03.243 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-09-13T16:12:03.244 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-09-13T16:12:03.245 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-09-13T16:12:03.245 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-09-13T16:12:03.246 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-09-13T16:12:03.247 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-09-13T16:12:03.248 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-09-13T16:12:03.248 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-09-13T16:12:03.250 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-09-13T16:12:03.250 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-09-13T16:12:03.251 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-09-13T16:12:03.252 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-09-13T16:12:03.253 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-09-13T16:12:03.254 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-09-13T16:12:03.254 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-09-13T16:12:03.256 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-09-13T16:12:03.257 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-09-13T16:12:03.258 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-09-13T16:12:03.259 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-09-13T16:12:03.260 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-09-13T16:12:03.261 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-09-13T16:12:03.262 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-09-13T16:12:03.263 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-09-13T16:12:03.264 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-09-13T16:12:03.265 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-09-13T16:12:03.266 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-09-13T16:12:03.267 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-09-13T16:12:03.268 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-09-13T16:12:03.269 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/security/ 2024-09-13T16:12:03.270 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-09-13T16:12:03.271 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-09-13T16:12:03.272 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-09-13T16:12:03.273 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-09-13T16:12:03.274 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-09-13T16:12:03.275 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-09-13T16:12:03.276 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-09-13T16:12:03.277 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-09-13T16:12:03.277 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-09-13T16:12:03.278 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-09-13T16:12:03.279 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-09-13T16:12:03.280 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-09-13T16:12:03.281 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-09-13T16:12:03.282 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-09-13T16:12:03.283 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/serial/ 2024-09-13T16:12:03.284 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-09-13T16:12:03.285 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-09-13T16:12:03.286 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/serial/driver 2024-09-13T16:12:03.287 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-09-13T16:12:03.287 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-09-13T16:12:03.289 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-09-13T16:12:03.289 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-09-13T16:12:03.291 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-09-13T16:12:03.291 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-09-13T16:12:03.292 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sh/ 2024-09-13T16:12:03.293 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-09-13T16:12:03.294 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-09-13T16:12:03.295 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-09-13T16:12:03.296 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/ 2024-09-13T16:12:03.297 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-09-13T16:12:03.298 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-09-13T16:12:03.299 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-09-13T16:12:03.300 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-09-13T16:12:03.301 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-09-13T16:12:03.302 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-09-13T16:12:03.303 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-09-13T16:12:03.304 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-09-13T16:12:03.304 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-09-13T16:12:03.305 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-09-13T16:12:03.306 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-09-13T16:12:03.307 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-09-13T16:12:03.308 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-09-13T16:12:03.309 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-09-13T16:12:03.310 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-09-13T16:12:03.311 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-09-13T16:12:03.312 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-09-13T16:12:03.313 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-09-13T16:12:03.314 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-09-13T16:12:03.315 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-09-13T16:12:03.316 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-09-13T16:12:03.317 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-09-13T16:12:03.318 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-09-13T16:12:03.319 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-09-13T16:12:03.322 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-09-13T16:12:03.323 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-09-13T16:12:03.324 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-09-13T16:12:03.325 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-09-13T16:12:03.326 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-09-13T16:12:03.327 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-09-13T16:12:03.328 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-09-13T16:12:03.330 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-09-13T16:12:03.331 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-09-13T16:12:03.332 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-09-13T16:12:03.333 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-09-13T16:12:03.335 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-09-13T16:12:03.335 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-09-13T16:12:03.337 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-09-13T16:12:03.338 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-09-13T16:12:03.339 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-09-13T16:12:03.340 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-09-13T16:12:03.341 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-09-13T16:12:03.342 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-09-13T16:12:03.344 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-09-13T16:12:03.345 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-09-13T16:12:03.346 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-09-13T16:12:03.347 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-09-13T16:12:03.348 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-09-13T16:12:03.349 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-09-13T16:12:03.350 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-09-13T16:12:03.351 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-09-13T16:12:03.352 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-09-13T16:12:03.353 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-09-13T16:12:03.354 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-09-13T16:12:03.355 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-09-13T16:12:03.356 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-09-13T16:12:03.357 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-09-13T16:12:03.358 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-09-13T16:12:03.359 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-09-13T16:12:03.361 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-09-13T16:12:03.362 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-09-13T16:12:03.363 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-09-13T16:12:03.364 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sparse.txt 2024-09-13T16:12:03.366 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/spi/ 2024-09-13T16:12:03.367 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-09-13T16:12:03.368 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-09-13T16:12:03.369 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-09-13T16:12:03.370 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-09-13T16:12:03.371 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-09-13T16:12:03.372 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-09-13T16:12:03.373 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-09-13T16:12:03.374 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-09-13T16:12:03.375 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-09-13T16:12:03.376 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/spi/spidev 2024-09-13T16:12:03.377 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-09-13T16:12:03.378 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-09-13T16:12:03.379 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-09-13T16:12:03.380 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-09-13T16:12:03.381 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-09-13T16:12:03.382 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/svga.txt 2024-09-13T16:12:03.383 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sysctl/ 2024-09-13T16:12:03.384 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-09-13T16:12:03.385 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sysctl/README 2024-09-13T16:12:03.386 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-09-13T16:12:03.387 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-09-13T16:12:03.388 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-09-13T16:12:03.389 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-09-13T16:12:03.390 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-09-13T16:12:03.391 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-09-13T16:12:03.392 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-09-13T16:12:03.393 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-09-13T16:12:03.394 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/target/ 2024-09-13T16:12:03.395 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-09-13T16:12:03.396 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-09-13T16:12:03.397 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-09-13T16:12:03.398 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/thermal/ 2024-09-13T16:12:03.399 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-09-13T16:12:03.400 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-09-13T16:12:03.401 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-09-13T16:12:03.402 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-09-13T16:12:03.403 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-09-13T16:12:03.404 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-09-13T16:12:03.405 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-09-13T16:12:03.406 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-09-13T16:12:03.407 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/timers/ 2024-09-13T16:12:03.408 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-09-13T16:12:03.409 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-09-13T16:12:03.410 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-09-13T16:12:03.411 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-09-13T16:12:03.412 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-09-13T16:12:03.413 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-09-13T16:12:03.413 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-09-13T16:12:03.415 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-09-13T16:12:03.416 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-09-13T16:12:03.417 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-09-13T16:12:03.418 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-09-13T16:12:03.419 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/tpm/ 2024-09-13T16:12:03.420 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-09-13T16:12:03.421 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/trace/ 2024-09-13T16:12:03.422 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-09-13T16:12:03.423 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-09-13T16:12:03.424 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-09-13T16:12:03.425 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-09-13T16:12:03.426 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-09-13T16:12:03.427 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-09-13T16:12:03.428 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-09-13T16:12:03.429 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-09-13T16:12:03.430 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-09-13T16:12:03.431 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-09-13T16:12:03.432 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-09-13T16:12:03.433 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-09-13T16:12:03.434 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-09-13T16:12:03.435 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-09-13T16:12:03.436 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-09-13T16:12:03.437 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-09-13T16:12:03.438 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-09-13T16:12:03.439 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-09-13T16:12:03.440 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/unicode.txt 2024-09-13T16:12:03.441 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/unshare.txt 2024-09-13T16:12:03.442 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/ 2024-09-13T16:12:03.443 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-09-13T16:12:03.444 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-09-13T16:12:03.445 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-09-13T16:12:03.446 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-09-13T16:12:03.447 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-09-13T16:12:03.448 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-09-13T16:12:03.449 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-09-13T16:12:03.450 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-09-13T16:12:03.452 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-09-13T16:12:03.453 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-09-13T16:12:03.454 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-09-13T16:12:03.455 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-09-13T16:12:03.456 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-09-13T16:12:03.457 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-09-13T16:12:03.457 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-09-13T16:12:03.459 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-09-13T16:12:03.459 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-09-13T16:12:03.460 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-09-13T16:12:03.461 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-09-13T16:12:03.462 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-09-13T16:12:03.463 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-09-13T16:12:03.465 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-09-13T16:12:03.465 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-09-13T16:12:03.466 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-09-13T16:12:03.467 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-09-13T16:12:03.468 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-09-13T16:12:03.469 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-09-13T16:12:03.470 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-09-13T16:12:03.472 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-09-13T16:12:03.473 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-09-13T16:12:03.474 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-09-13T16:12:03.475 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-09-13T16:12:03.476 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-09-13T16:12:03.477 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-09-13T16:12:03.477 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-09-13T16:12:03.479 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-09-13T16:12:03.479 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vDSO/ 2024-09-13T16:12:03.480 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-09-13T16:12:03.481 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-09-13T16:12:03.482 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-09-13T16:12:03.483 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-09-13T16:12:03.484 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-09-13T16:12:03.485 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vfio.txt 2024-09-13T16:12:03.486 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-09-13T16:12:03.487 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video-output.txt 2024-09-13T16:12:03.488 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/ 2024-09-13T16:12:03.489 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-09-13T16:12:03.490 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-09-13T16:12:03.491 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-09-13T16:12:03.492 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-09-13T16:12:03.493 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-09-13T16:12:03.494 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-09-13T16:12:03.494 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-09-13T16:12:03.495 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-09-13T16:12:03.496 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-09-13T16:12:03.497 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-09-13T16:12:03.498 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-09-13T16:12:03.499 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-09-13T16:12:03.500 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-09-13T16:12:03.501 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-09-13T16:12:03.502 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-09-13T16:12:03.503 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-09-13T16:12:03.503 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-09-13T16:12:03.504 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-09-13T16:12:03.505 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-09-13T16:12:03.506 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-09-13T16:12:03.507 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-09-13T16:12:03.508 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-09-13T16:12:03.509 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-09-13T16:12:03.510 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-09-13T16:12:03.511 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-09-13T16:12:03.513 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-09-13T16:12:03.513 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-09-13T16:12:03.515 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-09-13T16:12:03.516 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-09-13T16:12:03.517 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-09-13T16:12:03.517 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-09-13T16:12:03.518 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-09-13T16:12:03.519 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-09-13T16:12:03.521 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-09-13T16:12:03.521 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-09-13T16:12:03.522 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-09-13T16:12:03.523 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-09-13T16:12:03.524 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-09-13T16:12:03.525 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-09-13T16:12:03.526 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-09-13T16:12:03.528 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-09-13T16:12:03.529 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-09-13T16:12:03.529 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-09-13T16:12:03.530 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-09-13T16:12:03.531 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-09-13T16:12:03.532 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-09-13T16:12:03.533 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-09-13T16:12:03.534 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-09-13T16:12:03.536 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-09-13T16:12:03.536 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-09-13T16:12:03.537 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-09-13T16:12:03.538 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-09-13T16:12:03.539 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-09-13T16:12:03.540 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-09-13T16:12:03.541 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-09-13T16:12:03.542 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-09-13T16:12:03.543 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-09-13T16:12:03.544 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-09-13T16:12:03.545 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-09-13T16:12:03.546 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-09-13T16:12:03.546 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-09-13T16:12:03.548 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-09-13T16:12:03.549 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-09-13T16:12:03.550 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-09-13T16:12:03.551 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-09-13T16:12:03.552 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-09-13T16:12:03.553 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-09-13T16:12:03.553 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-09-13T16:12:03.554 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-09-13T16:12:03.555 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-09-13T16:12:03.556 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-09-13T16:12:03.557 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-09-13T16:12:03.558 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-09-13T16:12:03.559 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-09-13T16:12:03.560 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-09-13T16:12:03.561 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-09-13T16:12:03.562 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-09-13T16:12:03.563 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-09-13T16:12:03.564 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/ 2024-09-13T16:12:03.565 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-09-13T16:12:03.566 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-09-13T16:12:03.567 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-09-13T16:12:03.568 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-09-13T16:12:03.570 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-09-13T16:12:03.571 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-09-13T16:12:03.572 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-09-13T16:12:03.573 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-09-13T16:12:03.574 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-09-13T16:12:03.575 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-09-13T16:12:03.576 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-09-13T16:12:03.577 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-09-13T16:12:03.578 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-09-13T16:12:03.578 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-09-13T16:12:03.579 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-09-13T16:12:03.580 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-09-13T16:12:03.581 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-09-13T16:12:03.581 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-09-13T16:12:03.582 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-09-13T16:12:03.583 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-09-13T16:12:03.584 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-09-13T16:12:03.585 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-09-13T16:12:03.586 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-09-13T16:12:03.587 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-09-13T16:12:03.588 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-09-13T16:12:03.589 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/ 2024-09-13T16:12:03.590 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-09-13T16:12:03.591 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-09-13T16:12:03.592 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-09-13T16:12:03.593 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/balance 2024-09-13T16:12:03.594 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-09-13T16:12:03.594 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-09-13T16:12:03.595 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-09-13T16:12:03.597 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-09-13T16:12:03.598 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-09-13T16:12:03.599 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-09-13T16:12:03.599 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/numa 2024-09-13T16:12:03.601 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-09-13T16:12:03.601 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-09-13T16:12:03.602 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-09-13T16:12:03.603 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-09-13T16:12:03.604 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-09-13T16:12:03.605 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-09-13T16:12:03.606 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-09-13T16:12:03.607 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-09-13T16:12:03.607 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-09-13T16:12:03.608 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-09-13T16:12:03.609 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-09-13T16:12:03.610 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-09-13T16:12:03.611 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-09-13T16:12:03.612 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-09-13T16:12:03.612 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/w1/ 2024-09-13T16:12:03.614 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-09-13T16:12:03.614 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-09-13T16:12:03.615 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-09-13T16:12:03.616 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-09-13T16:12:03.617 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-09-13T16:12:03.618 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-09-13T16:12:03.619 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-09-13T16:12:03.620 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-09-13T16:12:03.621 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-09-13T16:12:03.622 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-09-13T16:12:03.623 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-09-13T16:12:03.624 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-09-13T16:12:03.625 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-09-13T16:12:03.626 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-09-13T16:12:03.627 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-09-13T16:12:03.627 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-09-13T16:12:03.629 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/watchdog/ 2024-09-13T16:12:03.631 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-09-13T16:12:03.631 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-09-13T16:12:03.633 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-09-13T16:12:03.634 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-09-13T16:12:03.635 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-09-13T16:12:03.636 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-09-13T16:12:03.637 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-09-13T16:12:03.637 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-09-13T16:12:03.638 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-09-13T16:12:03.639 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-09-13T16:12:03.640 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-09-13T16:12:03.642 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-09-13T16:12:03.643 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-09-13T16:12:03.643 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/wimax/ 2024-09-13T16:12:03.645 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-09-13T16:12:03.646 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-09-13T16:12:03.647 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-09-13T16:12:03.648 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/ 2024-09-13T16:12:03.649 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-09-13T16:12:03.650 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-09-13T16:12:03.651 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-09-13T16:12:03.652 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-09-13T16:12:03.653 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-09-13T16:12:03.654 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-09-13T16:12:03.655 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-09-13T16:12:03.656 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-09-13T16:12:03.657 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-09-13T16:12:03.659 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-09-13T16:12:03.660 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-09-13T16:12:03.661 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-09-13T16:12:03.662 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-09-13T16:12:03.663 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-09-13T16:12:03.664 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-09-13T16:12:03.665 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-09-13T16:12:03.666 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-09-13T16:12:03.667 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-09-13T16:12:03.667 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-09-13T16:12:03.668 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-09-13T16:12:03.669 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-09-13T16:12:03.671 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-09-13T16:12:03.672 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-09-13T16:12:03.673 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-09-13T16:12:03.674 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/xtensa/ 2024-09-13T16:12:03.675 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-09-13T16:12:03.676 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-09-13T16:12:03.678 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/xz.txt 2024-09-13T16:12:03.679 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-09-13T16:12:03.679 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-09-13T16:12:03.681 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-09-13T16:12:03.682 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-09-13T16:12:03.683 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-09-13T16:12:03.684 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-09-13T16:12:03.684 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-09-13T16:12:03.686 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-09-13T16:12:03.687 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-09-13T16:12:03.688 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-09-13T16:12:03.689 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-09-13T16:12:03.690 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-09-13T16:12:03.691 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-09-13T16:12:03.692 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-09-13T16:12:03.693 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-09-13T16:12:03.694 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-09-13T16:12:03.695 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-09-13T16:12:03.696 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-09-13T16:12:03.840 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-09-13T16:12:03.841 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-09-13T16:12:03.842 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-09-13T16:12:03.843 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-09-13T16:12:03.844 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-09-13T16:12:03.846 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-09-13T16:12:03.846 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-09-13T16:12:03.847 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-09-13T16:12:03.848 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-09-13T16:12:03.849 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-09-13T16:12:03.850 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-09-13T16:12:03.851 INFO:tasks.workunit.client.0.smithi086.stdout:linux-4.0.5/Documentation/zorro.txt 2024-09-13T16:12:04.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:04 smithi086 ceph-mon[30379]: pgmap v416: 129 pgs: 129 active+clean; 77 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 6.4 MiB/s wr, 75 op/s 2024-09-13T16:12:04.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:04 smithi139 ceph-mon[35320]: pgmap v416: 129 pgs: 129 active+clean; 77 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 6.4 MiB/s wr, 75 op/s 2024-09-13T16:12:05.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:04 smithi194 ceph-mon[35694]: pgmap v416: 129 pgs: 129 active+clean; 77 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 6.4 MiB/s wr, 75 op/s 2024-09-13T16:12:05.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:05 smithi086 ceph-mon[30379]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:05.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:05 smithi139 ceph-mon[35320]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:06.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:05 smithi194 ceph-mon[35694]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:06.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:06 smithi086 ceph-mon[30379]: pgmap v417: 129 pgs: 129 active+clean; 87 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 7.3 MiB/s wr, 269 op/s 2024-09-13T16:12:06.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:06 smithi139 ceph-mon[35320]: pgmap v417: 129 pgs: 129 active+clean; 87 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 7.3 MiB/s wr, 269 op/s 2024-09-13T16:12:07.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:06 smithi194 ceph-mon[35694]: pgmap v417: 129 pgs: 129 active+clean; 87 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 7.3 MiB/s wr, 269 op/s 2024-09-13T16:12:08.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:08 smithi086 ceph-mon[30379]: pgmap v418: 129 pgs: 129 active+clean; 87 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 7.3 MiB/s wr, 466 op/s 2024-09-13T16:12:08.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:08 smithi139 ceph-mon[35320]: pgmap v418: 129 pgs: 129 active+clean; 87 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 7.3 MiB/s wr, 466 op/s 2024-09-13T16:12:09.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:08 smithi194 ceph-mon[35694]: pgmap v418: 129 pgs: 129 active+clean; 87 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 7.3 MiB/s wr, 466 op/s 2024-09-13T16:12:10.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:09 smithi086 ceph-mon[30379]: pgmap v419: 129 pgs: 129 active+clean; 88 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 5.5 MiB/s wr, 469 op/s 2024-09-13T16:12:10.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:09 smithi139 ceph-mon[35320]: pgmap v419: 129 pgs: 129 active+clean; 88 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 5.5 MiB/s wr, 469 op/s 2024-09-13T16:12:10.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:09 smithi194 ceph-mon[35694]: pgmap v419: 129 pgs: 129 active+clean; 88 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 5.5 MiB/s wr, 469 op/s 2024-09-13T16:12:12.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:12 smithi139 ceph-mon[35320]: pgmap v420: 129 pgs: 129 active+clean; 88 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 3.5 MiB/s wr, 472 op/s 2024-09-13T16:12:12.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:12 smithi194 ceph-mon[35694]: pgmap v420: 129 pgs: 129 active+clean; 88 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 3.5 MiB/s wr, 472 op/s 2024-09-13T16:12:12.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:12 smithi086 ceph-mon[30379]: pgmap v420: 129 pgs: 129 active+clean; 88 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 3.5 MiB/s wr, 472 op/s 2024-09-13T16:12:14.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:14 smithi139 ceph-mon[35320]: pgmap v421: 129 pgs: 129 active+clean; 91 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 2.4 MiB/s wr, 488 op/s 2024-09-13T16:12:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:14 smithi194 ceph-mon[35694]: pgmap v421: 129 pgs: 129 active+clean; 91 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 2.4 MiB/s wr, 488 op/s 2024-09-13T16:12:14.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:14 smithi086 ceph-mon[30379]: pgmap v421: 129 pgs: 129 active+clean; 91 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 2.4 MiB/s wr, 488 op/s 2024-09-13T16:12:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.299+0000 7f244de00640 1 -- 172.21.15.86:0/3212280595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2448102f60 msgr2=0x7f24481033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.299+0000 7f244de00640 1 --2- 172.21.15.86:0/3212280595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2448102f60 0x7f24481033e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2434009900 tx=0x7f243402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.299+0000 7f244de00640 1 -- 172.21.15.86:0/3212280595 shutdown_connections 2024-09-13T16:12:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.299+0000 7f244de00640 1 --2- 172.21.15.86:0/3212280595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2448103920 0x7f244810a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.299+0000 7f244de00640 1 --2- 172.21.15.86:0/3212280595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2448102f60 0x7f24481033e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.299+0000 7f244de00640 1 --2- 172.21.15.86:0/3212280595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2448101d70 0x7f2448102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.299+0000 7f244de00640 1 -- 172.21.15.86:0/3212280595 >> 172.21.15.86:0/3212280595 conn(0x7f24480fd4d0 msgr2=0x7f24480ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.299+0000 7f244de00640 1 -- 172.21.15.86:0/3212280595 shutdown_connections 2024-09-13T16:12:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.299+0000 7f244de00640 1 -- 172.21.15.86:0/3212280595 wait complete. 2024-09-13T16:12:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.300+0000 7f244de00640 1 Processor -- start 2024-09-13T16:12:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.300+0000 7f244de00640 1 -- start start 2024-09-13T16:12:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.300+0000 7f244de00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2448101d70 0x7f2448197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.300+0000 7f244de00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2448102f60 0x7f2448198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.300+0000 7f244de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2448103920 0x7f244819f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.300+0000 7f244de00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244819f840 con 0x7f2448102f60 2024-09-13T16:12:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.300+0000 7f244de00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244819f9b0 con 0x7f2448101d70 2024-09-13T16:12:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.300+0000 7f244de00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244819fb70 con 0x7f2448103920 2024-09-13T16:12:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.301+0000 7f244ca00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2448101d70 0x7f2448197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.301+0000 7f2447e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2448102f60 0x7f2448198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:15.305 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.301+0000 7f244ca00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2448101d70 0x7f2448197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:47810/0 (socket says 172.21.15.86:47810) 2024-09-13T16:12:15.305 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.301+0000 7f244ca00640 1 -- 172.21.15.86:0/4028986170 learned_addr learned my addr 172.21.15.86:0/4028986170 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:15.305 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.301+0000 7f244d400640 1 --2- 172.21.15.86:0/4028986170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2448103920 0x7f244819f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:15.305 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.301+0000 7f244ca00640 1 -- 172.21.15.86:0/4028986170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2448103920 msgr2=0x7f244819f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:15.305 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.301+0000 7f244ca00640 1 --2- 172.21.15.86:0/4028986170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2448103920 0x7f244819f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.305 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.301+0000 7f244ca00640 1 -- 172.21.15.86:0/4028986170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2448102f60 msgr2=0x7f2448198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:15.305 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.301+0000 7f244ca00640 1 --2- 172.21.15.86:0/4028986170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2448102f60 0x7f2448198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.305 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.301+0000 7f244ca00640 1 -- 172.21.15.86:0/4028986170 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2440009840 con 0x7f2448101d70 2024-09-13T16:12:15.305 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.301+0000 7f244ca00640 1 --2- 172.21.15.86:0/4028986170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2448101d70 0x7f2448197d50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f243c00e9c0 tx=0x7f243c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:15.305 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.301+0000 7f2445600640 1 -- 172.21.15.86:0/4028986170 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c009700 con 0x7f2448101d70 2024-09-13T16:12:15.305 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.301+0000 7f2445600640 1 -- 172.21.15.86:0/4028986170 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f243c00cd80 con 0x7f2448101d70 2024-09-13T16:12:15.305 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.301+0000 7f244de00640 1 -- 172.21.15.86:0/4028986170 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2434009560 con 0x7f2448101d70 2024-09-13T16:12:15.305 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.301+0000 7f2445600640 1 -- 172.21.15.86:0/4028986170 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c010430 con 0x7f2448101d70 2024-09-13T16:12:15.305 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.302+0000 7f244de00640 1 -- 172.21.15.86:0/4028986170 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24481a01a0 con 0x7f2448101d70 2024-09-13T16:12:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.304+0000 7f24522a7740 1 Processor -- start 2024-09-13T16:12:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.304+0000 7f24522a7740 1 -- start start 2024-09-13T16:12:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.304+0000 7f2445600640 1 -- 172.21.15.86:0/4028986170 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f243c003680 con 0x7f2448101d70 2024-09-13T16:12:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.305+0000 7f24522a7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 0x559f969d5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.305+0000 7f24522a7740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969d55c0 0x559f969da080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.305+0000 7f24522a7740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969da650 0x559f969dcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.305+0000 7f24522a7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f968e0bb0 con 0x559f969d4c80 2024-09-13T16:12:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.305+0000 7f24522a7740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9693ea70 con 0x559f969da650 2024-09-13T16:12:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.305+0000 7f24522a7740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9693c200 con 0x559f969d55c0 2024-09-13T16:12:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.305+0000 7f244d400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 0x559f969d5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.305+0000 7f2447e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969da650 0x559f969dcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.305+0000 7f244d400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 0x559f969d5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34630/0 (socket says 172.21.15.86:34630) 2024-09-13T16:12:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.305+0000 7f2447e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969da650 0x559f969dcb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:47814/0 (socket says 172.21.15.86:47814) 2024-09-13T16:12:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.305+0000 7f244d400640 1 -- 172.21.15.86:0/2070653368 learned_addr learned my addr 172.21.15.86:0/2070653368 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.305+0000 7f244ca00640 1 --2- 172.21.15.86:0/2070653368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969d55c0 0x559f969da080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.306+0000 7f2447e00640 1 -- 172.21.15.86:0/2070653368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969d55c0 msgr2=0x559f969da080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.306+0000 7f2447e00640 1 --2- 172.21.15.86:0/2070653368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969d55c0 0x559f969da080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.306+0000 7f2447e00640 1 -- 172.21.15.86:0/2070653368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 msgr2=0x559f969d5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.306+0000 7f2447e00640 1 --2- 172.21.15.86:0/2070653368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 0x559f969d5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.306+0000 7f2447e00640 1 -- 172.21.15.86:0/2070653368 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f968d9940 con 0x559f969da650 2024-09-13T16:12:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.306+0000 7f244d400640 1 --2- 172.21.15.86:0/2070653368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 0x559f969d5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:12:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.306+0000 7f2447e00640 1 --2- 172.21.15.86:0/2070653368 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969da650 0x559f969dcb10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f243402a910 tx=0x7f2434031650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f600b47df89474e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.306+0000 7f243a000640 1 -- 172.21.15.86:0/2070653368 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434031ae0 con 0x559f969da650 2024-09-13T16:12:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.306+0000 7f243a000640 1 -- 172.21.15.86:0/2070653368 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2434004510 con 0x559f969da650 2024-09-13T16:12:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.306+0000 7f243a000640 1 -- 172.21.15.86:0/2070653368 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24340046c0 con 0x559f969da650 2024-09-13T16:12:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.306+0000 7f2445600640 1 --2- 172.21.15.86:0/4028986170 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f24300a1130 0x7f24300a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.307+0000 7f2445600640 1 -- 172.21.15.86:0/4028986170 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f243c014070 con 0x7f2448101d70 2024-09-13T16:12:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.307+0000 7f244d400640 1 --2- 172.21.15.86:0/4028986170 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f24300a1130 0x7f24300a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.307+0000 7f24522a7740 1 -- 172.21.15.86:0/2070653368 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969da650 msgr2=0x559f969dcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.307+0000 7f24522a7740 1 --2- 172.21.15.86:0/2070653368 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969da650 0x559f969dcb10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f243402a910 tx=0x7f2434031650 comp rx=0 tx=0).stop 2024-09-13T16:12:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.307+0000 7f24522a7740 1 -- 172.21.15.86:0/2070653368 shutdown_connections 2024-09-13T16:12:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.307+0000 7f24522a7740 1 --2- 172.21.15.86:0/2070653368 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969da650 0x559f969dcb10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.307+0000 7f24522a7740 1 --2- 172.21.15.86:0/2070653368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969d55c0 0x559f969da080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.307+0000 7f24522a7740 1 --2- 172.21.15.86:0/2070653368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 0x559f969d5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.307+0000 7f24522a7740 1 -- 172.21.15.86:0/2070653368 >> 172.21.15.86:0/2070653368 conn(0x559f969d02f0 msgr2=0x559f969d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.307+0000 7f24522a7740 1 -- 172.21.15.86:0/2070653368 shutdown_connections 2024-09-13T16:12:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.307+0000 7f24522a7740 1 -- 172.21.15.86:0/2070653368 wait complete. 2024-09-13T16:12:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.307+0000 7f244d400640 1 --2- 172.21.15.86:0/4028986170 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f24300a1130 0x7f24300a35f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2440009fd0 tx=0x7f2440009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.308+0000 7f24522a7740 1 -- start start 2024-09-13T16:12:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.308+0000 7f24522a7740 1 Processor -- start 2024-09-13T16:12:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.308+0000 7f24522a7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 0x559f969de850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.308+0000 7f24522a7740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d55c0 0x559f969ded90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.308+0000 7f24522a7740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969da650 0x559f969e5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.308+0000 7f24522a7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f96937af0 con 0x559f969d4c80 2024-09-13T16:12:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.308+0000 7f24522a7740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f968f5f20 con 0x559f969d55c0 2024-09-13T16:12:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.308+0000 7f24522a7740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f968f5bc0 con 0x559f969da650 2024-09-13T16:12:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.308+0000 7f24522a7740 10 client.0 _ll_register_callbacks cb 0x559f96927a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:12:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.308+0000 7f2447e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d55c0 0x559f969ded90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.309+0000 7f244ca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 0x559f969de850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.309+0000 7f2447e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d55c0 0x559f969ded90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:47826/0 (socket says 172.21.15.86:47826) 2024-09-13T16:12:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.309+0000 7f2447e00640 1 -- 172.21.15.86:0/3096734402 learned_addr learned my addr 172.21.15.86:0/3096734402 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.309+0000 7f244d400640 1 --2- 172.21.15.86:0/3096734402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969da650 0x559f969e5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.309+0000 7f2447e00640 1 -- 172.21.15.86:0/3096734402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969da650 msgr2=0x559f969e5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.309+0000 7f2447e00640 1 --2- 172.21.15.86:0/3096734402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969da650 0x559f969e5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.309+0000 7f2447e00640 1 -- 172.21.15.86:0/3096734402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 msgr2=0x559f969de850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.309+0000 7f2447e00640 1 --2- 172.21.15.86:0/3096734402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 0x559f969de850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.309+0000 7f2447e00640 1 -- 172.21.15.86:0/3096734402 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f244810aab0 con 0x559f969d55c0 2024-09-13T16:12:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.309+0000 7f244ca00640 1 --2- 172.21.15.86:0/3096734402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 0x559f969de850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:12:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.309+0000 7f2447e00640 1 --2- 172.21.15.86:0/3096734402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d55c0 0x559f969ded90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2434031400 tx=0x7f243402a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8ade3b4bdcbe9e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.309+0000 7f242ea00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-13T16:12:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.310+0000 7f242ea00640 1 -- 172.21.15.86:0/3096734402 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243404b070 con 0x559f969d55c0 2024-09-13T16:12:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.310+0000 7f242ea00640 1 -- 172.21.15.86:0/3096734402 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f2434031ae0 con 0x559f969d55c0 2024-09-13T16:12:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.310+0000 7f24522a7740 1 -- 172.21.15.86:0/3096734402 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f96961c90 con 0x559f969d55c0 2024-09-13T16:12:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.310+0000 7f242ea00640 1 -- 172.21.15.86:0/3096734402 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2434031cc0 con 0x559f969d55c0 2024-09-13T16:12:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.310+0000 7f24522a7740 10 client.25496 fetch_fsmap learned FSMap version 26 2024-09-13T16:12:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.310+0000 7f24522a7740 1 -- 172.21.15.86:0/3096734402 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559f96936170 con 0x559f969d55c0 2024-09-13T16:12:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.310+0000 7f242ea00640 1 -- 172.21.15.86:0/3096734402 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x559f96961c90 con 0x559f969d55c0 2024-09-13T16:12:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.310+0000 7f242ea00640 1 -- 172.21.15.86:0/3096734402 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f243403d520 con 0x559f969d55c0 2024-09-13T16:12:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.310+0000 7f24522a7740 10 client.25496 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T16:12:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.310+0000 7f24522a7740 10 client.25496 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:12:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.310+0000 7f24522a7740 20 client.25496 populate_metadata read hostname 'smithi086' 2024-09-13T16:12:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.310+0000 7f24522a7740 1 --2- 172.21.15.86:0/3096734402 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x559f969ea150 0x559f969ec570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.311+0000 7f24522a7740 4 client.25496 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:12:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.311+0000 7f24522a7740 1 -- 172.21.15.86:0/3096734402 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f9692a7d0 con 0x559f969ea150 2024-09-13T16:12:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.311+0000 7f244ca00640 1 --2- 172.21.15.86:0/3096734402 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x559f969ea150 0x559f969ec570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.311+0000 7f244ca00640 1 --2- 172.21.15.86:0/3096734402 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x559f969ea150 0x559f969ec570 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ba75d5923262664 server_cookie=74b02905dfebadac in_seq=0 out_seq=0 2024-09-13T16:12:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.311+0000 7f242ea00640 10 client.25496 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.312+0000 7f242ea00640 1 -- 172.21.15.86:0/3096734402 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559f9692a7d0 con 0x559f969ea150 2024-09-13T16:12:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.312+0000 7f242ea00640 10 client.25496 handle_command_reply: tid=0 2024-09-13T16:12:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.312+0000 7f24522a7740 1 client.25496 shutdown 2024-09-13T16:12:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.312+0000 7f24522a7740 1 -- 172.21.15.86:0/3096734402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d55c0 msgr2=0x559f969ded90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.312+0000 7f24522a7740 1 --2- 172.21.15.86:0/3096734402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d55c0 0x559f969ded90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2434031400 tx=0x7f243402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.312+0000 7f24522a7740 1 -- 172.21.15.86:0/3096734402 shutdown_connections 2024-09-13T16:12:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.312+0000 7f24522a7740 1 --2- 172.21.15.86:0/3096734402 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x559f969ea150 0x559f969ec570 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.312+0000 7f24522a7740 1 --2- 172.21.15.86:0/3096734402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969da650 0x559f969e5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.312+0000 7f24522a7740 1 --2- 172.21.15.86:0/3096734402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d55c0 0x559f969ded90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.312+0000 7f242ea00640 0 client.25496 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.312+0000 7f24522a7740 1 --2- 172.21.15.86:0/3096734402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 0x559f969de850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.312+0000 7f24522a7740 1 -- 172.21.15.86:0/3096734402 >> 172.21.15.86:0/3096734402 conn(0x559f969d02f0 msgr2=0x559f969d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.312+0000 7f24522a7740 1 -- 172.21.15.86:0/3096734402 shutdown_connections 2024-09-13T16:12:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.313+0000 7f24522a7740 1 -- 172.21.15.86:0/3096734402 wait complete. 2024-09-13T16:12:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.313+0000 7f24522a7740 20 client.25496 trim_cache size 0 max 16384 2024-09-13T16:12:15.329 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.327+0000 7f24522a7740 1 Processor -- start 2024-09-13T16:12:15.330 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.327+0000 7f24522a7740 1 -- start start 2024-09-13T16:12:15.330 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.327+0000 7f24522a7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 0x559f969ddd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:15.330 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.327+0000 7f24522a7740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d55c0 0x559f969e5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:15.330 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.327+0000 7f24522a7740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969da650 0x559f969d9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:15.330 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.327+0000 7f24522a7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9669ee60 con 0x559f969d4c80 2024-09-13T16:12:15.330 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.327+0000 7f24522a7740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f969d6020 con 0x559f969d55c0 2024-09-13T16:12:15.330 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.327+0000 7f24522a7740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f969dd220 con 0x559f969da650 2024-09-13T16:12:15.330 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.327+0000 7f244ca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 0x559f969ddd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:15.330 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.327+0000 7f2447e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d55c0 0x559f969e5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:15.330 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.327+0000 7f244ca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 0x559f969ddd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34654/0 (socket says 172.21.15.86:34654) 2024-09-13T16:12:15.330 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.327+0000 7f244ca00640 1 -- 172.21.15.86:0/90240736 learned_addr learned my addr 172.21.15.86:0/90240736 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.327+0000 7f244d400640 1 --2- 172.21.15.86:0/90240736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969da650 0x559f969d9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.328+0000 7f244ca00640 1 -- 172.21.15.86:0/90240736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969da650 msgr2=0x559f969d9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.328+0000 7f244ca00640 1 --2- 172.21.15.86:0/90240736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969da650 0x559f969d9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.328+0000 7f244ca00640 1 -- 172.21.15.86:0/90240736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d55c0 msgr2=0x559f969e5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.328+0000 7f244ca00640 1 --2- 172.21.15.86:0/90240736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d55c0 0x559f969e5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.328+0000 7f244ca00640 1 -- 172.21.15.86:0/90240736 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f968d8180 con 0x559f969d4c80 2024-09-13T16:12:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.328+0000 7f2447e00640 1 --2- 172.21.15.86:0/90240736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d55c0 0x559f969e5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:12:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.328+0000 7f244ca00640 1 --2- 172.21.15.86:0/90240736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 0x559f969ddd40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f243c00c6a0 tx=0x7f243c003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e69a9d6fc74d00e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.328+0000 7f243aa00640 1 -- 172.21.15.86:0/90240736 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c099d50 con 0x559f969d4c80 2024-09-13T16:12:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.328+0000 7f243aa00640 1 -- 172.21.15.86:0/90240736 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f243c099b70 con 0x559f969d4c80 2024-09-13T16:12:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.328+0000 7f243aa00640 1 -- 172.21.15.86:0/90240736 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c0ca9d0 con 0x559f969d4c80 2024-09-13T16:12:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.329+0000 7f24522a7740 1 -- 172.21.15.86:0/90240736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 msgr2=0x559f969ddd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.329+0000 7f24522a7740 1 --2- 172.21.15.86:0/90240736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 0x559f969ddd40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f243c00c6a0 tx=0x7f243c003a80 comp rx=0 tx=0).stop 2024-09-13T16:12:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.329+0000 7f24522a7740 1 -- 172.21.15.86:0/90240736 shutdown_connections 2024-09-13T16:12:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.329+0000 7f24522a7740 1 --2- 172.21.15.86:0/90240736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969da650 0x559f969d9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.329+0000 7f24522a7740 1 --2- 172.21.15.86:0/90240736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d55c0 0x559f969e5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.329+0000 7f24522a7740 1 --2- 172.21.15.86:0/90240736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d4c80 0x559f969ddd40 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.329+0000 7f24522a7740 1 -- 172.21.15.86:0/90240736 >> 172.21.15.86:0/90240736 conn(0x559f969d02f0 msgr2=0x559f969d64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.329+0000 7f24522a7740 1 -- 172.21.15.86:0/90240736 shutdown_connections 2024-09-13T16:12:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.329+0000 7f24522a7740 1 -- 172.21.15.86:0/90240736 wait complete. 2024-09-13T16:12:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.329+0000 7f24522a7740 1 -- start start 2024-09-13T16:12:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.329+0000 7f24522a7740 1 Processor -- start 2024-09-13T16:12:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.330+0000 7f24522a7740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d4c80 0x559f969e1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.330+0000 7f24522a7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d55c0 0x559f969e24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.330+0000 7f24522a7740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969da650 0x559f969e5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.330+0000 7f24522a7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f969e5a50 con 0x559f969d55c0 2024-09-13T16:12:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.330+0000 7f24522a7740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f969e5bc0 con 0x559f969d4c80 2024-09-13T16:12:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.330+0000 7f24522a7740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f969e5d80 con 0x559f969da650 2024-09-13T16:12:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.330+0000 7f24522a7740 10 client.0 _ll_register_callbacks cb 0x7f243c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:12:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.330+0000 7f244ca00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d4c80 0x559f969e1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.330+0000 7f2447e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d55c0 0x559f969e24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.330+0000 7f244ca00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d4c80 0x559f969e1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:47832/0 (socket says 172.21.15.86:47832) 2024-09-13T16:12:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.330+0000 7f244ca00640 1 -- 172.21.15.86:0/1336530105 learned_addr learned my addr 172.21.15.86:0/1336530105 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.330+0000 7f244d400640 1 --2- 172.21.15.86:0/1336530105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969da650 0x559f969e5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.330+0000 7f2447e00640 1 -- 172.21.15.86:0/1336530105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969da650 msgr2=0x559f969e5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.330+0000 7f2447e00640 1 --2- 172.21.15.86:0/1336530105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969da650 0x559f969e5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.331+0000 7f2447e00640 1 -- 172.21.15.86:0/1336530105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d4c80 msgr2=0x559f969e1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.331+0000 7f2447e00640 1 --2- 172.21.15.86:0/1336530105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d4c80 0x559f969e1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.331+0000 7f2447e00640 1 -- 172.21.15.86:0/1336530105 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f96936170 con 0x559f969d55c0 2024-09-13T16:12:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.331+0000 7f244ca00640 1 --2- 172.21.15.86:0/1336530105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d4c80 0x559f969e1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:12:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.331+0000 7f2447e00640 1 --2- 172.21.15.86:0/1336530105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d55c0 0x559f969e24f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2434009900 tx=0x7f24340043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a808462bce4f449f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.331+0000 7f242ea00640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T16:12:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.331+0000 7f242ea00640 1 -- 172.21.15.86:0/1336530105 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243404b040 con 0x559f969d55c0 2024-09-13T16:12:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.331+0000 7f242ea00640 1 -- 172.21.15.86:0/1336530105 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f243403daa0 con 0x559f969d55c0 2024-09-13T16:12:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.331+0000 7f24522a7740 1 -- 172.21.15.86:0/1336530105 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2434004510 con 0x559f969d55c0 2024-09-13T16:12:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.331+0000 7f242ea00640 1 -- 172.21.15.86:0/1336530105 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f243403dc60 con 0x559f969d55c0 2024-09-13T16:12:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.331+0000 7f24522a7740 10 client.15474 fetch_fsmap learned FSMap version 26 2024-09-13T16:12:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.331+0000 7f24522a7740 1 -- 172.21.15.86:0/1336530105 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f24481a01a0 con 0x559f969d55c0 2024-09-13T16:12:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.332+0000 7f242ea00640 1 -- 172.21.15.86:0/1336530105 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2434068080 con 0x559f969d55c0 2024-09-13T16:12:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.332+0000 7f242ea00640 1 -- 172.21.15.86:0/1336530105 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f243405e510 con 0x559f969d55c0 2024-09-13T16:12:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.332+0000 7f24522a7740 10 client.15474 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T16:12:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.332+0000 7f24522a7740 10 client.15474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:12:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.332+0000 7f24522a7740 20 client.15474 populate_metadata read hostname 'smithi086' 2024-09-13T16:12:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.332+0000 7f24522a7740 1 --2- 172.21.15.86:0/1336530105 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x559f96a41660 0x559f96a43a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.332+0000 7f24522a7740 4 client.15474 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:12:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.332+0000 7f24522a7740 1 -- 172.21.15.86:0/1336530105 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559f9662b300 con 0x559f96a41660 2024-09-13T16:12:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.332+0000 7f244ca00640 1 --2- 172.21.15.86:0/1336530105 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x559f96a41660 0x559f96a43a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.332+0000 7f244ca00640 1 --2- 172.21.15.86:0/1336530105 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x559f96a41660 0x559f96a43a80 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62683a2cc7e7438c server_cookie=e2238e619026c6c8 in_seq=0 out_seq=0 2024-09-13T16:12:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:15.332+0000 7f242ea00640 10 client.15474 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:16.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:16 smithi139 ceph-mon[35320]: pgmap v422: 129 pgs: 129 active+clean; 91 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 1.7 MiB/s wr, 435 op/s 2024-09-13T16:12:16.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:16 smithi194 ceph-mon[35694]: pgmap v422: 129 pgs: 129 active+clean; 91 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 1.7 MiB/s wr, 435 op/s 2024-09-13T16:12:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.817+0000 7f242ea00640 1 -- 172.21.15.86:0/1336530105 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559f9662b300 con 0x559f96a41660 2024-09-13T16:12:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.817+0000 7f242ea00640 10 client.15474 handle_command_reply: tid=0 2024-09-13T16:12:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.817+0000 7f24522a7740 1 client.15474 shutdown 2024-09-13T16:12:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.818+0000 7f24522a7740 1 -- 172.21.15.86:0/1336530105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d55c0 msgr2=0x559f969e24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.818+0000 7f24522a7740 1 --2- 172.21.15.86:0/1336530105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d55c0 0x559f969e24f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2434009900 tx=0x7f24340043c0 comp rx=0 tx=0).stop 2024-09-13T16:12:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.818+0000 7f24522a7740 1 -- 172.21.15.86:0/1336530105 shutdown_connections 2024-09-13T16:12:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.818+0000 7f24522a7740 1 --2- 172.21.15.86:0/1336530105 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x559f96a41660 0x559f96a43a80 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.818+0000 7f24522a7740 1 --2- 172.21.15.86:0/1336530105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f969da650 0x559f969e5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.818+0000 7f24522a7740 1 --2- 172.21.15.86:0/1336530105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f969d55c0 0x559f969e24f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.818+0000 7f24522a7740 1 --2- 172.21.15.86:0/1336530105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559f969d4c80 0x559f969e1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.818+0000 7f24522a7740 1 -- 172.21.15.86:0/1336530105 >> 172.21.15.86:0/1336530105 conn(0x559f969d02f0 msgr2=0x559f969d9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.818+0000 7f242ea00640 0 client.15474 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.818+0000 7f24522a7740 1 -- 172.21.15.86:0/1336530105 shutdown_connections 2024-09-13T16:12:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.818+0000 7f24522a7740 1 -- 172.21.15.86:0/1336530105 wait complete. 2024-09-13T16:12:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.818+0000 7f24522a7740 20 client.15474 trim_cache size 0 max 16384 2024-09-13T16:12:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-09-13T16:12:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-09-13T16:12:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-09-13T16:12:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-09-13T16:12:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.819+0000 7f244de00640 1 -- 172.21.15.86:0/4028986170 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f24300a1130 msgr2=0x7f24300a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.819+0000 7f244de00640 1 --2- 172.21.15.86:0/4028986170 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f24300a1130 0x7f24300a35f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2440009fd0 tx=0x7f2440009500 comp rx=0 tx=0).stop 2024-09-13T16:12:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.819+0000 7f244de00640 1 -- 172.21.15.86:0/4028986170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2448101d70 msgr2=0x7f2448197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.819+0000 7f244de00640 1 --2- 172.21.15.86:0/4028986170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2448101d70 0x7f2448197d50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f243c00e9c0 tx=0x7f243c00ee80 comp rx=0 tx=0).stop 2024-09-13T16:12:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.819+0000 7f244de00640 1 -- 172.21.15.86:0/4028986170 shutdown_connections 2024-09-13T16:12:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.819+0000 7f244de00640 1 --2- 172.21.15.86:0/4028986170 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f24300a1130 0x7f24300a35f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.819+0000 7f244de00640 1 --2- 172.21.15.86:0/4028986170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2448103920 0x7f244819f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.819+0000 7f244de00640 1 --2- 172.21.15.86:0/4028986170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2448102f60 0x7f2448198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.819+0000 7f244de00640 1 --2- 172.21.15.86:0/4028986170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2448101d70 0x7f2448197d50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.819+0000 7f244de00640 1 -- 172.21.15.86:0/4028986170 >> 172.21.15.86:0/4028986170 conn(0x7f24480fd4d0 msgr2=0x7f24481062e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.819+0000 7f244de00640 1 -- 172.21.15.86:0/4028986170 shutdown_connections 2024-09-13T16:12:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:16.819+0000 7f244de00640 1 -- 172.21.15.86:0/4028986170 wait complete. 2024-09-13T16:12:16.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:16 smithi086 ceph-mon[30379]: pgmap v422: 129 pgs: 129 active+clean; 91 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 1.7 MiB/s wr, 435 op/s 2024-09-13T16:12:18.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:18 smithi139 ceph-mon[35320]: pgmap v423: 129 pgs: 129 active+clean; 100 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 571 op/s 2024-09-13T16:12:18.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:18 smithi194 ceph-mon[35694]: pgmap v423: 129 pgs: 129 active+clean; 100 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 571 op/s 2024-09-13T16:12:18.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:18 smithi086 ceph-mon[30379]: pgmap v423: 129 pgs: 129 active+clean; 100 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 571 op/s 2024-09-13T16:12:20.741 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:20 smithi086 ceph-mon[30379]: pgmap v424: 129 pgs: 129 active+clean; 100 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 786 op/s 2024-09-13T16:12:20.754 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:20 smithi139 ceph-mon[35320]: pgmap v424: 129 pgs: 129 active+clean; 100 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 786 op/s 2024-09-13T16:12:20.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:20 smithi194 ceph-mon[35694]: pgmap v424: 129 pgs: 129 active+clean; 100 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 786 op/s 2024-09-13T16:12:22.496 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:22 smithi086 ceph-mon[30379]: pgmap v425: 129 pgs: 129 active+clean; 95 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 1.20k op/s 2024-09-13T16:12:22.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:22 smithi139 ceph-mon[35320]: pgmap v425: 129 pgs: 129 active+clean; 95 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 1.20k op/s 2024-09-13T16:12:22.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:22 smithi194 ceph-mon[35694]: pgmap v425: 129 pgs: 129 active+clean; 95 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 1.20k op/s 2024-09-13T16:12:24.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:24 smithi139 ceph-mon[35320]: pgmap v426: 129 pgs: 129 active+clean; 102 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 1.29k op/s 2024-09-13T16:12:24.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:24 smithi194 ceph-mon[35694]: pgmap v426: 129 pgs: 129 active+clean; 102 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 1.29k op/s 2024-09-13T16:12:24.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:24 smithi086 ceph-mon[30379]: pgmap v426: 129 pgs: 129 active+clean; 102 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 1.29k op/s 2024-09-13T16:12:26.505 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:26 smithi086 ceph-mon[30379]: pgmap v427: 129 pgs: 129 active+clean; 106 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.4 MiB/s wr, 1.53k op/s 2024-09-13T16:12:26.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:26 smithi139 ceph-mon[35320]: pgmap v427: 129 pgs: 129 active+clean; 106 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.4 MiB/s wr, 1.53k op/s 2024-09-13T16:12:26.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:26 smithi194 ceph-mon[35694]: pgmap v427: 129 pgs: 129 active+clean; 106 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.4 MiB/s wr, 1.53k op/s 2024-09-13T16:12:28.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:28 smithi139 ceph-mon[35320]: pgmap v428: 129 pgs: 129 active+clean; 130 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.0 MiB/s wr, 1.94k op/s 2024-09-13T16:12:28.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:28 smithi194 ceph-mon[35694]: pgmap v428: 129 pgs: 129 active+clean; 130 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.0 MiB/s wr, 1.94k op/s 2024-09-13T16:12:28.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:28 smithi086 ceph-mon[30379]: pgmap v428: 129 pgs: 129 active+clean; 130 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.0 MiB/s wr, 1.94k op/s 2024-09-13T16:12:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.934+0000 7fdcd1400640 1 -- 172.21.15.86:0/4005164792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdccc101f20 msgr2=0x7fdccc102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.934+0000 7fdcd1400640 1 --2- 172.21.15.86:0/4005164792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdccc101f20 0x7fdccc102320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009900 tx=0x7fdcbc02a3e0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.934+0000 7fdcd1400640 1 -- 172.21.15.86:0/4005164792 shutdown_connections 2024-09-13T16:12:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.934+0000 7fdcd1400640 1 --2- 172.21.15.86:0/4005164792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdccc103a30 0x7fdccc10a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.934+0000 7fdcd1400640 1 --2- 172.21.15.86:0/4005164792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdccc103070 0x7fdccc1034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.934+0000 7fdcd1400640 1 --2- 172.21.15.86:0/4005164792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdccc101f20 0x7fdccc102320 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.934+0000 7fdcd1400640 1 -- 172.21.15.86:0/4005164792 >> 172.21.15.86:0/4005164792 conn(0x7fdccc0fd680 msgr2=0x7fdccc0ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.934+0000 7fdcd1400640 1 -- 172.21.15.86:0/4005164792 shutdown_connections 2024-09-13T16:12:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.934+0000 7fdcd1400640 1 -- 172.21.15.86:0/4005164792 wait complete. 2024-09-13T16:12:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.935+0000 7fdcd1400640 1 Processor -- start 2024-09-13T16:12:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.935+0000 7fdcd1400640 1 -- start start 2024-09-13T16:12:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.936+0000 7fdcd1400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdccc101f20 0x7fdccc198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.936+0000 7fdcd1400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdccc103070 0x7fdccc1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.936+0000 7fdcd1400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdccc103a30 0x7fdccc19f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.936+0000 7fdcd1400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc19fb00 con 0x7fdccc103a30 2024-09-13T16:12:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.936+0000 7fdcd1400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc19fc70 con 0x7fdccc103070 2024-09-13T16:12:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.936+0000 7fdcd1400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc19fe30 con 0x7fdccc101f20 2024-09-13T16:12:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.936+0000 7fdcc9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdccc103070 0x7fdccc1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.936+0000 7fdcca800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdccc101f20 0x7fdccc198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:29.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.936+0000 7fdcc9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdccc103070 0x7fdccc1985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:44320/0 (socket says 172.21.15.86:44320) 2024-09-13T16:12:29.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.936+0000 7fdcc9e00640 1 -- 172.21.15.86:0/1700172891 learned_addr learned my addr 172.21.15.86:0/1700172891 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:29.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.936+0000 7fdccb200640 1 --2- 172.21.15.86:0/1700172891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdccc103a30 0x7fdccc19f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:29.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.936+0000 7fdcc9e00640 1 -- 172.21.15.86:0/1700172891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdccc101f20 msgr2=0x7fdccc198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:29.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.936+0000 7fdcc9e00640 1 --2- 172.21.15.86:0/1700172891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdccc101f20 0x7fdccc198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.936+0000 7fdcc9e00640 1 -- 172.21.15.86:0/1700172891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdccc103a30 msgr2=0x7fdccc19f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:29.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.936+0000 7fdcc9e00640 1 --2- 172.21.15.86:0/1700172891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdccc103a30 0x7fdccc19f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.936+0000 7fdcc9e00640 1 -- 172.21.15.86:0/1700172891 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc009560 con 0x7fdccc103070 2024-09-13T16:12:29.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.937+0000 7fdcc9e00640 1 --2- 172.21.15.86:0/1700172891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdccc103070 0x7fdccc1985a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800e9c0 tx=0x7fdcb800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:29.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.937+0000 7fdcc3400640 1 -- 172.21.15.86:0/1700172891 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8009700 con 0x7fdccc103070 2024-09-13T16:12:29.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.937+0000 7fdcc3400640 1 -- 172.21.15.86:0/1700172891 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdcb800cd80 con 0x7fdccc103070 2024-09-13T16:12:29.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.937+0000 7fdcd1400640 1 -- 172.21.15.86:0/1700172891 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdccc1a0110 con 0x7fdccc103070 2024-09-13T16:12:29.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.937+0000 7fdcc3400640 1 -- 172.21.15.86:0/1700172891 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8010430 con 0x7fdccc103070 2024-09-13T16:12:29.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.937+0000 7fdcd1400640 1 -- 172.21.15.86:0/1700172891 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdccc1a0670 con 0x7fdccc103070 2024-09-13T16:12:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.940+0000 7fdcc3400640 1 -- 172.21.15.86:0/1700172891 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fdcb8003680 con 0x7fdccc103070 2024-09-13T16:12:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.940+0000 7fdcd4299740 1 Processor -- start 2024-09-13T16:12:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.941+0000 7fdcd4299740 1 -- start start 2024-09-13T16:12:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.941+0000 7fdcd4299740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b973925a70 0x55b973925e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.941+0000 7fdcd4299740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b9739263b0 0x55b97392ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.941+0000 7fdcd4299740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b97392b440 0x55b97392d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.941+0000 7fdcd4299740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b973831bb0 con 0x55b973925a70 2024-09-13T16:12:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.941+0000 7fdcd4299740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b97388fa70 con 0x55b97392b440 2024-09-13T16:12:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.941+0000 7fdcd4299740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b97388d200 con 0x55b9739263b0 2024-09-13T16:12:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.941+0000 7fdccb200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b973925a70 0x55b973925e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.941+0000 7fdcca800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b9739263b0 0x55b97392ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.941+0000 7fdcc9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b97392b440 0x55b97392d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.941+0000 7fdcca800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b9739263b0 0x55b97392ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:45062/0 (socket says 172.21.15.86:45062) 2024-09-13T16:12:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.941+0000 7fdcca800640 1 -- 172.21.15.86:0/3784848860 learned_addr learned my addr 172.21.15.86:0/3784848860 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.941+0000 7fdcca800640 1 -- 172.21.15.86:0/3784848860 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b97392b440 msgr2=0x55b97392d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.941+0000 7fdcca800640 1 --2- 172.21.15.86:0/3784848860 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b97392b440 0x55b97392d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.941+0000 7fdcca800640 1 -- 172.21.15.86:0/3784848860 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b973925a70 msgr2=0x55b973925e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.941+0000 7fdcca800640 1 --2- 172.21.15.86:0/3784848860 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b973925a70 0x55b973925e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.941+0000 7fdcca800640 1 -- 172.21.15.86:0/3784848860 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b97382a940 con 0x55b9739263b0 2024-09-13T16:12:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.942+0000 7fdcc3400640 1 --2- 172.21.15.86:0/1700172891 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fdcb00a1110 0x7fdcb00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.942+0000 7fdcca800640 1 --2- 172.21.15.86:0/3784848860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b9739263b0 0x55b97392ae70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc031510 tx=0x7fdcbc0040e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c1dc2c77b4714b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.942+0000 7fdcc3400640 1 -- 172.21.15.86:0/1700172891 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fdcb8014070 con 0x7fdccc103070 2024-09-13T16:12:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.942+0000 7fdcb7e00640 1 -- 172.21.15.86:0/3784848860 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc005040 con 0x55b9739263b0 2024-09-13T16:12:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.942+0000 7fdcb7e00640 1 -- 172.21.15.86:0/3784848860 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdcbc0046c0 con 0x55b9739263b0 2024-09-13T16:12:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.942+0000 7fdcb7e00640 1 -- 172.21.15.86:0/3784848860 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc031810 con 0x55b9739263b0 2024-09-13T16:12:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.942+0000 7fdccb200640 1 --2- 172.21.15.86:0/1700172891 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fdcb00a1110 0x7fdcb00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.943+0000 7fdcd4299740 1 -- 172.21.15.86:0/3784848860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b9739263b0 msgr2=0x55b97392ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.943+0000 7fdcd4299740 1 --2- 172.21.15.86:0/3784848860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b9739263b0 0x55b97392ae70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc031510 tx=0x7fdcbc0040e0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.943+0000 7fdcd4299740 1 -- 172.21.15.86:0/3784848860 shutdown_connections 2024-09-13T16:12:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.943+0000 7fdcd4299740 1 --2- 172.21.15.86:0/3784848860 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b97392b440 0x55b97392d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.943+0000 7fdcd4299740 1 --2- 172.21.15.86:0/3784848860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b9739263b0 0x55b97392ae70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.943+0000 7fdcd4299740 1 --2- 172.21.15.86:0/3784848860 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b973925a70 0x55b973925e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.943+0000 7fdcd4299740 1 -- 172.21.15.86:0/3784848860 >> 172.21.15.86:0/3784848860 conn(0x55b9739210e0 msgr2=0x55b9739214e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.943+0000 7fdccb200640 1 --2- 172.21.15.86:0/1700172891 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fdcb00a1110 0x7fdcb00a35d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4005fd0 tx=0x7fdcc4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.943+0000 7fdcd4299740 1 -- 172.21.15.86:0/3784848860 shutdown_connections 2024-09-13T16:12:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.943+0000 7fdcd4299740 1 -- 172.21.15.86:0/3784848860 wait complete. 2024-09-13T16:12:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.943+0000 7fdcd4299740 1 -- start start 2024-09-13T16:12:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.944+0000 7fdcd4299740 1 Processor -- start 2024-09-13T16:12:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.944+0000 7fdcd4299740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b973925a70 0x55b97392f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.944+0000 7fdcd4299740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b9739263b0 0x55b97392fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.944+0000 7fdcd4299740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b97392b440 0x55b973936c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.944+0000 7fdcd4299740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b973888af0 con 0x55b97392b440 2024-09-13T16:12:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.944+0000 7fdcd4299740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b973846f20 con 0x55b973925a70 2024-09-13T16:12:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.944+0000 7fdcd4299740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b973846bc0 con 0x55b9739263b0 2024-09-13T16:12:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.944+0000 7fdcd4299740 10 client.0 _ll_register_callbacks cb 0x55b973878a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:12:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.944+0000 7fdcca800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b973925a70 0x55b97392f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.944+0000 7fdcca800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b973925a70 0x55b97392f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:44348/0 (socket says 172.21.15.86:44348) 2024-09-13T16:12:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.944+0000 7fdcca800640 1 -- 172.21.15.86:0/17492680 learned_addr learned my addr 172.21.15.86:0/17492680 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.944+0000 7fdccb200640 1 --2- 172.21.15.86:0/17492680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b97392b440 0x55b973936c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.944+0000 7fdcc9e00640 1 --2- 172.21.15.86:0/17492680 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b9739263b0 0x55b97392fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.944+0000 7fdcca800640 1 -- 172.21.15.86:0/17492680 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b9739263b0 msgr2=0x55b97392fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.944+0000 7fdcca800640 1 --2- 172.21.15.86:0/17492680 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b9739263b0 0x55b97392fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.945+0000 7fdcca800640 1 -- 172.21.15.86:0/17492680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b97392b440 msgr2=0x55b973936c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.945+0000 7fdcca800640 1 --2- 172.21.15.86:0/17492680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b97392b440 0x55b973936c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.945+0000 7fdcca800640 1 -- 172.21.15.86:0/17492680 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdccc10ac80 con 0x55b973925a70 2024-09-13T16:12:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.945+0000 7fdcca800640 1 --2- 172.21.15.86:0/17492680 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b973925a70 0x55b97392f680 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc02a900 tx=0x7fdcbc0045c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=577ac90a1e5f9b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.945+0000 7fdcb4c00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-13T16:12:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.945+0000 7fdcb4c00640 1 -- 172.21.15.86:0/17492680 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc049070 con 0x55b973925a70 2024-09-13T16:12:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.945+0000 7fdcd4299740 1 -- 172.21.15.86:0/17492680 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b9738b2c90 con 0x55b973925a70 2024-09-13T16:12:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.945+0000 7fdcb4c00640 1 -- 172.21.15.86:0/17492680 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fdcbc004830 con 0x55b973925a70 2024-09-13T16:12:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.945+0000 7fdcb4c00640 1 -- 172.21.15.86:0/17492680 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcbc0049f0 con 0x55b973925a70 2024-09-13T16:12:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.945+0000 7fdcd4299740 10 client.25514 fetch_fsmap learned FSMap version 26 2024-09-13T16:12:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.945+0000 7fdcd4299740 1 -- 172.21.15.86:0/17492680 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b973887170 con 0x55b973925a70 2024-09-13T16:12:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.946+0000 7fdcb4c00640 1 -- 172.21.15.86:0/17492680 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55b9738b2c90 con 0x55b973925a70 2024-09-13T16:12:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.946+0000 7fdcb4c00640 1 -- 172.21.15.86:0/17492680 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fdcbc057070 con 0x55b973925a70 2024-09-13T16:12:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.946+0000 7fdcd4299740 10 client.25514 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T16:12:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.946+0000 7fdcd4299740 10 client.25514 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:12:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.946+0000 7fdcd4299740 20 client.25514 populate_metadata read hostname 'smithi086' 2024-09-13T16:12:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.946+0000 7fdcd4299740 1 --2- 172.21.15.86:0/17492680 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55b97393aee0 0x55b97393d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.946+0000 7fdcd4299740 4 client.25514 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:12:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.946+0000 7fdcd4299740 1 -- 172.21.15.86:0/17492680 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b97387b7d0 con 0x55b97393aee0 2024-09-13T16:12:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.946+0000 7fdcc9e00640 1 --2- 172.21.15.86:0/17492680 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55b97393aee0 0x55b97393d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.946+0000 7fdcc9e00640 1 --2- 172.21.15.86:0/17492680 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55b97393aee0 0x55b97393d300 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b09ed76e562a93cd server_cookie=2a51145138d6011e in_seq=0 out_seq=0 2024-09-13T16:12:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.946+0000 7fdcb4c00640 10 client.25514 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.947+0000 7fdcb4c00640 1 -- 172.21.15.86:0/17492680 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b97387b7d0 con 0x55b97393aee0 2024-09-13T16:12:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.947+0000 7fdcb4c00640 10 client.25514 handle_command_reply: tid=0 2024-09-13T16:12:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.947+0000 7fdcd4299740 1 client.25514 shutdown 2024-09-13T16:12:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.947+0000 7fdcd4299740 1 -- 172.21.15.86:0/17492680 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b973925a70 msgr2=0x55b97392f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.947+0000 7fdcd4299740 1 --2- 172.21.15.86:0/17492680 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b973925a70 0x55b97392f680 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc02a900 tx=0x7fdcbc0045c0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.947+0000 7fdcd4299740 1 -- 172.21.15.86:0/17492680 shutdown_connections 2024-09-13T16:12:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.947+0000 7fdcd4299740 1 --2- 172.21.15.86:0/17492680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b97392b440 0x55b973936c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.947+0000 7fdcd4299740 1 --2- 172.21.15.86:0/17492680 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55b97393aee0 0x55b97393d300 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.947+0000 7fdcd4299740 1 --2- 172.21.15.86:0/17492680 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b9739263b0 0x55b97392fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.947+0000 7fdcb4c00640 0 client.25514 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.947+0000 7fdcd4299740 1 --2- 172.21.15.86:0/17492680 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b973925a70 0x55b97392f680 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.948+0000 7fdcd4299740 1 -- 172.21.15.86:0/17492680 >> 172.21.15.86:0/17492680 conn(0x55b9739210e0 msgr2=0x55b9739228f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.948+0000 7fdcd4299740 1 -- 172.21.15.86:0/17492680 shutdown_connections 2024-09-13T16:12:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.948+0000 7fdcd4299740 1 -- 172.21.15.86:0/17492680 wait complete. 2024-09-13T16:12:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.948+0000 7fdcd4299740 20 client.25514 trim_cache size 0 max 16384 2024-09-13T16:12:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.961+0000 7fdcd4299740 1 Processor -- start 2024-09-13T16:12:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.961+0000 7fdcd4299740 1 -- start start 2024-09-13T16:12:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.961+0000 7fdcd4299740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b973925a70 0x55b973927270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.961+0000 7fdcd4299740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b9739263b0 0x55b9739277b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:29.963 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.961+0000 7fdcd4299740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b97392b440 0x55b973936bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:29.963 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.961+0000 7fdcd4299740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9735efe60 con 0x55b973925a70 2024-09-13T16:12:29.963 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.961+0000 7fdcd4299740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b97392e010 con 0x55b97392b440 2024-09-13T16:12:29.963 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.961+0000 7fdcd4299740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b97392e600 con 0x55b9739263b0 2024-09-13T16:12:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.961+0000 7fdcca800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b973925a70 0x55b973927270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.961+0000 7fdcca800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b973925a70 0x55b973927270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43910/0 (socket says 172.21.15.86:43910) 2024-09-13T16:12:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.961+0000 7fdcca800640 1 -- 172.21.15.86:0/755590610 learned_addr learned my addr 172.21.15.86:0/755590610 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.961+0000 7fdccb200640 1 --2- 172.21.15.86:0/755590610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b97392b440 0x55b973936bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.961+0000 7fdcc9e00640 1 --2- 172.21.15.86:0/755590610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b9739263b0 0x55b9739277b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.961+0000 7fdcca800640 1 -- 172.21.15.86:0/755590610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b9739263b0 msgr2=0x55b9739277b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.961+0000 7fdcca800640 1 --2- 172.21.15.86:0/755590610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b9739263b0 0x55b9739277b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.962+0000 7fdcca800640 1 -- 172.21.15.86:0/755590610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b97392b440 msgr2=0x55b973936bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.962+0000 7fdcca800640 1 --2- 172.21.15.86:0/755590610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b97392b440 0x55b973936bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.962+0000 7fdcca800640 1 -- 172.21.15.86:0/755590610 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b973829180 con 0x55b973925a70 2024-09-13T16:12:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.962+0000 7fdcca800640 1 --2- 172.21.15.86:0/755590610 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b973925a70 0x55b973927270 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc004630 tx=0x7fdcbc02a3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d4a1c6ac5d6a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.962+0000 7fdcc0c00640 1 -- 172.21.15.86:0/755590610 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc049070 con 0x55b973925a70 2024-09-13T16:12:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.962+0000 7fdcc0c00640 1 -- 172.21.15.86:0/755590610 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdcbc04a040 con 0x55b973925a70 2024-09-13T16:12:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.962+0000 7fdcc0c00640 1 -- 172.21.15.86:0/755590610 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc0315b0 con 0x55b973925a70 2024-09-13T16:12:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.963+0000 7fdcd4299740 1 -- 172.21.15.86:0/755590610 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b973925a70 msgr2=0x55b973927270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.963+0000 7fdcd4299740 1 --2- 172.21.15.86:0/755590610 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b973925a70 0x55b973927270 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc004630 tx=0x7fdcbc02a3e0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.963+0000 7fdcd4299740 1 -- 172.21.15.86:0/755590610 shutdown_connections 2024-09-13T16:12:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.963+0000 7fdcd4299740 1 --2- 172.21.15.86:0/755590610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b97392b440 0x55b973936bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.963+0000 7fdcd4299740 1 --2- 172.21.15.86:0/755590610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b9739263b0 0x55b9739277b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.963+0000 7fdcd4299740 1 --2- 172.21.15.86:0/755590610 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b973925a70 0x55b973927270 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.963+0000 7fdcd4299740 1 -- 172.21.15.86:0/755590610 >> 172.21.15.86:0/755590610 conn(0x55b9739210e0 msgr2=0x55b97392a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.963+0000 7fdcd4299740 1 -- 172.21.15.86:0/755590610 shutdown_connections 2024-09-13T16:12:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.963+0000 7fdcd4299740 1 -- 172.21.15.86:0/755590610 wait complete. 2024-09-13T16:12:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.963+0000 7fdcd4299740 1 -- start start 2024-09-13T16:12:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.963+0000 7fdcd4299740 1 Processor -- start 2024-09-13T16:12:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdcd4299740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b973925a70 0x55b973936880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdcd4299740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b9739263b0 0x55b973934ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdcd4299740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b97392b440 0x55b973935420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdcd4299740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b973935960 con 0x55b97392b440 2024-09-13T16:12:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdcd4299740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b973935ad0 con 0x55b9739263b0 2024-09-13T16:12:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdcd4299740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b973935c90 con 0x55b973925a70 2024-09-13T16:12:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdcd4299740 10 client.0 _ll_register_callbacks cb 0x7fdcc40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:12:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdccb200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b97392b440 0x55b973935420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdcca800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b973925a70 0x55b973936880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdcc9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b9739263b0 0x55b973934ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdccb200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b97392b440 0x55b973935420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43920/0 (socket says 172.21.15.86:43920) 2024-09-13T16:12:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdcca800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b973925a70 0x55b973936880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:45084/0 (socket says 172.21.15.86:45084) 2024-09-13T16:12:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdccb200640 1 -- 172.21.15.86:0/3385730003 learned_addr learned my addr 172.21.15.86:0/3385730003 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdccb200640 1 -- 172.21.15.86:0/3385730003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b973925a70 msgr2=0x55b973936880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdccb200640 1 --2- 172.21.15.86:0/3385730003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b973925a70 0x55b973936880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdccb200640 1 -- 172.21.15.86:0/3385730003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b9739263b0 msgr2=0x55b973934ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdccb200640 1 --2- 172.21.15.86:0/3385730003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b9739263b0 0x55b973934ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdccb200640 1 -- 172.21.15.86:0/3385730003 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b973887170 con 0x55b97392b440 2024-09-13T16:12:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdcca800640 1 --2- 172.21.15.86:0/3385730003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b973925a70 0x55b973936880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:12:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.964+0000 7fdcc9e00640 1 --2- 172.21.15.86:0/3385730003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b9739263b0 0x55b973934ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:12:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.965+0000 7fdccb200640 1 --2- 172.21.15.86:0/3385730003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b97392b440 0x55b973935420 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4004030 tx=0x7fdcc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c62e8dd71c73f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.965+0000 7fdcb4c00640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T16:12:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.965+0000 7fdcb4c00640 1 -- 172.21.15.86:0/3385730003 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4024070 con 0x55b97392b440 2024-09-13T16:12:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.965+0000 7fdcb4c00640 1 -- 172.21.15.86:0/3385730003 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fdcc4004b20 con 0x55b97392b440 2024-09-13T16:12:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.965+0000 7fdcd4299740 1 -- 172.21.15.86:0/3385730003 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdcbc0046c0 con 0x55b97392b440 2024-09-13T16:12:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.965+0000 7fdcb4c00640 1 -- 172.21.15.86:0/3385730003 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcc4016070 con 0x55b97392b440 2024-09-13T16:12:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.965+0000 7fdcd4299740 10 client.15492 fetch_fsmap learned FSMap version 26 2024-09-13T16:12:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.965+0000 7fdcd4299740 1 -- 172.21.15.86:0/3385730003 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b97384e560 con 0x55b97392b440 2024-09-13T16:12:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.965+0000 7fdcb4c00640 1 -- 172.21.15.86:0/3385730003 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdcbc0046c0 con 0x55b97392b440 2024-09-13T16:12:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.966+0000 7fdcb4c00640 1 -- 172.21.15.86:0/3385730003 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fdcc4005430 con 0x55b97392b440 2024-09-13T16:12:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.966+0000 7fdcd4299740 10 client.15492 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T16:12:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.966+0000 7fdcd4299740 10 client.15492 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:12:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.966+0000 7fdcd4299740 20 client.15492 populate_metadata read hostname 'smithi086' 2024-09-13T16:12:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.966+0000 7fdcd4299740 1 --2- 172.21.15.86:0/3385730003 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55b973992bd0 0x55b973994ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:29.972 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.966+0000 7fdcd4299740 4 client.15492 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:12:29.972 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.966+0000 7fdcd4299740 1 -- 172.21.15.86:0/3385730003 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b97357c300 con 0x55b973992bd0 2024-09-13T16:12:29.972 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.966+0000 7fdcca800640 1 --2- 172.21.15.86:0/3385730003 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55b973992bd0 0x55b973994ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:29.972 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.966+0000 7fdcca800640 1 --2- 172.21.15.86:0/3385730003 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55b973992bd0 0x55b973994ff0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=878fcc05c4f99d7 server_cookie=7ef8d9cb8b642375 in_seq=0 out_seq=0 2024-09-13T16:12:29.972 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:29.966+0000 7fdcb4c00640 10 client.15492 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:30.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:30 smithi139 ceph-mon[35320]: pgmap v429: 129 pgs: 129 active+clean; 148 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.1 MiB/s wr, 1.84k op/s 2024-09-13T16:12:30.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:30 smithi194 ceph-mon[35694]: pgmap v429: 129 pgs: 129 active+clean; 148 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.1 MiB/s wr, 1.84k op/s 2024-09-13T16:12:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.803+0000 7fdcb4c00640 1 -- 172.21.15.86:0/3385730003 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b97357c300 con 0x55b973992bd0 2024-09-13T16:12:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.803+0000 7fdcb4c00640 10 client.15492 handle_command_reply: tid=0 2024-09-13T16:12:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.803+0000 7fdcd4299740 1 client.15492 shutdown 2024-09-13T16:12:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.803+0000 7fdcd4299740 1 -- 172.21.15.86:0/3385730003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b97392b440 msgr2=0x55b973935420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.803+0000 7fdcd4299740 1 --2- 172.21.15.86:0/3385730003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b97392b440 0x55b973935420 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4004030 tx=0x7fdcc4004a40 comp rx=0 tx=0).stop 2024-09-13T16:12:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.804+0000 7fdcd4299740 1 -- 172.21.15.86:0/3385730003 shutdown_connections 2024-09-13T16:12:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.804+0000 7fdcd4299740 1 --2- 172.21.15.86:0/3385730003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b97392b440 0x55b973935420 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.804+0000 7fdcd4299740 1 --2- 172.21.15.86:0/3385730003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b9739263b0 0x55b973934ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.804+0000 7fdcd4299740 1 --2- 172.21.15.86:0/3385730003 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x55b973992bd0 0x55b973994ff0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.804+0000 7fdcd4299740 1 --2- 172.21.15.86:0/3385730003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b973925a70 0x55b973936880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.804+0000 7fdcd4299740 1 -- 172.21.15.86:0/3385730003 >> 172.21.15.86:0/3385730003 conn(0x55b9739210e0 msgr2=0x55b97392a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:30.807 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.804+0000 7fdcb4c00640 0 client.15492 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:30.807 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.804+0000 7fdcd4299740 1 -- 172.21.15.86:0/3385730003 shutdown_connections 2024-09-13T16:12:30.807 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.804+0000 7fdcd4299740 1 -- 172.21.15.86:0/3385730003 wait complete. 2024-09-13T16:12:30.807 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.804+0000 7fdcd4299740 20 client.15492 trim_cache size 0 max 16384 2024-09-13T16:12:30.807 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-09-13T16:12:30.807 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-09-13T16:12:30.807 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-09-13T16:12:30.807 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-09-13T16:12:30.808 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.805+0000 7fdcd1400640 1 -- 172.21.15.86:0/1700172891 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fdcb00a1110 msgr2=0x7fdcb00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:30.808 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.805+0000 7fdcd1400640 1 --2- 172.21.15.86:0/1700172891 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fdcb00a1110 0x7fdcb00a35d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4005fd0 tx=0x7fdcc4009500 comp rx=0 tx=0).stop 2024-09-13T16:12:30.808 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.805+0000 7fdcd1400640 1 -- 172.21.15.86:0/1700172891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdccc103070 msgr2=0x7fdccc1985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:30.808 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.805+0000 7fdcd1400640 1 --2- 172.21.15.86:0/1700172891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdccc103070 0x7fdccc1985a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800e9c0 tx=0x7fdcb800ee80 comp rx=0 tx=0).stop 2024-09-13T16:12:30.808 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.805+0000 7fdcd1400640 1 -- 172.21.15.86:0/1700172891 shutdown_connections 2024-09-13T16:12:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.805+0000 7fdcd1400640 1 --2- 172.21.15.86:0/1700172891 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fdcb00a1110 0x7fdcb00a35d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.805+0000 7fdcd1400640 1 --2- 172.21.15.86:0/1700172891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdccc103a30 0x7fdccc19f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.805+0000 7fdcd1400640 1 --2- 172.21.15.86:0/1700172891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdccc103070 0x7fdccc1985a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.805+0000 7fdcd1400640 1 --2- 172.21.15.86:0/1700172891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdccc101f20 0x7fdccc198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.805+0000 7fdcd1400640 1 -- 172.21.15.86:0/1700172891 >> 172.21.15.86:0/1700172891 conn(0x7fdccc0fd680 msgr2=0x7fdccc0ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.805+0000 7fdcd1400640 1 -- 172.21.15.86:0/1700172891 shutdown_connections 2024-09-13T16:12:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:30.805+0000 7fdcd1400640 1 -- 172.21.15.86:0/1700172891 wait complete. 2024-09-13T16:12:30.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:30 smithi086 ceph-mon[30379]: pgmap v429: 129 pgs: 129 active+clean; 148 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.1 MiB/s wr, 1.84k op/s 2024-09-13T16:12:32.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:32 smithi139 ceph-mon[35320]: pgmap v430: 129 pgs: 129 active+clean; 156 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.6 MiB/s wr, 1.72k op/s 2024-09-13T16:12:32.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:32 smithi194 ceph-mon[35694]: pgmap v430: 129 pgs: 129 active+clean; 156 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.6 MiB/s wr, 1.72k op/s 2024-09-13T16:12:32.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:32 smithi086 ceph-mon[30379]: pgmap v430: 129 pgs: 129 active+clean; 156 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.6 MiB/s wr, 1.72k op/s 2024-09-13T16:12:33.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:33 smithi194 ceph-mon[35694]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:33.866 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:33 smithi086 ceph-mon[30379]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:33.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:33 smithi139 ceph-mon[35320]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:34.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:34 smithi086 ceph-mon[30379]: pgmap v431: 129 pgs: 129 active+clean; 142 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.7 MiB/s wr, 1.55k op/s 2024-09-13T16:12:34.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:34 smithi139 ceph-mon[35320]: pgmap v431: 129 pgs: 129 active+clean; 142 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.7 MiB/s wr, 1.55k op/s 2024-09-13T16:12:35.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:34 smithi194 ceph-mon[35694]: pgmap v431: 129 pgs: 129 active+clean; 142 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.7 MiB/s wr, 1.55k op/s 2024-09-13T16:12:35.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:35 smithi086 ceph-mon[30379]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:35.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:35 smithi139 ceph-mon[35320]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:36.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:35 smithi194 ceph-mon[35694]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:36.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:36 smithi086 ceph-mon[30379]: pgmap v432: 129 pgs: 129 active+clean; 129 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.1 MiB/s wr, 1.82k op/s 2024-09-13T16:12:36.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:36 smithi139 ceph-mon[35320]: pgmap v432: 129 pgs: 129 active+clean; 129 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.1 MiB/s wr, 1.82k op/s 2024-09-13T16:12:37.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:36 smithi194 ceph-mon[35694]: pgmap v432: 129 pgs: 129 active+clean; 129 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.1 MiB/s wr, 1.82k op/s 2024-09-13T16:12:38.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:38 smithi086 ceph-mon[30379]: pgmap v433: 129 pgs: 129 active+clean; 132 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.7 MiB/s wr, 1.70k op/s 2024-09-13T16:12:38.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:38 smithi139 ceph-mon[35320]: pgmap v433: 129 pgs: 129 active+clean; 132 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.7 MiB/s wr, 1.70k op/s 2024-09-13T16:12:39.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:38 smithi194 ceph-mon[35694]: pgmap v433: 129 pgs: 129 active+clean; 132 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.7 MiB/s wr, 1.70k op/s 2024-09-13T16:12:40.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:40 smithi086 ceph-mon[30379]: pgmap v434: 129 pgs: 129 active+clean; 133 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 1.42k op/s 2024-09-13T16:12:40.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:40 smithi139 ceph-mon[35320]: pgmap v434: 129 pgs: 129 active+clean; 133 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 1.42k op/s 2024-09-13T16:12:41.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:40 smithi194 ceph-mon[35694]: pgmap v434: 129 pgs: 129 active+clean; 133 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 1.42k op/s 2024-09-13T16:12:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:42 smithi086 ceph-mon[30379]: pgmap v435: 129 pgs: 129 active+clean; 132 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 1.32k op/s 2024-09-13T16:12:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:12:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:12:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:12:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:42 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:12:42.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:42 smithi139 ceph-mon[35320]: pgmap v435: 129 pgs: 129 active+clean; 132 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 1.32k op/s 2024-09-13T16:12:42.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:42 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:12:42.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:42 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:12:42.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:42 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:12:42.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:42 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:12:43.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:42 smithi194 ceph-mon[35694]: pgmap v435: 129 pgs: 129 active+clean; 132 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 1.32k op/s 2024-09-13T16:12:43.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:42 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:12:43.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:42 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:12:43.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:42 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:12:43.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:42 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:12:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.924+0000 7f4f86200640 1 -- 172.21.15.86:0/3679847334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f80101d80 msgr2=0x7f4f80102180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.924+0000 7f4f86200640 1 --2- 172.21.15.86:0/3679847334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f80101d80 0x7f4f80102180 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009900 tx=0x7f4f7002a410 comp rx=0 tx=0).stop 2024-09-13T16:12:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.924+0000 7f4f86200640 1 -- 172.21.15.86:0/3679847334 shutdown_connections 2024-09-13T16:12:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.924+0000 7f4f86200640 1 --2- 172.21.15.86:0/3679847334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f80103930 0x7f4f8010a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.924+0000 7f4f86200640 1 --2- 172.21.15.86:0/3679847334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f80102f70 0x7f4f801033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.924+0000 7f4f86200640 1 --2- 172.21.15.86:0/3679847334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f80101d80 0x7f4f80102180 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.924+0000 7f4f86200640 1 -- 172.21.15.86:0/3679847334 >> 172.21.15.86:0/3679847334 conn(0x7f4f800fd4e0 msgr2=0x7f4f800ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.924+0000 7f4f86200640 1 -- 172.21.15.86:0/3679847334 shutdown_connections 2024-09-13T16:12:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.924+0000 7f4f86200640 1 -- 172.21.15.86:0/3679847334 wait complete. 2024-09-13T16:12:43.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.925+0000 7f4f86200640 1 Processor -- start 2024-09-13T16:12:43.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.925+0000 7f4f86200640 1 -- start start 2024-09-13T16:12:43.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.925+0000 7f4f86200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f80101d80 0x7f4f80197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.925+0000 7f4f86200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f80102f70 0x7f4f801982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.925+0000 7f4f86200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f80103930 0x7f4f8019f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.925+0000 7f4f86200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8019f850 con 0x7f4f80102f70 2024-09-13T16:12:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.925+0000 7f4f86200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8019f9c0 con 0x7f4f80103930 2024-09-13T16:12:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.925+0000 7f4f86200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8019fb80 con 0x7f4f80101d80 2024-09-13T16:12:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.925+0000 7f4f77e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f80102f70 0x7f4f801982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.926+0000 7f4f85800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f80103930 0x7f4f8019f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.926+0000 7f4f77e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f80102f70 0x7f4f801982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57276/0 (socket says 172.21.15.86:57276) 2024-09-13T16:12:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.926+0000 7f4f77e00640 1 -- 172.21.15.86:0/1936970384 learned_addr learned my addr 172.21.15.86:0/1936970384 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.926+0000 7f4f84e00640 1 --2- 172.21.15.86:0/1936970384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f80101d80 0x7f4f80197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.926+0000 7f4f85800640 1 -- 172.21.15.86:0/1936970384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f80101d80 msgr2=0x7f4f80197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.926+0000 7f4f85800640 1 --2- 172.21.15.86:0/1936970384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f80101d80 0x7f4f80197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.926+0000 7f4f85800640 1 -- 172.21.15.86:0/1936970384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f80102f70 msgr2=0x7f4f801982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.926+0000 7f4f85800640 1 --2- 172.21.15.86:0/1936970384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f80102f70 0x7f4f801982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.926+0000 7f4f85800640 1 -- 172.21.15.86:0/1936970384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f70009560 con 0x7f4f80103930 2024-09-13T16:12:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.926+0000 7f4f85800640 1 --2- 172.21.15.86:0/1936970384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f80103930 0x7f4f8019f310 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009fd0 tx=0x7f4f7800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.926+0000 7f4f7e000640 1 -- 172.21.15.86:0/1936970384 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7800ce20 con 0x7f4f80103930 2024-09-13T16:12:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.926+0000 7f4f7e000640 1 -- 172.21.15.86:0/1936970384 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4f78005020 con 0x7f4f80103930 2024-09-13T16:12:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.926+0000 7f4f86200640 1 -- 172.21.15.86:0/1936970384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8019fe60 con 0x7f4f80103930 2024-09-13T16:12:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.926+0000 7f4f7e000640 1 -- 172.21.15.86:0/1936970384 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78010690 con 0x7f4f80103930 2024-09-13T16:12:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.927+0000 7f4f86200640 1 -- 172.21.15.86:0/1936970384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f801a0290 con 0x7f4f80103930 2024-09-13T16:12:43.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.929+0000 7f4f7e000640 1 -- 172.21.15.86:0/1936970384 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4f78005500 con 0x7f4f80103930 2024-09-13T16:12:43.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.930+0000 7f4f8a675740 1 Processor -- start 2024-09-13T16:12:43.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.930+0000 7f4f8a675740 1 -- start start 2024-09-13T16:12:43.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.930+0000 7f4f8a675740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5c8c80 0x5648fe5c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:43.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.930+0000 7f4f8a675740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c95c0 0x5648fe5ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:43.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.930+0000 7f4f8a675740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5ce650 0x5648fe5d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:43.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.930+0000 7f4f8a675740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fe4d4bb0 con 0x5648fe5c95c0 2024-09-13T16:12:43.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.930+0000 7f4f8a675740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fe532a70 con 0x5648fe5ce650 2024-09-13T16:12:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.930+0000 7f4f8a675740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fe530200 con 0x5648fe5c8c80 2024-09-13T16:12:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.930+0000 7f4f84e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c95c0 0x5648fe5ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.930+0000 7f4f77e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5c8c80 0x5648fe5c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.930+0000 7f4f77e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5c8c80 0x5648fe5c9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:57030/0 (socket says 172.21.15.86:57030) 2024-09-13T16:12:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.930+0000 7f4f77e00640 1 -- 172.21.15.86:0/3450473438 learned_addr learned my addr 172.21.15.86:0/3450473438 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.930+0000 7f4f77e00640 1 --2- 172.21.15.86:0/3450473438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5ce650 0x5648fe5d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.931+0000 7f4f84e00640 1 -- 172.21.15.86:0/3450473438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5c8c80 msgr2=0x5648fe5c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.931+0000 7f4f84e00640 1 --2- 172.21.15.86:0/3450473438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5c8c80 0x5648fe5c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.931+0000 7f4f84e00640 1 -- 172.21.15.86:0/3450473438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5ce650 msgr2=0x5648fe5d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.931+0000 7f4f84e00640 1 --2- 172.21.15.86:0/3450473438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5ce650 0x5648fe5d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.931+0000 7f4f84e00640 1 -- 172.21.15.86:0/3450473438 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648fe4cd940 con 0x5648fe5c95c0 2024-09-13T16:12:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.931+0000 7f4f7e000640 1 --2- 172.21.15.86:0/1936970384 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4f640a1130 0x7f4f640a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.931+0000 7f4f7e000640 1 -- 172.21.15.86:0/1936970384 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f4f78014070 con 0x7f4f80103930 2024-09-13T16:12:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.931+0000 7f4f84e00640 1 --2- 172.21.15.86:0/3450473438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c95c0 0x5648fe5ce080 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4f70031400 tx=0x7f4f70004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956f148b09a23b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.931+0000 7f4f77e00640 1 --2- 172.21.15.86:0/1936970384 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4f640a1130 0x7f4f640a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.931+0000 7f4f76000640 1 -- 172.21.15.86:0/3450473438 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70005240 con 0x5648fe5c95c0 2024-09-13T16:12:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.931+0000 7f4f76000640 1 -- 172.21.15.86:0/3450473438 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4f70004510 con 0x5648fe5c95c0 2024-09-13T16:12:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.931+0000 7f4f76000640 1 -- 172.21.15.86:0/3450473438 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f700037f0 con 0x5648fe5c95c0 2024-09-13T16:12:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.932+0000 7f4f8a675740 1 -- 172.21.15.86:0/3450473438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c95c0 msgr2=0x5648fe5ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.932+0000 7f4f77e00640 1 --2- 172.21.15.86:0/1936970384 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4f640a1130 0x7f4f640a35f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800afd0 tx=0x7f4f68004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.932+0000 7f4f8a675740 1 --2- 172.21.15.86:0/3450473438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c95c0 0x5648fe5ce080 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4f70031400 tx=0x7f4f70004260 comp rx=0 tx=0).stop 2024-09-13T16:12:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.932+0000 7f4f8a675740 1 -- 172.21.15.86:0/3450473438 shutdown_connections 2024-09-13T16:12:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.932+0000 7f4f8a675740 1 --2- 172.21.15.86:0/3450473438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5ce650 0x5648fe5d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.932+0000 7f4f8a675740 1 --2- 172.21.15.86:0/3450473438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c95c0 0x5648fe5ce080 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.932+0000 7f4f8a675740 1 --2- 172.21.15.86:0/3450473438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5c8c80 0x5648fe5c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.932+0000 7f4f8a675740 1 -- 172.21.15.86:0/3450473438 >> 172.21.15.86:0/3450473438 conn(0x5648fe5c42f0 msgr2=0x5648fe5c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.932+0000 7f4f8a675740 1 -- 172.21.15.86:0/3450473438 shutdown_connections 2024-09-13T16:12:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.932+0000 7f4f8a675740 1 -- 172.21.15.86:0/3450473438 wait complete. 2024-09-13T16:12:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.933+0000 7f4f8a675740 1 -- start start 2024-09-13T16:12:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.933+0000 7f4f8a675740 1 Processor -- start 2024-09-13T16:12:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.933+0000 7f4f8a675740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c8c80 0x5648fe5d28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.933+0000 7f4f8a675740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c95c0 0x5648fe5d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.933+0000 7f4f8a675740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5ce650 0x5648fe5d9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.933+0000 7f4f8a675740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fe52baf0 con 0x5648fe5c8c80 2024-09-13T16:12:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.933+0000 7f4f8a675740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fe4e9f20 con 0x5648fe5c95c0 2024-09-13T16:12:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.933+0000 7f4f8a675740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fe4e9bc0 con 0x5648fe5ce650 2024-09-13T16:12:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.933+0000 7f4f8a675740 10 client.0 _ll_register_callbacks cb 0x5648fe51ba70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:12:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.933+0000 7f4f84e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c8c80 0x5648fe5d28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.934+0000 7f4f84e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c8c80 0x5648fe5d28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57300/0 (socket says 172.21.15.86:57300) 2024-09-13T16:12:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.934+0000 7f4f84e00640 1 -- 172.21.15.86:0/3818505405 learned_addr learned my addr 172.21.15.86:0/3818505405 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.934+0000 7f4f85800640 1 --2- 172.21.15.86:0/3818505405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5ce650 0x5648fe5d9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.934+0000 7f4f77e00640 1 --2- 172.21.15.86:0/3818505405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c95c0 0x5648fe5d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.934+0000 7f4f84e00640 1 -- 172.21.15.86:0/3818505405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5ce650 msgr2=0x5648fe5d9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.934+0000 7f4f84e00640 1 --2- 172.21.15.86:0/3818505405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5ce650 0x5648fe5d9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.934+0000 7f4f84e00640 1 -- 172.21.15.86:0/3818505405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c95c0 msgr2=0x5648fe5d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:43.942 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.934+0000 7f4f84e00640 1 --2- 172.21.15.86:0/3818505405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c95c0 0x5648fe5d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.942 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.934+0000 7f4f84e00640 1 -- 172.21.15.86:0/3818505405 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8010aac0 con 0x5648fe5c8c80 2024-09-13T16:12:43.942 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.934+0000 7f4f84e00640 1 --2- 172.21.15.86:0/3818505405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c8c80 0x5648fe5d28c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4f70000c00 tx=0x7f4f70005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356317d023d50c2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:43.942 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.934+0000 7f4f6ea00640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T16:12:43.942 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.934+0000 7f4f6ea00640 1 -- 172.21.15.86:0/3818505405 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70005190 con 0x5648fe5c8c80 2024-09-13T16:12:43.942 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.934+0000 7f4f6ea00640 1 -- 172.21.15.86:0/3818505405 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f4f7004c070 con 0x5648fe5c8c80 2024-09-13T16:12:43.942 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.934+0000 7f4f8a675740 1 -- 172.21.15.86:0/3818505405 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648fe555c90 con 0x5648fe5c8c80 2024-09-13T16:12:43.942 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.935+0000 7f4f6ea00640 1 -- 172.21.15.86:0/3818505405 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f700052f0 con 0x5648fe5c8c80 2024-09-13T16:12:43.942 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.935+0000 7f4f8a675740 10 client.15504 fetch_fsmap learned FSMap version 28 2024-09-13T16:12:43.942 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.935+0000 7f4f8a675740 1 -- 172.21.15.86:0/3818505405 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5648fe52a170 con 0x5648fe5c8c80 2024-09-13T16:12:43.942 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.935+0000 7f4f6ea00640 1 -- 172.21.15.86:0/3818505405 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5648fe555c90 con 0x5648fe5c8c80 2024-09-13T16:12:43.942 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.935+0000 7f4f6ea00640 1 -- 172.21.15.86:0/3818505405 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4f70043020 con 0x5648fe5c8c80 2024-09-13T16:12:43.942 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.935+0000 7f4f8a675740 10 client.15504 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T16:12:43.943 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.935+0000 7f4f8a675740 10 client.15504 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:12:43.943 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.935+0000 7f4f8a675740 20 client.15504 populate_metadata read hostname 'smithi086' 2024-09-13T16:12:43.943 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.935+0000 7f4f8a675740 1 --2- 172.21.15.86:0/3818505405 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5648fe5de120 0x5648fe5e0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:43.943 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.935+0000 7f4f8a675740 4 client.15504 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:12:43.943 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.935+0000 7f4f8a675740 1 -- 172.21.15.86:0/3818505405 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5648fe51e7d0 con 0x5648fe5de120 2024-09-13T16:12:43.943 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.935+0000 7f4f77e00640 1 --2- 172.21.15.86:0/3818505405 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5648fe5de120 0x5648fe5e0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:43.943 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.936+0000 7f4f77e00640 1 --2- 172.21.15.86:0/3818505405 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5648fe5de120 0x5648fe5e0540 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6157baa20818bb2 server_cookie=2c3d3d5e201b87d9 in_seq=0 out_seq=0 2024-09-13T16:12:43.943 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.936+0000 7f4f6ea00640 10 client.15504 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:43.945 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.938+0000 7f4f6ea00640 1 -- 172.21.15.86:0/3818505405 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5648fe51e7d0 con 0x5648fe5de120 2024-09-13T16:12:43.945 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.938+0000 7f4f6ea00640 10 client.15504 handle_command_reply: tid=0 2024-09-13T16:12:43.945 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.939+0000 7f4f8a675740 1 client.15504 shutdown 2024-09-13T16:12:43.945 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.939+0000 7f4f8a675740 1 -- 172.21.15.86:0/3818505405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c8c80 msgr2=0x5648fe5d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:43.945 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.939+0000 7f4f8a675740 1 --2- 172.21.15.86:0/3818505405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c8c80 0x5648fe5d28c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4f70000c00 tx=0x7f4f70005e50 comp rx=0 tx=0).stop 2024-09-13T16:12:43.945 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.939+0000 7f4f8a675740 1 -- 172.21.15.86:0/3818505405 shutdown_connections 2024-09-13T16:12:43.945 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.939+0000 7f4f8a675740 1 --2- 172.21.15.86:0/3818505405 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5648fe5de120 0x5648fe5e0540 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.945 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.939+0000 7f4f8a675740 1 --2- 172.21.15.86:0/3818505405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5ce650 0x5648fe5d9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.945 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.939+0000 7f4f8a675740 1 --2- 172.21.15.86:0/3818505405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c95c0 0x5648fe5d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.946 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.939+0000 7f4f8a675740 1 --2- 172.21.15.86:0/3818505405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c8c80 0x5648fe5d28c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.946 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.939+0000 7f4f6ea00640 0 client.15504 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:43.946 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.939+0000 7f4f8a675740 1 -- 172.21.15.86:0/3818505405 >> 172.21.15.86:0/3818505405 conn(0x5648fe5c42f0 msgr2=0x5648fe5c5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:43.946 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.939+0000 7f4f8a675740 1 -- 172.21.15.86:0/3818505405 shutdown_connections 2024-09-13T16:12:43.946 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.939+0000 7f4f8a675740 1 -- 172.21.15.86:0/3818505405 wait complete. 2024-09-13T16:12:43.946 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.939+0000 7f4f8a675740 20 client.15504 trim_cache size 0 max 16384 2024-09-13T16:12:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.956+0000 7f4f8a675740 1 Processor -- start 2024-09-13T16:12:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.956+0000 7f4f8a675740 1 -- start start 2024-09-13T16:12:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.956+0000 7f4f8a675740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c8c80 0x5648fe5ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.957+0000 7f4f8a675740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5c95c0 0x5648fe5caa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.957+0000 7f4f8a675740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5ce650 0x5648fe5d9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.957+0000 7f4f8a675740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fe292e60 con 0x5648fe5ce650 2024-09-13T16:12:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.957+0000 7f4f8a675740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fe5d39a0 con 0x5648fe5c8c80 2024-09-13T16:12:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.957+0000 7f4f8a675740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fe5e56c0 con 0x5648fe5c95c0 2024-09-13T16:12:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.957+0000 7f4f84e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c8c80 0x5648fe5ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.957+0000 7f4f77e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5c95c0 0x5648fe5caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.957+0000 7f4f85800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5ce650 0x5648fe5d9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.957+0000 7f4f84e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c8c80 0x5648fe5ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:60892/0 (socket says 172.21.15.86:60892) 2024-09-13T16:12:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.957+0000 7f4f84e00640 1 -- 172.21.15.86:0/1725842992 learned_addr learned my addr 172.21.15.86:0/1725842992 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.957+0000 7f4f84e00640 1 -- 172.21.15.86:0/1725842992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5c95c0 msgr2=0x5648fe5caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.957+0000 7f4f84e00640 1 --2- 172.21.15.86:0/1725842992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5c95c0 0x5648fe5caa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.957+0000 7f4f84e00640 1 -- 172.21.15.86:0/1725842992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5ce650 msgr2=0x5648fe5d9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.957+0000 7f4f84e00640 1 --2- 172.21.15.86:0/1725842992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5ce650 0x5648fe5d9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.957+0000 7f4f84e00640 1 -- 172.21.15.86:0/1725842992 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648fe4cc180 con 0x5648fe5c8c80 2024-09-13T16:12:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.957+0000 7f4f77e00640 1 --2- 172.21.15.86:0/1725842992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5c95c0 0x5648fe5caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:12:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.957+0000 7f4f85800640 1 --2- 172.21.15.86:0/1725842992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5ce650 0x5648fe5d9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:12:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.957+0000 7f4f84e00640 1 --2- 172.21.15.86:0/1725842992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c8c80 0x5648fe5ca520 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4f7002a930 tx=0x7f4f700038b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c5b15cd4e7ee1d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.958+0000 7f4f76a00640 1 -- 172.21.15.86:0/1725842992 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70003a00 con 0x5648fe5c8c80 2024-09-13T16:12:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.958+0000 7f4f76a00640 1 -- 172.21.15.86:0/1725842992 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4f70046e90 con 0x5648fe5c8c80 2024-09-13T16:12:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.958+0000 7f4f76a00640 1 -- 172.21.15.86:0/1725842992 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70031810 con 0x5648fe5c8c80 2024-09-13T16:12:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.958+0000 7f4f8a675740 1 -- 172.21.15.86:0/1725842992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c8c80 msgr2=0x5648fe5ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.958+0000 7f4f8a675740 1 --2- 172.21.15.86:0/1725842992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c8c80 0x5648fe5ca520 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4f7002a930 tx=0x7f4f700038b0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.959+0000 7f4f8a675740 1 -- 172.21.15.86:0/1725842992 shutdown_connections 2024-09-13T16:12:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.959+0000 7f4f8a675740 1 --2- 172.21.15.86:0/1725842992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5ce650 0x5648fe5d9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.959+0000 7f4f8a675740 1 --2- 172.21.15.86:0/1725842992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5c95c0 0x5648fe5caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.959+0000 7f4f8a675740 1 --2- 172.21.15.86:0/1725842992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c8c80 0x5648fe5ca520 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.959+0000 7f4f8a675740 1 -- 172.21.15.86:0/1725842992 >> 172.21.15.86:0/1725842992 conn(0x5648fe5c42f0 msgr2=0x5648fe5cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.959+0000 7f4f8a675740 1 -- 172.21.15.86:0/1725842992 shutdown_connections 2024-09-13T16:12:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.959+0000 7f4f8a675740 1 -- 172.21.15.86:0/1725842992 wait complete. 2024-09-13T16:12:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.959+0000 7f4f8a675740 1 -- start start 2024-09-13T16:12:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.959+0000 7f4f8a675740 1 Processor -- start 2024-09-13T16:12:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.959+0000 7f4f8a675740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c8c80 0x5648fe5d6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.959+0000 7f4f8a675740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c95c0 0x5648fe5d65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.960+0000 7f4f8a675740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5ce650 0x5648fe5d94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.960+0000 7f4f8a675740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fe5d99e0 con 0x5648fe5c8c80 2024-09-13T16:12:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.960+0000 7f4f8a675740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fe5d9b50 con 0x5648fe5c95c0 2024-09-13T16:12:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.960+0000 7f4f8a675740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fe5d9d10 con 0x5648fe5ce650 2024-09-13T16:12:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.960+0000 7f4f8a675740 10 client.0 _ll_register_callbacks cb 0x7f4f70009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:12:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.960+0000 7f4f77e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c95c0 0x5648fe5d65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:43.967 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.960+0000 7f4f84e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c8c80 0x5648fe5d6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:43.967 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.960+0000 7f4f77e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c95c0 0x5648fe5d65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:60904/0 (socket says 172.21.15.86:60904) 2024-09-13T16:12:43.967 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.960+0000 7f4f77e00640 1 -- 172.21.15.86:0/1538761396 learned_addr learned my addr 172.21.15.86:0/1538761396 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:43.967 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.960+0000 7f4f85800640 1 --2- 172.21.15.86:0/1538761396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5ce650 0x5648fe5d94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:43.967 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.960+0000 7f4f77e00640 1 -- 172.21.15.86:0/1538761396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5ce650 msgr2=0x5648fe5d94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:43.967 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.960+0000 7f4f77e00640 1 --2- 172.21.15.86:0/1538761396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5ce650 0x5648fe5d94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.967 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.960+0000 7f4f77e00640 1 -- 172.21.15.86:0/1538761396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c8c80 msgr2=0x5648fe5d6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:43.967 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.960+0000 7f4f77e00640 1 --2- 172.21.15.86:0/1538761396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c8c80 0x5648fe5d6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:43.967 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.960+0000 7f4f77e00640 1 -- 172.21.15.86:0/1538761396 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6800dab0 con 0x5648fe5c95c0 2024-09-13T16:12:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.960+0000 7f4f84e00640 1 --2- 172.21.15.86:0/1538761396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c8c80 0x5648fe5d6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:12:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.960+0000 7f4f77e00640 1 --2- 172.21.15.86:0/1538761396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c95c0 0x5648fe5d65c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4f68005870 tx=0x7f4f6800a7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd150e282e584479 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.960+0000 7f4f6ea00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-13T16:12:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.961+0000 7f4f6ea00640 1 -- 172.21.15.86:0/1538761396 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68026040 con 0x5648fe5c95c0 2024-09-13T16:12:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.961+0000 7f4f6ea00640 1 -- 172.21.15.86:0/1538761396 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f4f6802c410 con 0x5648fe5c95c0 2024-09-13T16:12:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.961+0000 7f4f8a675740 1 -- 172.21.15.86:0/1538761396 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f70004510 con 0x5648fe5c95c0 2024-09-13T16:12:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.961+0000 7f4f6ea00640 1 -- 172.21.15.86:0/1538761396 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f68013e80 con 0x5648fe5c95c0 2024-09-13T16:12:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.961+0000 7f4f8a675740 10 client.25535 fetch_fsmap learned FSMap version 28 2024-09-13T16:12:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.961+0000 7f4f8a675740 1 -- 172.21.15.86:0/1538761396 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f4f801a0290 con 0x5648fe5c95c0 2024-09-13T16:12:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.961+0000 7f4f6ea00640 1 -- 172.21.15.86:0/1538761396 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4f70004510 con 0x5648fe5c95c0 2024-09-13T16:12:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.961+0000 7f4f6ea00640 1 -- 172.21.15.86:0/1538761396 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4f680047a0 con 0x5648fe5c95c0 2024-09-13T16:12:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.961+0000 7f4f8a675740 10 client.25535 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T16:12:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.961+0000 7f4f8a675740 10 client.25535 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:12:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.961+0000 7f4f8a675740 20 client.25535 populate_metadata read hostname 'smithi086' 2024-09-13T16:12:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.962+0000 7f4f8a675740 1 --2- 172.21.15.86:0/1538761396 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5648fe635a80 0x5648fe637ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.962+0000 7f4f8a675740 4 client.25535 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:12:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.962+0000 7f4f8a675740 1 -- 172.21.15.86:0/1538761396 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5648fe21f300 con 0x5648fe635a80 2024-09-13T16:12:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.962+0000 7f4f84e00640 1 --2- 172.21.15.86:0/1538761396 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5648fe635a80 0x5648fe637ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.962+0000 7f4f6ea00640 10 client.25535 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:43.962+0000 7f4f84e00640 1 --2- 172.21.15.86:0/1538761396 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5648fe635a80 0x5648fe637ea0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1a6df9d3eacff72 server_cookie=57b42d928d6a500 in_seq=0 out_seq=0 2024-09-13T16:12:44.800 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:44 smithi139 ceph-mon[35320]: pgmap v436: 129 pgs: 129 active+clean; 128 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 1.12k op/s 2024-09-13T16:12:44.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:44 smithi086 ceph-mon[30379]: pgmap v436: 129 pgs: 129 active+clean; 128 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 1.12k op/s 2024-09-13T16:12:45.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:44 smithi194 ceph-mon[35694]: pgmap v436: 129 pgs: 129 active+clean; 128 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 1.12k op/s 2024-09-13T16:12:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.223+0000 7f4f6ea00640 1 -- 172.21.15.86:0/1538761396 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5648fe21f300 con 0x5648fe635a80 2024-09-13T16:12:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.223+0000 7f4f6ea00640 10 client.25535 handle_command_reply: tid=0 2024-09-13T16:12:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.223+0000 7f4f8a675740 1 client.25535 shutdown 2024-09-13T16:12:45.226 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.223+0000 7f4f8a675740 1 -- 172.21.15.86:0/1538761396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c95c0 msgr2=0x5648fe5d65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:45.226 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.223+0000 7f4f8a675740 1 --2- 172.21.15.86:0/1538761396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c95c0 0x5648fe5d65c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4f68005870 tx=0x7f4f6800a7d0 comp rx=0 tx=0).stop 2024-09-13T16:12:45.226 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.224+0000 7f4f8a675740 1 -- 172.21.15.86:0/1538761396 shutdown_connections 2024-09-13T16:12:45.226 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.224+0000 7f4f8a675740 1 --2- 172.21.15.86:0/1538761396 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5648fe635a80 0x5648fe637ea0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:45.226 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.224+0000 7f4f8a675740 1 --2- 172.21.15.86:0/1538761396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648fe5ce650 0x5648fe5d94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:45.226 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.224+0000 7f4f6ea00640 0 client.25535 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:45.226 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.224+0000 7f4f8a675740 1 --2- 172.21.15.86:0/1538761396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648fe5c95c0 0x5648fe5d65c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:45.226 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.224+0000 7f4f8a675740 1 --2- 172.21.15.86:0/1538761396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648fe5c8c80 0x5648fe5d6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:45.226 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.224+0000 7f4f8a675740 1 -- 172.21.15.86:0/1538761396 >> 172.21.15.86:0/1538761396 conn(0x5648fe5c42f0 msgr2=0x5648fe5cd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:45.226 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.224+0000 7f4f8a675740 1 -- 172.21.15.86:0/1538761396 shutdown_connections 2024-09-13T16:12:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.224+0000 7f4f8a675740 1 -- 172.21.15.86:0/1538761396 wait complete. 2024-09-13T16:12:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.224+0000 7f4f8a675740 20 client.25535 trim_cache size 0 max 16384 2024-09-13T16:12:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-09-13T16:12:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-09-13T16:12:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-09-13T16:12:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-09-13T16:12:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.225+0000 7f4f86200640 1 -- 172.21.15.86:0/1936970384 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4f640a1130 msgr2=0x7f4f640a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.225+0000 7f4f86200640 1 --2- 172.21.15.86:0/1936970384 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4f640a1130 0x7f4f640a35f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800afd0 tx=0x7f4f68004730 comp rx=0 tx=0).stop 2024-09-13T16:12:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.225+0000 7f4f86200640 1 -- 172.21.15.86:0/1936970384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f80103930 msgr2=0x7f4f8019f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.225+0000 7f4f86200640 1 --2- 172.21.15.86:0/1936970384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f80103930 0x7f4f8019f310 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009fd0 tx=0x7f4f7800ef10 comp rx=0 tx=0).stop 2024-09-13T16:12:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.225+0000 7f4f86200640 1 -- 172.21.15.86:0/1936970384 shutdown_connections 2024-09-13T16:12:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.225+0000 7f4f86200640 1 --2- 172.21.15.86:0/1936970384 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f4f640a1130 0x7f4f640a35f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.225+0000 7f4f86200640 1 --2- 172.21.15.86:0/1936970384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f80103930 0x7f4f8019f310 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.225+0000 7f4f86200640 1 --2- 172.21.15.86:0/1936970384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f80102f70 0x7f4f801982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.225+0000 7f4f86200640 1 --2- 172.21.15.86:0/1936970384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f80101d80 0x7f4f80197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.225+0000 7f4f86200640 1 -- 172.21.15.86:0/1936970384 >> 172.21.15.86:0/1936970384 conn(0x7f4f800fd4e0 msgr2=0x7f4f80106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.225+0000 7f4f86200640 1 -- 172.21.15.86:0/1936970384 shutdown_connections 2024-09-13T16:12:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:45.225+0000 7f4f86200640 1 -- 172.21.15.86:0/1936970384 wait complete. 2024-09-13T16:12:46.868 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:46 smithi086 ceph-mon[30379]: pgmap v437: 129 pgs: 129 active+clean; 129 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 999 op/s 2024-09-13T16:12:46.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:46 smithi139 ceph-mon[35320]: pgmap v437: 129 pgs: 129 active+clean; 129 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 999 op/s 2024-09-13T16:12:47.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:46 smithi194 ceph-mon[35694]: pgmap v437: 129 pgs: 129 active+clean; 129 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 999 op/s 2024-09-13T16:12:48.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:48 smithi086 ceph-mon[30379]: pgmap v438: 129 pgs: 129 active+clean; 118 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 970 op/s 2024-09-13T16:12:48.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:48 smithi139 ceph-mon[35320]: pgmap v438: 129 pgs: 129 active+clean; 118 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 970 op/s 2024-09-13T16:12:49.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:48 smithi194 ceph-mon[35694]: pgmap v438: 129 pgs: 129 active+clean; 118 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 970 op/s 2024-09-13T16:12:50.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:50 smithi086 ceph-mon[30379]: pgmap v439: 129 pgs: 129 active+clean; 126 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 1.30k op/s 2024-09-13T16:12:50.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:50 smithi139 ceph-mon[35320]: pgmap v439: 129 pgs: 129 active+clean; 126 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 1.30k op/s 2024-09-13T16:12:51.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:50 smithi194 ceph-mon[35694]: pgmap v439: 129 pgs: 129 active+clean; 126 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 1.30k op/s 2024-09-13T16:12:51.361 INFO:tasks.workunit.client.0.smithi086.stdout:Ok 2024-09-13T16:12:51.361 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T16:12:51.361 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T16:12:52.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:52 smithi086 ceph-mon[30379]: pgmap v440: 129 pgs: 129 active+clean; 125 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 1.34k op/s 2024-09-13T16:12:52.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:52 smithi139 ceph-mon[35320]: pgmap v440: 129 pgs: 129 active+clean; 125 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 1.34k op/s 2024-09-13T16:12:53.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:52 smithi194 ceph-mon[35694]: pgmap v440: 129 pgs: 129 active+clean; 125 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 1.34k op/s 2024-09-13T16:12:54.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:54 smithi086 ceph-mon[30379]: pgmap v441: 129 pgs: 129 active+clean; 125 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 1.27k op/s 2024-09-13T16:12:54.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:54 smithi139 ceph-mon[35320]: pgmap v441: 129 pgs: 129 active+clean; 125 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 1.27k op/s 2024-09-13T16:12:55.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:54 smithi194 ceph-mon[35694]: pgmap v441: 129 pgs: 129 active+clean; 125 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 1.27k op/s 2024-09-13T16:12:56.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:56 smithi086 ceph-mon[30379]: pgmap v442: 129 pgs: 129 active+clean; 81 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 1.24k op/s 2024-09-13T16:12:56.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:56 smithi139 ceph-mon[35320]: pgmap v442: 129 pgs: 129 active+clean; 81 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 1.24k op/s 2024-09-13T16:12:57.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:56 smithi194 ceph-mon[35694]: pgmap v442: 129 pgs: 129 active+clean; 81 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 1.24k op/s 2024-09-13T16:12:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.341+0000 7f6318400640 1 -- 172.21.15.86:0/2258288382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63100744f0 msgr2=0x7f6310072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.341+0000 7f6318400640 1 --2- 172.21.15.86:0/2258288382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63100744f0 0x7f6310072940 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6304009900 tx=0x7f630402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.341+0000 7f6318400640 1 -- 172.21.15.86:0/2258288382 shutdown_connections 2024-09-13T16:12:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.341+0000 7f6318400640 1 --2- 172.21.15.86:0/2258288382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f631010c2e0 0x7f631010e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.341+0000 7f6318400640 1 --2- 172.21.15.86:0/2258288382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6310072f10 0x7f6310073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.341+0000 7f6318400640 1 --2- 172.21.15.86:0/2258288382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63100744f0 0x7f6310072940 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.341+0000 7f6318400640 1 -- 172.21.15.86:0/2258288382 >> 172.21.15.86:0/2258288382 conn(0x7f63100fb4b0 msgr2=0x7f63100fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.342+0000 7f6318400640 1 -- 172.21.15.86:0/2258288382 shutdown_connections 2024-09-13T16:12:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.342+0000 7f6318400640 1 -- 172.21.15.86:0/2258288382 wait complete. 2024-09-13T16:12:58.345 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.343+0000 7f6318400640 1 Processor -- start 2024-09-13T16:12:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.343+0000 7f6318400640 1 -- start start 2024-09-13T16:12:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.343+0000 7f6318400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6310072f10 0x7f631019c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.343+0000 7f6318400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63100744f0 0x7f631019c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.343+0000 7f6318400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f631010c2e0 0x7f63101a3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.343+0000 7f6318400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63101a3eb0 con 0x7f6310072f10 2024-09-13T16:12:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.343+0000 7f6318400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63101a4020 con 0x7f631010c2e0 2024-09-13T16:12:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.343+0000 7f6318400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63101a41e0 con 0x7f63100744f0 2024-09-13T16:12:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.343+0000 7f6315a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6310072f10 0x7f631019c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.343+0000 7f6316400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f631010c2e0 0x7f63101a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.343+0000 7f6315000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63100744f0 0x7f631019c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.343+0000 7f6316400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f631010c2e0 0x7f63101a3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:40532/0 (socket says 172.21.15.86:40532) 2024-09-13T16:12:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.343+0000 7f6316400640 1 -- 172.21.15.86:0/1004998701 learned_addr learned my addr 172.21.15.86:0/1004998701 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.344+0000 7f6316400640 1 -- 172.21.15.86:0/1004998701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63100744f0 msgr2=0x7f631019c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.344+0000 7f6316400640 1 --2- 172.21.15.86:0/1004998701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63100744f0 0x7f631019c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.344+0000 7f6316400640 1 -- 172.21.15.86:0/1004998701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6310072f10 msgr2=0x7f631019c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.344+0000 7f6316400640 1 --2- 172.21.15.86:0/1004998701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6310072f10 0x7f631019c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.344+0000 7f6316400640 1 -- 172.21.15.86:0/1004998701 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6304009560 con 0x7f631010c2e0 2024-09-13T16:12:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.344+0000 7f6315000640 1 --2- 172.21.15.86:0/1004998701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63100744f0 0x7f631019c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:12:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.344+0000 7f6316400640 1 --2- 172.21.15.86:0/1004998701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f631010c2e0 0x7f63101a3970 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f630800eb10 tx=0x7f630800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.344+0000 7f630e000640 1 -- 172.21.15.86:0/1004998701 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308004b20 con 0x7f631010c2e0 2024-09-13T16:12:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.344+0000 7f6318400640 1 -- 172.21.15.86:0/1004998701 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63101a44c0 con 0x7f631010c2e0 2024-09-13T16:12:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.344+0000 7f630e000640 1 -- 172.21.15.86:0/1004998701 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6308004c80 con 0x7f631010c2e0 2024-09-13T16:12:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.344+0000 7f630e000640 1 -- 172.21.15.86:0/1004998701 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308010670 con 0x7f631010c2e0 2024-09-13T16:12:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.344+0000 7f6318400640 1 -- 172.21.15.86:0/1004998701 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63101a4a20 con 0x7f631010c2e0 2024-09-13T16:12:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.347+0000 7f631af22740 1 Processor -- start 2024-09-13T16:12:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.347+0000 7f630e000640 1 -- 172.21.15.86:0/1004998701 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6308005020 con 0x7f631010c2e0 2024-09-13T16:12:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.348+0000 7f631af22740 1 -- start start 2024-09-13T16:12:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.348+0000 7f631af22740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdefaa70 0x5584fdefae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.348+0000 7f631af22740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdefb3b0 0x5584fdeffe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.348+0000 7f631af22740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdf00440 0x5584fdf02900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.348+0000 7f631af22740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584fde06bb0 con 0x5584fdefaa70 2024-09-13T16:12:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.348+0000 7f631af22740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584fde64a70 con 0x5584fdf00440 2024-09-13T16:12:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.348+0000 7f631af22740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584fde62200 con 0x5584fdefb3b0 2024-09-13T16:12:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.348+0000 7f6315000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdefaa70 0x5584fdefae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.348+0000 7f6315a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdefb3b0 0x5584fdeffe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.348+0000 7f6315a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdefb3b0 0x5584fdeffe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:34122/0 (socket says 172.21.15.86:34122) 2024-09-13T16:12:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.348+0000 7f6315a00640 1 -- 172.21.15.86:0/3019381363 learned_addr learned my addr 172.21.15.86:0/3019381363 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.348+0000 7f6315000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdefaa70 0x5584fdefae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44294/0 (socket says 172.21.15.86:44294) 2024-09-13T16:12:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.348+0000 7f6315000640 1 --2- 172.21.15.86:0/3019381363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdf00440 0x5584fdf02900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.349+0000 7f6315a00640 1 -- 172.21.15.86:0/3019381363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdf00440 msgr2=0x5584fdf02900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.349+0000 7f6315a00640 1 --2- 172.21.15.86:0/3019381363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdf00440 0x5584fdf02900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.349+0000 7f6315a00640 1 -- 172.21.15.86:0/3019381363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdefaa70 msgr2=0x5584fdefae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:58.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.349+0000 7f6315a00640 1 --2- 172.21.15.86:0/3019381363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdefaa70 0x5584fdefae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.349+0000 7f6315a00640 1 -- 172.21.15.86:0/3019381363 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584fddff940 con 0x5584fdefb3b0 2024-09-13T16:12:58.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.349+0000 7f6315a00640 1 --2- 172.21.15.86:0/3019381363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdefb3b0 0x5584fdeffe70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6304005940 tx=0x7f6304031650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=345a50945958016d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:58.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.349+0000 7f630e000640 1 --2- 172.21.15.86:0/1004998701 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f62f80a1110 0x7f62f80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.349+0000 7f630e000640 1 -- 172.21.15.86:0/1004998701 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f6308014070 con 0x7f631010c2e0 2024-09-13T16:12:58.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.349+0000 7f6302a00640 1 -- 172.21.15.86:0/3019381363 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6304031ce0 con 0x5584fdefb3b0 2024-09-13T16:12:58.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.349+0000 7f6302a00640 1 -- 172.21.15.86:0/3019381363 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6304004510 con 0x5584fdefb3b0 2024-09-13T16:12:58.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.349+0000 7f6315000640 1 --2- 172.21.15.86:0/1004998701 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f62f80a1110 0x7f62f80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.349+0000 7f6302a00640 1 -- 172.21.15.86:0/3019381363 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6304004920 con 0x5584fdefb3b0 2024-09-13T16:12:58.353 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.350+0000 7f631af22740 1 -- 172.21.15.86:0/3019381363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdefb3b0 msgr2=0x5584fdeffe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.350+0000 7f631af22740 1 --2- 172.21.15.86:0/3019381363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdefb3b0 0x5584fdeffe70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6304005940 tx=0x7f6304031650 comp rx=0 tx=0).stop 2024-09-13T16:12:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.350+0000 7f6315000640 1 --2- 172.21.15.86:0/1004998701 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f62f80a1110 0x7f62f80a35d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0058c0 tx=0x7f62fc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.350+0000 7f631af22740 1 -- 172.21.15.86:0/3019381363 shutdown_connections 2024-09-13T16:12:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.350+0000 7f631af22740 1 --2- 172.21.15.86:0/3019381363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdf00440 0x5584fdf02900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.350+0000 7f631af22740 1 --2- 172.21.15.86:0/3019381363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdefb3b0 0x5584fdeffe70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.350+0000 7f631af22740 1 --2- 172.21.15.86:0/3019381363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdefaa70 0x5584fdefae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.350+0000 7f631af22740 1 -- 172.21.15.86:0/3019381363 >> 172.21.15.86:0/3019381363 conn(0x5584fdef60e0 msgr2=0x5584fdef64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.350+0000 7f631af22740 1 -- 172.21.15.86:0/3019381363 shutdown_connections 2024-09-13T16:12:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.350+0000 7f631af22740 1 -- 172.21.15.86:0/3019381363 wait complete. 2024-09-13T16:12:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.351+0000 7f631af22740 1 -- start start 2024-09-13T16:12:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.351+0000 7f631af22740 1 Processor -- start 2024-09-13T16:12:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.351+0000 7f631af22740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefaa70 0x5584fdf04680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.351+0000 7f631af22740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdefb3b0 0x5584fdf04bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.351+0000 7f631af22740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdf00440 0x5584fdf0bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.351+0000 7f631af22740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584fde5daf0 con 0x5584fdf00440 2024-09-13T16:12:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.351+0000 7f631af22740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584fde1bf20 con 0x5584fdefaa70 2024-09-13T16:12:58.360 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.351+0000 7f631af22740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584fde1bbc0 con 0x5584fdefb3b0 2024-09-13T16:12:58.360 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.351+0000 7f631af22740 10 client.0 _ll_register_callbacks cb 0x5584fde4da70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:12:58.360 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.351+0000 7f6315a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefaa70 0x5584fdf04680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.360 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.351+0000 7f6315000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdefb3b0 0x5584fdf04bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.360 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.352+0000 7f6315a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefaa70 0x5584fdf04680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:40548/0 (socket says 172.21.15.86:40548) 2024-09-13T16:12:58.360 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.352+0000 7f6315a00640 1 -- 172.21.15.86:0/2379589989 learned_addr learned my addr 172.21.15.86:0/2379589989 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:58.360 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.352+0000 7f6316400640 1 --2- 172.21.15.86:0/2379589989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdf00440 0x5584fdf0bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.360 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.352+0000 7f6315a00640 1 -- 172.21.15.86:0/2379589989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdefb3b0 msgr2=0x5584fdf04bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:58.360 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.352+0000 7f6315a00640 1 --2- 172.21.15.86:0/2379589989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdefb3b0 0x5584fdf04bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.360 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.352+0000 7f6315a00640 1 -- 172.21.15.86:0/2379589989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdf00440 msgr2=0x5584fdf0bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.352+0000 7f6315a00640 1 --2- 172.21.15.86:0/2379589989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdf00440 0x5584fdf0bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.352+0000 7f6315a00640 1 -- 172.21.15.86:0/2379589989 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631010f020 con 0x5584fdefaa70 2024-09-13T16:12:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.352+0000 7f6316400640 1 --2- 172.21.15.86:0/2379589989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdf00440 0x5584fdf0bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:12:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.352+0000 7f6315a00640 1 --2- 172.21.15.86:0/2379589989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefaa70 0x5584fdf04680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f630402a9e0 tx=0x7f6304004260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90b7119f82f21697 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.352+0000 7f62f7400640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-13T16:12:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.352+0000 7f62f7400640 1 -- 172.21.15.86:0/2379589989 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630404b070 con 0x5584fdefaa70 2024-09-13T16:12:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.353+0000 7f631af22740 1 -- 172.21.15.86:0/2379589989 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5584fde87c90 con 0x5584fdefaa70 2024-09-13T16:12:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.353+0000 7f62f7400640 1 -- 172.21.15.86:0/2379589989 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f6304031cf0 con 0x5584fdefaa70 2024-09-13T16:12:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.353+0000 7f62f7400640 1 -- 172.21.15.86:0/2379589989 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6304031900 con 0x5584fdefaa70 2024-09-13T16:12:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.353+0000 7f631af22740 10 client.25547 fetch_fsmap learned FSMap version 28 2024-09-13T16:12:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.353+0000 7f631af22740 1 -- 172.21.15.86:0/2379589989 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5584fde5c170 con 0x5584fdefaa70 2024-09-13T16:12:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.353+0000 7f62f7400640 1 -- 172.21.15.86:0/2379589989 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5584fde87c90 con 0x5584fdefaa70 2024-09-13T16:12:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.353+0000 7f62f7400640 1 -- 172.21.15.86:0/2379589989 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f630403d4e0 con 0x5584fdefaa70 2024-09-13T16:12:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.353+0000 7f631af22740 10 client.25547 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T16:12:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.353+0000 7f631af22740 10 client.25547 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:12:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.353+0000 7f631af22740 20 client.25547 populate_metadata read hostname 'smithi086' 2024-09-13T16:12:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.353+0000 7f631af22740 1 --2- 172.21.15.86:0/2379589989 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5584fdf0ff80 0x5584fdf123a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.353+0000 7f631af22740 4 client.25547 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:12:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.353+0000 7f631af22740 1 -- 172.21.15.86:0/2379589989 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5584fde507d0 con 0x5584fdf0ff80 2024-09-13T16:12:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.354+0000 7f6315000640 1 --2- 172.21.15.86:0/2379589989 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5584fdf0ff80 0x5584fdf123a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.354+0000 7f6315000640 1 --2- 172.21.15.86:0/2379589989 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5584fdf0ff80 0x5584fdf123a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d257c764386b78cd server_cookie=54049c1ea53a1918 in_seq=0 out_seq=0 2024-09-13T16:12:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.354+0000 7f62f7400640 10 client.25547 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.355+0000 7f62f7400640 1 -- 172.21.15.86:0/2379589989 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5584fde507d0 con 0x5584fdf0ff80 2024-09-13T16:12:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.355+0000 7f62f7400640 10 client.25547 handle_command_reply: tid=0 2024-09-13T16:12:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.355+0000 7f631af22740 1 client.25547 shutdown 2024-09-13T16:12:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.355+0000 7f631af22740 1 -- 172.21.15.86:0/2379589989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefaa70 msgr2=0x5584fdf04680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.355+0000 7f631af22740 1 --2- 172.21.15.86:0/2379589989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefaa70 0x5584fdf04680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f630402a9e0 tx=0x7f6304004260 comp rx=0 tx=0).stop 2024-09-13T16:12:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.355+0000 7f631af22740 1 -- 172.21.15.86:0/2379589989 shutdown_connections 2024-09-13T16:12:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.355+0000 7f631af22740 1 --2- 172.21.15.86:0/2379589989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdf00440 0x5584fdf0bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.355+0000 7f631af22740 1 --2- 172.21.15.86:0/2379589989 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5584fdf0ff80 0x5584fdf123a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.355+0000 7f631af22740 1 --2- 172.21.15.86:0/2379589989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdefb3b0 0x5584fdf04bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.355+0000 7f62f7400640 0 client.25547 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.355+0000 7f631af22740 1 --2- 172.21.15.86:0/2379589989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefaa70 0x5584fdf04680 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.355+0000 7f631af22740 1 -- 172.21.15.86:0/2379589989 >> 172.21.15.86:0/2379589989 conn(0x5584fdef60e0 msgr2=0x5584fdef78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.356+0000 7f631af22740 1 -- 172.21.15.86:0/2379589989 shutdown_connections 2024-09-13T16:12:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.356+0000 7f631af22740 1 -- 172.21.15.86:0/2379589989 wait complete. 2024-09-13T16:12:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.356+0000 7f631af22740 20 client.25547 trim_cache size 0 max 16384 2024-09-13T16:12:58.370 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.369+0000 7f631af22740 1 Processor -- start 2024-09-13T16:12:58.371 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.369+0000 7f631af22740 1 -- start start 2024-09-13T16:12:58.371 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.369+0000 7f631af22740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdefaa70 0x5584fdf04430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.371 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.369+0000 7f631af22740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefb3b0 0x5584fdf0bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.371 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.369+0000 7f631af22740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdf00440 0x5584fdf04970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.371 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.369+0000 7f631af22740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584fdbc4e60 con 0x5584fdf00440 2024-09-13T16:12:58.371 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.369+0000 7f631af22740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584fdefbe10 con 0x5584fdefb3b0 2024-09-13T16:12:58.371 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.369+0000 7f631af22740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584fdf03010 con 0x5584fdefaa70 2024-09-13T16:12:58.371 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.369+0000 7f6315000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefb3b0 0x5584fdf0bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.371 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.369+0000 7f6315000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefb3b0 0x5584fdf0bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:40550/0 (socket says 172.21.15.86:40550) 2024-09-13T16:12:58.371 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.369+0000 7f6315000640 1 -- 172.21.15.86:0/40291152 learned_addr learned my addr 172.21.15.86:0/40291152 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:58.371 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.369+0000 7f6316400640 1 --2- 172.21.15.86:0/40291152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdf00440 0x5584fdf04970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.369+0000 7f6315a00640 1 --2- 172.21.15.86:0/40291152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdefaa70 0x5584fdf04430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.370+0000 7f6315000640 1 -- 172.21.15.86:0/40291152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdefaa70 msgr2=0x5584fdf04430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.370+0000 7f6315000640 1 --2- 172.21.15.86:0/40291152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdefaa70 0x5584fdf04430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.370+0000 7f6315000640 1 -- 172.21.15.86:0/40291152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdf00440 msgr2=0x5584fdf04970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.370+0000 7f6315000640 1 --2- 172.21.15.86:0/40291152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdf00440 0x5584fdf04970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.370+0000 7f6315000640 1 -- 172.21.15.86:0/40291152 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584fddfe180 con 0x5584fdefb3b0 2024-09-13T16:12:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.370+0000 7f6316400640 1 --2- 172.21.15.86:0/40291152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdf00440 0x5584fdf04970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:12:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.370+0000 7f6315000640 1 --2- 172.21.15.86:0/40291152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefb3b0 0x5584fdf0bb20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x5584fdf12c70 tx=0x7f62fc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8eb18a74196a862 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.370+0000 7f6303400640 1 -- 172.21.15.86:0/40291152 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc031070 con 0x5584fdefb3b0 2024-09-13T16:12:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.370+0000 7f6303400640 1 -- 172.21.15.86:0/40291152 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f62fc00fcc0 con 0x5584fdefb3b0 2024-09-13T16:12:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.370+0000 7f6303400640 1 -- 172.21.15.86:0/40291152 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc028040 con 0x5584fdefb3b0 2024-09-13T16:12:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.371+0000 7f631af22740 1 -- 172.21.15.86:0/40291152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefb3b0 msgr2=0x5584fdf0bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.371+0000 7f631af22740 1 --2- 172.21.15.86:0/40291152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefb3b0 0x5584fdf0bb20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x5584fdf12c70 tx=0x7f62fc0046c0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.371+0000 7f631af22740 1 -- 172.21.15.86:0/40291152 shutdown_connections 2024-09-13T16:12:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.371+0000 7f631af22740 1 --2- 172.21.15.86:0/40291152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdf00440 0x5584fdf04970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.371+0000 7f631af22740 1 --2- 172.21.15.86:0/40291152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefb3b0 0x5584fdf0bb20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.371+0000 7f631af22740 1 --2- 172.21.15.86:0/40291152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdefaa70 0x5584fdf04430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.371+0000 7f631af22740 1 -- 172.21.15.86:0/40291152 >> 172.21.15.86:0/40291152 conn(0x5584fdef60e0 msgr2=0x5584fdefc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.371+0000 7f631af22740 1 -- 172.21.15.86:0/40291152 shutdown_connections 2024-09-13T16:12:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.371+0000 7f631af22740 1 -- 172.21.15.86:0/40291152 wait complete. 2024-09-13T16:12:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.371+0000 7f631af22740 1 -- start start 2024-09-13T16:12:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.371+0000 7f631af22740 1 Processor -- start 2024-09-13T16:12:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.372+0000 7f631af22740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefaa70 0x5584fdf09960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.372+0000 7f631af22740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdefb3b0 0x5584fdf09ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.372+0000 7f631af22740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdf00440 0x5584fdf0aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.372+0000 7f631af22740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584fdf0b3f0 con 0x5584fdefb3b0 2024-09-13T16:12:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.372+0000 7f631af22740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584fdf0b560 con 0x5584fdefaa70 2024-09-13T16:12:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.372+0000 7f631af22740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584fdf0b720 con 0x5584fdf00440 2024-09-13T16:12:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.372+0000 7f631af22740 10 client.0 _ll_register_callbacks cb 0x7f63080093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:12:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.372+0000 7f6315a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefaa70 0x5584fdf09960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.372+0000 7f6315000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdefb3b0 0x5584fdf09ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.372+0000 7f6315a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefaa70 0x5584fdf09960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:40552/0 (socket says 172.21.15.86:40552) 2024-09-13T16:12:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.372+0000 7f6315a00640 1 -- 172.21.15.86:0/1455262319 learned_addr learned my addr 172.21.15.86:0/1455262319 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:12:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.372+0000 7f6316400640 1 --2- 172.21.15.86:0/1455262319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdf00440 0x5584fdf0aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.372+0000 7f6315a00640 1 -- 172.21.15.86:0/1455262319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdf00440 msgr2=0x5584fdf0aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.372+0000 7f6315a00640 1 --2- 172.21.15.86:0/1455262319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdf00440 0x5584fdf0aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.372+0000 7f6315a00640 1 -- 172.21.15.86:0/1455262319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdefb3b0 msgr2=0x5584fdf09ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.372+0000 7f6315a00640 1 --2- 172.21.15.86:0/1455262319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdefb3b0 0x5584fdf09ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.372+0000 7f6315a00640 1 -- 172.21.15.86:0/1455262319 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63101a4a20 con 0x5584fdefaa70 2024-09-13T16:12:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.373+0000 7f6315a00640 1 --2- 172.21.15.86:0/1455262319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefaa70 0x5584fdf09960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6304009800 tx=0x7f63040319f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61d2efb7b7a5de21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.373+0000 7f62f7400640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-13T16:12:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.373+0000 7f62f7400640 1 -- 172.21.15.86:0/1455262319 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630404b070 con 0x5584fdefaa70 2024-09-13T16:12:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.373+0000 7f631af22740 1 -- 172.21.15.86:0/1455262319 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6304004510 con 0x5584fdefaa70 2024-09-13T16:12:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.373+0000 7f62f7400640 1 -- 172.21.15.86:0/1455262319 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f6304000e40 con 0x5584fdefaa70 2024-09-13T16:12:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.373+0000 7f62f7400640 1 -- 172.21.15.86:0/1455262319 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f630403d970 con 0x5584fdefaa70 2024-09-13T16:12:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.373+0000 7f631af22740 10 client.25553 fetch_fsmap learned FSMap version 28 2024-09-13T16:12:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.373+0000 7f631af22740 1 -- 172.21.15.86:0/1455262319 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f62fc01b040 con 0x5584fdefaa70 2024-09-13T16:12:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.373+0000 7f62f7400640 1 -- 172.21.15.86:0/1455262319 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6304004510 con 0x5584fdefaa70 2024-09-13T16:12:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.373+0000 7f62f7400640 1 -- 172.21.15.86:0/1455262319 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f63040046c0 con 0x5584fdefaa70 2024-09-13T16:12:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.374+0000 7f631af22740 10 client.25553 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T16:12:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.374+0000 7f631af22740 10 client.25553 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:12:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.374+0000 7f631af22740 20 client.25553 populate_metadata read hostname 'smithi086' 2024-09-13T16:12:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.374+0000 7f631af22740 1 --2- 172.21.15.86:0/1455262319 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5584fdf670c0 0x5584fdf694e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.374+0000 7f631af22740 4 client.25553 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:12:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.374+0000 7f631af22740 1 -- 172.21.15.86:0/1455262319 --> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5584fdb51300 con 0x5584fdf670c0 2024-09-13T16:12:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.374+0000 7f6315000640 1 --2- 172.21.15.86:0/1455262319 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5584fdf670c0 0x5584fdf694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.374+0000 7f62f7400640 10 client.25553 ms_handle_connect on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.374+0000 7f6315000640 1 --2- 172.21.15.86:0/1455262319 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5584fdf670c0 0x5584fdf694e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e13d5b018151cc1c server_cookie=e6ee192317b3ec21 in_seq=0 out_seq=0 2024-09-13T16:12:58.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:12:58 smithi086 ceph-mon[30379]: pgmap v443: 129 pgs: 129 active+clean; 47 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 1.22k op/s 2024-09-13T16:12:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.927+0000 7f62f7400640 1 -- 172.21.15.86:0/1455262319 <== mds.0 v2:172.21.15.139:6838/3370280063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5584fdb51300 con 0x5584fdf670c0 2024-09-13T16:12:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.927+0000 7f62f7400640 10 client.25553 handle_command_reply: tid=0 2024-09-13T16:12:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.927+0000 7f631af22740 1 client.25553 shutdown 2024-09-13T16:12:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.927+0000 7f631af22740 1 -- 172.21.15.86:0/1455262319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefaa70 msgr2=0x5584fdf09960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.927+0000 7f631af22740 1 --2- 172.21.15.86:0/1455262319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefaa70 0x5584fdf09960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6304009800 tx=0x7f63040319f0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.928+0000 7f631af22740 1 -- 172.21.15.86:0/1455262319 shutdown_connections 2024-09-13T16:12:58.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.928+0000 7f631af22740 1 --2- 172.21.15.86:0/1455262319 >> [v2:172.21.15.139:6838/3370280063,v1:172.21.15.139:6839/3370280063] conn(0x5584fdf670c0 0x5584fdf694e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.928+0000 7f631af22740 1 --2- 172.21.15.86:0/1455262319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5584fdf00440 0x5584fdf0aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.928+0000 7f631af22740 1 --2- 172.21.15.86:0/1455262319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5584fdefb3b0 0x5584fdf09ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.928+0000 7f631af22740 1 --2- 172.21.15.86:0/1455262319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdefaa70 0x5584fdf09960 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.928+0000 7f631af22740 1 -- 172.21.15.86:0/1455262319 >> 172.21.15.86:0/1455262319 conn(0x5584fdef60e0 msgr2=0x5584fdf04430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:58.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.928+0000 7f62f7400640 0 client.25553 ms_handle_reset on v2:172.21.15.139:6838/3370280063 2024-09-13T16:12:58.929 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.928+0000 7f631af22740 1 -- 172.21.15.86:0/1455262319 shutdown_connections 2024-09-13T16:12:58.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.928+0000 7f631af22740 1 -- 172.21.15.86:0/1455262319 wait complete. 2024-09-13T16:12:58.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.928+0000 7f631af22740 20 client.25553 trim_cache size 0 max 16384 2024-09-13T16:12:58.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:{ 2024-09-13T16:12:58.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "message": "", 2024-09-13T16:12:58.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout: "return_code": 0 2024-09-13T16:12:58.930 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stdout:} 2024-09-13T16:12:58.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.929+0000 7f6318400640 1 -- 172.21.15.86:0/1004998701 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f62f80a1110 msgr2=0x7f62f80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:58.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.929+0000 7f6318400640 1 --2- 172.21.15.86:0/1004998701 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f62f80a1110 0x7f62f80a35d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0058c0 tx=0x7f62fc005850 comp rx=0 tx=0).stop 2024-09-13T16:12:58.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.929+0000 7f6318400640 1 -- 172.21.15.86:0/1004998701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f631010c2e0 msgr2=0x7f63101a3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:58.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.929+0000 7f6318400640 1 --2- 172.21.15.86:0/1004998701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f631010c2e0 0x7f63101a3970 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f630800eb10 tx=0x7f630800c2d0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.929+0000 7f6318400640 1 -- 172.21.15.86:0/1004998701 shutdown_connections 2024-09-13T16:12:58.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.929+0000 7f6318400640 1 --2- 172.21.15.86:0/1004998701 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f62f80a1110 0x7f62f80a35d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.929+0000 7f6318400640 1 --2- 172.21.15.86:0/1004998701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f631010c2e0 0x7f63101a3970 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.929+0000 7f6318400640 1 --2- 172.21.15.86:0/1004998701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63100744f0 0x7f631019c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.929+0000 7f6318400640 1 --2- 172.21.15.86:0/1004998701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6310072f10 0x7f631019c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.931 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.929+0000 7f6318400640 1 -- 172.21.15.86:0/1004998701 >> 172.21.15.86:0/1004998701 conn(0x7f63100fb4b0 msgr2=0x7f63100fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.929+0000 7f6318400640 1 -- 172.21.15.86:0/1004998701 shutdown_connections 2024-09-13T16:12:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi086.front.sepia.ceph.com.smithi086.stderr:2024-09-13T16:12:58.929+0000 7f6318400640 1 -- 172.21.15.86:0/1004998701 wait complete. 2024-09-13T16:12:58.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:12:58 smithi139 ceph-mon[35320]: pgmap v443: 129 pgs: 129 active+clean; 47 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 1.22k op/s 2024-09-13T16:12:59.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:12:58 smithi194 ceph-mon[35694]: pgmap v443: 129 pgs: 129 active+clean; 47 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 1.22k op/s 2024-09-13T16:13:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:00 smithi086 ceph-mon[30379]: pgmap v444: 129 pgs: 129 active+clean; 44 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 1.02k op/s 2024-09-13T16:13:00.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:00 smithi086 ceph-mon[30379]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:13:00.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:00 smithi139 ceph-mon[35320]: pgmap v444: 129 pgs: 129 active+clean; 44 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 1.02k op/s 2024-09-13T16:13:00.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:00 smithi139 ceph-mon[35320]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:13:01.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:00 smithi194 ceph-mon[35694]: pgmap v444: 129 pgs: 129 active+clean; 44 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 1.02k op/s 2024-09-13T16:13:01.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:00 smithi194 ceph-mon[35694]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:13:02.694 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-09-13T16:13:02.695 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T16:13:02.821 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:02 smithi086 ceph-mon[30379]: pgmap v445: 129 pgs: 129 active+clean; 36 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 772 op/s 2024-09-13T16:13:02.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:02 smithi139 ceph-mon[35320]: pgmap v445: 129 pgs: 129 active+clean; 36 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 772 op/s 2024-09-13T16:13:03.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:02 smithi194 ceph-mon[35694]: pgmap v445: 129 pgs: 129 active+clean; 36 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 772 op/s 2024-09-13T16:13:03.856 DEBUG:teuthology.parallel:result is None 2024-09-13T16:13:03.856 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T16:13:03.923 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T16:13:03.924 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-13T16:13:03.934 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T16:13:03.947 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-13T16:13:03.957 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:13:04.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.141+0000 7fe69ac00640 1 -- 172.21.15.86:0/2542920064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe694107a50 msgr2=0x7fe694109f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:04.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.141+0000 7fe69ac00640 1 --2- 172.21.15.86:0/2542920064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe694107a50 0x7fe694109f10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe68c009ca0 tx=0x7fe68c02a950 comp rx=0 tx=0).stop 2024-09-13T16:13:04.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.141+0000 7fe69ac00640 1 -- 172.21.15.86:0/2542920064 shutdown_connections 2024-09-13T16:13:04.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.141+0000 7fe69ac00640 1 --2- 172.21.15.86:0/2542920064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe694107a50 0x7fe694109f10 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.141+0000 7fe69ac00640 1 --2- 172.21.15.86:0/2542920064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe694072eb0 0x7fe694073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.141+0000 7fe69ac00640 1 --2- 172.21.15.86:0/2542920064 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe694074490 0x7fe6940728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.143 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.141+0000 7fe69ac00640 1 -- 172.21.15.86:0/2542920064 >> 172.21.15.86:0/2542920064 conn(0x7fe6940fb360 msgr2=0x7fe6940fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:04.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.141+0000 7fe69ac00640 1 -- 172.21.15.86:0/2542920064 shutdown_connections 2024-09-13T16:13:04.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.141+0000 7fe69ac00640 1 -- 172.21.15.86:0/2542920064 wait complete. 2024-09-13T16:13:04.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.142+0000 7fe69ac00640 1 Processor -- start 2024-09-13T16:13:04.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.142+0000 7fe69ac00640 1 -- start start 2024-09-13T16:13:04.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.142+0000 7fe69ac00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe694072eb0 0x7fe694197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:04.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.142+0000 7fe69ac00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe694074490 0x7fe6941983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:04.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.142+0000 7fe69ac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe694107a50 0x7fe69419f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:04.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.142+0000 7fe69ac00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69419f960 con 0x7fe694074490 2024-09-13T16:13:04.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.142+0000 7fe69ac00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69419fad0 con 0x7fe694072eb0 2024-09-13T16:13:04.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.142+0000 7fe69ac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69419fc90 con 0x7fe694107a50 2024-09-13T16:13:04.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.142+0000 7fe698e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe694074490 0x7fe6941983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:04.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.142+0000 7fe698e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe694074490 0x7fe6941983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46838/0 (socket says 172.21.15.86:46838) 2024-09-13T16:13:04.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.142+0000 7fe698e00640 1 -- 172.21.15.86:0/2116768756 learned_addr learned my addr 172.21.15.86:0/2116768756 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:04.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.142+0000 7fe69a200640 1 --2- 172.21.15.86:0/2116768756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe694107a50 0x7fe69419f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:04.147 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.143+0000 7fe699800640 1 --2- 172.21.15.86:0/2116768756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe694072eb0 0x7fe694197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:04.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.143+0000 7fe698e00640 1 -- 172.21.15.86:0/2116768756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe694107a50 msgr2=0x7fe69419f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:04.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.143+0000 7fe698e00640 1 --2- 172.21.15.86:0/2116768756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe694107a50 0x7fe69419f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.143+0000 7fe698e00640 1 -- 172.21.15.86:0/2116768756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe694072eb0 msgr2=0x7fe694197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:04.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.143+0000 7fe698e00640 1 --2- 172.21.15.86:0/2116768756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe694072eb0 0x7fe694197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.143+0000 7fe698e00640 1 -- 172.21.15.86:0/2116768756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68c009900 con 0x7fe694074490 2024-09-13T16:13:04.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.143+0000 7fe698e00640 1 --2- 172.21.15.86:0/2116768756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe694074490 0x7fe6941983b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe68000e9f0 tx=0x7fe68000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:04.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.143+0000 7fe692000640 1 -- 172.21.15.86:0/2116768756 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe680009720 con 0x7fe694074490 2024-09-13T16:13:04.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.143+0000 7fe692000640 1 -- 172.21.15.86:0/2116768756 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe68000cd80 con 0x7fe694074490 2024-09-13T16:13:04.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.143+0000 7fe69ac00640 1 -- 172.21.15.86:0/2116768756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe69419ff70 con 0x7fe694074490 2024-09-13T16:13:04.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.143+0000 7fe692000640 1 -- 172.21.15.86:0/2116768756 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe680010690 con 0x7fe694074490 2024-09-13T16:13:04.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.144+0000 7fe69ac00640 1 -- 172.21.15.86:0/2116768756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6941a03a0 con 0x7fe694074490 2024-09-13T16:13:04.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.145+0000 7fe69ac00640 1 -- 172.21.15.86:0/2116768756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe694106810 con 0x7fe694074490 2024-09-13T16:13:04.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.146+0000 7fe692000640 1 -- 172.21.15.86:0/2116768756 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe6800046c0 con 0x7fe694074490 2024-09-13T16:13:04.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.147+0000 7fe692000640 1 --2- 172.21.15.86:0/2116768756 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe67c0a1090 0x7fe67c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:04.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.148+0000 7fe692000640 1 -- 172.21.15.86:0/2116768756 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fe680014070 con 0x7fe694074490 2024-09-13T16:13:04.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.148+0000 7fe699800640 1 --2- 172.21.15.86:0/2116768756 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe67c0a1090 0x7fe67c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:04.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.148+0000 7fe699800640 1 --2- 172.21.15.86:0/2116768756 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe67c0a1090 0x7fe67c0a3550 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe688009bd0 tx=0x7fe688005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:04.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.152+0000 7fe692000640 1 -- 172.21.15.86:0/2116768756 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe680096410 con 0x7fe694074490 2024-09-13T16:13:04.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.323+0000 7fe69ac00640 1 -- 172.21.15.86:0/2116768756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe69410d7f0 con 0x7fe694074490 2024-09-13T16:13:04.326 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.325+0000 7fe692000640 1 -- 172.21.15.86:0/2116768756 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24703 (secure 0 0 0) 0x7fe680099a30 con 0x7fe694074490 2024-09-13T16:13:04.327 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:13:04.327 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":94,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:10:00.680229+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":7}]},{"pgid":"3.19","mappings":[{"from":3,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2f","mappings":[{"from":1,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:13:04.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.327+0000 7fe69ac00640 1 -- 172.21.15.86:0/2116768756 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe67c0a1090 msgr2=0x7fe67c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:04.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.327+0000 7fe69ac00640 1 --2- 172.21.15.86:0/2116768756 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe67c0a1090 0x7fe67c0a3550 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe688009bd0 tx=0x7fe688005f90 comp rx=0 tx=0).stop 2024-09-13T16:13:04.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.327+0000 7fe69ac00640 1 -- 172.21.15.86:0/2116768756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe694074490 msgr2=0x7fe6941983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:04.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.327+0000 7fe69ac00640 1 --2- 172.21.15.86:0/2116768756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe694074490 0x7fe6941983b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe68000e9f0 tx=0x7fe68000edf0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.327+0000 7fe69ac00640 1 -- 172.21.15.86:0/2116768756 shutdown_connections 2024-09-13T16:13:04.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.327+0000 7fe69ac00640 1 --2- 172.21.15.86:0/2116768756 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe67c0a1090 0x7fe67c0a3550 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.327+0000 7fe69ac00640 1 --2- 172.21.15.86:0/2116768756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe694107a50 0x7fe69419f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.327+0000 7fe69ac00640 1 --2- 172.21.15.86:0/2116768756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe694074490 0x7fe6941983b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.329 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.327+0000 7fe69ac00640 1 --2- 172.21.15.86:0/2116768756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe694072eb0 0x7fe694197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.327+0000 7fe69ac00640 1 -- 172.21.15.86:0/2116768756 >> 172.21.15.86:0/2116768756 conn(0x7fe6940fb360 msgr2=0x7fe6941039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:04.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.327+0000 7fe69ac00640 1 -- 172.21.15.86:0/2116768756 shutdown_connections 2024-09-13T16:13:04.330 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.327+0000 7fe69ac00640 1 -- 172.21.15.86:0/2116768756 wait complete. 2024-09-13T16:13:04.345 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:03:27.830423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:08:07.732536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:08:08.742145+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T16:08:11.721740+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T16:13:04.345 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:13:04.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.501+0000 7fc57be00640 1 -- 172.21.15.86:0/648896391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5740760b0 msgr2=0x7fc574076510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:04.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.501+0000 7fc57be00640 1 --2- 172.21.15.86:0/648896391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5740760b0 0x7fc574076510 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc560009900 tx=0x7fc56002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.501+0000 7fc57be00640 1 -- 172.21.15.86:0/648896391 shutdown_connections 2024-09-13T16:13:04.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.501+0000 7fc57be00640 1 --2- 172.21.15.86:0/648896391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc574076a50 0x7fc5740772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.503 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.501+0000 7fc57be00640 1 --2- 172.21.15.86:0/648896391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5740760b0 0x7fc574076510 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.501+0000 7fc57be00640 1 --2- 172.21.15.86:0/648896391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc574074e70 0x7fc574075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.501+0000 7fc57be00640 1 -- 172.21.15.86:0/648896391 >> 172.21.15.86:0/648896391 conn(0x7fc5740fd6f0 msgr2=0x7fc5740ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:04.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.501+0000 7fc57be00640 1 -- 172.21.15.86:0/648896391 shutdown_connections 2024-09-13T16:13:04.504 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.501+0000 7fc57be00640 1 -- 172.21.15.86:0/648896391 wait complete. 2024-09-13T16:13:04.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.502+0000 7fc57be00640 1 Processor -- start 2024-09-13T16:13:04.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.502+0000 7fc57be00640 1 -- start start 2024-09-13T16:13:04.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.502+0000 7fc57be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc574074e70 0x7fc57419c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:04.506 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.502+0000 7fc57be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5740760b0 0x7fc57419c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:04.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.502+0000 7fc57be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc574076a50 0x7fc5741a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:04.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.502+0000 7fc57be00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5741a3f70 con 0x7fc5740760b0 2024-09-13T16:13:04.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.502+0000 7fc57be00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5741a40e0 con 0x7fc574074e70 2024-09-13T16:13:04.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.502+0000 7fc57be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5741a42a0 con 0x7fc574076a50 2024-09-13T16:13:04.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.503+0000 7fc578a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5740760b0 0x7fc57419c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:04.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.503+0000 7fc578a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5740760b0 0x7fc57419c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46862/0 (socket says 172.21.15.86:46862) 2024-09-13T16:13:04.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.503+0000 7fc578a00640 1 -- 172.21.15.86:0/302914301 learned_addr learned my addr 172.21.15.86:0/302914301 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:04.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.503+0000 7fc579e00640 1 --2- 172.21.15.86:0/302914301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc574076a50 0x7fc5741a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:04.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.503+0000 7fc579400640 1 --2- 172.21.15.86:0/302914301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc574074e70 0x7fc57419c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:04.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.503+0000 7fc578a00640 1 -- 172.21.15.86:0/302914301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc574076a50 msgr2=0x7fc5741a3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:04.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.503+0000 7fc578a00640 1 --2- 172.21.15.86:0/302914301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc574076a50 0x7fc5741a3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.503+0000 7fc578a00640 1 -- 172.21.15.86:0/302914301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc574074e70 msgr2=0x7fc57419c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:04.507 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.503+0000 7fc578a00640 1 --2- 172.21.15.86:0/302914301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc574074e70 0x7fc57419c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.503+0000 7fc578a00640 1 -- 172.21.15.86:0/302914301 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc560009560 con 0x7fc5740760b0 2024-09-13T16:13:04.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.503+0000 7fc578a00640 1 --2- 172.21.15.86:0/302914301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5740760b0 0x7fc57419c9c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc560031510 tx=0x7fc5600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:04.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.504+0000 7fc572000640 1 -- 172.21.15.86:0/302914301 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560004cc0 con 0x7fc5740760b0 2024-09-13T16:13:04.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.504+0000 7fc572000640 1 -- 172.21.15.86:0/302914301 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc560003ad0 con 0x7fc5740760b0 2024-09-13T16:13:04.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.504+0000 7fc572000640 1 -- 172.21.15.86:0/302914301 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560031d60 con 0x7fc5740760b0 2024-09-13T16:13:04.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.504+0000 7fc57be00640 1 -- 172.21.15.86:0/302914301 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5741a4520 con 0x7fc5740760b0 2024-09-13T16:13:04.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.504+0000 7fc57be00640 1 -- 172.21.15.86:0/302914301 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5741a4980 con 0x7fc5740760b0 2024-09-13T16:13:04.508 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.505+0000 7fc57be00640 1 -- 172.21.15.86:0/302914301 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57410eb30 con 0x7fc5740760b0 2024-09-13T16:13:04.509 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.507+0000 7fc572000640 1 -- 172.21.15.86:0/302914301 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc560003c40 con 0x7fc5740760b0 2024-09-13T16:13:04.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.508+0000 7fc572000640 1 --2- 172.21.15.86:0/302914301 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc55c0a1090 0x7fc55c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:04.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.508+0000 7fc572000640 1 -- 172.21.15.86:0/302914301 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fc5600edd70 con 0x7fc5740760b0 2024-09-13T16:13:04.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.509+0000 7fc579400640 1 --2- 172.21.15.86:0/302914301 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc55c0a1090 0x7fc55c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:04.510 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.509+0000 7fc579400640 1 --2- 172.21.15.86:0/302914301 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc55c0a1090 0x7fc55c0a3550 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc568005d00 tx=0x7fc56800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:04.513 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.511+0000 7fc572000640 1 -- 172.21.15.86:0/302914301 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc5600b7190 con 0x7fc5740760b0 2024-09-13T16:13:04.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:04 smithi086 ceph-mon[30379]: pgmap v446: 129 pgs: 129 active+clean; 22 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 807 op/s 2024-09-13T16:13:04.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:04 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2116768756' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:13:04.683 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.682+0000 7fc57be00640 1 -- 172.21.15.86:0/302914301 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc574112010 con 0x7fc5740760b0 2024-09-13T16:13:04.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.682+0000 7fc572000640 1 -- 172.21.15.86:0/302914301 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5600ba7b0 con 0x7fc5740760b0 2024-09-13T16:13:04.684 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-09-13T16:13:04.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.685+0000 7fc57be00640 1 -- 172.21.15.86:0/302914301 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc55c0a1090 msgr2=0x7fc55c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:04.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.685+0000 7fc57be00640 1 --2- 172.21.15.86:0/302914301 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc55c0a1090 0x7fc55c0a3550 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc568005d00 tx=0x7fc56800b410 comp rx=0 tx=0).stop 2024-09-13T16:13:04.686 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.685+0000 7fc57be00640 1 -- 172.21.15.86:0/302914301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5740760b0 msgr2=0x7fc57419c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:04.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.685+0000 7fc57be00640 1 --2- 172.21.15.86:0/302914301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5740760b0 0x7fc57419c9c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc560031510 tx=0x7fc5600046c0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.685+0000 7fc57be00640 1 -- 172.21.15.86:0/302914301 shutdown_connections 2024-09-13T16:13:04.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.685+0000 7fc57be00640 1 --2- 172.21.15.86:0/302914301 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fc55c0a1090 0x7fc55c0a3550 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.685+0000 7fc57be00640 1 --2- 172.21.15.86:0/302914301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc574076a50 0x7fc5741a3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.685+0000 7fc57be00640 1 --2- 172.21.15.86:0/302914301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5740760b0 0x7fc57419c9c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.685+0000 7fc57be00640 1 --2- 172.21.15.86:0/302914301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc574074e70 0x7fc57419c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.685+0000 7fc57be00640 1 -- 172.21.15.86:0/302914301 >> 172.21.15.86:0/302914301 conn(0x7fc5740fd6f0 msgr2=0x7fc5740fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:04.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.685+0000 7fc57be00640 1 -- 172.21.15.86:0/302914301 shutdown_connections 2024-09-13T16:13:04.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.685+0000 7fc57be00640 1 -- 172.21.15.86:0/302914301 wait complete. 2024-09-13T16:13:04.702 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:13:04.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.861+0000 7f5ed7200640 1 -- 172.21.15.86:0/931519629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed81059c0 msgr2=0x7f5ed8107e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:04.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.861+0000 7f5ed7200640 1 --2- 172.21.15.86:0/931519629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed81059c0 0x7f5ed8107e30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009ca0 tx=0x7f5ed002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.861+0000 7f5ed7200640 1 -- 172.21.15.86:0/931519629 shutdown_connections 2024-09-13T16:13:04.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.861+0000 7f5ed7200640 1 --2- 172.21.15.86:0/931519629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed81059c0 0x7f5ed8107e30 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.861+0000 7f5ed7200640 1 --2- 172.21.15.86:0/931519629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ed8103090 0x7f5ed8105480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.861+0000 7f5ed7200640 1 --2- 172.21.15.86:0/931519629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ed8100760 0x7f5ed8102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.861+0000 7f5ed7200640 1 -- 172.21.15.86:0/931519629 >> 172.21.15.86:0/931519629 conn(0x7f5ed80fa360 msgr2=0x7f5ed80fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:04.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.861+0000 7f5ed7200640 1 -- 172.21.15.86:0/931519629 shutdown_connections 2024-09-13T16:13:04.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.861+0000 7f5ed7200640 1 -- 172.21.15.86:0/931519629 wait complete. 2024-09-13T16:13:04.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.862+0000 7f5ed7200640 1 Processor -- start 2024-09-13T16:13:04.864 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.862+0000 7f5ed7200640 1 -- start start 2024-09-13T16:13:04.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.862+0000 7f5ed7200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ed8100760 0x7f5ed8197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:04.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.862+0000 7f5ed7200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ed8103090 0x7f5ed8198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:04.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.862+0000 7f5ed7200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed81059c0 0x7f5ed819f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:04.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.862+0000 7f5ed7200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed819fae0 con 0x7f5ed81059c0 2024-09-13T16:13:04.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.862+0000 7f5ed7200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed819fc50 con 0x7f5ed8100760 2024-09-13T16:13:04.866 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.862+0000 7f5ed7200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed819fe10 con 0x7f5ed8103090 2024-09-13T16:13:04.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.862+0000 7f5ed5e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ed8100760 0x7f5ed8197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:04.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.862+0000 7f5ed6800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed81059c0 0x7f5ed819f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:04.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.862+0000 7f5ed5e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ed8100760 0x7f5ed8197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:44850/0 (socket says 172.21.15.86:44850) 2024-09-13T16:13:04.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.862+0000 7f5ed5e00640 1 -- 172.21.15.86:0/1863824434 learned_addr learned my addr 172.21.15.86:0/1863824434 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:04.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.862+0000 7f5ecfe00640 1 --2- 172.21.15.86:0/1863824434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ed8103090 0x7f5ed8198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:04.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.863+0000 7f5ed5e00640 1 -- 172.21.15.86:0/1863824434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ed8103090 msgr2=0x7f5ed8198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:04.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.863+0000 7f5ed5e00640 1 --2- 172.21.15.86:0/1863824434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ed8103090 0x7f5ed8198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.863+0000 7f5ed5e00640 1 -- 172.21.15.86:0/1863824434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed81059c0 msgr2=0x7f5ed819f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:04.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.863+0000 7f5ed5e00640 1 --2- 172.21.15.86:0/1863824434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed81059c0 0x7f5ed819f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:04.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.863+0000 7f5ed5e00640 1 -- 172.21.15.86:0/1863824434 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed0009900 con 0x7f5ed8100760 2024-09-13T16:13:04.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.863+0000 7f5ed5e00640 1 --2- 172.21.15.86:0/1863824434 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ed8100760 0x7f5ed8197ff0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800e9f0 tx=0x7f5ec800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:04.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.863+0000 7f5ecea00640 1 -- 172.21.15.86:0/1863824434 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8009700 con 0x7f5ed8100760 2024-09-13T16:13:04.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.863+0000 7f5ecea00640 1 -- 172.21.15.86:0/1863824434 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5ec800cd80 con 0x7f5ed8100760 2024-09-13T16:13:04.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.863+0000 7f5ed7200640 1 -- 172.21.15.86:0/1863824434 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed81a00f0 con 0x7f5ed8100760 2024-09-13T16:13:04.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.863+0000 7f5ecea00640 1 -- 172.21.15.86:0/1863824434 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8018920 con 0x7f5ed8100760 2024-09-13T16:13:04.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.863+0000 7f5ed7200640 1 -- 172.21.15.86:0/1863824434 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed81a0600 con 0x7f5ed8100760 2024-09-13T16:13:04.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.864+0000 7f5ed7200640 1 -- 172.21.15.86:0/1863824434 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed81074b0 con 0x7f5ed8100760 2024-09-13T16:13:04.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.866+0000 7f5ecea00640 1 -- 172.21.15.86:0/1863824434 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5ec8018a80 con 0x7f5ed8100760 2024-09-13T16:13:04.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.868+0000 7f5ecea00640 1 --2- 172.21.15.86:0/1863824434 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f5ebc0a1090 0x7f5ebc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:04.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.868+0000 7f5ecea00640 1 -- 172.21.15.86:0/1863824434 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f5ec8014070 con 0x7f5ed8100760 2024-09-13T16:13:04.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.868+0000 7f5ecfe00640 1 --2- 172.21.15.86:0/1863824434 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f5ebc0a1090 0x7f5ebc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:04.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.868+0000 7f5ecfe00640 1 --2- 172.21.15.86:0/1863824434 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f5ebc0a1090 0x7f5ebc0a3550 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8199500 tx=0x7f5ec0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:04.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:04.870+0000 7f5ecea00640 1 -- 172.21.15.86:0/1863824434 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5ec80968d0 con 0x7f5ed8100760 2024-09-13T16:13:04.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:04 smithi139 ceph-mon[35320]: pgmap v446: 129 pgs: 129 active+clean; 22 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 807 op/s 2024-09-13T16:13:04.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:04 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2116768756' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:13:05.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:04 smithi194 ceph-mon[35694]: pgmap v446: 129 pgs: 129 active+clean; 22 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 807 op/s 2024-09-13T16:13:05.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:04 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2116768756' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:13:05.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.037+0000 7f5ed7200640 1 -- 172.21.15.86:0/1863824434 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ed810b710 con 0x7f5ed8100760 2024-09-13T16:13:05.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.038+0000 7f5ecea00640 1 -- 172.21.15.86:0/1863824434 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5ec8099ef0 con 0x7f5ed8100760 2024-09-13T16:13:05.039 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-09-13T16:13:05.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.040+0000 7f5ed7200640 1 -- 172.21.15.86:0/1863824434 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f5ebc0a1090 msgr2=0x7f5ebc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:05.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.040+0000 7f5ed7200640 1 --2- 172.21.15.86:0/1863824434 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f5ebc0a1090 0x7f5ebc0a3550 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8199500 tx=0x7f5ec0005f90 comp rx=0 tx=0).stop 2024-09-13T16:13:05.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.040+0000 7f5ed7200640 1 -- 172.21.15.86:0/1863824434 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ed8100760 msgr2=0x7f5ed8197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:05.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.040+0000 7f5ed7200640 1 --2- 172.21.15.86:0/1863824434 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ed8100760 0x7f5ed8197ff0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800e9f0 tx=0x7f5ec800eeb0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.040+0000 7f5ed7200640 1 -- 172.21.15.86:0/1863824434 shutdown_connections 2024-09-13T16:13:05.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.040+0000 7f5ed7200640 1 --2- 172.21.15.86:0/1863824434 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f5ebc0a1090 0x7f5ebc0a3550 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.040+0000 7f5ed7200640 1 --2- 172.21.15.86:0/1863824434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed81059c0 0x7f5ed819f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.040+0000 7f5ed7200640 1 --2- 172.21.15.86:0/1863824434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ed8103090 0x7f5ed8198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.040+0000 7f5ed7200640 1 --2- 172.21.15.86:0/1863824434 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ed8100760 0x7f5ed8197ff0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.040+0000 7f5ed7200640 1 -- 172.21.15.86:0/1863824434 >> 172.21.15.86:0/1863824434 conn(0x7f5ed80fa360 msgr2=0x7f5ed80ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:05.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.040+0000 7f5ed7200640 1 -- 172.21.15.86:0/1863824434 shutdown_connections 2024-09-13T16:13:05.042 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.040+0000 7f5ed7200640 1 -- 172.21.15.86:0/1863824434 wait complete. 2024-09-13T16:13:05.059 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:13:05.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.214+0000 7fbc27e00640 1 -- 172.21.15.86:0/4095820837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc28103090 msgr2=0x7fbc28105480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:05.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.214+0000 7fbc27e00640 1 --2- 172.21.15.86:0/4095820837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc28103090 0x7fbc28105480 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbc14009900 tx=0x7fbc1402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.214+0000 7fbc27e00640 1 -- 172.21.15.86:0/4095820837 shutdown_connections 2024-09-13T16:13:05.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.214+0000 7fbc27e00640 1 --2- 172.21.15.86:0/4095820837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc281059c0 0x7fbc28107e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.214+0000 7fbc27e00640 1 --2- 172.21.15.86:0/4095820837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc28103090 0x7fbc28105480 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.214+0000 7fbc27e00640 1 --2- 172.21.15.86:0/4095820837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc28100760 0x7fbc28102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.214+0000 7fbc27e00640 1 -- 172.21.15.86:0/4095820837 >> 172.21.15.86:0/4095820837 conn(0x7fbc280fa360 msgr2=0x7fbc280fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:05.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.214+0000 7fbc27e00640 1 -- 172.21.15.86:0/4095820837 shutdown_connections 2024-09-13T16:13:05.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.214+0000 7fbc27e00640 1 -- 172.21.15.86:0/4095820837 wait complete. 2024-09-13T16:13:05.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.215+0000 7fbc27e00640 1 Processor -- start 2024-09-13T16:13:05.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.215+0000 7fbc27e00640 1 -- start start 2024-09-13T16:13:05.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.215+0000 7fbc27e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc28100760 0x7fbc28195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:05.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.215+0000 7fbc27e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc28103090 0x7fbc28196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:05.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.215+0000 7fbc27e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc281059c0 0x7fbc2819d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:05.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.215+0000 7fbc27e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2819da10 con 0x7fbc28103090 2024-09-13T16:13:05.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.215+0000 7fbc27e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2819db80 con 0x7fbc28100760 2024-09-13T16:13:05.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.215+0000 7fbc27e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2819dd40 con 0x7fbc281059c0 2024-09-13T16:13:05.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.215+0000 7fbc26000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc28103090 0x7fbc28196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:05.219 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.215+0000 7fbc26000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc28103090 0x7fbc28196460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46900/0 (socket says 172.21.15.86:46900) 2024-09-13T16:13:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.215+0000 7fbc26000640 1 -- 172.21.15.86:0/4139703592 learned_addr learned my addr 172.21.15.86:0/4139703592 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.215+0000 7fbc26a00640 1 --2- 172.21.15.86:0/4139703592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc28100760 0x7fbc28195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.215+0000 7fbc27400640 1 --2- 172.21.15.86:0/4139703592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc281059c0 0x7fbc2819d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.216+0000 7fbc26000640 1 -- 172.21.15.86:0/4139703592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc281059c0 msgr2=0x7fbc2819d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.216+0000 7fbc26000640 1 --2- 172.21.15.86:0/4139703592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc281059c0 0x7fbc2819d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.216+0000 7fbc26000640 1 -- 172.21.15.86:0/4139703592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc28100760 msgr2=0x7fbc28195f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.216+0000 7fbc26000640 1 --2- 172.21.15.86:0/4139703592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc28100760 0x7fbc28195f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.216+0000 7fbc26000640 1 -- 172.21.15.86:0/4139703592 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc14009560 con 0x7fbc28103090 2024-09-13T16:13:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.216+0000 7fbc27400640 1 --2- 172.21.15.86:0/4139703592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc281059c0 0x7fbc2819d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:13:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.216+0000 7fbc26000640 1 --2- 172.21.15.86:0/4139703592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc28103090 0x7fbc28196460 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbc14031510 tx=0x7fbc14005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.216+0000 7fbc1f400640 1 -- 172.21.15.86:0/4139703592 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14004c50 con 0x7fbc28103090 2024-09-13T16:13:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.216+0000 7fbc1f400640 1 -- 172.21.15.86:0/4139703592 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbc14004db0 con 0x7fbc28103090 2024-09-13T16:13:05.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.216+0000 7fbc27e00640 1 -- 172.21.15.86:0/4139703592 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2819dfc0 con 0x7fbc28103090 2024-09-13T16:13:05.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.216+0000 7fbc1f400640 1 -- 172.21.15.86:0/4139703592 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14031cf0 con 0x7fbc28103090 2024-09-13T16:13:05.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.216+0000 7fbc27e00640 1 -- 172.21.15.86:0/4139703592 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2819e390 con 0x7fbc28103090 2024-09-13T16:13:05.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.217+0000 7fbc27e00640 1 -- 172.21.15.86:0/4139703592 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc280fbe50 con 0x7fbc28103090 2024-09-13T16:13:05.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.220+0000 7fbc1f400640 1 -- 172.21.15.86:0/4139703592 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbc140035f0 con 0x7fbc28103090 2024-09-13T16:13:05.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.222+0000 7fbc1f400640 1 --2- 172.21.15.86:0/4139703592 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbc0c0a1090 0x7fbc0c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:05.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.222+0000 7fbc1f400640 1 -- 172.21.15.86:0/4139703592 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fbc140edc20 con 0x7fbc28103090 2024-09-13T16:13:05.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.222+0000 7fbc26a00640 1 --2- 172.21.15.86:0/4139703592 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbc0c0a1090 0x7fbc0c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:05.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.223+0000 7fbc26a00640 1 --2- 172.21.15.86:0/4139703592 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbc0c0a1090 0x7fbc0c0a3550 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009bd0 tx=0x7fbc18005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:05.227 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.226+0000 7fbc1f400640 1 -- 172.21.15.86:0/4139703592 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbc140b6f90 con 0x7fbc28103090 2024-09-13T16:13:05.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.403+0000 7fbc27e00640 1 -- 172.21.15.86:0/4139703592 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc280fb8c0 con 0x7fbc28103090 2024-09-13T16:13:05.405 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.404+0000 7fbc1f400640 1 -- 172.21.15.86:0/4139703592 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc14040020 con 0x7fbc28103090 2024-09-13T16:13:05.405 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2024-09-13T16:13:05.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.406+0000 7fbc27e00640 1 -- 172.21.15.86:0/4139703592 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbc0c0a1090 msgr2=0x7fbc0c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:05.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.406+0000 7fbc27e00640 1 --2- 172.21.15.86:0/4139703592 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbc0c0a1090 0x7fbc0c0a3550 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009bd0 tx=0x7fbc18005f90 comp rx=0 tx=0).stop 2024-09-13T16:13:05.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.406+0000 7fbc27e00640 1 -- 172.21.15.86:0/4139703592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc28103090 msgr2=0x7fbc28196460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:05.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.406+0000 7fbc27e00640 1 --2- 172.21.15.86:0/4139703592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc28103090 0x7fbc28196460 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbc14031510 tx=0x7fbc14005690 comp rx=0 tx=0).stop 2024-09-13T16:13:05.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.406+0000 7fbc27e00640 1 -- 172.21.15.86:0/4139703592 shutdown_connections 2024-09-13T16:13:05.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.406+0000 7fbc27e00640 1 --2- 172.21.15.86:0/4139703592 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fbc0c0a1090 0x7fbc0c0a3550 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.406+0000 7fbc27e00640 1 --2- 172.21.15.86:0/4139703592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc281059c0 0x7fbc2819d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.408 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.406+0000 7fbc27e00640 1 --2- 172.21.15.86:0/4139703592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc28103090 0x7fbc28196460 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.406+0000 7fbc27e00640 1 --2- 172.21.15.86:0/4139703592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc28100760 0x7fbc28195f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.406+0000 7fbc27e00640 1 -- 172.21.15.86:0/4139703592 >> 172.21.15.86:0/4139703592 conn(0x7fbc280fa360 msgr2=0x7fbc28102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:05.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.406+0000 7fbc27e00640 1 -- 172.21.15.86:0/4139703592 shutdown_connections 2024-09-13T16:13:05.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.406+0000 7fbc27e00640 1 -- 172.21.15.86:0/4139703592 wait complete. 2024-09-13T16:13:05.424 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T16:13:05.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.582+0000 7f5d59200640 1 -- 172.21.15.86:0/232817850 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d541018a0 msgr2=0x7f5d54108130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:05.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.582+0000 7f5d59200640 1 --2- 172.21.15.86:0/232817850 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d541018a0 0x7f5d54108130 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c009ca0 tx=0x7f5d4c02a8c0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.582+0000 7f5d59200640 1 -- 172.21.15.86:0/232817850 shutdown_connections 2024-09-13T16:13:05.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.582+0000 7f5d59200640 1 --2- 172.21.15.86:0/232817850 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d541018a0 0x7f5d54108130 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.582+0000 7f5d59200640 1 --2- 172.21.15.86:0/232817850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d54100ee0 0x7f5d54101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.582+0000 7f5d59200640 1 --2- 172.21.15.86:0/232817850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d540ffcf0 0x7f5d541000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.582+0000 7f5d59200640 1 -- 172.21.15.86:0/232817850 >> 172.21.15.86:0/232817850 conn(0x7f5d540fb450 msgr2=0x7f5d540fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:05.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.582+0000 7f5d59200640 1 -- 172.21.15.86:0/232817850 shutdown_connections 2024-09-13T16:13:05.585 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.582+0000 7f5d59200640 1 -- 172.21.15.86:0/232817850 wait complete. 2024-09-13T16:13:05.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.583+0000 7f5d59200640 1 Processor -- start 2024-09-13T16:13:05.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.583+0000 7f5d59200640 1 -- start start 2024-09-13T16:13:05.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.583+0000 7f5d59200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d540ffcf0 0x7f5d54197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:05.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.583+0000 7f5d59200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d54100ee0 0x7f5d541984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:05.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.583+0000 7f5d59200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d541018a0 0x7f5d5419f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:05.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.583+0000 7f5d59200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5419fa50 con 0x7f5d54100ee0 2024-09-13T16:13:05.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.583+0000 7f5d59200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5419fbc0 con 0x7f5d541018a0 2024-09-13T16:13:05.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.583+0000 7f5d59200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5419fd80 con 0x7f5d540ffcf0 2024-09-13T16:13:05.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.584+0000 7f5d52a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d54100ee0 0x7f5d541984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:05.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.584+0000 7f5d52a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d54100ee0 0x7f5d541984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46918/0 (socket says 172.21.15.86:46918) 2024-09-13T16:13:05.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.584+0000 7f5d52a00640 1 -- 172.21.15.86:0/3831064254 learned_addr learned my addr 172.21.15.86:0/3831064254 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:05.587 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.584+0000 7f5d53400640 1 --2- 172.21.15.86:0/3831064254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d540ffcf0 0x7f5d54197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:05.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.584+0000 7f5d53e00640 1 --2- 172.21.15.86:0/3831064254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d541018a0 0x7f5d5419f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:05.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.584+0000 7f5d52a00640 1 -- 172.21.15.86:0/3831064254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d540ffcf0 msgr2=0x7f5d54197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:05.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.584+0000 7f5d52a00640 1 --2- 172.21.15.86:0/3831064254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d540ffcf0 0x7f5d54197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.584+0000 7f5d52a00640 1 -- 172.21.15.86:0/3831064254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d541018a0 msgr2=0x7f5d5419f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:05.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.584+0000 7f5d52a00640 1 --2- 172.21.15.86:0/3831064254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d541018a0 0x7f5d5419f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.584+0000 7f5d52a00640 1 -- 172.21.15.86:0/3831064254 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c009900 con 0x7f5d54100ee0 2024-09-13T16:13:05.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.584+0000 7f5d52a00640 1 --2- 172.21.15.86:0/3831064254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d54100ee0 0x7f5d541984a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000d950 tx=0x7f5d4000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:05.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.585+0000 7f5d4be00640 1 -- 172.21.15.86:0/3831064254 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d40009a30 con 0x7f5d54100ee0 2024-09-13T16:13:05.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.585+0000 7f5d59200640 1 -- 172.21.15.86:0/3831064254 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d541a0060 con 0x7f5d54100ee0 2024-09-13T16:13:05.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.585+0000 7f5d4be00640 1 -- 172.21.15.86:0/3831064254 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5d40009b90 con 0x7f5d54100ee0 2024-09-13T16:13:05.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.585+0000 7f5d4be00640 1 -- 172.21.15.86:0/3831064254 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d40004a00 con 0x7f5d54100ee0 2024-09-13T16:13:05.588 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.585+0000 7f5d59200640 1 -- 172.21.15.86:0/3831064254 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d541a0570 con 0x7f5d54100ee0 2024-09-13T16:13:05.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.586+0000 7f5d59200640 1 -- 172.21.15.86:0/3831064254 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d5410b780 con 0x7f5d54100ee0 2024-09-13T16:13:05.589 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.588+0000 7f5d4be00640 1 -- 172.21.15.86:0/3831064254 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5d40009d00 con 0x7f5d54100ee0 2024-09-13T16:13:05.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.589+0000 7f5d4be00640 1 --2- 172.21.15.86:0/3831064254 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f5d380a1090 0x7f5d380a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:05.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.589+0000 7f5d4be00640 1 -- 172.21.15.86:0/3831064254 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f5d400cc660 con 0x7f5d54100ee0 2024-09-13T16:13:05.590 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.589+0000 7f5d53400640 1 --2- 172.21.15.86:0/3831064254 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f5d380a1090 0x7f5d380a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:05.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.590+0000 7f5d53400640 1 --2- 172.21.15.86:0/3831064254 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f5d380a1090 0x7f5d380a3550 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5d54100d40 tx=0x7f5d4400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:05.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.592+0000 7f5d4be00640 1 -- 172.21.15.86:0/3831064254 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5d400959d0 con 0x7f5d54100ee0 2024-09-13T16:13:05.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.761+0000 7f5d59200640 1 -- 172.21.15.86:0/3831064254 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5d541a0900 con 0x7f5d54100ee0 2024-09-13T16:13:05.763 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.762+0000 7f5d4be00640 1 -- 172.21.15.86:0/3831064254 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5d40098ff0 con 0x7f5d54100ee0 2024-09-13T16:13:05.763 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-09-13T16:13:05.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.764+0000 7f5d59200640 1 -- 172.21.15.86:0/3831064254 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f5d380a1090 msgr2=0x7f5d380a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:05.765 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.764+0000 7f5d59200640 1 --2- 172.21.15.86:0/3831064254 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f5d380a1090 0x7f5d380a3550 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5d54100d40 tx=0x7f5d4400b390 comp rx=0 tx=0).stop 2024-09-13T16:13:05.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.764+0000 7f5d59200640 1 -- 172.21.15.86:0/3831064254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d54100ee0 msgr2=0x7f5d541984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:05.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.764+0000 7f5d59200640 1 --2- 172.21.15.86:0/3831064254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d54100ee0 0x7f5d541984a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000d950 tx=0x7f5d4000de10 comp rx=0 tx=0).stop 2024-09-13T16:13:05.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.764+0000 7f5d59200640 1 -- 172.21.15.86:0/3831064254 shutdown_connections 2024-09-13T16:13:05.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.764+0000 7f5d59200640 1 --2- 172.21.15.86:0/3831064254 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f5d380a1090 0x7f5d380a3550 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.764+0000 7f5d59200640 1 --2- 172.21.15.86:0/3831064254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d541018a0 0x7f5d5419f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.764+0000 7f5d59200640 1 --2- 172.21.15.86:0/3831064254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d54100ee0 0x7f5d541984a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.764+0000 7f5d59200640 1 --2- 172.21.15.86:0/3831064254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d540ffcf0 0x7f5d54197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.764+0000 7f5d59200640 1 -- 172.21.15.86:0/3831064254 >> 172.21.15.86:0/3831064254 conn(0x7f5d540fb450 msgr2=0x7f5d541066b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:05.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.764+0000 7f5d59200640 1 -- 172.21.15.86:0/3831064254 shutdown_connections 2024-09-13T16:13:05.766 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.764+0000 7f5d59200640 1 -- 172.21.15.86:0/3831064254 wait complete. 2024-09-13T16:13:05.780 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:05 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/302914301' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:13:05.780 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:05 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/1863824434' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:13:05.780 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:05 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/4139703592' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:13:05.782 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-13T16:13:05.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.934+0000 7f19fdc00640 1 -- 172.21.15.86:0/3861495658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19f80fedd0 msgr2=0x7f19f80ff250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:05.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.934+0000 7f19fdc00640 1 --2- 172.21.15.86:0/3861495658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19f80fedd0 0x7f19f80ff250 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009900 tx=0x7f19e402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.934+0000 7f19fdc00640 1 -- 172.21.15.86:0/3861495658 shutdown_connections 2024-09-13T16:13:05.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.934+0000 7f19fdc00640 1 --2- 172.21.15.86:0/3861495658 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f80ff790 0x7f19f8100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.934+0000 7f19fdc00640 1 --2- 172.21.15.86:0/3861495658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19f80fedd0 0x7f19f80ff250 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.934+0000 7f19fdc00640 1 --2- 172.21.15.86:0/3861495658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19f80fe070 0x7f19f80fe470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.934+0000 7f19fdc00640 1 -- 172.21.15.86:0/3861495658 >> 172.21.15.86:0/3861495658 conn(0x7f19f80f9bb0 msgr2=0x7f19f80fbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:05.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.934+0000 7f19fdc00640 1 -- 172.21.15.86:0/3861495658 shutdown_connections 2024-09-13T16:13:05.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.934+0000 7f19fdc00640 1 -- 172.21.15.86:0/3861495658 wait complete. 2024-09-13T16:13:05.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.935+0000 7f19fdc00640 1 Processor -- start 2024-09-13T16:13:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.935+0000 7f19fdc00640 1 -- start start 2024-09-13T16:13:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.935+0000 7f19fdc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19f80fe070 0x7f19f81980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.935+0000 7f19fdc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f80fedd0 0x7f19f8198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.935+0000 7f19fdc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19f80ff790 0x7f19f819f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.935+0000 7f19fdc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f819fbc0 con 0x7f19f80ff790 2024-09-13T16:13:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.935+0000 7f19fdc00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f819fd30 con 0x7f19f80fe070 2024-09-13T16:13:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.935+0000 7f19fdc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f819fef0 con 0x7f19f80fedd0 2024-09-13T16:13:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.936+0000 7f19f7400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19f80ff790 0x7f19f819f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.936+0000 7f19f7400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19f80ff790 0x7f19f819f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46944/0 (socket says 172.21.15.86:46944) 2024-09-13T16:13:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.936+0000 7f19f6a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19f80fe070 0x7f19f81980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.936+0000 7f19f7400640 1 -- 172.21.15.86:0/3607727822 learned_addr learned my addr 172.21.15.86:0/3607727822 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.936+0000 7f19f6000640 1 --2- 172.21.15.86:0/3607727822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f80fedd0 0x7f19f8198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.936+0000 7f19f7400640 1 -- 172.21.15.86:0/3607727822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f80fedd0 msgr2=0x7f19f8198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.936+0000 7f19f7400640 1 --2- 172.21.15.86:0/3607727822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f80fedd0 0x7f19f8198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.936+0000 7f19f7400640 1 -- 172.21.15.86:0/3607727822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19f80fe070 msgr2=0x7f19f81980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.936+0000 7f19f7400640 1 --2- 172.21.15.86:0/3607727822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19f80fe070 0x7f19f81980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.936+0000 7f19f7400640 1 -- 172.21.15.86:0/3607727822 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e4009560 con 0x7f19f80ff790 2024-09-13T16:13:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.936+0000 7f19f6000640 1 --2- 172.21.15.86:0/3607727822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f80fedd0 0x7f19f8198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:13:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.936+0000 7f19f6a00640 1 --2- 172.21.15.86:0/3607727822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19f80fe070 0x7f19f81980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:13:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.936+0000 7f19f7400640 1 --2- 172.21.15.86:0/3607727822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19f80ff790 0x7f19f819f680 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f19f000eb10 tx=0x7f19f000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.937+0000 7f19ef400640 1 -- 172.21.15.86:0/3607727822 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f0004b20 con 0x7f19f80ff790 2024-09-13T16:13:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.937+0000 7f19fdc00640 1 -- 172.21.15.86:0/3607727822 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f81a01d0 con 0x7f19f80ff790 2024-09-13T16:13:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.937+0000 7f19ef400640 1 -- 172.21.15.86:0/3607727822 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f19f0004c80 con 0x7f19f80ff790 2024-09-13T16:13:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.937+0000 7f19ef400640 1 -- 172.21.15.86:0/3607727822 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f0010670 con 0x7f19f80ff790 2024-09-13T16:13:05.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.937+0000 7f19fdc00640 1 -- 172.21.15.86:0/3607727822 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f81a0700 con 0x7f19f80ff790 2024-09-13T16:13:05.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.938+0000 7f19fdc00640 1 -- 172.21.15.86:0/3607727822 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f8109d90 con 0x7f19f80ff790 2024-09-13T16:13:05.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.940+0000 7f19ef400640 1 -- 172.21.15.86:0/3607727822 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f19f0005020 con 0x7f19f80ff790 2024-09-13T16:13:05.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.941+0000 7f19ef400640 1 --2- 172.21.15.86:0/3607727822 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f19dc0a1110 0x7f19dc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:05.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.941+0000 7f19ef400640 1 -- 172.21.15.86:0/3607727822 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f19f0014070 con 0x7f19f80ff790 2024-09-13T16:13:05.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.941+0000 7f19f6a00640 1 --2- 172.21.15.86:0/3607727822 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f19dc0a1110 0x7f19dc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:05.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.942+0000 7f19f6a00640 1 --2- 172.21.15.86:0/3607727822 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f19dc0a1110 0x7f19dc0a35d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009fc0 tx=0x7f19e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:05.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:05.945+0000 7f19ef400640 1 -- 172.21.15.86:0/3607727822 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f19f0096610 con 0x7f19f80ff790 2024-09-13T16:13:05.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:05 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/302914301' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:13:05.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:05 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/1863824434' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:13:05.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:05 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/4139703592' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:13:06.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:05 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/302914301' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:13:06.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:05 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/1863824434' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:13:06.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:05 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/4139703592' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:13:06.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:06.158+0000 7f19fdc00640 1 -- 172.21.15.86:0/3607727822 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f19f810da20 con 0x7f19f80ff790 2024-09-13T16:13:06.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:06.168+0000 7f19ef400640 1 -- 172.21.15.86:0/3607727822 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) v1 ==== 81+0+733407 (secure 0 0 0) 0x7f19f0099c30 con 0x7f19f80ff790 2024-09-13T16:13:06.181 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:13:06.182 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T16:13:06.182 INFO:teuthology.orchestra.run.smithi086.stdout: "epoch": 20, 2024-09-13T16:13:06.182 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.182 INFO:teuthology.orchestra.run.smithi086.stdout: "active_gid": 14150, 2024-09-13T16:13:06.182 INFO:teuthology.orchestra.run.smithi086.stdout: "active_name": "x", 2024-09-13T16:13:06.182 INFO:teuthology.orchestra.run.smithi086.stdout: "active_addrs": { 2024-09-13T16:13:06.182 INFO:teuthology.orchestra.run.smithi086.stdout: "addrvec": [ 2024-09-13T16:13:06.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.182 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v2", 2024-09-13T16:13:06.182 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "172.21.15.86:6800", 2024-09-13T16:13:06.182 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 1239909622 2024-09-13T16:13:06.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.183 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v1", 2024-09-13T16:13:06.183 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "172.21.15.86:6801", 2024-09-13T16:13:06.183 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 1239909622 2024-09-13T16:13:06.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.183 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T16:13:06.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.183 INFO:teuthology.orchestra.run.smithi086.stdout: "active_addr": "172.21.15.86:6801/1239909622", 2024-09-13T16:13:06.183 INFO:teuthology.orchestra.run.smithi086.stdout: "active_change": "2024-09-13T16:00:59.245596+0000", 2024-09-13T16:13:06.183 INFO:teuthology.orchestra.run.smithi086.stdout: "active_mgr_features": 4540138322906710015, 2024-09-13T16:13:06.183 INFO:teuthology.orchestra.run.smithi086.stdout: "available": true, 2024-09-13T16:13:06.183 INFO:teuthology.orchestra.run.smithi086.stdout: "standbys": [ 2024-09-13T16:13:06.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.184 INFO:teuthology.orchestra.run.smithi086.stdout: "gid": 24109, 2024-09-13T16:13:06.184 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "z", 2024-09-13T16:13:06.184 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_features": 4540138322906710015, 2024-09-13T16:13:06.184 INFO:teuthology.orchestra.run.smithi086.stdout: "available_modules": [ 2024-09-13T16:13:06.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.184 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "alerts", 2024-09-13T16:13:06.184 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.184 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.184 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.185 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-09-13T16:13:06.185 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-09-13T16:13:06.185 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.185 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.185 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.185 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-09-13T16:13:06.185 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.185 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.185 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.185 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T16:13:06.185 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.186 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.186 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.186 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.186 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.186 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.186 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.186 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.186 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.186 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.186 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.186 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.187 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.187 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.187 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.187 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.187 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.187 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.187 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.187 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.187 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.187 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.187 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.187 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.187 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.188 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.188 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.188 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.188 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.188 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.188 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.188 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.188 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.188 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.188 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.188 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.189 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.189 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.189 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.189 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.189 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.189 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.189 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.189 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.189 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.189 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.189 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.189 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.189 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.190 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.190 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.190 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.190 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.190 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.190 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.190 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.190 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.190 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.190 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.190 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.190 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.190 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.191 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.191 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.191 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.191 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.191 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.191 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.191 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.191 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_destination": { 2024-09-13T16:13:06.191 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_destination", 2024-09-13T16:13:06.191 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.191 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.191 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.192 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.192 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.192 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.192 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.192 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Email address to send alerts to", 2024-09-13T16:13:06.192 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.192 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.192 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.192 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_from_name": { 2024-09-13T16:13:06.192 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_from_name", 2024-09-13T16:13:06.193 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.193 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.193 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.193 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "Ceph", 2024-09-13T16:13:06.193 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.193 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.193 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.193 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Email From: name", 2024-09-13T16:13:06.193 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.193 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.193 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.193 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_host": { 2024-09-13T16:13:06.194 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_host", 2024-09-13T16:13:06.194 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.194 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.194 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.194 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.194 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.194 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.194 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.194 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SMTP server", 2024-09-13T16:13:06.194 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.194 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.194 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.195 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_password": { 2024-09-13T16:13:06.195 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_password", 2024-09-13T16:13:06.195 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.195 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.195 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.195 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.195 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.195 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.195 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.195 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Password to authenticate with", 2024-09-13T16:13:06.195 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.195 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.195 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.196 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_port": { 2024-09-13T16:13:06.196 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_port", 2024-09-13T16:13:06.196 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.196 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.196 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.196 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "465", 2024-09-13T16:13:06.196 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.196 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.196 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.196 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SMTP port", 2024-09-13T16:13:06.196 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.196 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.197 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.197 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_sender": { 2024-09-13T16:13:06.197 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_sender", 2024-09-13T16:13:06.197 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.197 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.197 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.197 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.197 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.197 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.197 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.197 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SMTP envelope sender", 2024-09-13T16:13:06.197 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.197 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.198 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.198 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_ssl": { 2024-09-13T16:13:06.198 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_ssl", 2024-09-13T16:13:06.198 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.198 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.198 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.198 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.198 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.198 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.198 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.198 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T16:13:06.199 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.199 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.199 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.199 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_user": { 2024-09-13T16:13:06.199 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_user", 2024-09-13T16:13:06.199 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.199 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.199 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.199 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.199 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.199 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.199 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.200 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "User to authenticate as", 2024-09-13T16:13:06.200 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.200 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.200 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.200 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.200 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.201 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "balancer", 2024-09-13T16:13:06.201 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.201 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.201 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.201 INFO:teuthology.orchestra.run.smithi086.stdout: "active": { 2024-09-13T16:13:06.201 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "active", 2024-09-13T16:13:06.201 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.201 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.201 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.201 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.201 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.201 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.202 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.202 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T16:13:06.202 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.202 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.203 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.203 INFO:teuthology.orchestra.run.smithi086.stdout: "begin_time": { 2024-09-13T16:13:06.203 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "begin_time", 2024-09-13T16:13:06.203 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.204 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.204 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.204 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0000", 2024-09-13T16:13:06.204 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.205 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.205 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.205 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T16:13:06.205 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T16:13:06.205 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.205 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.206 INFO:teuthology.orchestra.run.smithi086.stdout: "begin_weekday": { 2024-09-13T16:13:06.206 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "begin_weekday", 2024-09-13T16:13:06.206 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-09-13T16:13:06.206 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.206 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.206 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-09-13T16:13:06.207 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "0", 2024-09-13T16:13:06.207 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "6", 2024-09-13T16:13:06.207 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.207 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T16:13:06.207 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T16:13:06.208 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.208 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.208 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_compat_max_iterations": { 2024-09-13T16:13:06.209 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crush_compat_max_iterations", 2024-09-13T16:13:06.209 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-09-13T16:13:06.209 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.209 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.210 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "25", 2024-09-13T16:13:06.210 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-09-13T16:13:06.210 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "250", 2024-09-13T16:13:06.211 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.211 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T16:13:06.211 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.212 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.212 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.212 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_compat_metrics": { 2024-09-13T16:13:06.213 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crush_compat_metrics", 2024-09-13T16:13:06.213 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.213 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.213 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.213 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T16:13:06.213 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.213 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.213 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.213 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T16:13:06.214 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T16:13:06.214 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.214 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.214 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_compat_step": { 2024-09-13T16:13:06.214 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crush_compat_step", 2024-09-13T16:13:06.214 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:06.214 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.214 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.214 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0.5", 2024-09-13T16:13:06.214 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "0.001", 2024-09-13T16:13:06.214 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "0.999", 2024-09-13T16:13:06.214 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.215 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "aggressiveness of optimization", 2024-09-13T16:13:06.215 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T16:13:06.215 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.215 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.215 INFO:teuthology.orchestra.run.smithi086.stdout: "end_time": { 2024-09-13T16:13:06.215 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "end_time", 2024-09-13T16:13:06.215 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.215 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.215 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.215 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "2359", 2024-09-13T16:13:06.215 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.215 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.215 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.216 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T16:13:06.216 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T16:13:06.216 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.216 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.216 INFO:teuthology.orchestra.run.smithi086.stdout: "end_weekday": { 2024-09-13T16:13:06.216 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "end_weekday", 2024-09-13T16:13:06.216 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-09-13T16:13:06.216 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.216 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.216 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-09-13T16:13:06.216 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "0", 2024-09-13T16:13:06.217 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "6", 2024-09-13T16:13:06.217 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.217 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T16:13:06.217 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T16:13:06.217 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.217 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.217 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.217 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.217 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.217 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.217 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.217 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.218 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.218 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.218 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.218 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.218 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.218 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.218 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.218 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.218 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.218 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.218 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.218 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.219 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.219 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.219 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.219 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.219 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.219 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.219 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.219 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.219 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.219 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.219 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.220 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.220 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.220 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.220 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.220 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.220 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.220 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.220 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.220 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.220 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.220 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.220 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.221 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.221 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.221 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.221 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.221 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.221 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.221 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.221 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.221 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.222 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.222 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.222 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.222 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.222 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.222 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.222 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.222 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.222 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.222 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.222 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.222 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.223 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.223 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.223 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.223 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.223 INFO:teuthology.orchestra.run.smithi086.stdout: "min_score": { 2024-09-13T16:13:06.223 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "min_score", 2024-09-13T16:13:06.223 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:06.223 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.223 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.223 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-09-13T16:13:06.223 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.223 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.224 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.224 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T16:13:06.224 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.224 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.224 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.224 INFO:teuthology.orchestra.run.smithi086.stdout: "mode": { 2024-09-13T16:13:06.224 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mode", 2024-09-13T16:13:06.224 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.224 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.224 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.224 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "upmap", 2024-09-13T16:13:06.224 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.225 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.225 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.225 INFO:teuthology.orchestra.run.smithi086.stdout: "crush-compat", 2024-09-13T16:13:06.225 INFO:teuthology.orchestra.run.smithi086.stdout: "none", 2024-09-13T16:13:06.225 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap" 2024-09-13T16:13:06.225 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.225 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Balancer mode", 2024-09-13T16:13:06.225 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.225 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.225 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.225 INFO:teuthology.orchestra.run.smithi086.stdout: "pool_ids": { 2024-09-13T16:13:06.226 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pool_ids", 2024-09-13T16:13:06.226 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.226 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.226 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.226 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.226 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.226 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.226 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.226 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T16:13:06.226 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.226 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.226 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.227 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-09-13T16:13:06.227 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-09-13T16:13:06.227 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.227 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.227 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.227 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-09-13T16:13:06.227 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.227 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.227 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.227 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T16:13:06.227 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.227 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.227 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.228 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap_max_deviation": { 2024-09-13T16:13:06.228 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "upmap_max_deviation", 2024-09-13T16:13:06.228 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.228 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.228 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.228 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-09-13T16:13:06.228 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-09-13T16:13:06.228 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.228 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.228 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T16:13:06.228 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T16:13:06.228 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.229 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.229 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap_max_optimizations": { 2024-09-13T16:13:06.229 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "upmap_max_optimizations", 2024-09-13T16:13:06.229 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-09-13T16:13:06.229 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.229 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.229 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:06.229 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.229 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.229 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.229 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T16:13:06.229 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.229 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.230 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.230 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.230 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.232 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephadm", 2024-09-13T16:13:06.232 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.232 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.233 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.233 INFO:teuthology.orchestra.run.smithi086.stdout: "agent_down_multiplier": { 2024-09-13T16:13:06.233 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "agent_down_multiplier", 2024-09-13T16:13:06.233 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:06.233 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.233 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.233 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "3.0", 2024-09-13T16:13:06.233 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.233 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.233 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.233 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T16:13:06.233 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.234 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.234 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.234 INFO:teuthology.orchestra.run.smithi086.stdout: "agent_refresh_rate": { 2024-09-13T16:13:06.234 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "agent_refresh_rate", 2024-09-13T16:13:06.234 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.234 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.234 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.234 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "20", 2024-09-13T16:13:06.234 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.234 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.234 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.234 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T16:13:06.234 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.235 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.235 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.235 INFO:teuthology.orchestra.run.smithi086.stdout: "agent_starting_port": { 2024-09-13T16:13:06.235 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "agent_starting_port", 2024-09-13T16:13:06.235 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.235 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.235 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.235 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "4721", 2024-09-13T16:13:06.235 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.235 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.235 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.236 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T16:13:06.236 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.236 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.236 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.236 INFO:teuthology.orchestra.run.smithi086.stdout: "allow_ptrace": { 2024-09-13T16:13:06.237 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "allow_ptrace", 2024-09-13T16:13:06.237 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.237 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.237 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.237 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.237 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.237 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.237 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.237 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T16:13:06.237 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T16:13:06.237 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.237 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.238 INFO:teuthology.orchestra.run.smithi086.stdout: "autotune_interval": { 2024-09-13T16:13:06.238 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "autotune_interval", 2024-09-13T16:13:06.238 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.238 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.238 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.238 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-09-13T16:13:06.238 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.238 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.238 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.238 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T16:13:06.239 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.239 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.239 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.239 INFO:teuthology.orchestra.run.smithi086.stdout: "autotune_memory_target_ratio": { 2024-09-13T16:13:06.239 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T16:13:06.239 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:06.239 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.239 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.240 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0.7", 2024-09-13T16:13:06.240 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.240 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.240 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.240 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T16:13:06.240 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.240 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.240 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.241 INFO:teuthology.orchestra.run.smithi086.stdout: "cgroups_split": { 2024-09-13T16:13:06.241 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cgroups_split", 2024-09-13T16:13:06.241 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.241 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.241 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.241 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.241 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.241 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.241 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.241 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T16:13:06.242 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.242 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.242 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.242 INFO:teuthology.orchestra.run.smithi086.stdout: "config_checks_enabled": { 2024-09-13T16:13:06.242 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "config_checks_enabled", 2024-09-13T16:13:06.242 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.242 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.243 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.243 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.243 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.243 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.243 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.243 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T16:13:06.243 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.243 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.243 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.244 INFO:teuthology.orchestra.run.smithi086.stdout: "config_dashboard": { 2024-09-13T16:13:06.244 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "config_dashboard", 2024-09-13T16:13:06.244 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.244 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.244 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.244 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.244 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.245 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.245 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.245 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T16:13:06.245 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.245 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.246 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.246 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_alertmanager": { 2024-09-13T16:13:06.246 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_alertmanager", 2024-09-13T16:13:06.246 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.246 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.247 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.247 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T16:13:06.247 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.247 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.247 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.248 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:06.248 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.248 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.248 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.248 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_base": { 2024-09-13T16:13:06.249 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_base", 2024-09-13T16:13:06.249 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.249 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.249 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.249 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T16:13:06.249 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.249 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.249 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.249 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Container image name, without the tag", 2024-09-13T16:13:06.249 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.249 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.250 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.250 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_elasticsearch": { 2024-09-13T16:13:06.250 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_elasticsearch", 2024-09-13T16:13:06.250 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.250 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.250 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.250 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T16:13:06.250 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.250 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.251 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.251 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "elasticsearch container image", 2024-09-13T16:13:06.251 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.251 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.251 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.251 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_grafana": { 2024-09-13T16:13:06.251 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_grafana", 2024-09-13T16:13:06.251 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.251 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.251 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.251 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T16:13:06.252 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.252 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.252 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.252 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:06.252 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.252 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.252 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.253 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_haproxy": { 2024-09-13T16:13:06.253 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_haproxy", 2024-09-13T16:13:06.253 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.253 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.253 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.253 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T16:13:06.254 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.254 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.254 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.254 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "HAproxy container image", 2024-09-13T16:13:06.254 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.254 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.255 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.255 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_jaeger_agent": { 2024-09-13T16:13:06.255 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_jaeger_agent", 2024-09-13T16:13:06.255 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.255 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.257 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.257 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T16:13:06.257 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.257 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.257 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.257 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Jaeger agent container image", 2024-09-13T16:13:06.257 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.257 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.257 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.257 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_jaeger_collector": { 2024-09-13T16:13:06.258 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_jaeger_collector", 2024-09-13T16:13:06.258 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.258 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.258 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.258 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T16:13:06.258 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.258 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.258 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.258 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Jaeger collector container image", 2024-09-13T16:13:06.258 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.258 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.258 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.258 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_jaeger_query": { 2024-09-13T16:13:06.259 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_jaeger_query", 2024-09-13T16:13:06.259 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.259 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.259 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.259 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T16:13:06.259 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.259 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.259 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.259 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Jaeger query container image", 2024-09-13T16:13:06.259 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.259 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.259 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.259 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_keepalived": { 2024-09-13T16:13:06.260 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_keepalived", 2024-09-13T16:13:06.260 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.260 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.260 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.260 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T16:13:06.260 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.260 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.260 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.260 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Keepalived container image", 2024-09-13T16:13:06.260 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.260 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.260 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.261 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_loki": { 2024-09-13T16:13:06.261 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_loki", 2024-09-13T16:13:06.261 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.261 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.261 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.261 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T16:13:06.261 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.261 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.261 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.261 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Loki container image", 2024-09-13T16:13:06.261 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.261 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.261 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.262 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_node_exporter": { 2024-09-13T16:13:06.262 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_node_exporter", 2024-09-13T16:13:06.262 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.262 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.262 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.262 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T16:13:06.262 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.262 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.262 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.262 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:06.262 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.262 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.263 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.263 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_nvmeof": { 2024-09-13T16:13:06.263 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_nvmeof", 2024-09-13T16:13:06.263 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.263 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.263 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.263 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T16:13:06.263 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.263 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.263 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.263 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Nvme-of container image", 2024-09-13T16:13:06.263 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.263 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.264 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.264 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_prometheus": { 2024-09-13T16:13:06.264 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_prometheus", 2024-09-13T16:13:06.264 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.264 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.264 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.264 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T16:13:06.264 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.264 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.264 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.264 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:06.264 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.264 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.265 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.265 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_promtail": { 2024-09-13T16:13:06.265 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_promtail", 2024-09-13T16:13:06.265 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.265 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.265 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.265 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T16:13:06.265 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.265 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.265 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.265 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Promtail container image", 2024-09-13T16:13:06.265 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.265 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.266 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.266 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_snmp_gateway": { 2024-09-13T16:13:06.266 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_snmp_gateway", 2024-09-13T16:13:06.266 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.266 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.266 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.266 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T16:13:06.266 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.266 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.266 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.266 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SNMP Gateway container image", 2024-09-13T16:13:06.267 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.267 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.267 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.267 INFO:teuthology.orchestra.run.smithi086.stdout: "container_init": { 2024-09-13T16:13:06.267 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_init", 2024-09-13T16:13:06.267 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.267 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.267 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.267 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.267 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.267 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.267 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.267 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T16:13:06.268 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.268 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.268 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.268 INFO:teuthology.orchestra.run.smithi086.stdout: "daemon_cache_timeout": { 2024-09-13T16:13:06.268 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "daemon_cache_timeout", 2024-09-13T16:13:06.268 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.268 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.268 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.268 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-09-13T16:13:06.268 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.268 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.268 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.269 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T16:13:06.269 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.269 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.269 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.269 INFO:teuthology.orchestra.run.smithi086.stdout: "default_cephadm_command_timeout": { 2024-09-13T16:13:06.269 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T16:13:06.269 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.269 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.269 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.269 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "900", 2024-09-13T16:13:06.269 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.269 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.269 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.270 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T16:13:06.270 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.270 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.270 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.270 INFO:teuthology.orchestra.run.smithi086.stdout: "default_registry": { 2024-09-13T16:13:06.270 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "default_registry", 2024-09-13T16:13:06.270 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.270 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.270 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.270 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io", 2024-09-13T16:13:06.270 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.271 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.271 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.271 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T16:13:06.271 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.271 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.271 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.271 INFO:teuthology.orchestra.run.smithi086.stdout: "device_cache_timeout": { 2024-09-13T16:13:06.271 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "device_cache_timeout", 2024-09-13T16:13:06.271 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.271 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.271 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.271 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "1800", 2024-09-13T16:13:06.272 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.272 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.272 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.272 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "seconds to cache device inventory", 2024-09-13T16:13:06.272 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.272 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.272 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.272 INFO:teuthology.orchestra.run.smithi086.stdout: "device_enhanced_scan": { 2024-09-13T16:13:06.272 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "device_enhanced_scan", 2024-09-13T16:13:06.272 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.272 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T16:13:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: "facts_cache_timeout": { 2024-09-13T16:13:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "facts_cache_timeout", 2024-09-13T16:13:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-09-13T16:13:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "seconds to cache host facts data", 2024-09-13T16:13:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "host_check_interval": { 2024-09-13T16:13:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "host_check_interval", 2024-09-13T16:13:06.275 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.275 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.275 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.275 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-09-13T16:13:06.275 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.275 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.275 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.275 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to perform a host check", 2024-09-13T16:13:06.275 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.275 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.275 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: "hw_monitoring": { 2024-09-13T16:13:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "hw_monitoring", 2024-09-13T16:13:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T16:13:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: "inventory_list_all": { 2024-09-13T16:13:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "inventory_list_all", 2024-09-13T16:13:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T16:13:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.279 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.279 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.279 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.279 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.279 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.279 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.279 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.279 INFO:teuthology.orchestra.run.smithi086.stdout: "log_refresh_metadata": { 2024-09-13T16:13:06.279 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_refresh_metadata", 2024-09-13T16:13:06.279 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.279 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T16:13:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T16:13:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.284 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.284 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.284 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.284 INFO:teuthology.orchestra.run.smithi086.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T16:13:06.284 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T16:13:06.284 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.284 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.284 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.284 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.284 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.284 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.284 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.285 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T16:13:06.285 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.285 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.285 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.285 INFO:teuthology.orchestra.run.smithi086.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T16:13:06.285 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T16:13:06.285 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.285 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.285 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.285 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "*", 2024-09-13T16:13:06.285 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.286 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.286 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.286 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T16:13:06.286 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.286 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.286 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.286 INFO:teuthology.orchestra.run.smithi086.stdout: "max_count_per_host": { 2024-09-13T16:13:06.286 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_count_per_host", 2024-09-13T16:13:06.286 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.286 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.286 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.286 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:06.287 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.287 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.287 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.287 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "max number of daemons per service per host", 2024-09-13T16:13:06.287 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.287 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.287 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.287 INFO:teuthology.orchestra.run.smithi086.stdout: "max_osd_draining_count": { 2024-09-13T16:13:06.287 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_osd_draining_count", 2024-09-13T16:13:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T16:13:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: "migration_current": { 2024-09-13T16:13:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "migration_current", 2024-09-13T16:13:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "internal - do not modify", 2024-09-13T16:13:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: "mode": { 2024-09-13T16:13:06.290 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mode", 2024-09-13T16:13:06.290 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.290 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.290 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.290 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "root", 2024-09-13T16:13:06.290 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.290 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.290 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.290 INFO:teuthology.orchestra.run.smithi086.stdout: "cephadm-package", 2024-09-13T16:13:06.290 INFO:teuthology.orchestra.run.smithi086.stdout: "root" 2024-09-13T16:13:06.290 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.290 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T16:13:06.290 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.291 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.291 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.291 INFO:teuthology.orchestra.run.smithi086.stdout: "oob_default_addr": { 2024-09-13T16:13:06.291 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "oob_default_addr", 2024-09-13T16:13:06.291 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.291 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.291 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.291 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "169.254.1.1", 2024-09-13T16:13:06.291 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.291 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.291 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.291 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T16:13:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: "prometheus_alerts_path": { 2024-09-13T16:13:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "prometheus_alerts_path", 2024-09-13T16:13:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T16:13:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T16:13:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_insecure": { 2024-09-13T16:13:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_insecure", 2024-09-13T16:13:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T16:13:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_password": { 2024-09-13T16:13:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_password", 2024-09-13T16:13:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T16:13:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_url": { 2024-09-13T16:13:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_url", 2024-09-13T16:13:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T16:13:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_username": { 2024-09-13T16:13:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_username", 2024-09-13T16:13:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T16:13:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: "secure_monitoring_stack": { 2024-09-13T16:13:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "secure_monitoring_stack", 2024-09-13T16:13:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T16:13:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: "service_discovery_port": { 2024-09-13T16:13:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "service_discovery_port", 2024-09-13T16:13:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8765", 2024-09-13T16:13:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "cephadm service discovery port", 2024-09-13T16:13:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: "ssh_config_file": { 2024-09-13T16:13:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssh_config_file", 2024-09-13T16:13:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T16:13:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "use_agent": { 2024-09-13T16:13:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "use_agent", 2024-09-13T16:13:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T16:13:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "use_repo_digest": { 2024-09-13T16:13:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "use_repo_digest", 2024-09-13T16:13:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T16:13:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_on_failed_host_check": { 2024-09-13T16:13:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_on_failed_host_check", 2024-09-13T16:13:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T16:13:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_on_stray_daemons": { 2024-09-13T16:13:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_on_stray_daemons", 2024-09-13T16:13:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T16:13:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_on_stray_hosts": { 2024-09-13T16:13:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_on_stray_hosts", 2024-09-13T16:13:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T16:13:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crash", 2024-09-13T16:13:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "retain_interval": { 2024-09-13T16:13:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "retain_interval", 2024-09-13T16:13:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "31536000", 2024-09-13T16:13:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T16:13:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_recent_interval": { 2024-09-13T16:13:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_recent_interval", 2024-09-13T16:13:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "1209600", 2024-09-13T16:13:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T16:13:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "dashboard", 2024-09-13T16:13:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T16:13:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T16:13:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T16:13:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T16:13:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T16:13:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T16:13:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "AUDIT_API_ENABLED": { 2024-09-13T16:13:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T16:13:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T16:13:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T16:13:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T16:13:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T16:13:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T16:13:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T16:13:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T16:13:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T16:13:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T16:13:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T16:13:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T16:13:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T16:13:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T16:13:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T16:13:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T16:13:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T16:13:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T16:13:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T16:13:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T16:13:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T16:13:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T16:13:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T16:13:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "admin", 2024-09-13T16:13:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T16:13:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T16:13:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_URL": { 2024-09-13T16:13:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_URL", 2024-09-13T16:13:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T16:13:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T16:13:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "admin", 2024-09-13T16:13:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T16:13:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T16:13:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T16:13:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T16:13:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T16:13:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T16:13:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T16:13:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T16:13:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T16:13:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T16:13:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T16:13:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T16:13:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T16:13:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T16:13:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T16:13:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T16:13:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T16:13:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T16:13:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T16:13:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T16:13:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T16:13:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T16:13:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T16:13:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T16:13:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T16:13:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T16:13:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T16:13:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T16:13:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T16:13:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T16:13:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T16:13:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T16:13:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T16:13:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T16:13:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T16:13:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8", 2024-09-13T16:13:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T16:13:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T16:13:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "45", 2024-09-13T16:13:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T16:13:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T16:13:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T16:13:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T16:13:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "admin", 2024-09-13T16:13:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T16:13:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T16:13:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T16:13:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T16:13:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T16:13:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T16:13:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T16:13:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T16:13:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-09-13T16:13:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T16:13:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T16:13:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T16:13:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T16:13:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-09-13T16:13:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "cross_origin_url": { 2024-09-13T16:13:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cross_origin_url", 2024-09-13T16:13:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "crt_file": { 2024-09-13T16:13:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crt_file", 2024-09-13T16:13:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "debug": { 2024-09-13T16:13:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "debug", 2024-09-13T16:13:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Enable/disable debug options", 2024-09-13T16:13:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "jwt_token_ttl": { 2024-09-13T16:13:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "jwt_token_ttl", 2024-09-13T16:13:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "28800", 2024-09-13T16:13:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "key_file": { 2024-09-13T16:13:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "key_file", 2024-09-13T16:13:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "motd": { 2024-09-13T16:13:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "motd", 2024-09-13T16:13:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "The message of the day", 2024-09-13T16:13:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "redirect_resolve_ip_addr": { 2024-09-13T16:13:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T16:13:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "server_addr": { 2024-09-13T16:13:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_addr", 2024-09-13T16:13:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "::", 2024-09-13T16:13:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "server_port": { 2024-09-13T16:13:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_port", 2024-09-13T16:13:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8080", 2024-09-13T16:13:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "ssl": { 2024-09-13T16:13:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssl", 2024-09-13T16:13:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "ssl_server_port": { 2024-09-13T16:13:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssl_server_port", 2024-09-13T16:13:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8443", 2024-09-13T16:13:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_behaviour": { 2024-09-13T16:13:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_behaviour", 2024-09-13T16:13:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "redirect", 2024-09-13T16:13:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "redirect" 2024-09-13T16:13:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_error_status_code": { 2024-09-13T16:13:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_error_status_code", 2024-09-13T16:13:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "500", 2024-09-13T16:13:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "400", 2024-09-13T16:13:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "599", 2024-09-13T16:13:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "url_prefix": { 2024-09-13T16:13:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "url_prefix", 2024-09-13T16:13:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "devicehealth", 2024-09-13T16:13:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: "enable_monitoring": { 2024-09-13T16:13:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enable_monitoring", 2024-09-13T16:13:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "monitor device health metrics", 2024-09-13T16:13:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "mark_out_threshold": { 2024-09-13T16:13:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mark_out_threshold", 2024-09-13T16:13:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "2419200", 2024-09-13T16:13:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T16:13:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "pool_name": { 2024-09-13T16:13:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pool_name", 2024-09-13T16:13:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "device_health_metrics", 2024-09-13T16:13:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T16:13:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: "retention_period": { 2024-09-13T16:13:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "retention_period", 2024-09-13T16:13:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "15552000", 2024-09-13T16:13:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how long to retain device health metrics", 2024-09-13T16:13:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "scrape_frequency": { 2024-09-13T16:13:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "scrape_frequency", 2024-09-13T16:13:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "86400", 2024-09-13T16:13:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T16:13:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "self_heal": { 2024-09-13T16:13:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "self_heal", 2024-09-13T16:13:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T16:13:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-09-13T16:13:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-09-13T16:13:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-09-13T16:13:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T16:13:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_threshold": { 2024-09-13T16:13:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_threshold", 2024-09-13T16:13:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "7257600", 2024-09-13T16:13:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T16:13:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "diskprediction_local", 2024-09-13T16:13:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.397 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.397 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.397 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.397 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.397 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.397 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.397 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.397 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.397 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.397 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.397 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.397 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.397 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.398 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.398 INFO:teuthology.orchestra.run.smithi086.stdout: "predict_interval": { 2024-09-13T16:13:06.398 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "predict_interval", 2024-09-13T16:13:06.398 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.398 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.398 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.398 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "86400", 2024-09-13T16:13:06.398 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.398 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.398 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.398 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.398 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.398 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.399 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.399 INFO:teuthology.orchestra.run.smithi086.stdout: "predictor_model": { 2024-09-13T16:13:06.399 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "predictor_model", 2024-09-13T16:13:06.399 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.399 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.399 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.399 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "prophetstor", 2024-09-13T16:13:06.399 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.399 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.399 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.399 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.399 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.399 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.399 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.400 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-09-13T16:13:06.400 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-09-13T16:13:06.400 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.400 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.400 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.400 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-09-13T16:13:06.400 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.400 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.400 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.400 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.400 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.400 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.401 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.401 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.401 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.401 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "influx", 2024-09-13T16:13:06.401 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": false, 2024-09-13T16:13:06.401 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "influxdb python module not found", 2024-09-13T16:13:06.401 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.401 INFO:teuthology.orchestra.run.smithi086.stdout: "batch_size": { 2024-09-13T16:13:06.401 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "batch_size", 2024-09-13T16:13:06.401 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.401 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.401 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5000", 2024-09-13T16:13:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T16:13:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: "database": { 2024-09-13T16:13:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "database", 2024-09-13T16:13:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "ceph", 2024-09-13T16:13:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T16:13:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: "hostname": { 2024-09-13T16:13:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "hostname", 2024-09-13T16:13:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.404 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.404 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.404 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.404 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.404 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "InfluxDB server hostname", 2024-09-13T16:13:06.404 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.404 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.404 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.404 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-09-13T16:13:06.405 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-09-13T16:13:06.405 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.405 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.405 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.405 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "30", 2024-09-13T16:13:06.405 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "5", 2024-09-13T16:13:06.405 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.405 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.405 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T16:13:06.405 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.405 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.405 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.406 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.406 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.406 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.406 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.406 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.406 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.406 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.406 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.406 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.406 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.406 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.406 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.407 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.407 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.407 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.407 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.407 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.407 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.407 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.407 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.407 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.407 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.407 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.407 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.407 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.408 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.408 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.408 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.408 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.408 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.408 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.408 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.408 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.408 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.408 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.408 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.408 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.409 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.409 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.409 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.409 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.409 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.409 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.409 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.409 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.409 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.409 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.409 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.409 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.409 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.409 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.410 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.410 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.410 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.410 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.410 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.410 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.410 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.410 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.410 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.410 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.410 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.410 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.410 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.410 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.411 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.411 INFO:teuthology.orchestra.run.smithi086.stdout: "password": { 2024-09-13T16:13:06.411 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "password", 2024-09-13T16:13:06.411 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.411 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.411 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.411 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.411 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.411 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.411 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.411 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "password of InfluxDB server user", 2024-09-13T16:13:06.411 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.411 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.412 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.412 INFO:teuthology.orchestra.run.smithi086.stdout: "port": { 2024-09-13T16:13:06.412 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "port", 2024-09-13T16:13:06.412 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.412 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.412 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.412 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8086", 2024-09-13T16:13:06.412 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.412 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.412 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.412 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "InfluxDB server port", 2024-09-13T16:13:06.412 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.413 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.413 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.413 INFO:teuthology.orchestra.run.smithi086.stdout: "ssl": { 2024-09-13T16:13:06.413 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssl", 2024-09-13T16:13:06.413 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.413 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.413 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.413 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "false", 2024-09-13T16:13:06.413 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.413 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.413 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.413 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T16:13:06.413 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.413 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.414 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.414 INFO:teuthology.orchestra.run.smithi086.stdout: "threads": { 2024-09-13T16:13:06.414 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "threads", 2024-09-13T16:13:06.414 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.414 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.414 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.414 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-09-13T16:13:06.414 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-09-13T16:13:06.414 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "32", 2024-09-13T16:13:06.414 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.414 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T16:13:06.414 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.414 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.415 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.415 INFO:teuthology.orchestra.run.smithi086.stdout: "username": { 2024-09-13T16:13:06.415 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "username", 2024-09-13T16:13:06.415 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.415 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.415 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.415 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.415 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.415 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.415 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.415 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "username of InfluxDB server user", 2024-09-13T16:13:06.415 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.415 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.415 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.416 INFO:teuthology.orchestra.run.smithi086.stdout: "verify_ssl": { 2024-09-13T16:13:06.416 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "verify_ssl", 2024-09-13T16:13:06.416 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.416 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.416 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.416 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "true", 2024-09-13T16:13:06.416 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.416 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.416 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.416 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T16:13:06.416 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.416 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.416 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.417 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.417 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.417 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "insights", 2024-09-13T16:13:06.417 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.417 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.417 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.417 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.417 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.417 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.417 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.417 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.417 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.418 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.418 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.418 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.418 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.418 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.418 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.418 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.418 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.418 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.418 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.418 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.418 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.418 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.418 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.419 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.419 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.419 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.419 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.419 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.419 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.419 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.419 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.419 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.419 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.419 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.419 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.420 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.420 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.420 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.420 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.420 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.420 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.420 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.420 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.420 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.420 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.420 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.420 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.420 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.421 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.421 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.421 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.421 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.421 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.421 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.421 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.421 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.421 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.421 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.421 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.421 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.421 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.422 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.422 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.422 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.422 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.422 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.422 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.422 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.422 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.422 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.422 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.422 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "iostat", 2024-09-13T16:13:06.422 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.423 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.423 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.423 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.423 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.423 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.423 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.423 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.423 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.423 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.423 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.423 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.423 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.423 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.423 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.424 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.424 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.424 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.424 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.424 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.424 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.424 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.424 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.424 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.424 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.424 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.424 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.424 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.425 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.425 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.425 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.425 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.425 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.425 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.425 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.425 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.425 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.425 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.425 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.425 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.425 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.426 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.426 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.426 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.426 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.426 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.426 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.426 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.426 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.426 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.426 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.426 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.426 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.426 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.426 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.427 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.427 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.427 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.427 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.427 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.427 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.427 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.427 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.427 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.427 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.427 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.427 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.427 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.428 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.428 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.428 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.428 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "k8sevents", 2024-09-13T16:13:06.428 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.428 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.428 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.428 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_event_retention_days": { 2024-09-13T16:13:06.428 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ceph_event_retention_days", 2024-09-13T16:13:06.428 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.428 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.428 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.429 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "7", 2024-09-13T16:13:06.429 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.429 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.429 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.429 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-13T16:13:06.429 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.429 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.429 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.429 INFO:teuthology.orchestra.run.smithi086.stdout: "config_check_secs": { 2024-09-13T16:13:06.429 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "config_check_secs", 2024-09-13T16:13:06.429 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.429 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.429 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.430 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:06.430 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "10", 2024-09-13T16:13:06.430 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.430 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.430 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-13T16:13:06.430 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.430 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.430 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.430 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.430 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.430 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.430 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.430 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.431 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.431 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.431 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.431 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.431 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.431 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.431 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.431 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.431 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.431 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.431 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.431 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.431 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.431 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.432 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.432 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.432 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.432 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.432 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.432 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.432 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.432 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.432 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.432 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.432 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.432 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.432 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.433 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.433 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.433 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.433 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.433 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.433 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.433 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.433 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.433 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.433 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.433 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.433 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.434 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.434 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.434 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.434 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.434 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.434 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.434 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.434 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.434 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.434 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.434 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.434 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.434 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.435 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.435 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.435 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.435 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.435 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.435 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.435 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.436 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.436 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.436 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.436 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.436 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "localpool", 2024-09-13T16:13:06.436 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.437 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.437 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.437 INFO:teuthology.orchestra.run.smithi086.stdout: "failure_domain": { 2024-09-13T16:13:06.437 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "failure_domain", 2024-09-13T16:13:06.437 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.437 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.437 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.437 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "host", 2024-09-13T16:13:06.437 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.437 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.437 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.437 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "failure domain for any created local pool", 2024-09-13T16:13:06.437 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T16:13:06.437 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.438 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.438 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.438 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.438 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.438 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.438 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.438 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.438 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.438 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.438 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.438 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.438 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.438 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.439 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.439 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.439 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.439 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.439 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.439 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.439 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.439 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.439 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.439 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.439 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.439 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.439 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.439 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.440 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.440 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.440 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.440 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.440 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.440 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.440 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.440 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.440 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.440 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.440 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.440 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.441 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.441 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.441 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.441 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.441 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.441 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.441 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.441 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.441 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.441 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.441 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.441 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.441 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.441 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.442 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.442 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.442 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.442 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.442 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.442 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.442 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.442 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.442 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.442 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.442 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.442 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.443 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.443 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.443 INFO:teuthology.orchestra.run.smithi086.stdout: "min_size": { 2024-09-13T16:13:06.443 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "min_size", 2024-09-13T16:13:06.443 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.443 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.443 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.443 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.443 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.443 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.443 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.443 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "default min_size for any created local pool", 2024-09-13T16:13:06.443 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T16:13:06.444 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.444 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.444 INFO:teuthology.orchestra.run.smithi086.stdout: "num_rep": { 2024-09-13T16:13:06.444 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "num_rep", 2024-09-13T16:13:06.444 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.444 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.444 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.444 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "3", 2024-09-13T16:13:06.444 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.444 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.444 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.444 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "default replica count for any created local pool", 2024-09-13T16:13:06.445 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.445 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.445 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.445 INFO:teuthology.orchestra.run.smithi086.stdout: "pg_num": { 2024-09-13T16:13:06.445 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pg_num", 2024-09-13T16:13:06.445 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.445 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.445 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.445 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "128", 2024-09-13T16:13:06.445 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.445 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.445 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.445 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T16:13:06.446 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.446 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.446 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.446 INFO:teuthology.orchestra.run.smithi086.stdout: "prefix": { 2024-09-13T16:13:06.446 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "prefix", 2024-09-13T16:13:06.446 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.446 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.446 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.446 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.446 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.446 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.446 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.447 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "name prefix for any created local pool", 2024-09-13T16:13:06.447 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.447 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.447 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.447 INFO:teuthology.orchestra.run.smithi086.stdout: "subtree": { 2024-09-13T16:13:06.447 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "subtree", 2024-09-13T16:13:06.447 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.447 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.447 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.447 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "rack", 2024-09-13T16:13:06.447 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.447 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.448 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.448 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T16:13:06.448 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T16:13:06.448 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.448 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.448 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.448 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.448 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mds_autoscaler", 2024-09-13T16:13:06.448 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.448 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.448 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.449 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.449 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.449 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.449 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.449 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.449 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.449 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.449 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.449 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.449 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.449 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.449 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.449 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.449 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.450 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.450 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.450 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.450 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.450 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.450 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.450 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.450 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.450 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.450 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.450 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.450 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.451 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.451 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.451 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.451 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.451 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.451 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.451 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.451 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.451 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.451 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.451 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.451 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.451 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.452 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.452 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.452 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.452 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.452 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.452 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.452 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.452 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.452 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.452 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.452 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.452 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.452 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.453 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.453 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.453 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.453 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.453 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.453 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.453 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.453 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.453 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.453 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.453 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.453 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.454 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.454 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.454 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.454 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.454 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mirroring", 2024-09-13T16:13:06.454 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.454 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.454 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.454 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.454 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.454 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.455 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.455 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.455 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.455 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.455 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.455 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.455 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.455 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.455 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.455 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.455 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.455 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.456 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.456 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.456 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.456 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.456 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.456 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.456 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.456 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.456 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.456 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.456 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.456 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.456 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.457 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.457 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.457 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.457 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.457 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.457 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.457 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.457 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.457 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.457 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.457 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.457 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.457 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.458 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.458 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.458 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.458 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.458 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.458 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.458 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.458 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.458 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.458 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.458 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.458 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.458 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.459 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.459 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.459 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.459 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.459 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.459 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.459 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.459 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.459 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.459 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.459 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.459 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.459 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.459 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.460 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "nfs", 2024-09-13T16:13:06.460 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.460 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.460 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.460 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.460 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.460 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.460 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.460 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.460 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.460 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.460 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.460 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.461 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.461 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.461 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.461 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.461 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.461 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.461 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.461 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.461 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.461 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.461 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.461 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.461 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.462 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.462 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.462 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.462 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.462 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.462 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.462 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.462 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.462 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.462 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.462 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.463 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.463 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.463 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.463 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.463 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.463 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.463 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.463 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.463 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.463 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.463 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.463 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.463 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.463 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.464 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.464 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.464 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.464 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.464 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.464 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.464 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.464 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.464 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.464 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.464 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.464 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.465 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.465 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.465 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.465 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.465 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.465 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.465 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.465 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.465 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.465 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "orchestrator", 2024-09-13T16:13:06.465 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.465 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.466 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.466 INFO:teuthology.orchestra.run.smithi086.stdout: "fail_fs": { 2024-09-13T16:13:06.466 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "fail_fs", 2024-09-13T16:13:06.466 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.466 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.466 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.466 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.466 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.466 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.466 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.466 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T16:13:06.466 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.466 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.466 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.467 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.467 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.467 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.467 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.467 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.467 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.467 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.467 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.467 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.467 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.467 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.467 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.468 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.468 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.468 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.468 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.468 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.468 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.468 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.468 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.468 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.468 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.468 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.468 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.468 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.469 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.469 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.469 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.469 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.469 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.469 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.469 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.469 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.469 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.469 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.469 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.469 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.470 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.470 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.470 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.470 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.470 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.470 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.470 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.470 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.470 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.470 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.470 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.470 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.470 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.471 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.471 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.471 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.471 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.471 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.471 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.471 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.471 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.471 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.471 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.471 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.471 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.471 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.471 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.472 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.472 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.472 INFO:teuthology.orchestra.run.smithi086.stdout: "orchestrator": { 2024-09-13T16:13:06.472 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "orchestrator", 2024-09-13T16:13:06.472 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.472 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.472 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.472 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.472 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.472 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.472 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.472 INFO:teuthology.orchestra.run.smithi086.stdout: "cephadm", 2024-09-13T16:13:06.472 INFO:teuthology.orchestra.run.smithi086.stdout: "rook", 2024-09-13T16:13:06.473 INFO:teuthology.orchestra.run.smithi086.stdout: "test_orchestrator" 2024-09-13T16:13:06.473 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.473 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Orchestrator backend", 2024-09-13T16:13:06.473 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.473 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.473 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.473 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.473 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.473 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "osd_perf_query", 2024-09-13T16:13:06.473 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.473 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.473 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.474 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.474 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.474 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.474 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.474 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.474 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.474 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.474 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.474 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.474 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.474 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.474 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.474 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.474 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.475 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.475 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.475 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.475 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.475 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.475 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.475 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.475 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.475 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.475 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.475 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.475 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.475 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.476 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.476 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.476 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.476 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.476 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.476 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.476 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.476 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.476 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.476 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.476 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.477 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.477 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.477 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.477 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.477 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.477 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.477 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.477 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.477 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.477 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.477 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.477 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.477 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.477 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.478 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.478 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.478 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.478 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.478 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.478 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.478 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.478 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.478 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.478 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.478 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.478 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.478 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.478 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.479 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.479 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.479 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "osd_support", 2024-09-13T16:13:06.479 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.479 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.479 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.479 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.479 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.479 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.479 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.479 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.479 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.480 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.480 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.480 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.480 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.480 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.480 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.480 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.480 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.480 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.480 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.480 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.480 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.480 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.480 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.481 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.481 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.481 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.481 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.481 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.481 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.481 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.481 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.481 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.481 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.481 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.481 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.482 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.482 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.482 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.482 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.482 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.482 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.482 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.482 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.482 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.482 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.482 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.482 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.482 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.483 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.483 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.483 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.483 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.483 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.483 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.483 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.483 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.483 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.483 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.483 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.483 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.483 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.484 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.484 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.484 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.484 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.484 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.484 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.484 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.484 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.484 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.484 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.484 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pg_autoscaler", 2024-09-13T16:13:06.484 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.485 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.485 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.485 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.485 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.485 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.485 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.485 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.485 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.485 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.485 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.485 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.485 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.485 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.485 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-09-13T16:13:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-09-13T16:13:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-09-13T16:13:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "threshold": { 2024-09-13T16:13:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "threshold", 2024-09-13T16:13:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "3.0", 2024-09-13T16:13:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1.0", 2024-09-13T16:13:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "scaling threshold", 2024-09-13T16:13:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T16:13:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "progress", 2024-09-13T16:13:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: "allow_pg_recovery_event": { 2024-09-13T16:13:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "allow_pg_recovery_event", 2024-09-13T16:13:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T16:13:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "enabled": { 2024-09-13T16:13:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enabled", 2024-09-13T16:13:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "max_completed_events": { 2024-09-13T16:13:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_completed_events", 2024-09-13T16:13:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "50", 2024-09-13T16:13:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "number of past completed events to remember", 2024-09-13T16:13:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-09-13T16:13:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-09-13T16:13:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-09-13T16:13:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how long the module is going to sleep", 2024-09-13T16:13:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "prometheus", 2024-09-13T16:13:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "cache": { 2024-09-13T16:13:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cache", 2024-09-13T16:13:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "exclude_perf_counters": { 2024-09-13T16:13:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "exclude_perf_counters", 2024-09-13T16:13:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T16:13:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T16:13:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_stats_pools": { 2024-09-13T16:13:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_stats_pools", 2024-09-13T16:13:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T16:13:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T16:13:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "300", 2024-09-13T16:13:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "scrape_interval": { 2024-09-13T16:13:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "scrape_interval", 2024-09-13T16:13:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "15.0", 2024-09-13T16:13:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "server_addr": { 2024-09-13T16:13:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_addr", 2024-09-13T16:13:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "::", 2024-09-13T16:13:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T16:13:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "server_port": { 2024-09-13T16:13:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_port", 2024-09-13T16:13:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "9283", 2024-09-13T16:13:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T16:13:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "stale_cache_strategy": { 2024-09-13T16:13:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "stale_cache_strategy", 2024-09-13T16:13:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "log", 2024-09-13T16:13:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_behaviour": { 2024-09-13T16:13:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_behaviour", 2024-09-13T16:13:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "default", 2024-09-13T16:13:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "default", 2024-09-13T16:13:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "error" 2024-09-13T16:13:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_error_status_code": { 2024-09-13T16:13:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_error_status_code", 2024-09-13T16:13:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "500", 2024-09-13T16:13:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "400", 2024-09-13T16:13:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "599", 2024-09-13T16:13:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_support", 2024-09-13T16:13:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "max_concurrent_snap_create": { 2024-09-13T16:13:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_concurrent_snap_create", 2024-09-13T16:13:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "mirror_snapshot_schedule": { 2024-09-13T16:13:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T16:13:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "trash_purge_schedule": { 2024-09-13T16:13:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "trash_purge_schedule", 2024-09-13T16:13:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "restful", 2024-09-13T16:13:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "enable_auth": { 2024-09-13T16:13:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enable_auth", 2024-09-13T16:13:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "key_file": { 2024-09-13T16:13:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "key_file", 2024-09-13T16:13:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "server_addr": { 2024-09-13T16:13:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_addr", 2024-09-13T16:13:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "server_port": { 2024-09-13T16:13:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_port", 2024-09-13T16:13:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rgw", 2024-09-13T16:13:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rook", 2024-09-13T16:13:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "storage_class": { 2024-09-13T16:13:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "storage_class", 2024-09-13T16:13:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "local", 2024-09-13T16:13:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-13T16:13:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "selftest", 2024-09-13T16:13:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "roption1": { 2024-09-13T16:13:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "roption1", 2024-09-13T16:13:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "roption2": { 2024-09-13T16:13:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "roption2", 2024-09-13T16:13:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "xyz", 2024-09-13T16:13:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption1": { 2024-09-13T16:13:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption1", 2024-09-13T16:13:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption2": { 2024-09-13T16:13:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption2", 2024-09-13T16:13:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption3": { 2024-09-13T16:13:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption3", 2024-09-13T16:13:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption4": { 2024-09-13T16:13:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption4", 2024-09-13T16:13:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption5": { 2024-09-13T16:13:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption5", 2024-09-13T16:13:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption6": { 2024-09-13T16:13:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption6", 2024-09-13T16:13:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption7": { 2024-09-13T16:13:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption7", 2024-09-13T16:13:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-09-13T16:13:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "42", 2024-09-13T16:13:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "testkey": { 2024-09-13T16:13:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "testkey", 2024-09-13T16:13:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "testlkey": { 2024-09-13T16:13:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "testlkey", 2024-09-13T16:13:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "testnewline": { 2024-09-13T16:13:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "testnewline", 2024-09-13T16:13:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snap_schedule", 2024-09-13T16:13:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: "allow_m_granularity": { 2024-09-13T16:13:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "allow_m_granularity", 2024-09-13T16:13:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T16:13:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "dump_on_update": { 2024-09-13T16:13:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "dump_on_update", 2024-09-13T16:13:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "dump database to debug log on update", 2024-09-13T16:13:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "stats", 2024-09-13T16:13:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "status", 2024-09-13T16:13:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.581 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.581 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.581 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.581 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.581 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.581 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.581 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.581 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.581 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.581 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.581 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.581 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.581 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.582 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.582 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.582 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.582 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.582 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.582 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.582 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.582 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.582 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.582 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.582 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.582 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.582 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.583 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.583 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.583 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.583 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.583 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.583 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.583 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.583 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.583 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.583 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.583 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.583 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.583 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.584 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.584 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.584 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.584 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.584 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.584 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.584 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.584 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.584 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.584 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.584 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.584 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.584 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.584 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.585 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.585 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.585 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.585 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.585 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.585 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.585 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.585 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.585 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "telegraf", 2024-09-13T16:13:06.585 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.585 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.585 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.586 INFO:teuthology.orchestra.run.smithi086.stdout: "address": { 2024-09-13T16:13:06.586 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "address", 2024-09-13T16:13:06.586 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.586 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.586 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.586 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T16:13:06.586 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.586 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.586 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.586 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.586 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.586 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.586 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.586 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-09-13T16:13:06.587 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-09-13T16:13:06.587 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.587 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.587 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.587 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "15", 2024-09-13T16:13:06.587 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.587 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.587 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.587 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.587 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.587 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.587 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.587 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.588 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.588 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.588 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.588 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.588 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.588 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.588 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.588 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.588 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.588 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.588 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.588 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.588 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.588 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.589 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.589 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.589 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.589 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.589 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.589 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.589 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.589 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.589 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.589 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.589 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.590 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.590 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.590 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.590 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.590 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.590 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.590 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.590 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.590 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.590 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.590 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.590 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.590 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.591 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.591 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.591 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.591 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.591 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.591 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.591 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.591 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.591 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.591 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.591 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.591 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.591 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.591 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.592 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.592 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.592 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.592 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.592 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.592 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.592 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.592 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.592 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.592 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.592 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.592 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.592 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.593 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.593 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.596 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "telemetry", 2024-09-13T16:13:06.596 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.596 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.596 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.596 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_basic": { 2024-09-13T16:13:06.596 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_basic", 2024-09-13T16:13:06.596 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.597 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.597 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.597 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.597 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.597 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.597 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.597 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T16:13:06.597 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.597 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.597 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.597 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_crash": { 2024-09-13T16:13:06.597 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_crash", 2024-09-13T16:13:06.598 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.598 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.598 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.598 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.598 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.598 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.598 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.598 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T16:13:06.598 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.598 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.599 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.599 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_device": { 2024-09-13T16:13:06.599 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_device", 2024-09-13T16:13:06.599 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.599 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.599 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.599 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.599 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.599 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.599 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.599 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T16:13:06.599 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.600 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.600 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.600 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_ident": { 2024-09-13T16:13:06.600 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_ident", 2024-09-13T16:13:06.600 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.600 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.600 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.600 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.600 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.600 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.600 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.600 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T16:13:06.601 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.601 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.601 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.601 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_perf": { 2024-09-13T16:13:06.601 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_perf", 2024-09-13T16:13:06.601 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.601 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.601 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.601 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.601 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.601 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.601 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.602 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T16:13:06.602 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.602 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.602 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.602 INFO:teuthology.orchestra.run.smithi086.stdout: "contact": { 2024-09-13T16:13:06.602 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "contact", 2024-09-13T16:13:06.602 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.602 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.602 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.602 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.603 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.603 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.603 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.603 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.603 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.603 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.603 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.603 INFO:teuthology.orchestra.run.smithi086.stdout: "description": { 2024-09-13T16:13:06.603 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "description", 2024-09-13T16:13:06.603 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.603 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.603 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.603 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.604 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.604 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.604 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.604 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.604 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.604 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.604 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.604 INFO:teuthology.orchestra.run.smithi086.stdout: "device_url": { 2024-09-13T16:13:06.604 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "device_url", 2024-09-13T16:13:06.604 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.604 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.605 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.605 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T16:13:06.605 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.605 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.605 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.605 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.605 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.605 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.605 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.606 INFO:teuthology.orchestra.run.smithi086.stdout: "enabled": { 2024-09-13T16:13:06.606 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enabled", 2024-09-13T16:13:06.606 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.606 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.606 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.606 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.606 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.606 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.606 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.606 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.606 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.606 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.606 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.607 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-09-13T16:13:06.607 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-09-13T16:13:06.607 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.607 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.607 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.607 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "24", 2024-09-13T16:13:06.607 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "8", 2024-09-13T16:13:06.607 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.607 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.607 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.607 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.607 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.607 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.608 INFO:teuthology.orchestra.run.smithi086.stdout: "last_opt_revision": { 2024-09-13T16:13:06.608 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "last_opt_revision", 2024-09-13T16:13:06.608 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.608 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.608 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.608 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "1", 2024-09-13T16:13:06.608 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.608 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.608 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.608 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.608 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.608 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.609 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.609 INFO:teuthology.orchestra.run.smithi086.stdout: "leaderboard": { 2024-09-13T16:13:06.609 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "leaderboard", 2024-09-13T16:13:06.609 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.609 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.609 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.609 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.609 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.609 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.609 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.609 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.609 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.609 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.610 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.610 INFO:teuthology.orchestra.run.smithi086.stdout: "leaderboard_description": { 2024-09-13T16:13:06.610 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "leaderboard_description", 2024-09-13T16:13:06.610 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.610 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.610 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.610 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.610 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.610 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.610 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.610 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.610 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.611 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.611 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.611 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.611 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.611 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.611 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.611 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.611 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.611 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.611 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.611 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.611 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.611 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.611 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.612 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.612 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.612 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.612 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.612 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.612 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.612 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.612 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.612 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.612 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.612 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.612 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.612 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.613 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.613 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.613 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.613 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.613 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.613 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.613 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.613 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.613 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.613 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.613 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.613 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.613 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.614 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.614 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.614 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.614 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.614 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.614 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.614 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.614 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.614 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.614 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.614 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.614 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.614 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.614 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.615 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.615 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.615 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.615 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.615 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.615 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.615 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.615 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.615 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.615 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.615 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.615 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.615 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.616 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.616 INFO:teuthology.orchestra.run.smithi086.stdout: "organization": { 2024-09-13T16:13:06.616 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "organization", 2024-09-13T16:13:06.616 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.616 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.616 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.616 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.616 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.616 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.616 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.616 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.616 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.616 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.617 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.617 INFO:teuthology.orchestra.run.smithi086.stdout: "proxy": { 2024-09-13T16:13:06.617 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "proxy", 2024-09-13T16:13:06.617 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.617 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.617 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.617 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.617 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.617 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.617 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.617 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.617 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.617 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.617 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.618 INFO:teuthology.orchestra.run.smithi086.stdout: "url": { 2024-09-13T16:13:06.618 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "url", 2024-09-13T16:13:06.618 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.618 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.618 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.618 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T16:13:06.618 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.618 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.618 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.618 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.618 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.618 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.618 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.619 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.619 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.619 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "test_orchestrator", 2024-09-13T16:13:06.619 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.619 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.619 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.619 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.619 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.619 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.619 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.619 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.619 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.620 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.620 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.620 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.620 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.620 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.620 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.620 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.620 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.620 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.620 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.620 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.620 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.620 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.620 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.621 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.621 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.621 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.621 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.621 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.621 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.621 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.621 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.621 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.621 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.621 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.621 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.622 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.622 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.622 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.622 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.622 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.622 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.622 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.622 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.622 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.622 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.622 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.622 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.623 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.623 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.623 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.623 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.623 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.623 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.623 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.623 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.623 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.623 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.623 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.623 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.624 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.624 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.624 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.624 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.624 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.624 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.624 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.624 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.624 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.624 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.624 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.624 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.625 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "volumes", 2024-09-13T16:13:06.625 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.625 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.625 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.625 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.625 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.625 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.625 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.625 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.625 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.625 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.625 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.625 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.625 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.626 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.626 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.626 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.626 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.626 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.626 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.626 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.626 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.626 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.626 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.626 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.626 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.626 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.627 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.627 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.627 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.627 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.627 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.627 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.627 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.627 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.627 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.627 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.627 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.627 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.627 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.628 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.628 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.628 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.628 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.628 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.628 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.628 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.628 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.628 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.628 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.628 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.628 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.628 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.629 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.629 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.629 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.629 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.629 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.629 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.629 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.629 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.629 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.629 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.629 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.629 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.629 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.630 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.630 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.630 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.630 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.630 INFO:teuthology.orchestra.run.smithi086.stdout: "max_concurrent_clones": { 2024-09-13T16:13:06.630 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_concurrent_clones", 2024-09-13T16:13:06.630 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.630 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.630 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.630 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "4", 2024-09-13T16:13:06.630 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.630 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.630 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.631 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T16:13:06.631 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.631 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.631 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.631 INFO:teuthology.orchestra.run.smithi086.stdout: "snapshot_clone_delay": { 2024-09-13T16:13:06.631 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snapshot_clone_delay", 2024-09-13T16:13:06.631 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.631 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.631 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.631 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-09-13T16:13:06.631 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.631 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.631 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.632 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T16:13:06.632 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.632 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.632 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.632 INFO:teuthology.orchestra.run.smithi086.stdout: "snapshot_clone_no_wait": { 2024-09-13T16:13:06.632 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T16:13:06.632 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.632 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.632 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.632 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.632 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.632 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.633 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.633 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T16:13:06.633 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.633 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.633 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.633 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.633 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.633 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix", 2024-09-13T16:13:06.633 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.633 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.634 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.634 INFO:teuthology.orchestra.run.smithi086.stdout: "discovery_interval": { 2024-09-13T16:13:06.634 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "discovery_interval", 2024-09-13T16:13:06.634 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-09-13T16:13:06.634 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.634 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.634 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "100", 2024-09-13T16:13:06.634 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.634 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.634 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.634 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.634 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.634 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.634 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.635 INFO:teuthology.orchestra.run.smithi086.stdout: "identifier": { 2024-09-13T16:13:06.635 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "identifier", 2024-09-13T16:13:06.635 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.635 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.635 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.635 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.635 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.635 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.635 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.635 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.635 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.636 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.636 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.636 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-09-13T16:13:06.636 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-09-13T16:13:06.636 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.636 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.636 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.636 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-09-13T16:13:06.636 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.636 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.636 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.636 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.636 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.637 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.637 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.637 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.637 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.637 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.637 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.637 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.637 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.637 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.637 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.637 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.637 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.637 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.638 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.638 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.638 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.638 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.638 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.638 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.638 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.638 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.638 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.638 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.638 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.638 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.638 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.638 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.639 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.639 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.639 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.639 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.639 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.639 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.639 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.639 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.639 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.639 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.639 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.639 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.640 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.640 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.640 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.640 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.640 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.640 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.640 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.640 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.640 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.640 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.640 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.640 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.640 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.640 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.641 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.641 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.641 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.641 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.641 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.641 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.641 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.641 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.641 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.641 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.641 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.641 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.641 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.642 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.642 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.642 INFO:teuthology.orchestra.run.smithi086.stdout: "zabbix_host": { 2024-09-13T16:13:06.642 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix_host", 2024-09-13T16:13:06.642 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.642 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.642 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.642 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.642 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.642 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.642 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.642 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.642 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.643 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.643 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.643 INFO:teuthology.orchestra.run.smithi086.stdout: "zabbix_port": { 2024-09-13T16:13:06.643 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix_port", 2024-09-13T16:13:06.643 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.643 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.643 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.643 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10051", 2024-09-13T16:13:06.643 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.643 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.643 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.643 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.643 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.644 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.644 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.644 INFO:teuthology.orchestra.run.smithi086.stdout: "zabbix_sender": { 2024-09-13T16:13:06.644 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix_sender", 2024-09-13T16:13:06.644 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.644 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.644 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.644 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T16:13:06.644 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.644 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.644 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.644 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.644 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.645 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.645 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.645 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.645 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.645 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.645 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T16:13:06.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.645 INFO:teuthology.orchestra.run.smithi086.stdout: "gid": 24113, 2024-09-13T16:13:06.645 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "y", 2024-09-13T16:13:06.645 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_features": 4540138322906710015, 2024-09-13T16:13:06.645 INFO:teuthology.orchestra.run.smithi086.stdout: "available_modules": [ 2024-09-13T16:13:06.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.645 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "alerts", 2024-09-13T16:13:06.646 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.646 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.646 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.646 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-09-13T16:13:06.646 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-09-13T16:13:06.646 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.646 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.646 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.646 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-09-13T16:13:06.646 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.646 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.646 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.646 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T16:13:06.646 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.647 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.647 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.647 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.647 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.647 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.647 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.647 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.647 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.647 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.647 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.647 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.647 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.647 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.647 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.648 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.648 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.648 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.648 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.648 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.648 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.648 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.648 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.648 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.648 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.648 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.648 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.648 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.649 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.649 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.649 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.649 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.649 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.649 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.649 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.649 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.649 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.649 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.649 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.649 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.650 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.650 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.650 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.650 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.650 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.650 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.650 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.650 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.650 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.650 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.650 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.650 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.650 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.650 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.650 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.651 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.651 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.651 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.651 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.651 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.651 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.651 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.651 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.651 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.651 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.651 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.651 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.651 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.652 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.652 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_destination": { 2024-09-13T16:13:06.652 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_destination", 2024-09-13T16:13:06.652 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.652 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.652 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.652 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.652 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.652 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.652 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.652 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Email address to send alerts to", 2024-09-13T16:13:06.652 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.653 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.653 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.653 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_from_name": { 2024-09-13T16:13:06.653 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_from_name", 2024-09-13T16:13:06.653 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.653 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.653 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.653 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "Ceph", 2024-09-13T16:13:06.653 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.653 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.653 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.653 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Email From: name", 2024-09-13T16:13:06.653 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.654 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.654 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.654 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_host": { 2024-09-13T16:13:06.654 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_host", 2024-09-13T16:13:06.654 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.654 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.654 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.654 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.654 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.654 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.654 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.654 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SMTP server", 2024-09-13T16:13:06.654 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.654 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.655 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.655 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_password": { 2024-09-13T16:13:06.655 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_password", 2024-09-13T16:13:06.655 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.655 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.655 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.655 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.655 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.655 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.655 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.655 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Password to authenticate with", 2024-09-13T16:13:06.655 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.655 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.656 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.656 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_port": { 2024-09-13T16:13:06.656 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_port", 2024-09-13T16:13:06.656 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.656 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.656 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.656 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "465", 2024-09-13T16:13:06.656 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.656 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.656 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.656 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SMTP port", 2024-09-13T16:13:06.656 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.656 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.657 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.657 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_sender": { 2024-09-13T16:13:06.657 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_sender", 2024-09-13T16:13:06.657 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.657 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.657 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.657 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.657 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.657 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.657 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.657 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SMTP envelope sender", 2024-09-13T16:13:06.657 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.657 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.657 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.658 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_ssl": { 2024-09-13T16:13:06.658 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_ssl", 2024-09-13T16:13:06.658 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.658 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.658 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.658 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.658 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.658 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.658 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.658 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T16:13:06.658 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.658 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.658 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.659 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_user": { 2024-09-13T16:13:06.659 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_user", 2024-09-13T16:13:06.659 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.659 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.659 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.659 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.659 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.659 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.659 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.659 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "User to authenticate as", 2024-09-13T16:13:06.659 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.659 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.659 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.660 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.660 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.660 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "balancer", 2024-09-13T16:13:06.660 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.660 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.660 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.660 INFO:teuthology.orchestra.run.smithi086.stdout: "active": { 2024-09-13T16:13:06.660 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "active", 2024-09-13T16:13:06.660 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.660 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.660 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.660 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.661 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.661 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.661 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.661 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T16:13:06.661 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.661 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.661 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.661 INFO:teuthology.orchestra.run.smithi086.stdout: "begin_time": { 2024-09-13T16:13:06.661 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "begin_time", 2024-09-13T16:13:06.661 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.661 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.661 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.661 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0000", 2024-09-13T16:13:06.662 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.662 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.662 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.662 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T16:13:06.662 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T16:13:06.662 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.662 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.662 INFO:teuthology.orchestra.run.smithi086.stdout: "begin_weekday": { 2024-09-13T16:13:06.662 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "begin_weekday", 2024-09-13T16:13:06.662 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-09-13T16:13:06.662 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.662 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.663 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-09-13T16:13:06.663 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "0", 2024-09-13T16:13:06.663 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "6", 2024-09-13T16:13:06.663 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.663 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T16:13:06.663 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T16:13:06.663 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.663 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.663 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_compat_max_iterations": { 2024-09-13T16:13:06.663 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crush_compat_max_iterations", 2024-09-13T16:13:06.663 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-09-13T16:13:06.663 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.663 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.663 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "25", 2024-09-13T16:13:06.664 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-09-13T16:13:06.664 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "250", 2024-09-13T16:13:06.664 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.664 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T16:13:06.664 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.664 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.664 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.664 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_compat_metrics": { 2024-09-13T16:13:06.664 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crush_compat_metrics", 2024-09-13T16:13:06.664 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.664 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.664 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.665 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T16:13:06.665 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.665 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.665 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.665 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T16:13:06.665 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T16:13:06.665 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.665 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.665 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_compat_step": { 2024-09-13T16:13:06.665 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crush_compat_step", 2024-09-13T16:13:06.665 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:06.665 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.665 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.666 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0.5", 2024-09-13T16:13:06.666 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "0.001", 2024-09-13T16:13:06.666 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "0.999", 2024-09-13T16:13:06.666 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.666 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "aggressiveness of optimization", 2024-09-13T16:13:06.666 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T16:13:06.666 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.666 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.666 INFO:teuthology.orchestra.run.smithi086.stdout: "end_time": { 2024-09-13T16:13:06.666 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "end_time", 2024-09-13T16:13:06.666 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.666 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.666 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.667 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "2359", 2024-09-13T16:13:06.667 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.667 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.667 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.667 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T16:13:06.667 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T16:13:06.667 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.667 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.667 INFO:teuthology.orchestra.run.smithi086.stdout: "end_weekday": { 2024-09-13T16:13:06.667 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "end_weekday", 2024-09-13T16:13:06.667 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-09-13T16:13:06.667 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.667 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.668 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-09-13T16:13:06.668 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "0", 2024-09-13T16:13:06.668 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "6", 2024-09-13T16:13:06.668 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.668 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T16:13:06.668 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T16:13:06.668 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.668 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.668 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.668 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.668 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.668 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.668 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.669 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.669 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.669 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.669 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.669 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.669 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.669 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.669 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.669 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.669 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.669 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.669 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.669 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.669 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.670 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.670 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.670 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.670 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.670 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.670 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.670 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.670 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.670 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.670 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.670 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.670 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.670 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.671 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.671 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.671 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.671 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.671 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.671 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.671 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.671 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.671 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.671 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.671 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.671 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.671 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.672 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.672 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.672 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.672 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.672 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.672 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.672 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.672 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.672 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.672 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.672 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.672 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.672 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.673 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.673 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.673 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.673 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.673 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.673 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.673 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.673 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.673 INFO:teuthology.orchestra.run.smithi086.stdout: "min_score": { 2024-09-13T16:13:06.673 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "min_score", 2024-09-13T16:13:06.673 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:06.673 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.673 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.673 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-09-13T16:13:06.674 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.674 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.674 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.674 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T16:13:06.674 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.674 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.674 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.674 INFO:teuthology.orchestra.run.smithi086.stdout: "mode": { 2024-09-13T16:13:06.674 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mode", 2024-09-13T16:13:06.674 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.674 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.674 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.674 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "upmap", 2024-09-13T16:13:06.675 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.675 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.675 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.675 INFO:teuthology.orchestra.run.smithi086.stdout: "crush-compat", 2024-09-13T16:13:06.675 INFO:teuthology.orchestra.run.smithi086.stdout: "none", 2024-09-13T16:13:06.675 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap" 2024-09-13T16:13:06.675 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.675 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Balancer mode", 2024-09-13T16:13:06.675 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.675 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.675 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.675 INFO:teuthology.orchestra.run.smithi086.stdout: "pool_ids": { 2024-09-13T16:13:06.676 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pool_ids", 2024-09-13T16:13:06.676 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.676 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.676 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.676 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.676 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.676 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.676 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.676 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T16:13:06.676 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.676 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.676 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.676 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-09-13T16:13:06.677 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-09-13T16:13:06.677 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.677 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.677 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.677 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-09-13T16:13:06.677 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.677 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.677 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.677 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T16:13:06.677 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.677 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.677 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.677 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap_max_deviation": { 2024-09-13T16:13:06.678 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "upmap_max_deviation", 2024-09-13T16:13:06.678 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.678 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.678 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.678 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-09-13T16:13:06.678 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-09-13T16:13:06.678 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.678 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.678 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T16:13:06.678 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T16:13:06.678 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.678 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.678 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap_max_optimizations": { 2024-09-13T16:13:06.679 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "upmap_max_optimizations", 2024-09-13T16:13:06.679 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-09-13T16:13:06.679 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.679 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.679 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:06.679 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.679 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.679 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.679 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T16:13:06.679 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.679 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.679 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.679 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.679 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.680 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephadm", 2024-09-13T16:13:06.680 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.680 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.680 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.680 INFO:teuthology.orchestra.run.smithi086.stdout: "agent_down_multiplier": { 2024-09-13T16:13:06.680 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "agent_down_multiplier", 2024-09-13T16:13:06.680 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:06.680 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.680 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.680 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "3.0", 2024-09-13T16:13:06.680 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.680 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.681 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.681 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T16:13:06.681 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.681 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.681 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.681 INFO:teuthology.orchestra.run.smithi086.stdout: "agent_refresh_rate": { 2024-09-13T16:13:06.681 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "agent_refresh_rate", 2024-09-13T16:13:06.681 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.681 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.681 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.681 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "20", 2024-09-13T16:13:06.681 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.681 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.682 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.682 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T16:13:06.682 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.682 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.682 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.682 INFO:teuthology.orchestra.run.smithi086.stdout: "agent_starting_port": { 2024-09-13T16:13:06.682 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "agent_starting_port", 2024-09-13T16:13:06.682 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.682 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.682 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.682 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "4721", 2024-09-13T16:13:06.682 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.683 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.683 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.683 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T16:13:06.683 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.683 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.683 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.683 INFO:teuthology.orchestra.run.smithi086.stdout: "allow_ptrace": { 2024-09-13T16:13:06.683 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "allow_ptrace", 2024-09-13T16:13:06.683 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.683 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.683 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.683 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.683 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.683 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.684 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.684 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T16:13:06.684 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T16:13:06.684 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.684 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.684 INFO:teuthology.orchestra.run.smithi086.stdout: "autotune_interval": { 2024-09-13T16:13:06.684 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "autotune_interval", 2024-09-13T16:13:06.684 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.684 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.684 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.684 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-09-13T16:13:06.684 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.685 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.685 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.685 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T16:13:06.685 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.685 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.685 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.685 INFO:teuthology.orchestra.run.smithi086.stdout: "autotune_memory_target_ratio": { 2024-09-13T16:13:06.685 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T16:13:06.685 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:06.685 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.685 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.685 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0.7", 2024-09-13T16:13:06.685 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.686 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.686 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.686 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T16:13:06.686 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.686 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.686 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.686 INFO:teuthology.orchestra.run.smithi086.stdout: "cgroups_split": { 2024-09-13T16:13:06.686 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cgroups_split", 2024-09-13T16:13:06.686 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.686 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.686 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.686 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.686 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.687 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.687 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.687 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T16:13:06.687 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.687 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.687 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.687 INFO:teuthology.orchestra.run.smithi086.stdout: "config_checks_enabled": { 2024-09-13T16:13:06.687 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "config_checks_enabled", 2024-09-13T16:13:06.687 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.687 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.687 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.687 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.688 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.688 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.688 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.688 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T16:13:06.688 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.688 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.688 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.688 INFO:teuthology.orchestra.run.smithi086.stdout: "config_dashboard": { 2024-09-13T16:13:06.688 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "config_dashboard", 2024-09-13T16:13:06.688 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.688 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.688 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.689 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.689 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.689 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.689 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.689 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T16:13:06.689 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.689 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.689 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.689 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_alertmanager": { 2024-09-13T16:13:06.689 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_alertmanager", 2024-09-13T16:13:06.689 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.689 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.689 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.690 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T16:13:06.690 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.690 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.690 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.690 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:06.690 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.690 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.690 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.690 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_base": { 2024-09-13T16:13:06.690 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_base", 2024-09-13T16:13:06.690 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.690 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.690 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.691 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T16:13:06.691 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.691 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.691 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.691 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Container image name, without the tag", 2024-09-13T16:13:06.691 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.691 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.691 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.691 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_elasticsearch": { 2024-09-13T16:13:06.691 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_elasticsearch", 2024-09-13T16:13:06.691 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.691 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.692 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.692 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T16:13:06.692 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.692 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.692 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.692 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "elasticsearch container image", 2024-09-13T16:13:06.692 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.692 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.692 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.692 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_grafana": { 2024-09-13T16:13:06.692 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_grafana", 2024-09-13T16:13:06.692 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.692 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.693 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.693 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T16:13:06.693 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.693 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.693 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.693 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:06.693 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.693 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.693 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.693 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_haproxy": { 2024-09-13T16:13:06.693 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_haproxy", 2024-09-13T16:13:06.693 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.693 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.694 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.694 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T16:13:06.694 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.694 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.694 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.694 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "HAproxy container image", 2024-09-13T16:13:06.694 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.694 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.694 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.694 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_jaeger_agent": { 2024-09-13T16:13:06.694 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_jaeger_agent", 2024-09-13T16:13:06.694 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.695 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.695 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.695 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T16:13:06.695 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.695 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.695 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.695 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Jaeger agent container image", 2024-09-13T16:13:06.695 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.695 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.695 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.695 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_jaeger_collector": { 2024-09-13T16:13:06.695 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_jaeger_collector", 2024-09-13T16:13:06.695 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.696 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.696 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.696 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T16:13:06.696 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.696 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.696 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.696 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Jaeger collector container image", 2024-09-13T16:13:06.696 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.696 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.696 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.696 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_jaeger_query": { 2024-09-13T16:13:06.696 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_jaeger_query", 2024-09-13T16:13:06.696 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.697 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.697 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.697 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T16:13:06.697 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.697 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.697 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.697 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Jaeger query container image", 2024-09-13T16:13:06.697 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.697 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.697 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.697 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_keepalived": { 2024-09-13T16:13:06.697 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_keepalived", 2024-09-13T16:13:06.697 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.698 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.698 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.698 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T16:13:06.698 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.698 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.698 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.698 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Keepalived container image", 2024-09-13T16:13:06.698 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.698 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.698 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.698 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_loki": { 2024-09-13T16:13:06.698 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_loki", 2024-09-13T16:13:06.699 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.699 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.699 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.699 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T16:13:06.699 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.699 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.699 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.699 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Loki container image", 2024-09-13T16:13:06.699 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.699 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.699 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.699 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_node_exporter": { 2024-09-13T16:13:06.700 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_node_exporter", 2024-09-13T16:13:06.700 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.700 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.700 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.700 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T16:13:06.700 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.700 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.700 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.700 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:06.700 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.700 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.700 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.701 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_nvmeof": { 2024-09-13T16:13:06.701 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_nvmeof", 2024-09-13T16:13:06.701 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.701 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.701 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.701 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T16:13:06.701 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.701 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.701 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.701 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Nvme-of container image", 2024-09-13T16:13:06.701 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.701 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.701 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.702 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_prometheus": { 2024-09-13T16:13:06.702 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_prometheus", 2024-09-13T16:13:06.702 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.702 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.702 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.702 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T16:13:06.702 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.702 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.702 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.702 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:06.702 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.702 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.703 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.703 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_promtail": { 2024-09-13T16:13:06.703 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_promtail", 2024-09-13T16:13:06.703 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.703 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.703 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.703 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T16:13:06.703 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.703 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.703 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.703 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Promtail container image", 2024-09-13T16:13:06.703 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.703 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.704 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.704 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_snmp_gateway": { 2024-09-13T16:13:06.704 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_snmp_gateway", 2024-09-13T16:13:06.704 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.704 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.704 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.704 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T16:13:06.704 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.704 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.704 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.704 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SNMP Gateway container image", 2024-09-13T16:13:06.704 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.705 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.705 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.705 INFO:teuthology.orchestra.run.smithi086.stdout: "container_init": { 2024-09-13T16:13:06.705 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_init", 2024-09-13T16:13:06.705 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.705 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.705 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.705 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.705 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.706 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.706 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.706 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T16:13:06.706 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.706 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.706 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.706 INFO:teuthology.orchestra.run.smithi086.stdout: "daemon_cache_timeout": { 2024-09-13T16:13:06.706 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "daemon_cache_timeout", 2024-09-13T16:13:06.706 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.706 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.706 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.706 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-09-13T16:13:06.706 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.707 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.707 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.707 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T16:13:06.707 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.707 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.707 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.707 INFO:teuthology.orchestra.run.smithi086.stdout: "default_cephadm_command_timeout": { 2024-09-13T16:13:06.707 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T16:13:06.707 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.707 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.707 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.707 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "900", 2024-09-13T16:13:06.708 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.708 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.708 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.708 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T16:13:06.708 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.708 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.708 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.708 INFO:teuthology.orchestra.run.smithi086.stdout: "default_registry": { 2024-09-13T16:13:06.708 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "default_registry", 2024-09-13T16:13:06.708 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.708 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.708 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.708 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io", 2024-09-13T16:13:06.709 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.709 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.709 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.709 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T16:13:06.709 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.709 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.709 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.709 INFO:teuthology.orchestra.run.smithi086.stdout: "device_cache_timeout": { 2024-09-13T16:13:06.709 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "device_cache_timeout", 2024-09-13T16:13:06.709 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.709 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.709 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.709 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "1800", 2024-09-13T16:13:06.709 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.710 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.710 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.710 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "seconds to cache device inventory", 2024-09-13T16:13:06.710 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.710 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.710 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.710 INFO:teuthology.orchestra.run.smithi086.stdout: "device_enhanced_scan": { 2024-09-13T16:13:06.710 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "device_enhanced_scan", 2024-09-13T16:13:06.710 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.710 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.710 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.710 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.710 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.711 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.711 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.711 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T16:13:06.711 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.711 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.711 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.711 INFO:teuthology.orchestra.run.smithi086.stdout: "facts_cache_timeout": { 2024-09-13T16:13:06.711 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "facts_cache_timeout", 2024-09-13T16:13:06.711 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.711 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.711 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.711 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-09-13T16:13:06.711 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.711 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.712 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.712 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "seconds to cache host facts data", 2024-09-13T16:13:06.712 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.712 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.712 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.712 INFO:teuthology.orchestra.run.smithi086.stdout: "host_check_interval": { 2024-09-13T16:13:06.712 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "host_check_interval", 2024-09-13T16:13:06.712 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.712 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.712 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.712 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-09-13T16:13:06.713 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.713 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.713 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.713 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to perform a host check", 2024-09-13T16:13:06.713 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.713 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.713 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.713 INFO:teuthology.orchestra.run.smithi086.stdout: "hw_monitoring": { 2024-09-13T16:13:06.713 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "hw_monitoring", 2024-09-13T16:13:06.713 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.713 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.713 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.713 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.714 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.714 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.714 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.714 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T16:13:06.714 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.714 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.714 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.714 INFO:teuthology.orchestra.run.smithi086.stdout: "inventory_list_all": { 2024-09-13T16:13:06.714 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "inventory_list_all", 2024-09-13T16:13:06.714 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.714 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.714 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.714 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.714 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.715 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.715 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.715 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T16:13:06.715 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.715 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.715 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.715 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.715 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.715 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.715 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.715 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.715 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.715 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.716 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.716 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.716 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.716 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.716 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.716 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.716 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.716 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.716 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.716 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.716 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.716 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.716 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.717 INFO:teuthology.orchestra.run.smithi086.stdout: "log_refresh_metadata": { 2024-09-13T16:13:06.717 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_refresh_metadata", 2024-09-13T16:13:06.717 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.717 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.717 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.717 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.717 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.717 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.717 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.717 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T16:13:06.717 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.717 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.717 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.718 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.718 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.718 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.718 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.718 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.718 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.718 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.718 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.718 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.718 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T16:13:06.718 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.719 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.719 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.719 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.719 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.719 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.719 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.719 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.719 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.719 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.719 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.719 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.719 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.719 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.720 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.720 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.720 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.720 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.720 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.720 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.720 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.720 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.720 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.720 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.720 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.720 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.720 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.721 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.721 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.721 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.721 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.721 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.721 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.721 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.721 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.721 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.721 INFO:teuthology.orchestra.run.smithi086.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T16:13:06.721 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T16:13:06.721 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.721 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.721 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.722 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.722 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.722 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.722 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.722 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T16:13:06.722 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.722 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.722 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.722 INFO:teuthology.orchestra.run.smithi086.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T16:13:06.722 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T16:13:06.722 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.722 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.722 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.723 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "*", 2024-09-13T16:13:06.723 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.723 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.723 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.723 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T16:13:06.723 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.723 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.723 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.723 INFO:teuthology.orchestra.run.smithi086.stdout: "max_count_per_host": { 2024-09-13T16:13:06.723 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_count_per_host", 2024-09-13T16:13:06.723 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.723 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.723 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.723 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:06.724 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.724 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.724 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.724 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "max number of daemons per service per host", 2024-09-13T16:13:06.724 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.724 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.724 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.724 INFO:teuthology.orchestra.run.smithi086.stdout: "max_osd_draining_count": { 2024-09-13T16:13:06.724 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_osd_draining_count", 2024-09-13T16:13:06.724 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.724 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.724 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.724 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:06.725 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.725 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.725 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.725 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T16:13:06.725 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.725 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.725 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.725 INFO:teuthology.orchestra.run.smithi086.stdout: "migration_current": { 2024-09-13T16:13:06.725 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "migration_current", 2024-09-13T16:13:06.725 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.725 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.726 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.726 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.726 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.726 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.726 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.726 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "internal - do not modify", 2024-09-13T16:13:06.726 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.726 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.726 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.726 INFO:teuthology.orchestra.run.smithi086.stdout: "mode": { 2024-09-13T16:13:06.726 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mode", 2024-09-13T16:13:06.726 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.726 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.727 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.727 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "root", 2024-09-13T16:13:06.727 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.727 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.727 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.727 INFO:teuthology.orchestra.run.smithi086.stdout: "cephadm-package", 2024-09-13T16:13:06.727 INFO:teuthology.orchestra.run.smithi086.stdout: "root" 2024-09-13T16:13:06.727 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.727 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T16:13:06.727 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.727 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.727 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.727 INFO:teuthology.orchestra.run.smithi086.stdout: "oob_default_addr": { 2024-09-13T16:13:06.728 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "oob_default_addr", 2024-09-13T16:13:06.728 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.728 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.728 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.728 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "169.254.1.1", 2024-09-13T16:13:06.728 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.728 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.728 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.728 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T16:13:06.728 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.728 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.728 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.728 INFO:teuthology.orchestra.run.smithi086.stdout: "prometheus_alerts_path": { 2024-09-13T16:13:06.729 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "prometheus_alerts_path", 2024-09-13T16:13:06.729 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.729 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.729 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.729 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T16:13:06.729 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.729 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.729 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.729 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T16:13:06.729 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.729 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.729 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.729 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_insecure": { 2024-09-13T16:13:06.730 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_insecure", 2024-09-13T16:13:06.730 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.730 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.730 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.730 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.730 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.730 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.730 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.730 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T16:13:06.730 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.730 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.730 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.730 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_password": { 2024-09-13T16:13:06.731 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_password", 2024-09-13T16:13:06.731 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.731 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.731 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.731 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.731 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.731 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.731 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.731 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T16:13:06.731 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.731 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.731 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.731 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_url": { 2024-09-13T16:13:06.731 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_url", 2024-09-13T16:13:06.732 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.732 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.732 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.732 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.732 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.732 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.732 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.732 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T16:13:06.732 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.732 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.732 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.732 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_username": { 2024-09-13T16:13:06.733 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_username", 2024-09-13T16:13:06.733 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.733 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.733 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.733 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.733 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.733 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.733 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.733 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T16:13:06.733 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.733 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.733 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.733 INFO:teuthology.orchestra.run.smithi086.stdout: "secure_monitoring_stack": { 2024-09-13T16:13:06.733 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "secure_monitoring_stack", 2024-09-13T16:13:06.734 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.734 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.734 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.734 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.734 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.734 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.734 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.734 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T16:13:06.734 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.734 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.734 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.734 INFO:teuthology.orchestra.run.smithi086.stdout: "service_discovery_port": { 2024-09-13T16:13:06.734 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "service_discovery_port", 2024-09-13T16:13:06.735 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.735 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.735 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.735 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8765", 2024-09-13T16:13:06.735 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.735 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.735 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.735 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "cephadm service discovery port", 2024-09-13T16:13:06.735 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.735 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.735 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.735 INFO:teuthology.orchestra.run.smithi086.stdout: "ssh_config_file": { 2024-09-13T16:13:06.735 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssh_config_file", 2024-09-13T16:13:06.735 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.736 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.736 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.736 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.736 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.736 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.736 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.736 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T16:13:06.736 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.736 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.736 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.736 INFO:teuthology.orchestra.run.smithi086.stdout: "use_agent": { 2024-09-13T16:13:06.736 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "use_agent", 2024-09-13T16:13:06.736 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.737 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.737 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.737 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.737 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.737 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.737 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.737 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T16:13:06.737 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.737 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.737 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.737 INFO:teuthology.orchestra.run.smithi086.stdout: "use_repo_digest": { 2024-09-13T16:13:06.738 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "use_repo_digest", 2024-09-13T16:13:06.738 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.738 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.738 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.738 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.738 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.738 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.738 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.738 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T16:13:06.738 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.738 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.738 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.738 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_on_failed_host_check": { 2024-09-13T16:13:06.739 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_on_failed_host_check", 2024-09-13T16:13:06.739 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.739 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.739 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.739 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.739 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.739 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.739 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.739 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T16:13:06.739 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.739 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.739 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.739 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_on_stray_daemons": { 2024-09-13T16:13:06.739 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_on_stray_daemons", 2024-09-13T16:13:06.740 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.740 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.740 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.740 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.740 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.740 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.740 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.740 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T16:13:06.740 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.740 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.740 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.740 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_on_stray_hosts": { 2024-09-13T16:13:06.741 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_on_stray_hosts", 2024-09-13T16:13:06.741 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.741 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.741 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.741 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.741 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.741 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.741 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.741 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T16:13:06.741 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.741 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.741 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.741 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.741 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.742 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crash", 2024-09-13T16:13:06.742 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.742 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.742 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.742 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.742 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.742 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.742 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.742 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.742 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.742 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.742 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.743 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.743 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.743 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.743 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.743 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.743 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.743 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.743 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.743 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.743 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.743 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.743 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.743 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.744 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.744 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.744 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.744 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.744 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.744 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.744 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.744 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.744 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.744 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.744 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.744 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.744 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.745 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.745 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.745 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.745 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.745 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.745 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.745 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.745 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.745 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.745 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.745 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.745 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.745 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.745 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.745 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.746 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.746 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.746 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.746 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.746 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.746 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.746 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.746 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.746 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.746 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.746 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.746 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.746 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.747 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.747 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.747 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.747 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.747 INFO:teuthology.orchestra.run.smithi086.stdout: "retain_interval": { 2024-09-13T16:13:06.747 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "retain_interval", 2024-09-13T16:13:06.747 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.747 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.747 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.747 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "31536000", 2024-09-13T16:13:06.747 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.747 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.747 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.748 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T16:13:06.748 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.748 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.748 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.748 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_recent_interval": { 2024-09-13T16:13:06.748 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_recent_interval", 2024-09-13T16:13:06.748 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.748 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.748 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.748 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "1209600", 2024-09-13T16:13:06.748 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.748 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.748 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.749 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T16:13:06.749 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.749 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.749 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.749 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.749 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.749 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "dashboard", 2024-09-13T16:13:06.749 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.749 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.749 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.749 INFO:teuthology.orchestra.run.smithi086.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T16:13:06.749 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T16:13:06.750 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.750 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.750 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.750 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:06.750 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.750 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.750 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.750 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.750 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.750 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.750 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.750 INFO:teuthology.orchestra.run.smithi086.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T16:13:06.750 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T16:13:06.751 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.751 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.751 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.751 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.751 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.751 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.751 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.751 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.751 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.751 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.751 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.751 INFO:teuthology.orchestra.run.smithi086.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T16:13:06.751 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T16:13:06.752 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.752 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.752 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.752 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.752 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.752 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.752 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.752 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.752 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.752 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.752 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.752 INFO:teuthology.orchestra.run.smithi086.stdout: "AUDIT_API_ENABLED": { 2024-09-13T16:13:06.752 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T16:13:06.753 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.753 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.753 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.753 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.753 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.753 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.753 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.753 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.753 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.753 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.753 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.753 INFO:teuthology.orchestra.run.smithi086.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T16:13:06.753 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T16:13:06.754 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.754 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.754 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.754 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.754 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.754 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.754 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.754 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.754 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.754 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.754 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.754 INFO:teuthology.orchestra.run.smithi086.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T16:13:06.754 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T16:13:06.755 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.755 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.755 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.755 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.755 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.755 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.755 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.755 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.755 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.755 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.755 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.755 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T16:13:06.756 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T16:13:06.756 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.756 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.756 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.756 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.756 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.756 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.756 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.756 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.756 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.756 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.756 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.756 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T16:13:06.757 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T16:13:06.757 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.757 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.757 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.757 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.757 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.757 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.757 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.757 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.757 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.757 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.757 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.757 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T16:13:06.758 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T16:13:06.758 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.758 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.758 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.758 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.758 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.758 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.758 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.758 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.758 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.758 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.758 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.758 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T16:13:06.759 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T16:13:06.759 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.759 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.759 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.759 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.759 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.759 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.759 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.759 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.759 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.759 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.759 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.760 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T16:13:06.760 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T16:13:06.760 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.760 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.760 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.760 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.760 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.760 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.760 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.760 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.760 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.760 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.760 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.761 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T16:13:06.761 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T16:13:06.761 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.761 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.761 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.761 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.761 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.761 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.761 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.761 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.761 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.761 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.761 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.762 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T16:13:06.762 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T16:13:06.762 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.762 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.762 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.762 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.762 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.762 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.762 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.762 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.762 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.762 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.762 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.762 INFO:teuthology.orchestra.run.smithi086.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T16:13:06.763 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T16:13:06.763 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.763 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.763 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.763 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.763 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.763 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.763 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.763 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.763 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.763 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.763 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.763 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T16:13:06.764 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T16:13:06.764 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.764 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.764 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.764 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "admin", 2024-09-13T16:13:06.764 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.764 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.764 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.764 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.764 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.764 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.764 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.765 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T16:13:06.765 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T16:13:06.765 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.765 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.765 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.765 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.765 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.765 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.765 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.765 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.765 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.765 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.765 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.766 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_URL": { 2024-09-13T16:13:06.766 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_URL", 2024-09-13T16:13:06.766 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.766 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.766 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.766 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.766 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.766 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.766 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.766 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.766 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.766 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.766 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.767 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T16:13:06.767 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T16:13:06.767 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.767 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.767 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.767 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "admin", 2024-09-13T16:13:06.767 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.767 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.767 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.767 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.767 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.767 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.767 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.768 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T16:13:06.768 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T16:13:06.768 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.768 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.768 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.768 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.768 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.768 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.768 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.768 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.768 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.768 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.769 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.769 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T16:13:06.769 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T16:13:06.769 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.769 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.769 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.769 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.769 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.769 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.769 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.769 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.770 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.770 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.770 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.770 INFO:teuthology.orchestra.run.smithi086.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T16:13:06.770 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T16:13:06.770 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.770 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.770 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.770 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.770 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.770 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.770 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.770 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.771 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.771 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.771 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.771 INFO:teuthology.orchestra.run.smithi086.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T16:13:06.771 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T16:13:06.771 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.771 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.771 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.771 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.771 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.771 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.771 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.772 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.772 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.772 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.772 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.772 INFO:teuthology.orchestra.run.smithi086.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T16:13:06.772 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T16:13:06.772 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.772 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.772 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.772 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.772 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.772 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.772 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.773 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.773 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.773 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.773 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.773 INFO:teuthology.orchestra.run.smithi086.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T16:13:06.773 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T16:13:06.773 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.773 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.773 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.773 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.773 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.773 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.773 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.774 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.774 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.774 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.774 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.774 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T16:13:06.774 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T16:13:06.774 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.774 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.774 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.774 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.774 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.774 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.774 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.774 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.775 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.775 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.775 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.775 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T16:13:06.775 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T16:13:06.775 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.775 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.775 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.775 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.775 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.775 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.775 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.775 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.775 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.776 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.776 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.776 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T16:13:06.776 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T16:13:06.776 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.776 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.776 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.776 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.776 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.776 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.776 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.776 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.777 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.777 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.777 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.777 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T16:13:06.777 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T16:13:06.777 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.777 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.777 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.777 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.777 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.777 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.777 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.777 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.778 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.778 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.778 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.778 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T16:13:06.778 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T16:13:06.778 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.778 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.778 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.778 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.778 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.778 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.778 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.778 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.779 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.779 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.779 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.779 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T16:13:06.779 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T16:13:06.779 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.779 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.779 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.779 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.779 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.779 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.779 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.779 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.780 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.780 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.780 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.780 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T16:13:06.780 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T16:13:06.780 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.780 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.780 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.780 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.780 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.780 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.780 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.780 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.781 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.781 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.781 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.781 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T16:13:06.781 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T16:13:06.781 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.781 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.781 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.781 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.781 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.781 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.781 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.781 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.782 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.782 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.782 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.782 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T16:13:06.782 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T16:13:06.782 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.782 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.782 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.782 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T16:13:06.782 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.782 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.782 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.783 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.783 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.783 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.783 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.783 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T16:13:06.783 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T16:13:06.783 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.783 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.783 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.783 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:06.783 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.783 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.783 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.784 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.784 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.784 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.784 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.784 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T16:13:06.784 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T16:13:06.784 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.784 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.784 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.784 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8", 2024-09-13T16:13:06.784 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.784 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.785 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.785 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.785 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.785 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.785 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.785 INFO:teuthology.orchestra.run.smithi086.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T16:13:06.785 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T16:13:06.785 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.785 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.785 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.785 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "45", 2024-09-13T16:13:06.785 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.786 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.786 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.786 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.786 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.786 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.786 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.786 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T16:13:06.786 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T16:13:06.786 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.786 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.786 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.786 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.786 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.786 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.787 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.787 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.787 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.787 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.787 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.787 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T16:13:06.787 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T16:13:06.787 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.787 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.787 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.787 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "admin", 2024-09-13T16:13:06.787 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.787 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T16:13:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T16:13:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T16:13:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T16:13:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T16:13:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T16:13:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T16:13:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T16:13:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-09-13T16:13:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T16:13:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T16:13:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T16:13:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T16:13:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-09-13T16:13:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "cross_origin_url": { 2024-09-13T16:13:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cross_origin_url", 2024-09-13T16:13:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "crt_file": { 2024-09-13T16:13:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crt_file", 2024-09-13T16:13:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "debug": { 2024-09-13T16:13:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "debug", 2024-09-13T16:13:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Enable/disable debug options", 2024-09-13T16:13:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "jwt_token_ttl": { 2024-09-13T16:13:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "jwt_token_ttl", 2024-09-13T16:13:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "28800", 2024-09-13T16:13:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "key_file": { 2024-09-13T16:13:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "key_file", 2024-09-13T16:13:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "motd": { 2024-09-13T16:13:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "motd", 2024-09-13T16:13:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "The message of the day", 2024-09-13T16:13:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "redirect_resolve_ip_addr": { 2024-09-13T16:13:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T16:13:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "server_addr": { 2024-09-13T16:13:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_addr", 2024-09-13T16:13:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "::", 2024-09-13T16:13:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "server_port": { 2024-09-13T16:13:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_port", 2024-09-13T16:13:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8080", 2024-09-13T16:13:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "ssl": { 2024-09-13T16:13:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssl", 2024-09-13T16:13:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "ssl_server_port": { 2024-09-13T16:13:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssl_server_port", 2024-09-13T16:13:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8443", 2024-09-13T16:13:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_behaviour": { 2024-09-13T16:13:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_behaviour", 2024-09-13T16:13:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "redirect", 2024-09-13T16:13:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "redirect" 2024-09-13T16:13:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_error_status_code": { 2024-09-13T16:13:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_error_status_code", 2024-09-13T16:13:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "500", 2024-09-13T16:13:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "400", 2024-09-13T16:13:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "599", 2024-09-13T16:13:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "url_prefix": { 2024-09-13T16:13:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "url_prefix", 2024-09-13T16:13:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "devicehealth", 2024-09-13T16:13:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "enable_monitoring": { 2024-09-13T16:13:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enable_monitoring", 2024-09-13T16:13:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "monitor device health metrics", 2024-09-13T16:13:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "mark_out_threshold": { 2024-09-13T16:13:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mark_out_threshold", 2024-09-13T16:13:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "2419200", 2024-09-13T16:13:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T16:13:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: "pool_name": { 2024-09-13T16:13:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pool_name", 2024-09-13T16:13:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "device_health_metrics", 2024-09-13T16:13:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T16:13:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "retention_period": { 2024-09-13T16:13:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "retention_period", 2024-09-13T16:13:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "15552000", 2024-09-13T16:13:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how long to retain device health metrics", 2024-09-13T16:13:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "scrape_frequency": { 2024-09-13T16:13:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "scrape_frequency", 2024-09-13T16:13:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "86400", 2024-09-13T16:13:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T16:13:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "self_heal": { 2024-09-13T16:13:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "self_heal", 2024-09-13T16:13:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T16:13:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-09-13T16:13:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-09-13T16:13:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-09-13T16:13:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T16:13:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_threshold": { 2024-09-13T16:13:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_threshold", 2024-09-13T16:13:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "7257600", 2024-09-13T16:13:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T16:13:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "diskprediction_local", 2024-09-13T16:13:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "predict_interval": { 2024-09-13T16:13:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "predict_interval", 2024-09-13T16:13:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "86400", 2024-09-13T16:13:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "predictor_model": { 2024-09-13T16:13:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "predictor_model", 2024-09-13T16:13:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "prophetstor", 2024-09-13T16:13:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-09-13T16:13:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-09-13T16:13:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-09-13T16:13:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "influx", 2024-09-13T16:13:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": false, 2024-09-13T16:13:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "influxdb python module not found", 2024-09-13T16:13:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "batch_size": { 2024-09-13T16:13:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "batch_size", 2024-09-13T16:13:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5000", 2024-09-13T16:13:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T16:13:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "database": { 2024-09-13T16:13:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "database", 2024-09-13T16:13:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "ceph", 2024-09-13T16:13:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T16:13:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "hostname": { 2024-09-13T16:13:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "hostname", 2024-09-13T16:13:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "InfluxDB server hostname", 2024-09-13T16:13:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-09-13T16:13:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-09-13T16:13:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "30", 2024-09-13T16:13:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "5", 2024-09-13T16:13:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T16:13:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "password": { 2024-09-13T16:13:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "password", 2024-09-13T16:13:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "password of InfluxDB server user", 2024-09-13T16:13:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: "port": { 2024-09-13T16:13:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "port", 2024-09-13T16:13:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8086", 2024-09-13T16:13:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "InfluxDB server port", 2024-09-13T16:13:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: "ssl": { 2024-09-13T16:13:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssl", 2024-09-13T16:13:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "false", 2024-09-13T16:13:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T16:13:06.851 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.851 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.851 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.851 INFO:teuthology.orchestra.run.smithi086.stdout: "threads": { 2024-09-13T16:13:06.851 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "threads", 2024-09-13T16:13:06.851 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.851 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.851 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.851 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-09-13T16:13:06.851 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-09-13T16:13:06.851 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "32", 2024-09-13T16:13:06.851 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.851 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T16:13:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: "username": { 2024-09-13T16:13:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "username", 2024-09-13T16:13:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "username of InfluxDB server user", 2024-09-13T16:13:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "verify_ssl": { 2024-09-13T16:13:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "verify_ssl", 2024-09-13T16:13:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "true", 2024-09-13T16:13:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T16:13:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "insights", 2024-09-13T16:13:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "iostat", 2024-09-13T16:13:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "k8sevents", 2024-09-13T16:13:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_event_retention_days": { 2024-09-13T16:13:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ceph_event_retention_days", 2024-09-13T16:13:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "7", 2024-09-13T16:13:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-13T16:13:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "config_check_secs": { 2024-09-13T16:13:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "config_check_secs", 2024-09-13T16:13:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "10", 2024-09-13T16:13:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-13T16:13:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "localpool", 2024-09-13T16:13:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "failure_domain": { 2024-09-13T16:13:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "failure_domain", 2024-09-13T16:13:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "host", 2024-09-13T16:13:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "failure domain for any created local pool", 2024-09-13T16:13:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T16:13:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "min_size": { 2024-09-13T16:13:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "min_size", 2024-09-13T16:13:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "default min_size for any created local pool", 2024-09-13T16:13:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T16:13:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "num_rep": { 2024-09-13T16:13:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "num_rep", 2024-09-13T16:13:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "3", 2024-09-13T16:13:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "default replica count for any created local pool", 2024-09-13T16:13:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "pg_num": { 2024-09-13T16:13:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pg_num", 2024-09-13T16:13:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "128", 2024-09-13T16:13:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T16:13:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "prefix": { 2024-09-13T16:13:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "prefix", 2024-09-13T16:13:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "name prefix for any created local pool", 2024-09-13T16:13:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "subtree": { 2024-09-13T16:13:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "subtree", 2024-09-13T16:13:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "rack", 2024-09-13T16:13:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T16:13:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T16:13:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mds_autoscaler", 2024-09-13T16:13:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mirroring", 2024-09-13T16:13:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "nfs", 2024-09-13T16:13:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "orchestrator", 2024-09-13T16:13:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: "fail_fs": { 2024-09-13T16:13:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "fail_fs", 2024-09-13T16:13:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T16:13:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.905 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.905 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.905 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.905 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.905 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.905 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.905 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.905 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.905 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.905 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.905 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.905 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.905 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.906 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.906 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.906 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.906 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.906 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.906 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.906 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.906 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.906 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.906 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.906 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.906 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.907 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.907 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.907 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.907 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.907 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.907 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.907 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.907 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.907 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.907 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.907 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.907 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.907 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.908 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.908 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.908 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.908 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.908 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.908 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.908 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.908 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.908 INFO:teuthology.orchestra.run.smithi086.stdout: "orchestrator": { 2024-09-13T16:13:06.908 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "orchestrator", 2024-09-13T16:13:06.908 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.908 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.908 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.909 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.909 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.909 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.909 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.909 INFO:teuthology.orchestra.run.smithi086.stdout: "cephadm", 2024-09-13T16:13:06.909 INFO:teuthology.orchestra.run.smithi086.stdout: "rook", 2024-09-13T16:13:06.909 INFO:teuthology.orchestra.run.smithi086.stdout: "test_orchestrator" 2024-09-13T16:13:06.909 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.909 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Orchestrator backend", 2024-09-13T16:13:06.909 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.909 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.909 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.909 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.909 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.910 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "osd_perf_query", 2024-09-13T16:13:06.910 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.910 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.910 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.910 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.910 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.910 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.910 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.910 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.910 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.910 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.910 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.910 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.911 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.911 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.911 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.911 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.911 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.911 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.911 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.911 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.911 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.911 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.911 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.911 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.911 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.912 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.912 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.912 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.912 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.912 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.912 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.912 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.912 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.912 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.912 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.912 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.912 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.912 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.913 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.913 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.913 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.913 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.913 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.913 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.913 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.913 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.913 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.913 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.913 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.913 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.913 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.913 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.914 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.914 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.914 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.914 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.914 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.914 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.914 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.914 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.914 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.914 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.914 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.914 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.914 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.914 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.915 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.915 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.915 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.915 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.915 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.915 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "osd_support", 2024-09-13T16:13:06.915 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.915 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.915 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.915 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.915 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.915 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.916 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.916 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.916 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.916 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.916 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.916 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.916 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.916 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.916 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.916 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.916 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.916 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.916 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.916 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.917 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.917 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.917 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.917 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.917 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.917 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.917 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.917 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.917 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.917 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.917 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.917 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.917 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.918 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.918 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.918 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.918 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.918 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.918 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.918 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.918 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.918 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.918 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.918 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.918 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.918 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.919 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.919 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.919 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.919 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.919 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.919 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.919 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.919 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.919 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.919 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.919 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.919 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.919 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.919 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.920 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.920 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.920 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.920 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.920 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.920 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.920 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.920 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.920 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.920 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.920 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.921 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pg_autoscaler", 2024-09-13T16:13:06.921 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.921 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.921 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.921 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.921 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.921 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.921 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.921 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.921 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.921 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.921 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.921 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.922 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.922 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.922 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.922 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.922 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.922 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.922 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.922 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.922 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.922 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.922 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.922 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.922 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.922 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.923 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.923 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.923 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.923 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.923 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.923 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.923 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.923 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.923 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.923 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.923 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.923 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.923 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.924 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.924 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.924 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.924 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.924 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.924 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.924 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.924 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.924 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.924 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.924 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.924 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.924 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.925 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.925 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.925 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.925 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.925 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.925 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.925 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.925 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.925 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.925 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.925 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.925 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.925 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.925 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.926 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.926 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.926 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.926 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-09-13T16:13:06.926 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-09-13T16:13:06.926 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.926 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.926 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.926 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-09-13T16:13:06.926 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.926 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.926 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.926 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.927 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.927 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.927 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.927 INFO:teuthology.orchestra.run.smithi086.stdout: "threshold": { 2024-09-13T16:13:06.927 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "threshold", 2024-09-13T16:13:06.927 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:06.927 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.927 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.927 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "3.0", 2024-09-13T16:13:06.927 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1.0", 2024-09-13T16:13:06.927 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.927 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.927 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "scaling threshold", 2024-09-13T16:13:06.928 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T16:13:06.928 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.928 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.928 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.928 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.928 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "progress", 2024-09-13T16:13:06.928 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.928 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.928 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.928 INFO:teuthology.orchestra.run.smithi086.stdout: "allow_pg_recovery_event": { 2024-09-13T16:13:06.928 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "allow_pg_recovery_event", 2024-09-13T16:13:06.928 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.929 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.929 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.929 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.929 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.929 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.929 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.929 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T16:13:06.929 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.929 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.929 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.929 INFO:teuthology.orchestra.run.smithi086.stdout: "enabled": { 2024-09-13T16:13:06.929 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enabled", 2024-09-13T16:13:06.930 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.930 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.930 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.930 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.930 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.930 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.930 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.930 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.930 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.930 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.930 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.930 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.930 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.930 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.931 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.931 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.931 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.931 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.931 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.931 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.931 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.931 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.931 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.931 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.931 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.931 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.931 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.932 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.932 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.932 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.932 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.932 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.932 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.932 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.932 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.932 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.932 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.932 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.932 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.933 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.933 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.933 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.933 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.933 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.933 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.933 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.933 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.933 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.933 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.933 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.933 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.933 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.933 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.934 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.934 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.934 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.934 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.934 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.934 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.934 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.934 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.934 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.934 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.934 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.934 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.934 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.935 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.935 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.935 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.935 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.935 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.935 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.935 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.935 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.935 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.935 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.935 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.935 INFO:teuthology.orchestra.run.smithi086.stdout: "max_completed_events": { 2024-09-13T16:13:06.935 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_completed_events", 2024-09-13T16:13:06.936 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.936 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.936 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.936 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "50", 2024-09-13T16:13:06.936 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.936 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.936 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.936 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "number of past completed events to remember", 2024-09-13T16:13:06.936 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.936 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.936 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.936 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-09-13T16:13:06.936 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-09-13T16:13:06.937 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:06.937 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.937 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.937 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-09-13T16:13:06.937 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.937 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.937 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.937 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how long the module is going to sleep", 2024-09-13T16:13:06.937 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.937 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.937 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.937 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.937 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.938 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "prometheus", 2024-09-13T16:13:06.938 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.938 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.938 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.938 INFO:teuthology.orchestra.run.smithi086.stdout: "cache": { 2024-09-13T16:13:06.938 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cache", 2024-09-13T16:13:06.938 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.938 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.938 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.938 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.938 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.938 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.938 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.939 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.939 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.939 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.939 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.939 INFO:teuthology.orchestra.run.smithi086.stdout: "exclude_perf_counters": { 2024-09-13T16:13:06.939 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "exclude_perf_counters", 2024-09-13T16:13:06.939 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.939 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.939 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.939 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.939 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.939 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.940 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.940 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T16:13:06.940 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T16:13:06.940 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.940 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.940 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.940 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.940 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.940 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.940 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.940 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.940 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.941 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.941 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.941 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.941 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.941 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.941 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.941 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.941 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.941 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.941 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.941 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.941 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.941 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.942 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.942 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.942 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.942 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.942 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.942 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.942 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.942 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.942 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.942 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.942 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.942 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.942 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.943 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.943 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.943 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.943 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.943 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.943 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.943 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.943 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.943 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.943 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.943 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.943 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.943 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.944 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.944 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.944 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.944 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.944 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.944 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.944 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.944 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.944 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.944 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.944 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.944 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.944 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.945 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.945 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.945 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.945 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.945 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.945 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.945 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.945 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_stats_pools": { 2024-09-13T16:13:06.945 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_stats_pools", 2024-09-13T16:13:06.945 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.945 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.945 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.946 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.946 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.946 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.946 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.946 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.946 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.946 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.946 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.946 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T16:13:06.946 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T16:13:06.946 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.946 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.946 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.946 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "300", 2024-09-13T16:13:06.947 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.947 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.947 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.947 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.947 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.947 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.947 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.947 INFO:teuthology.orchestra.run.smithi086.stdout: "scrape_interval": { 2024-09-13T16:13:06.947 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "scrape_interval", 2024-09-13T16:13:06.947 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:06.947 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.947 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.947 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "15.0", 2024-09-13T16:13:06.948 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.948 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.948 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.948 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.948 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.948 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.948 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.948 INFO:teuthology.orchestra.run.smithi086.stdout: "server_addr": { 2024-09-13T16:13:06.948 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_addr", 2024-09-13T16:13:06.948 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.948 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.948 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.948 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "::", 2024-09-13T16:13:06.949 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.949 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.949 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.949 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T16:13:06.949 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.949 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.949 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.949 INFO:teuthology.orchestra.run.smithi086.stdout: "server_port": { 2024-09-13T16:13:06.949 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_port", 2024-09-13T16:13:06.949 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.949 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.949 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.949 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "9283", 2024-09-13T16:13:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T16:13:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: "stale_cache_strategy": { 2024-09-13T16:13:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "stale_cache_strategy", 2024-09-13T16:13:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "log", 2024-09-13T16:13:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_behaviour": { 2024-09-13T16:13:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_behaviour", 2024-09-13T16:13:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "default", 2024-09-13T16:13:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: "default", 2024-09-13T16:13:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: "error" 2024-09-13T16:13:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_error_status_code": { 2024-09-13T16:13:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_error_status_code", 2024-09-13T16:13:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "500", 2024-09-13T16:13:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "400", 2024-09-13T16:13:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "599", 2024-09-13T16:13:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_support", 2024-09-13T16:13:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.957 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.957 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.957 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.957 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.957 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.957 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.957 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.957 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.957 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.957 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.957 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.957 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.957 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.957 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.957 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: "max_concurrent_snap_create": { 2024-09-13T16:13:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_concurrent_snap_create", 2024-09-13T16:13:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: "mirror_snapshot_schedule": { 2024-09-13T16:13:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T16:13:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: "trash_purge_schedule": { 2024-09-13T16:13:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "trash_purge_schedule", 2024-09-13T16:13:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.962 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.962 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.962 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.962 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.962 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.962 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "restful", 2024-09-13T16:13:06.962 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.962 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.962 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.962 INFO:teuthology.orchestra.run.smithi086.stdout: "enable_auth": { 2024-09-13T16:13:06.962 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enable_auth", 2024-09-13T16:13:06.963 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.963 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.963 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.963 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.963 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.963 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.963 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.963 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.963 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.963 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.963 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.963 INFO:teuthology.orchestra.run.smithi086.stdout: "key_file": { 2024-09-13T16:13:06.963 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "key_file", 2024-09-13T16:13:06.964 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.964 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.964 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.964 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.964 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.964 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.964 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.964 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.964 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.964 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.964 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.964 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.965 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.965 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.965 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.965 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.965 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.965 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.965 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.965 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.965 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.965 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.965 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.965 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.965 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.965 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.966 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.966 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.966 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.966 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.966 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.966 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.966 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.966 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.966 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.966 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.966 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.966 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.966 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.967 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.967 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.967 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.967 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.967 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.967 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.967 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.967 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.967 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.967 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.967 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.967 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.968 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.968 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.968 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.968 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.968 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.968 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.968 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.968 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.968 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.968 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.968 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.968 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.968 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.969 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.969 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.969 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.969 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.969 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.969 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.969 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.969 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.969 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.969 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.969 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.969 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.969 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.970 INFO:teuthology.orchestra.run.smithi086.stdout: "server_addr": { 2024-09-13T16:13:06.970 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_addr", 2024-09-13T16:13:06.970 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.970 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.970 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.970 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.970 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.970 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.970 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.970 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.970 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.970 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.970 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.971 INFO:teuthology.orchestra.run.smithi086.stdout: "server_port": { 2024-09-13T16:13:06.971 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_port", 2024-09-13T16:13:06.971 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.971 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.971 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.971 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.971 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.971 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.971 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.971 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.971 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.971 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.971 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.971 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.971 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.972 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rgw", 2024-09-13T16:13:06.972 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.972 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.972 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.972 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.972 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.972 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.972 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.972 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.972 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.973 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.973 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.973 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.973 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.973 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.973 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.973 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.973 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.973 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.973 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.973 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.973 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.973 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.973 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.974 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.974 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.974 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.974 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.974 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.974 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.974 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.974 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.974 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.974 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.974 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.974 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.974 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.975 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.975 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.975 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.975 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.975 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.975 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.975 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.975 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.975 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.975 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.975 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.975 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.975 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.976 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.976 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.976 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.976 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.976 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.976 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.976 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.976 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.976 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.976 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.976 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.976 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.976 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.977 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.977 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.977 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.977 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.977 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.977 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.977 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.977 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.977 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.977 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rook", 2024-09-13T16:13:06.977 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.977 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.978 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.978 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.978 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.978 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.978 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.978 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.978 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.978 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.978 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.978 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.978 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.978 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.978 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.979 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.979 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.979 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.979 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.979 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.979 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.979 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.979 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.979 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.979 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.979 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.979 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.979 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.980 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.980 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.980 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.980 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.980 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.980 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.980 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.980 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.980 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.980 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.980 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.980 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.981 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.981 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.981 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.981 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.981 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.981 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.981 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.981 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.981 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.981 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.981 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.981 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.981 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.981 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.982 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.982 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.982 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.982 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.982 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.982 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.982 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.982 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.982 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.982 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.982 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.982 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.983 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.983 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.983 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.983 INFO:teuthology.orchestra.run.smithi086.stdout: "storage_class": { 2024-09-13T16:13:06.983 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "storage_class", 2024-09-13T16:13:06.983 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.983 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.983 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.983 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "local", 2024-09-13T16:13:06.983 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.983 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.983 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.983 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-13T16:13:06.984 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.984 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.984 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.984 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.984 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:06.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:06.984 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "selftest", 2024-09-13T16:13:06.984 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:06.984 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:06.984 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:06.984 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:06.984 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:06.984 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.985 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.985 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.985 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.985 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.985 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.985 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.985 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.985 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.985 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.985 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.985 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.985 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.985 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.985 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.986 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.986 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.986 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.986 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:06.986 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:06.986 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.986 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.986 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.986 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.986 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.986 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.986 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.986 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.987 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.987 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.987 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.987 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:06.987 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:06.987 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.987 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.987 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.987 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:06.987 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.987 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.987 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:06.988 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:06.988 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:06.988 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:06.988 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:06.988 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:06.988 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:06.988 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:06.988 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.988 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.988 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.988 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.988 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:06.989 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:06.989 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.989 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.989 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:06.989 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:06.989 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.989 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.989 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.989 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.989 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.989 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.989 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.989 INFO:teuthology.orchestra.run.smithi086.stdout: "roption1": { 2024-09-13T16:13:06.990 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "roption1", 2024-09-13T16:13:06.990 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.990 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.990 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.990 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.990 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.990 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.990 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.990 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.990 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.990 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.990 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.991 INFO:teuthology.orchestra.run.smithi086.stdout: "roption2": { 2024-09-13T16:13:06.991 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "roption2", 2024-09-13T16:13:06.991 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.991 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.991 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.991 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "xyz", 2024-09-13T16:13:06.991 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.991 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.991 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.991 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.991 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.991 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.991 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.992 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption1": { 2024-09-13T16:13:06.992 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption1", 2024-09-13T16:13:06.992 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.992 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.992 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.992 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.992 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.992 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.992 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.992 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.992 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.992 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.992 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.993 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption2": { 2024-09-13T16:13:06.993 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption2", 2024-09-13T16:13:06.993 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.993 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.993 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.993 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.993 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.993 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.993 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.993 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.993 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.993 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.993 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.994 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption3": { 2024-09-13T16:13:06.994 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption3", 2024-09-13T16:13:06.994 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:06.994 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.994 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.994 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.994 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.994 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.994 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.994 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.994 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.994 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.994 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.995 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption4": { 2024-09-13T16:13:06.995 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption4", 2024-09-13T16:13:06.995 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.995 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.995 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.995 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.995 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.995 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.995 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.995 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.995 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.995 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.995 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.996 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption5": { 2024-09-13T16:13:06.996 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption5", 2024-09-13T16:13:06.996 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.996 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.996 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.996 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.996 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.996 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.996 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.996 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.996 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.996 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.996 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.997 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption6": { 2024-09-13T16:13:06.997 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption6", 2024-09-13T16:13:06.997 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:06.997 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.997 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.997 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:06.997 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.997 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.997 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.997 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.997 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.997 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.997 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.998 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption7": { 2024-09-13T16:13:06.998 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption7", 2024-09-13T16:13:06.998 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:06.998 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.998 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.998 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.998 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-09-13T16:13:06.998 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "42", 2024-09-13T16:13:06.998 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.998 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.998 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.998 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.998 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:06.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:06.999 INFO:teuthology.orchestra.run.smithi086.stdout: "testkey": { 2024-09-13T16:13:06.999 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "testkey", 2024-09-13T16:13:06.999 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:06.999 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:06.999 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:06.999 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:06.999 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:06.999 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:06.999 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:06.999 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:06.999 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:06.999 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:06.999 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.000 INFO:teuthology.orchestra.run.smithi086.stdout: "testlkey": { 2024-09-13T16:13:07.000 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "testlkey", 2024-09-13T16:13:07.000 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.000 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.000 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.000 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.000 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.000 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.000 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.000 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.000 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.000 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.001 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.001 INFO:teuthology.orchestra.run.smithi086.stdout: "testnewline": { 2024-09-13T16:13:07.001 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "testnewline", 2024-09-13T16:13:07.001 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.001 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.001 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.001 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.001 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.001 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.001 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.001 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.002 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.002 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.002 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.002 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.002 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.002 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snap_schedule", 2024-09-13T16:13:07.002 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.002 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.002 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.002 INFO:teuthology.orchestra.run.smithi086.stdout: "allow_m_granularity": { 2024-09-13T16:13:07.002 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "allow_m_granularity", 2024-09-13T16:13:07.003 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.003 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.003 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.003 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.003 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.003 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.003 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.003 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T16:13:07.003 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.003 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.003 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.003 INFO:teuthology.orchestra.run.smithi086.stdout: "dump_on_update": { 2024-09-13T16:13:07.003 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "dump_on_update", 2024-09-13T16:13:07.004 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.004 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.004 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.004 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.004 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.004 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.004 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.004 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "dump database to debug log on update", 2024-09-13T16:13:07.004 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.004 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.004 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.004 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.004 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.005 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.005 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.005 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.005 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.005 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.005 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.005 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.005 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.005 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.005 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.005 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.005 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.005 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.005 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.006 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.006 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.006 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.006 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.006 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.006 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.006 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.006 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.006 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.006 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.006 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.006 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.006 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.007 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.007 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.007 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.007 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.007 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.007 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.007 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.007 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.007 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.007 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.007 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.007 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.008 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.008 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.008 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.008 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.008 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.008 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.008 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.008 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.008 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.008 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.008 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.008 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.009 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.009 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.009 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.009 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.009 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.009 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.009 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.009 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.009 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.009 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.009 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.009 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.009 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.009 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.010 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.010 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "stats", 2024-09-13T16:13:07.010 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.010 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.010 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.010 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.010 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.010 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.010 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.010 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.010 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.010 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.011 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.011 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.011 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.011 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.011 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.011 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.011 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.011 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.011 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.011 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.011 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.011 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.011 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.011 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.012 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.012 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.012 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.012 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.012 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.012 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.012 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.012 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.012 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.012 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.012 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.012 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.012 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.013 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.013 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.013 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.013 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.013 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.013 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.013 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.013 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.013 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.013 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.013 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.013 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.013 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.013 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.013 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.014 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.014 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.014 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.014 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.014 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.014 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.014 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.014 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.014 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.014 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.014 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.014 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.014 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.015 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.015 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.015 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.015 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.015 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.015 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.015 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "status", 2024-09-13T16:13:07.015 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.015 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.015 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.015 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.015 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.016 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.016 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.016 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.016 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.016 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.016 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.016 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.016 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.016 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.016 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.016 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.016 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.016 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.016 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.017 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.017 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.017 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.017 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.017 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.017 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.017 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.017 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.017 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.017 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.017 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.017 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.017 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.018 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.018 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.018 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.018 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.018 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.018 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.018 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.018 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.018 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.018 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.018 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.018 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.019 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.019 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.019 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.019 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.019 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.019 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.019 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.019 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.019 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.019 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.019 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.019 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.019 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.020 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.020 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.020 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.020 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.020 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.020 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.020 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.020 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.020 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.020 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.020 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.020 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.020 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.020 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.021 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "telegraf", 2024-09-13T16:13:07.021 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.021 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.021 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.021 INFO:teuthology.orchestra.run.smithi086.stdout: "address": { 2024-09-13T16:13:07.021 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "address", 2024-09-13T16:13:07.021 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.021 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.021 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.021 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T16:13:07.021 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.021 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.022 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.022 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.022 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.022 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.022 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.022 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-09-13T16:13:07.022 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-09-13T16:13:07.022 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.022 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.022 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.022 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "15", 2024-09-13T16:13:07.022 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.023 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.023 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.023 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.023 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.023 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.023 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.023 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.023 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.023 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.023 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.023 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.024 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.024 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.024 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.024 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.024 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.024 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.024 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.024 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.024 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.024 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.024 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.024 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.024 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.025 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.025 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.025 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.025 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.025 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.025 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.025 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.025 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.025 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.025 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.025 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.025 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.025 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.026 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.026 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.026 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.026 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.026 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.026 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.026 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.026 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.026 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.026 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.026 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.026 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.026 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.027 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.027 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.027 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.027 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.027 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.027 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.027 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.027 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.027 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.027 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.027 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.027 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.027 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.028 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.028 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.028 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.028 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.028 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.028 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.028 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.028 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.028 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.028 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.028 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.029 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "telemetry", 2024-09-13T16:13:07.029 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.029 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.029 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.029 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_basic": { 2024-09-13T16:13:07.029 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_basic", 2024-09-13T16:13:07.029 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.029 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.029 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.029 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.029 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.029 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.029 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.029 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T16:13:07.030 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.030 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.030 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.030 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_crash": { 2024-09-13T16:13:07.030 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_crash", 2024-09-13T16:13:07.030 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.030 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.030 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.030 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.030 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.030 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.030 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.030 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T16:13:07.031 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.031 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.031 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.031 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_device": { 2024-09-13T16:13:07.031 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_device", 2024-09-13T16:13:07.031 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.031 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.031 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.031 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.031 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.031 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.031 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.032 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T16:13:07.032 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.032 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.032 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.032 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_ident": { 2024-09-13T16:13:07.032 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_ident", 2024-09-13T16:13:07.032 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.032 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.032 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.032 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.032 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.032 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.032 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.033 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T16:13:07.033 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.033 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.033 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.033 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_perf": { 2024-09-13T16:13:07.033 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_perf", 2024-09-13T16:13:07.033 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.033 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.033 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.033 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.033 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.033 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.033 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.034 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T16:13:07.034 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.034 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.034 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.034 INFO:teuthology.orchestra.run.smithi086.stdout: "contact": { 2024-09-13T16:13:07.034 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "contact", 2024-09-13T16:13:07.034 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.034 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.034 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.034 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.034 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.034 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.034 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.035 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.035 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.035 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.035 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.035 INFO:teuthology.orchestra.run.smithi086.stdout: "description": { 2024-09-13T16:13:07.035 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "description", 2024-09-13T16:13:07.035 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.035 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.035 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.035 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.035 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.035 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.036 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.036 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.036 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.036 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.036 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.036 INFO:teuthology.orchestra.run.smithi086.stdout: "device_url": { 2024-09-13T16:13:07.036 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "device_url", 2024-09-13T16:13:07.036 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.036 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.036 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.036 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T16:13:07.036 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.037 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.037 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.037 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.037 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.037 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.037 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.037 INFO:teuthology.orchestra.run.smithi086.stdout: "enabled": { 2024-09-13T16:13:07.037 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enabled", 2024-09-13T16:13:07.037 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.037 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.037 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.037 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.037 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.038 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.038 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.038 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.038 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.038 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.038 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.038 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-09-13T16:13:07.038 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-09-13T16:13:07.038 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.038 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.038 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.038 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "24", 2024-09-13T16:13:07.038 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "8", 2024-09-13T16:13:07.038 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.039 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.039 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.039 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.039 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.039 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.039 INFO:teuthology.orchestra.run.smithi086.stdout: "last_opt_revision": { 2024-09-13T16:13:07.039 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "last_opt_revision", 2024-09-13T16:13:07.039 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.039 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.039 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.039 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "1", 2024-09-13T16:13:07.039 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.039 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.040 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.040 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.040 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.040 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.040 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.040 INFO:teuthology.orchestra.run.smithi086.stdout: "leaderboard": { 2024-09-13T16:13:07.040 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "leaderboard", 2024-09-13T16:13:07.040 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.040 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.040 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.040 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.040 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.040 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.041 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.041 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.041 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.041 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.041 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.041 INFO:teuthology.orchestra.run.smithi086.stdout: "leaderboard_description": { 2024-09-13T16:13:07.041 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "leaderboard_description", 2024-09-13T16:13:07.041 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.041 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.041 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.041 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.041 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.041 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.041 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.042 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.042 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.042 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.042 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.042 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.042 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.042 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.042 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.042 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.042 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.042 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.042 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.042 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.043 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.043 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.043 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.043 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.043 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.043 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.043 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.043 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.043 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.043 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.043 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.043 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.044 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.044 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.044 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.044 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.044 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.044 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.044 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.044 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.044 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.044 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.044 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.044 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.044 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.045 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.045 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.045 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.045 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.045 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.045 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.045 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.045 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.045 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.045 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.045 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.045 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.045 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.045 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.046 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.046 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.046 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.046 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.046 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.046 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.046 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.046 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.046 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.046 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.048 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.048 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.048 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.048 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.048 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.048 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.048 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.048 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.049 INFO:teuthology.orchestra.run.smithi086.stdout: "organization": { 2024-09-13T16:13:07.049 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "organization", 2024-09-13T16:13:07.049 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.049 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.049 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.049 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.049 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.049 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.049 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.049 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.049 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.049 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.049 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.050 INFO:teuthology.orchestra.run.smithi086.stdout: "proxy": { 2024-09-13T16:13:07.050 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "proxy", 2024-09-13T16:13:07.050 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.050 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.050 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.050 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.050 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.050 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.050 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.050 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.050 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.050 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.050 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.051 INFO:teuthology.orchestra.run.smithi086.stdout: "url": { 2024-09-13T16:13:07.051 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "url", 2024-09-13T16:13:07.051 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.051 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.051 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.051 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T16:13:07.051 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.051 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.051 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.051 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.051 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.051 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.051 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.052 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.052 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.052 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "test_orchestrator", 2024-09-13T16:13:07.052 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.052 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.052 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.052 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.052 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.052 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.052 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.052 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.053 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.053 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.053 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.053 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.053 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.053 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.053 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.053 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.053 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.053 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.053 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.053 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.053 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.053 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.054 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.054 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.054 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.054 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.054 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.054 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.054 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.054 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.054 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.054 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.054 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.054 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.054 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.055 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.055 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.055 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.055 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.055 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.055 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.055 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.055 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.055 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.055 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.055 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.055 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.055 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.055 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.056 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.056 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.056 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.056 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.056 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.056 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.056 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.056 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.056 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.056 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.056 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.056 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.057 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.057 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.057 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.057 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.057 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.057 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.057 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.057 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.057 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.057 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.057 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "volumes", 2024-09-13T16:13:07.057 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.057 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.058 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.058 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.058 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.058 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.058 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.058 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.058 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.058 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.058 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.058 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.058 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.058 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.058 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.058 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.059 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.059 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.059 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.059 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.059 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.059 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.059 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.059 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.059 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.059 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.059 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.059 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.060 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.060 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.060 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.060 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.060 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.060 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.060 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.060 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.060 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.060 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.060 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.060 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "max_concurrent_clones": { 2024-09-13T16:13:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_concurrent_clones", 2024-09-13T16:13:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "4", 2024-09-13T16:13:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T16:13:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "snapshot_clone_delay": { 2024-09-13T16:13:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snapshot_clone_delay", 2024-09-13T16:13:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-09-13T16:13:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T16:13:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "snapshot_clone_no_wait": { 2024-09-13T16:13:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T16:13:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T16:13:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix", 2024-09-13T16:13:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: "discovery_interval": { 2024-09-13T16:13:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "discovery_interval", 2024-09-13T16:13:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-09-13T16:13:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "100", 2024-09-13T16:13:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: "identifier": { 2024-09-13T16:13:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "identifier", 2024-09-13T16:13:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-09-13T16:13:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-09-13T16:13:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-09-13T16:13:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.071 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.071 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.071 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.071 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.071 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.071 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.071 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.071 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.071 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.071 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.071 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.071 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.071 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.072 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.072 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.072 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.072 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.072 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.072 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.072 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.072 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.072 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.072 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.072 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.072 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.072 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.073 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.073 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.073 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.073 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.073 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.073 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.073 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.073 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.073 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.073 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.073 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.073 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.073 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.074 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.074 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.074 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.074 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.074 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.074 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.074 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.074 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.074 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.074 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.074 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.074 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: "zabbix_host": { 2024-09-13T16:13:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix_host", 2024-09-13T16:13:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: "zabbix_port": { 2024-09-13T16:13:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix_port", 2024-09-13T16:13:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10051", 2024-09-13T16:13:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "zabbix_sender": { 2024-09-13T16:13:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix_sender", 2024-09-13T16:13:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T16:13:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T16:13:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: "modules": [ 2024-09-13T16:13:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: "cephadm", 2024-09-13T16:13:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: "dashboard", 2024-09-13T16:13:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: "iostat", 2024-09-13T16:13:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: "nfs", 2024-09-13T16:13:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: "restful" 2024-09-13T16:13:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: "available_modules": [ 2024-09-13T16:13:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "alerts", 2024-09-13T16:13:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-09-13T16:13:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-09-13T16:13:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.080 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-09-13T16:13:07.080 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.080 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.080 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.080 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T16:13:07.080 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.080 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.080 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.080 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.080 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.080 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.080 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.080 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_destination": { 2024-09-13T16:13:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_destination", 2024-09-13T16:13:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Email address to send alerts to", 2024-09-13T16:13:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_from_name": { 2024-09-13T16:13:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_from_name", 2024-09-13T16:13:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "Ceph", 2024-09-13T16:13:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Email From: name", 2024-09-13T16:13:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_host": { 2024-09-13T16:13:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_host", 2024-09-13T16:13:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SMTP server", 2024-09-13T16:13:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_password": { 2024-09-13T16:13:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_password", 2024-09-13T16:13:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.089 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.089 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.089 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.089 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Password to authenticate with", 2024-09-13T16:13:07.089 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.089 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.089 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.089 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_port": { 2024-09-13T16:13:07.089 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_port", 2024-09-13T16:13:07.089 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.089 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "465", 2024-09-13T16:13:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SMTP port", 2024-09-13T16:13:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_sender": { 2024-09-13T16:13:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_sender", 2024-09-13T16:13:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SMTP envelope sender", 2024-09-13T16:13:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_ssl": { 2024-09-13T16:13:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_ssl", 2024-09-13T16:13:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T16:13:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: "smtp_user": { 2024-09-13T16:13:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "smtp_user", 2024-09-13T16:13:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "User to authenticate as", 2024-09-13T16:13:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "balancer", 2024-09-13T16:13:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: "active": { 2024-09-13T16:13:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "active", 2024-09-13T16:13:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T16:13:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: "begin_time": { 2024-09-13T16:13:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "begin_time", 2024-09-13T16:13:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0000", 2024-09-13T16:13:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T16:13:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T16:13:07.096 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.096 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.096 INFO:teuthology.orchestra.run.smithi086.stdout: "begin_weekday": { 2024-09-13T16:13:07.096 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "begin_weekday", 2024-09-13T16:13:07.096 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-09-13T16:13:07.096 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.096 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.096 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-09-13T16:13:07.096 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "0", 2024-09-13T16:13:07.096 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "6", 2024-09-13T16:13:07.096 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.096 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T16:13:07.096 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T16:13:07.097 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.097 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.097 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_compat_max_iterations": { 2024-09-13T16:13:07.097 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crush_compat_max_iterations", 2024-09-13T16:13:07.097 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-09-13T16:13:07.097 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.097 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.097 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "25", 2024-09-13T16:13:07.097 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-09-13T16:13:07.097 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "250", 2024-09-13T16:13:07.097 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.097 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T16:13:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_compat_metrics": { 2024-09-13T16:13:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crush_compat_metrics", 2024-09-13T16:13:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T16:13:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T16:13:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T16:13:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_compat_step": { 2024-09-13T16:13:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crush_compat_step", 2024-09-13T16:13:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0.5", 2024-09-13T16:13:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "0.001", 2024-09-13T16:13:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "0.999", 2024-09-13T16:13:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "aggressiveness of optimization", 2024-09-13T16:13:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T16:13:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: "end_time": { 2024-09-13T16:13:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "end_time", 2024-09-13T16:13:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "2359", 2024-09-13T16:13:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T16:13:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T16:13:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "end_weekday": { 2024-09-13T16:13:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "end_weekday", 2024-09-13T16:13:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-09-13T16:13:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-09-13T16:13:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "0", 2024-09-13T16:13:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "6", 2024-09-13T16:13:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T16:13:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T16:13:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.103 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.103 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.103 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.103 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.103 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.103 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.103 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.103 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.103 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.103 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.103 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.103 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.103 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.103 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.104 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.104 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.104 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.104 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.104 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.104 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.104 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.104 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.104 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.104 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.104 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.104 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.105 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.105 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.105 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.105 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.105 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.105 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.105 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.105 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.105 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.105 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.105 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.105 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.105 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.105 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.106 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.106 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.106 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.106 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.106 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.106 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.106 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.106 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.106 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.106 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.106 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.106 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.106 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.106 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "min_score": { 2024-09-13T16:13:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "min_score", 2024-09-13T16:13:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-09-13T16:13:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T16:13:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "mode": { 2024-09-13T16:13:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mode", 2024-09-13T16:13:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "upmap", 2024-09-13T16:13:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "crush-compat", 2024-09-13T16:13:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "none", 2024-09-13T16:13:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap" 2024-09-13T16:13:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Balancer mode", 2024-09-13T16:13:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "pool_ids": { 2024-09-13T16:13:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pool_ids", 2024-09-13T16:13:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T16:13:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-09-13T16:13:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-09-13T16:13:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-09-13T16:13:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T16:13:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap_max_deviation": { 2024-09-13T16:13:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "upmap_max_deviation", 2024-09-13T16:13:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-09-13T16:13:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-09-13T16:13:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T16:13:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T16:13:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "upmap_max_optimizations": { 2024-09-13T16:13:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "upmap_max_optimizations", 2024-09-13T16:13:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-09-13T16:13:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T16:13:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephadm", 2024-09-13T16:13:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "agent_down_multiplier": { 2024-09-13T16:13:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "agent_down_multiplier", 2024-09-13T16:13:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "3.0", 2024-09-13T16:13:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T16:13:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "agent_refresh_rate": { 2024-09-13T16:13:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "agent_refresh_rate", 2024-09-13T16:13:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "20", 2024-09-13T16:13:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T16:13:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "agent_starting_port": { 2024-09-13T16:13:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "agent_starting_port", 2024-09-13T16:13:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "4721", 2024-09-13T16:13:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T16:13:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "allow_ptrace": { 2024-09-13T16:13:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "allow_ptrace", 2024-09-13T16:13:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T16:13:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T16:13:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "autotune_interval": { 2024-09-13T16:13:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "autotune_interval", 2024-09-13T16:13:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-09-13T16:13:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T16:13:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "autotune_memory_target_ratio": { 2024-09-13T16:13:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T16:13:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0.7", 2024-09-13T16:13:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T16:13:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "cgroups_split": { 2024-09-13T16:13:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cgroups_split", 2024-09-13T16:13:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T16:13:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "config_checks_enabled": { 2024-09-13T16:13:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "config_checks_enabled", 2024-09-13T16:13:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T16:13:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "config_dashboard": { 2024-09-13T16:13:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "config_dashboard", 2024-09-13T16:13:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T16:13:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_alertmanager": { 2024-09-13T16:13:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_alertmanager", 2024-09-13T16:13:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T16:13:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_base": { 2024-09-13T16:13:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_base", 2024-09-13T16:13:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T16:13:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Container image name, without the tag", 2024-09-13T16:13:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_elasticsearch": { 2024-09-13T16:13:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_elasticsearch", 2024-09-13T16:13:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T16:13:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "elasticsearch container image", 2024-09-13T16:13:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_grafana": { 2024-09-13T16:13:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_grafana", 2024-09-13T16:13:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T16:13:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_haproxy": { 2024-09-13T16:13:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_haproxy", 2024-09-13T16:13:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T16:13:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "HAproxy container image", 2024-09-13T16:13:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_jaeger_agent": { 2024-09-13T16:13:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_jaeger_agent", 2024-09-13T16:13:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T16:13:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Jaeger agent container image", 2024-09-13T16:13:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_jaeger_collector": { 2024-09-13T16:13:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_jaeger_collector", 2024-09-13T16:13:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T16:13:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Jaeger collector container image", 2024-09-13T16:13:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_jaeger_query": { 2024-09-13T16:13:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_jaeger_query", 2024-09-13T16:13:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T16:13:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Jaeger query container image", 2024-09-13T16:13:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_keepalived": { 2024-09-13T16:13:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_keepalived", 2024-09-13T16:13:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T16:13:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Keepalived container image", 2024-09-13T16:13:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_loki": { 2024-09-13T16:13:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_loki", 2024-09-13T16:13:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T16:13:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Loki container image", 2024-09-13T16:13:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_node_exporter": { 2024-09-13T16:13:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_node_exporter", 2024-09-13T16:13:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T16:13:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_nvmeof": { 2024-09-13T16:13:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_nvmeof", 2024-09-13T16:13:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T16:13:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Nvme-of container image", 2024-09-13T16:13:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_prometheus": { 2024-09-13T16:13:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_prometheus", 2024-09-13T16:13:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T16:13:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_promtail": { 2024-09-13T16:13:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_promtail", 2024-09-13T16:13:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T16:13:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Promtail container image", 2024-09-13T16:13:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image_snmp_gateway": { 2024-09-13T16:13:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_image_snmp_gateway", 2024-09-13T16:13:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T16:13:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "SNMP Gateway container image", 2024-09-13T16:13:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "container_init": { 2024-09-13T16:13:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "container_init", 2024-09-13T16:13:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T16:13:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "daemon_cache_timeout": { 2024-09-13T16:13:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "daemon_cache_timeout", 2024-09-13T16:13:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-09-13T16:13:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T16:13:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "default_cephadm_command_timeout": { 2024-09-13T16:13:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T16:13:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "900", 2024-09-13T16:13:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T16:13:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "default_registry": { 2024-09-13T16:13:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "default_registry", 2024-09-13T16:13:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "docker.io", 2024-09-13T16:13:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T16:13:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "device_cache_timeout": { 2024-09-13T16:13:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "device_cache_timeout", 2024-09-13T16:13:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "1800", 2024-09-13T16:13:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "seconds to cache device inventory", 2024-09-13T16:13:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "device_enhanced_scan": { 2024-09-13T16:13:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "device_enhanced_scan", 2024-09-13T16:13:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T16:13:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "facts_cache_timeout": { 2024-09-13T16:13:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "facts_cache_timeout", 2024-09-13T16:13:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-09-13T16:13:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "seconds to cache host facts data", 2024-09-13T16:13:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "host_check_interval": { 2024-09-13T16:13:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "host_check_interval", 2024-09-13T16:13:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-09-13T16:13:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to perform a host check", 2024-09-13T16:13:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "hw_monitoring": { 2024-09-13T16:13:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "hw_monitoring", 2024-09-13T16:13:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T16:13:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "inventory_list_all": { 2024-09-13T16:13:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "inventory_list_all", 2024-09-13T16:13:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T16:13:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "log_refresh_metadata": { 2024-09-13T16:13:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_refresh_metadata", 2024-09-13T16:13:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T16:13:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T16:13:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T16:13:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T16:13:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T16:13:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T16:13:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T16:13:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "*", 2024-09-13T16:13:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T16:13:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "max_count_per_host": { 2024-09-13T16:13:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_count_per_host", 2024-09-13T16:13:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "max number of daemons per service per host", 2024-09-13T16:13:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "max_osd_draining_count": { 2024-09-13T16:13:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_osd_draining_count", 2024-09-13T16:13:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T16:13:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "migration_current": { 2024-09-13T16:13:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "migration_current", 2024-09-13T16:13:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "internal - do not modify", 2024-09-13T16:13:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "mode": { 2024-09-13T16:13:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mode", 2024-09-13T16:13:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "root", 2024-09-13T16:13:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "cephadm-package", 2024-09-13T16:13:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "root" 2024-09-13T16:13:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T16:13:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "oob_default_addr": { 2024-09-13T16:13:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "oob_default_addr", 2024-09-13T16:13:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "169.254.1.1", 2024-09-13T16:13:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T16:13:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "prometheus_alerts_path": { 2024-09-13T16:13:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "prometheus_alerts_path", 2024-09-13T16:13:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T16:13:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T16:13:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_insecure": { 2024-09-13T16:13:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_insecure", 2024-09-13T16:13:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T16:13:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_password": { 2024-09-13T16:13:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_password", 2024-09-13T16:13:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T16:13:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_url": { 2024-09-13T16:13:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_url", 2024-09-13T16:13:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T16:13:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "registry_username": { 2024-09-13T16:13:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "registry_username", 2024-09-13T16:13:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T16:13:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "secure_monitoring_stack": { 2024-09-13T16:13:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "secure_monitoring_stack", 2024-09-13T16:13:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T16:13:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "service_discovery_port": { 2024-09-13T16:13:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "service_discovery_port", 2024-09-13T16:13:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8765", 2024-09-13T16:13:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "cephadm service discovery port", 2024-09-13T16:13:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "ssh_config_file": { 2024-09-13T16:13:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssh_config_file", 2024-09-13T16:13:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T16:13:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "use_agent": { 2024-09-13T16:13:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "use_agent", 2024-09-13T16:13:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T16:13:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "use_repo_digest": { 2024-09-13T16:13:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "use_repo_digest", 2024-09-13T16:13:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T16:13:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_on_failed_host_check": { 2024-09-13T16:13:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_on_failed_host_check", 2024-09-13T16:13:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T16:13:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_on_stray_daemons": { 2024-09-13T16:13:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_on_stray_daemons", 2024-09-13T16:13:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T16:13:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_on_stray_hosts": { 2024-09-13T16:13:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_on_stray_hosts", 2024-09-13T16:13:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T16:13:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crash", 2024-09-13T16:13:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "retain_interval": { 2024-09-13T16:13:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "retain_interval", 2024-09-13T16:13:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "31536000", 2024-09-13T16:13:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T16:13:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_recent_interval": { 2024-09-13T16:13:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_recent_interval", 2024-09-13T16:13:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "1209600", 2024-09-13T16:13:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T16:13:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "dashboard", 2024-09-13T16:13:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T16:13:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T16:13:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T16:13:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T16:13:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T16:13:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T16:13:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "AUDIT_API_ENABLED": { 2024-09-13T16:13:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T16:13:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T16:13:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T16:13:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T16:13:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T16:13:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T16:13:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T16:13:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T16:13:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T16:13:07.189 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.189 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.189 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.189 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.189 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.189 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.189 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.189 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.189 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.189 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.189 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.189 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T16:13:07.189 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T16:13:07.189 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.190 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.190 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.190 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.190 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.190 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.190 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.190 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.190 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.190 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.190 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.190 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T16:13:07.190 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T16:13:07.190 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.191 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.191 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.191 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.191 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.191 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.191 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.191 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.191 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.191 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.191 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.191 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T16:13:07.191 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T16:13:07.191 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.191 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.192 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.192 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.192 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.192 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.192 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.192 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.192 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.192 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.192 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.192 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T16:13:07.192 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T16:13:07.192 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.192 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.193 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.193 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.193 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.193 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.193 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.193 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.193 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.193 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.193 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.193 INFO:teuthology.orchestra.run.smithi086.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T16:13:07.193 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T16:13:07.193 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.193 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.194 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.194 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.194 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.194 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.194 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.194 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.194 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.194 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.194 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.194 INFO:teuthology.orchestra.run.smithi086.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T16:13:07.194 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T16:13:07.194 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.194 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.195 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.195 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.195 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.195 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.195 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.195 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.195 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.195 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.195 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.195 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T16:13:07.195 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T16:13:07.195 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.195 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.196 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.196 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "admin", 2024-09-13T16:13:07.196 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.196 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.196 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.196 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.196 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.196 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.196 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.196 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T16:13:07.196 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T16:13:07.196 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.197 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.197 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.197 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.197 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.197 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.197 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.197 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.197 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.197 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.197 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.197 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_URL": { 2024-09-13T16:13:07.197 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_URL", 2024-09-13T16:13:07.197 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.198 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.198 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.198 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.198 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.198 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.198 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.198 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.198 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.198 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.198 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.198 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T16:13:07.198 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T16:13:07.198 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.199 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.199 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.199 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "admin", 2024-09-13T16:13:07.199 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.199 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.199 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.199 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.199 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.199 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.199 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.199 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T16:13:07.199 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T16:13:07.199 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.199 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.200 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.200 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.200 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.200 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.200 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.200 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.200 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.200 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.200 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.200 INFO:teuthology.orchestra.run.smithi086.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T16:13:07.200 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T16:13:07.200 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.200 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.201 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.201 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.201 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.201 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.201 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.201 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.201 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.201 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.201 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.201 INFO:teuthology.orchestra.run.smithi086.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T16:13:07.201 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T16:13:07.201 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.202 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.202 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.202 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.202 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.202 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.202 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.202 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.202 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.202 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.202 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.202 INFO:teuthology.orchestra.run.smithi086.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T16:13:07.202 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T16:13:07.202 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.202 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.203 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.203 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.203 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.203 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.203 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.203 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.203 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.203 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.203 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.203 INFO:teuthology.orchestra.run.smithi086.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T16:13:07.203 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T16:13:07.203 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.203 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.204 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.204 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.204 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.204 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.204 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.204 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.204 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.204 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.204 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.204 INFO:teuthology.orchestra.run.smithi086.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T16:13:07.204 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T16:13:07.204 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.204 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.205 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.205 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.205 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.205 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.205 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.205 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.205 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.205 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.205 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.205 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T16:13:07.205 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T16:13:07.205 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.206 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.206 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.206 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.206 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.206 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.206 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.206 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.206 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.206 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.206 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.206 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T16:13:07.206 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T16:13:07.206 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.207 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.207 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.207 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.207 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.207 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.207 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.207 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.207 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.207 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.207 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.207 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T16:13:07.208 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T16:13:07.208 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.208 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.208 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.208 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.208 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.208 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.208 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.208 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.208 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.208 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.208 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.208 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T16:13:07.209 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T16:13:07.209 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.209 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.209 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.209 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.209 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.209 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.209 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.209 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.209 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.209 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.209 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.209 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T16:13:07.209 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T16:13:07.210 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.210 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.210 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.210 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.210 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.210 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.210 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.210 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.210 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.210 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.210 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.210 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T16:13:07.210 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T16:13:07.211 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.211 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.211 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.211 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.211 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.211 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.211 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.211 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.211 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.211 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.211 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.211 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T16:13:07.211 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T16:13:07.212 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.212 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.212 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.212 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.212 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.212 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.212 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.212 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.212 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.212 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.212 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.212 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T16:13:07.212 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T16:13:07.213 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.213 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.213 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.213 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.213 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.213 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.213 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.213 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.213 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.213 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.213 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.213 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T16:13:07.213 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T16:13:07.214 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.214 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.214 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.214 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T16:13:07.214 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.214 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.214 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.214 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.214 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.214 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.214 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.214 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T16:13:07.214 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T16:13:07.215 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.215 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.215 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.215 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:07.215 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.215 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.215 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.215 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.215 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.215 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.215 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.215 INFO:teuthology.orchestra.run.smithi086.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T16:13:07.215 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T16:13:07.216 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.216 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.216 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.216 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8", 2024-09-13T16:13:07.216 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.216 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.216 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.216 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.216 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.216 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.216 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.216 INFO:teuthology.orchestra.run.smithi086.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T16:13:07.217 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T16:13:07.217 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.217 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.217 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.217 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "45", 2024-09-13T16:13:07.217 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.217 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.217 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.217 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.217 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.217 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.217 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.217 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T16:13:07.218 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T16:13:07.218 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.218 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.218 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.218 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.218 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.218 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.218 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.218 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.218 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.218 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.218 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.218 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T16:13:07.219 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T16:13:07.219 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.219 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.219 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.219 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "admin", 2024-09-13T16:13:07.219 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.219 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.219 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.219 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.219 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.219 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.219 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.220 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T16:13:07.220 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T16:13:07.220 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.220 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.220 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.220 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.220 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.220 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.220 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.220 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.220 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.220 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.220 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.221 INFO:teuthology.orchestra.run.smithi086.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T16:13:07.221 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T16:13:07.221 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.221 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.221 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.221 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.221 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.221 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.221 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.221 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.221 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.221 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.221 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.222 INFO:teuthology.orchestra.run.smithi086.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T16:13:07.222 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T16:13:07.222 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.222 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.222 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.222 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.222 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.222 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.222 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.222 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.222 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.222 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.222 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.223 INFO:teuthology.orchestra.run.smithi086.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T16:13:07.223 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T16:13:07.223 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.223 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.223 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.223 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-09-13T16:13:07.223 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.223 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.223 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.223 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.223 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.223 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.223 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.224 INFO:teuthology.orchestra.run.smithi086.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T16:13:07.224 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T16:13:07.224 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.224 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.224 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.224 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:07.224 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.224 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.224 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.224 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.224 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.224 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.225 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.225 INFO:teuthology.orchestra.run.smithi086.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T16:13:07.225 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T16:13:07.225 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.225 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.225 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.225 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-09-13T16:13:07.225 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.225 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.225 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.225 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.225 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.225 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "cross_origin_url": { 2024-09-13T16:13:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cross_origin_url", 2024-09-13T16:13:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.226 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.227 INFO:teuthology.orchestra.run.smithi086.stdout: "crt_file": { 2024-09-13T16:13:07.227 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "crt_file", 2024-09-13T16:13:07.227 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.227 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.227 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.227 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.227 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.227 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.227 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.227 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.227 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.227 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.228 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.228 INFO:teuthology.orchestra.run.smithi086.stdout: "debug": { 2024-09-13T16:13:07.228 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "debug", 2024-09-13T16:13:07.228 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.228 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.228 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.228 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.228 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.228 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.228 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.228 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Enable/disable debug options", 2024-09-13T16:13:07.228 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.229 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.229 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.229 INFO:teuthology.orchestra.run.smithi086.stdout: "jwt_token_ttl": { 2024-09-13T16:13:07.229 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "jwt_token_ttl", 2024-09-13T16:13:07.229 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.229 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.229 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.229 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "28800", 2024-09-13T16:13:07.229 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.229 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.229 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.229 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.229 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.230 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.230 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.230 INFO:teuthology.orchestra.run.smithi086.stdout: "key_file": { 2024-09-13T16:13:07.230 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "key_file", 2024-09-13T16:13:07.230 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.230 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.230 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.230 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.230 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.230 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.230 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.230 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.230 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.231 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.231 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.231 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.231 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.231 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.231 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.231 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.231 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.231 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.231 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.231 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.231 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.231 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.232 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.232 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.232 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.232 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.232 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.232 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.232 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.232 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.232 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.232 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.232 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.232 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.233 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.233 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.233 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.233 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.233 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.233 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.233 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.233 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.233 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.233 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.233 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.233 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.233 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.234 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.234 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.234 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.234 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.234 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.234 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.234 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.234 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.234 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.234 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.234 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.234 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.234 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.235 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.235 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.235 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.235 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.235 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.235 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.235 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.235 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.235 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.235 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.235 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.235 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.235 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.236 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.236 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.236 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.236 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.236 INFO:teuthology.orchestra.run.smithi086.stdout: "motd": { 2024-09-13T16:13:07.236 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "motd", 2024-09-13T16:13:07.236 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.236 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.236 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.236 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.236 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.236 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.237 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.237 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "The message of the day", 2024-09-13T16:13:07.237 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.237 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.237 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.237 INFO:teuthology.orchestra.run.smithi086.stdout: "redirect_resolve_ip_addr": { 2024-09-13T16:13:07.237 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T16:13:07.237 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.237 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.237 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.237 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.237 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.238 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.238 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.238 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.238 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.238 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.238 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.238 INFO:teuthology.orchestra.run.smithi086.stdout: "server_addr": { 2024-09-13T16:13:07.238 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_addr", 2024-09-13T16:13:07.238 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.238 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.239 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.239 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "::", 2024-09-13T16:13:07.239 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.239 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.239 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.239 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.239 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.239 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.239 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.239 INFO:teuthology.orchestra.run.smithi086.stdout: "server_port": { 2024-09-13T16:13:07.239 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_port", 2024-09-13T16:13:07.239 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.239 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.240 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.240 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8080", 2024-09-13T16:13:07.240 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.240 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.240 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.240 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.240 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.240 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.240 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.240 INFO:teuthology.orchestra.run.smithi086.stdout: "ssl": { 2024-09-13T16:13:07.240 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssl", 2024-09-13T16:13:07.240 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.241 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.241 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.241 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.241 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.241 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.241 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.241 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.241 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.241 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.241 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.241 INFO:teuthology.orchestra.run.smithi086.stdout: "ssl_server_port": { 2024-09-13T16:13:07.241 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssl_server_port", 2024-09-13T16:13:07.241 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.242 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.242 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.242 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8443", 2024-09-13T16:13:07.242 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.242 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.242 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.242 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.242 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.242 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.242 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.242 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_behaviour": { 2024-09-13T16:13:07.242 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_behaviour", 2024-09-13T16:13:07.242 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.243 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.243 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.243 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "redirect", 2024-09-13T16:13:07.243 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.243 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.243 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.243 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.243 INFO:teuthology.orchestra.run.smithi086.stdout: "redirect" 2024-09-13T16:13:07.243 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.243 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.243 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.243 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.243 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.243 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_error_status_code": { 2024-09-13T16:13:07.244 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_error_status_code", 2024-09-13T16:13:07.244 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.244 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.244 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.244 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "500", 2024-09-13T16:13:07.244 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "400", 2024-09-13T16:13:07.244 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "599", 2024-09-13T16:13:07.244 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.244 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.244 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.244 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.244 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.245 INFO:teuthology.orchestra.run.smithi086.stdout: "url_prefix": { 2024-09-13T16:13:07.245 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "url_prefix", 2024-09-13T16:13:07.245 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.245 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.245 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.245 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.245 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.245 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.245 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.245 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.245 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.245 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.246 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.246 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.246 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.246 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "devicehealth", 2024-09-13T16:13:07.246 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.246 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.246 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.246 INFO:teuthology.orchestra.run.smithi086.stdout: "enable_monitoring": { 2024-09-13T16:13:07.246 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enable_monitoring", 2024-09-13T16:13:07.246 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.246 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.246 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.247 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.247 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.247 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.247 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.247 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "monitor device health metrics", 2024-09-13T16:13:07.247 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.247 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.247 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.247 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.247 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.247 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.247 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.247 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.248 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.248 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.248 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.248 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.248 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.248 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.248 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.248 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.248 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.248 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.248 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.248 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.248 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.249 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.249 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.249 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.249 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.249 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.249 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.249 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.249 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.249 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.249 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.249 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.249 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.249 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.250 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.250 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.250 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.250 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.250 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.250 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.250 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.250 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.252 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.252 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.252 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.252 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.252 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.252 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.252 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.252 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.252 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.252 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.252 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.252 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.253 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.253 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.253 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.253 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.253 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.253 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.253 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.253 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.253 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.253 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.253 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.253 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.254 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.254 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.254 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.254 INFO:teuthology.orchestra.run.smithi086.stdout: "mark_out_threshold": { 2024-09-13T16:13:07.254 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mark_out_threshold", 2024-09-13T16:13:07.254 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.254 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.254 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.254 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "2419200", 2024-09-13T16:13:07.254 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.254 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.254 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.254 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T16:13:07.255 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.255 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.255 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.255 INFO:teuthology.orchestra.run.smithi086.stdout: "pool_name": { 2024-09-13T16:13:07.255 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pool_name", 2024-09-13T16:13:07.255 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.255 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.255 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.255 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "device_health_metrics", 2024-09-13T16:13:07.255 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.255 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.255 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.255 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T16:13:07.256 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.256 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.256 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.256 INFO:teuthology.orchestra.run.smithi086.stdout: "retention_period": { 2024-09-13T16:13:07.256 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "retention_period", 2024-09-13T16:13:07.256 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.256 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.256 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.256 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "15552000", 2024-09-13T16:13:07.256 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.256 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.256 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.256 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how long to retain device health metrics", 2024-09-13T16:13:07.257 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.257 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.257 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.257 INFO:teuthology.orchestra.run.smithi086.stdout: "scrape_frequency": { 2024-09-13T16:13:07.257 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "scrape_frequency", 2024-09-13T16:13:07.257 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.257 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.257 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.257 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "86400", 2024-09-13T16:13:07.257 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.257 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.257 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.258 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T16:13:07.258 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.258 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.258 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.258 INFO:teuthology.orchestra.run.smithi086.stdout: "self_heal": { 2024-09-13T16:13:07.258 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "self_heal", 2024-09-13T16:13:07.258 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.258 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.258 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.258 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.258 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.258 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.258 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.259 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T16:13:07.259 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.259 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.259 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.259 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-09-13T16:13:07.259 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-09-13T16:13:07.259 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.259 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.259 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.259 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-09-13T16:13:07.259 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.259 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.259 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.260 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T16:13:07.260 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.260 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.260 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.260 INFO:teuthology.orchestra.run.smithi086.stdout: "warn_threshold": { 2024-09-13T16:13:07.260 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "warn_threshold", 2024-09-13T16:13:07.260 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.260 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.260 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.260 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "7257600", 2024-09-13T16:13:07.260 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.260 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.260 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.261 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T16:13:07.261 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.261 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.261 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.261 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.261 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.261 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "diskprediction_local", 2024-09-13T16:13:07.261 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.261 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.261 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.262 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.262 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.262 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.262 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.262 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.262 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.262 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.262 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.262 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.262 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.262 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.262 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.262 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.262 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.263 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.263 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.263 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.263 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.263 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.263 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.263 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.263 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.263 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.263 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.263 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.263 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.263 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.264 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.264 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.264 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.264 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.264 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.264 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.264 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.264 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.264 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.264 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.264 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.264 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.265 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.265 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.265 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.265 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.265 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.265 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.265 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.265 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.265 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.265 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.265 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.265 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.265 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.266 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.266 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.266 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.266 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.266 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.266 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.266 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.266 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.266 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.266 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.266 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.266 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.267 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.267 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.267 INFO:teuthology.orchestra.run.smithi086.stdout: "predict_interval": { 2024-09-13T16:13:07.267 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "predict_interval", 2024-09-13T16:13:07.267 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.267 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.267 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.267 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "86400", 2024-09-13T16:13:07.267 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.267 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.267 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.267 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.268 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.268 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.268 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.268 INFO:teuthology.orchestra.run.smithi086.stdout: "predictor_model": { 2024-09-13T16:13:07.268 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "predictor_model", 2024-09-13T16:13:07.268 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.268 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.268 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.268 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "prophetstor", 2024-09-13T16:13:07.268 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.268 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.268 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.268 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.269 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.269 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.269 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.269 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-09-13T16:13:07.269 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-09-13T16:13:07.269 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.269 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.269 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.269 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "600", 2024-09-13T16:13:07.269 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.269 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.269 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.269 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.270 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.270 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.270 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.270 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.270 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.270 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "influx", 2024-09-13T16:13:07.270 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": false, 2024-09-13T16:13:07.270 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "influxdb python module not found", 2024-09-13T16:13:07.270 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.270 INFO:teuthology.orchestra.run.smithi086.stdout: "batch_size": { 2024-09-13T16:13:07.270 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "batch_size", 2024-09-13T16:13:07.271 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.271 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.271 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.271 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5000", 2024-09-13T16:13:07.271 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.271 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.271 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.271 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T16:13:07.271 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.271 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.271 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.271 INFO:teuthology.orchestra.run.smithi086.stdout: "database": { 2024-09-13T16:13:07.271 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "database", 2024-09-13T16:13:07.272 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.272 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.272 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.272 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "ceph", 2024-09-13T16:13:07.272 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.272 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.272 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.272 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T16:13:07.272 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.272 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.272 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.272 INFO:teuthology.orchestra.run.smithi086.stdout: "hostname": { 2024-09-13T16:13:07.273 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "hostname", 2024-09-13T16:13:07.273 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.273 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.273 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.273 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.273 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.273 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.273 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.273 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "InfluxDB server hostname", 2024-09-13T16:13:07.273 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.273 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.273 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.273 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-09-13T16:13:07.274 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-09-13T16:13:07.274 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.274 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.274 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.274 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "30", 2024-09-13T16:13:07.274 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "5", 2024-09-13T16:13:07.274 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.274 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.274 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T16:13:07.274 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.274 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.274 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.274 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.274 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.275 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.275 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.275 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.275 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.275 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.275 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.275 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.275 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.275 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.275 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.275 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.275 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.275 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.275 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.276 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.276 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.276 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.276 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.276 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.276 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.276 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.276 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.276 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.276 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.276 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.276 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.276 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.277 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.277 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.277 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.277 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.277 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.277 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.277 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.277 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.277 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.277 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.277 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.277 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.277 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.278 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.278 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.278 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.278 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.278 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.278 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.278 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.278 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.278 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.278 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.278 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.278 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.278 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.278 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.279 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.279 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.279 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.279 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.279 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.279 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.279 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.279 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.279 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.279 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.279 INFO:teuthology.orchestra.run.smithi086.stdout: "password": { 2024-09-13T16:13:07.280 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "password", 2024-09-13T16:13:07.280 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.280 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.280 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.280 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.280 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.280 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.280 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.280 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "password of InfluxDB server user", 2024-09-13T16:13:07.280 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.280 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.280 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.281 INFO:teuthology.orchestra.run.smithi086.stdout: "port": { 2024-09-13T16:13:07.281 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "port", 2024-09-13T16:13:07.281 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.281 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.281 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.281 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "8086", 2024-09-13T16:13:07.281 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.281 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.281 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.281 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "InfluxDB server port", 2024-09-13T16:13:07.281 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.281 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.281 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: "ssl": { 2024-09-13T16:13:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ssl", 2024-09-13T16:13:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "false", 2024-09-13T16:13:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T16:13:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: "threads": { 2024-09-13T16:13:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "threads", 2024-09-13T16:13:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-09-13T16:13:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-09-13T16:13:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "32", 2024-09-13T16:13:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T16:13:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: "username": { 2024-09-13T16:13:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "username", 2024-09-13T16:13:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "username of InfluxDB server user", 2024-09-13T16:13:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.285 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.285 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.285 INFO:teuthology.orchestra.run.smithi086.stdout: "verify_ssl": { 2024-09-13T16:13:07.285 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "verify_ssl", 2024-09-13T16:13:07.285 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.285 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.285 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.285 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "true", 2024-09-13T16:13:07.285 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.285 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.285 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.285 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T16:13:07.285 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.286 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.286 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.286 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.286 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.286 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "insights", 2024-09-13T16:13:07.286 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.286 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.286 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.286 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.286 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.286 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.286 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.287 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.287 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.287 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.287 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.287 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.287 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.287 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.287 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.287 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.287 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.287 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.287 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.287 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.287 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.288 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.288 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.288 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.288 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.288 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.288 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.288 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.288 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.288 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.288 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.288 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.288 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.289 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.289 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.289 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.289 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.289 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.289 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.289 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.289 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.289 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.289 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.289 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.289 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.289 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.290 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.290 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.290 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.290 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.290 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.290 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.290 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.290 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.290 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.290 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.290 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.290 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.290 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.291 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.291 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.291 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.291 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.291 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.291 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.291 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.291 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.291 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.291 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.292 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.292 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.292 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "iostat", 2024-09-13T16:13:07.292 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.292 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.292 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.292 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.292 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.292 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.292 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.292 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.292 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.293 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.293 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.293 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.293 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.293 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.293 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.293 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.293 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.293 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.293 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.293 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.293 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.293 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.293 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.294 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.294 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.294 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.294 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.294 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.294 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.294 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.294 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.294 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.294 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.294 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.294 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.294 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.295 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.295 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.295 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.295 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.295 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.295 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.295 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.295 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.295 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.295 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.295 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.295 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.295 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.296 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.296 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.296 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.296 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.296 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.296 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.296 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.296 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.296 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.296 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.296 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.296 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.296 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.297 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.297 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.297 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.297 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.297 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.297 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.297 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.297 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.297 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.297 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "k8sevents", 2024-09-13T16:13:07.297 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.298 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.298 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.298 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_event_retention_days": { 2024-09-13T16:13:07.298 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "ceph_event_retention_days", 2024-09-13T16:13:07.298 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.298 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.298 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.298 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "7", 2024-09-13T16:13:07.298 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.298 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.298 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.298 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-13T16:13:07.298 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.299 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.299 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.299 INFO:teuthology.orchestra.run.smithi086.stdout: "config_check_secs": { 2024-09-13T16:13:07.299 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "config_check_secs", 2024-09-13T16:13:07.299 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.299 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.299 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.299 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:07.299 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "10", 2024-09-13T16:13:07.299 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.299 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.299 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-13T16:13:07.299 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.300 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.300 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.300 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.300 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.300 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.300 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.300 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.300 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.300 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.300 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.300 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.300 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.301 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.301 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.301 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.301 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.301 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.301 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.301 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.301 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.301 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.301 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.301 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.301 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.301 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.302 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.302 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.302 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.302 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.302 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.302 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.302 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.302 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.302 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.302 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.302 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.302 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.302 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.303 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.303 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.303 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.303 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.303 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.303 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.303 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.303 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.303 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.303 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.303 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.303 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.303 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.303 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.304 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.304 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.304 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.304 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.304 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.304 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.304 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.304 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.304 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.304 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.304 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.304 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.305 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.305 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.305 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.305 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.305 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.305 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.305 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "localpool", 2024-09-13T16:13:07.305 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.305 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.305 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.305 INFO:teuthology.orchestra.run.smithi086.stdout: "failure_domain": { 2024-09-13T16:13:07.305 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "failure_domain", 2024-09-13T16:13:07.306 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.306 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.306 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.306 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "host", 2024-09-13T16:13:07.306 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.306 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.306 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.306 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "failure domain for any created local pool", 2024-09-13T16:13:07.306 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T16:13:07.306 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.306 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.306 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.306 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.307 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.307 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.307 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.307 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.307 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.307 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.307 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.307 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.307 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.307 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.307 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.307 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.307 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.307 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.307 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.308 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.308 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.308 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.308 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.308 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.308 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.308 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.308 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.308 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.308 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.308 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.308 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.308 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.309 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.309 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.309 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.309 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.309 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.309 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.309 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.309 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.309 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.309 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.309 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.309 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.309 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.310 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.310 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.310 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.310 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.310 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.310 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.310 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.310 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.310 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.310 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.310 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.310 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.310 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.311 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.311 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.311 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.311 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.311 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.311 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.311 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.311 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.311 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.311 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.311 INFO:teuthology.orchestra.run.smithi086.stdout: "min_size": { 2024-09-13T16:13:07.311 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "min_size", 2024-09-13T16:13:07.311 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.312 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.312 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.312 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.312 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.312 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.312 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.312 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "default min_size for any created local pool", 2024-09-13T16:13:07.312 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T16:13:07.312 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.312 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.312 INFO:teuthology.orchestra.run.smithi086.stdout: "num_rep": { 2024-09-13T16:13:07.312 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "num_rep", 2024-09-13T16:13:07.313 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.313 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.313 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.313 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "3", 2024-09-13T16:13:07.313 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.313 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.313 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.313 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "default replica count for any created local pool", 2024-09-13T16:13:07.313 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.313 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.313 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.313 INFO:teuthology.orchestra.run.smithi086.stdout: "pg_num": { 2024-09-13T16:13:07.313 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pg_num", 2024-09-13T16:13:07.313 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.314 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.314 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.314 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "128", 2024-09-13T16:13:07.314 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.314 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.314 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.314 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T16:13:07.314 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.314 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.314 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.314 INFO:teuthology.orchestra.run.smithi086.stdout: "prefix": { 2024-09-13T16:13:07.314 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "prefix", 2024-09-13T16:13:07.315 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.315 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.315 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.315 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.315 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.315 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.315 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.315 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "name prefix for any created local pool", 2024-09-13T16:13:07.315 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.315 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.315 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.315 INFO:teuthology.orchestra.run.smithi086.stdout: "subtree": { 2024-09-13T16:13:07.316 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "subtree", 2024-09-13T16:13:07.316 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.316 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.316 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.316 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "rack", 2024-09-13T16:13:07.316 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.316 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.316 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.316 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T16:13:07.316 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T16:13:07.316 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.316 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.317 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.317 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.317 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mds_autoscaler", 2024-09-13T16:13:07.317 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.317 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.317 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.317 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.317 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.317 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.317 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.317 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.318 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.318 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.318 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.318 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.318 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.318 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.318 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.318 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.318 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.318 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.318 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.318 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.318 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.319 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.319 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.319 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.319 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.319 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.319 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.319 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.319 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.319 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.319 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.319 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.319 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.319 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.320 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.320 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.320 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.320 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.320 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.320 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.320 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.320 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.320 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.320 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.320 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.320 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.321 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.321 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.321 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.321 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.321 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.321 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.321 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.321 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.321 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.321 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.321 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.321 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.321 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.322 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.322 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.322 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.322 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.322 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.322 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.322 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.322 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.322 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.322 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.322 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.322 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.323 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mirroring", 2024-09-13T16:13:07.323 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.323 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.323 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.323 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.323 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.323 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.323 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.323 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.323 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.323 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.323 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.323 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.323 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.324 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.324 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.324 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.324 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.324 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.324 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.324 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.324 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.324 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.324 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.324 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.324 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.324 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.325 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.325 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.325 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.325 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.325 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.325 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.325 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.325 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.325 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.325 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.325 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.325 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.325 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.326 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.326 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.326 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.326 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.326 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.326 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.326 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.326 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.326 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.326 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.326 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.326 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.326 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.327 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.327 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.327 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.327 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.327 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.327 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.327 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.327 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.327 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.327 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.327 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.327 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.327 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.327 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.328 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.328 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.328 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.328 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.328 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.328 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "nfs", 2024-09-13T16:13:07.328 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.328 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.328 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.328 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.328 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.329 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.329 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.329 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.329 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.329 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.329 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.329 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.329 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.329 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.329 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.329 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.329 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.329 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.330 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.330 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.330 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.330 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.330 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.330 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.330 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.330 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.330 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.330 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.330 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.330 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.330 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.331 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.331 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.331 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.331 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.331 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.331 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.331 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.331 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.331 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.331 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.331 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.331 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.331 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.332 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.332 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.332 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.332 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.332 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.332 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.332 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.332 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.332 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.332 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.332 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.332 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.333 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.333 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.333 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.333 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.333 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.333 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.333 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.333 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.333 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.333 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.333 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.333 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.333 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "orchestrator", 2024-09-13T16:13:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "fail_fs": { 2024-09-13T16:13:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "fail_fs", 2024-09-13T16:13:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T16:13:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: "orchestrator": { 2024-09-13T16:13:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "orchestrator", 2024-09-13T16:13:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "cephadm", 2024-09-13T16:13:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "rook", 2024-09-13T16:13:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "test_orchestrator" 2024-09-13T16:13:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Orchestrator backend", 2024-09-13T16:13:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "osd_perf_query", 2024-09-13T16:13:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "osd_support", 2024-09-13T16:13:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "pg_autoscaler", 2024-09-13T16:13:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-09-13T16:13:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-09-13T16:13:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-09-13T16:13:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "threshold": { 2024-09-13T16:13:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "threshold", 2024-09-13T16:13:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "3.0", 2024-09-13T16:13:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1.0", 2024-09-13T16:13:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "scaling threshold", 2024-09-13T16:13:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T16:13:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "progress", 2024-09-13T16:13:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "allow_pg_recovery_event": { 2024-09-13T16:13:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "allow_pg_recovery_event", 2024-09-13T16:13:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T16:13:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "enabled": { 2024-09-13T16:13:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enabled", 2024-09-13T16:13:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "max_completed_events": { 2024-09-13T16:13:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_completed_events", 2024-09-13T16:13:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "50", 2024-09-13T16:13:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "number of past completed events to remember", 2024-09-13T16:13:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "sleep_interval": { 2024-09-13T16:13:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "sleep_interval", 2024-09-13T16:13:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "5", 2024-09-13T16:13:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "how long the module is going to sleep", 2024-09-13T16:13:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "prometheus", 2024-09-13T16:13:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "cache": { 2024-09-13T16:13:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cache", 2024-09-13T16:13:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "exclude_perf_counters": { 2024-09-13T16:13:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "exclude_perf_counters", 2024-09-13T16:13:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T16:13:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T16:13:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_stats_pools": { 2024-09-13T16:13:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_stats_pools", 2024-09-13T16:13:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T16:13:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T16:13:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "300", 2024-09-13T16:13:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "scrape_interval": { 2024-09-13T16:13:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "scrape_interval", 2024-09-13T16:13:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "15.0", 2024-09-13T16:13:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "server_addr": { 2024-09-13T16:13:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_addr", 2024-09-13T16:13:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "::", 2024-09-13T16:13:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T16:13:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "server_port": { 2024-09-13T16:13:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_port", 2024-09-13T16:13:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "9283", 2024-09-13T16:13:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T16:13:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "stale_cache_strategy": { 2024-09-13T16:13:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "stale_cache_strategy", 2024-09-13T16:13:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "log", 2024-09-13T16:13:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_behaviour": { 2024-09-13T16:13:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_behaviour", 2024-09-13T16:13:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "default", 2024-09-13T16:13:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "default", 2024-09-13T16:13:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "error" 2024-09-13T16:13:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "standby_error_status_code": { 2024-09-13T16:13:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "standby_error_status_code", 2024-09-13T16:13:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "500", 2024-09-13T16:13:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "400", 2024-09-13T16:13:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "599", 2024-09-13T16:13:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_support", 2024-09-13T16:13:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "max_concurrent_snap_create": { 2024-09-13T16:13:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_concurrent_snap_create", 2024-09-13T16:13:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10", 2024-09-13T16:13:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "mirror_snapshot_schedule": { 2024-09-13T16:13:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T16:13:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "trash_purge_schedule": { 2024-09-13T16:13:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "trash_purge_schedule", 2024-09-13T16:13:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "restful", 2024-09-13T16:13:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "enable_auth": { 2024-09-13T16:13:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enable_auth", 2024-09-13T16:13:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "key_file": { 2024-09-13T16:13:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "key_file", 2024-09-13T16:13:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "server_addr": { 2024-09-13T16:13:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_addr", 2024-09-13T16:13:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "server_port": { 2024-09-13T16:13:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "server_port", 2024-09-13T16:13:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rgw", 2024-09-13T16:13:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rook", 2024-09-13T16:13:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: "storage_class": { 2024-09-13T16:13:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "storage_class", 2024-09-13T16:13:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "local", 2024-09-13T16:13:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-13T16:13:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "selftest", 2024-09-13T16:13:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: "roption1": { 2024-09-13T16:13:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "roption1", 2024-09-13T16:13:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.425 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.425 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.425 INFO:teuthology.orchestra.run.smithi086.stdout: "roption2": { 2024-09-13T16:13:07.425 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "roption2", 2024-09-13T16:13:07.425 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.425 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.425 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.425 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "xyz", 2024-09-13T16:13:07.425 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.425 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.426 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.426 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.426 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.426 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.426 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.426 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption1": { 2024-09-13T16:13:07.426 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption1", 2024-09-13T16:13:07.426 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.426 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.426 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.426 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.427 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.427 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.427 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.427 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.427 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.427 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.427 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.427 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption2": { 2024-09-13T16:13:07.427 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption2", 2024-09-13T16:13:07.427 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.427 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.428 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.428 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.428 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.428 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.428 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.428 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.428 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.428 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.428 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.428 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption3": { 2024-09-13T16:13:07.429 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption3", 2024-09-13T16:13:07.429 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "float", 2024-09-13T16:13:07.429 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.429 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.429 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.429 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.429 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.429 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.429 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.429 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.429 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.430 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.430 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption4": { 2024-09-13T16:13:07.430 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption4", 2024-09-13T16:13:07.430 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.430 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.430 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.430 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.430 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.430 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.431 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.431 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.431 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.431 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.431 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.431 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption5": { 2024-09-13T16:13:07.431 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption5", 2024-09-13T16:13:07.431 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.431 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.431 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.431 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.432 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.432 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.432 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.432 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.432 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.432 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.432 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.432 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption6": { 2024-09-13T16:13:07.432 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption6", 2024-09-13T16:13:07.432 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.433 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.433 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.433 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.433 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.433 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.433 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.433 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.433 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.433 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.433 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.433 INFO:teuthology.orchestra.run.smithi086.stdout: "rwoption7": { 2024-09-13T16:13:07.434 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rwoption7", 2024-09-13T16:13:07.434 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.434 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.434 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.434 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.434 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "1", 2024-09-13T16:13:07.434 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "42", 2024-09-13T16:13:07.434 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.434 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.434 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.434 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.435 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.435 INFO:teuthology.orchestra.run.smithi086.stdout: "testkey": { 2024-09-13T16:13:07.435 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "testkey", 2024-09-13T16:13:07.435 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.435 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.435 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.435 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.435 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.435 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.435 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.435 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.436 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.436 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.436 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.436 INFO:teuthology.orchestra.run.smithi086.stdout: "testlkey": { 2024-09-13T16:13:07.436 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "testlkey", 2024-09-13T16:13:07.436 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.436 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.436 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.436 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.436 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.436 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.437 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.437 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.437 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.437 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.437 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.437 INFO:teuthology.orchestra.run.smithi086.stdout: "testnewline": { 2024-09-13T16:13:07.437 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "testnewline", 2024-09-13T16:13:07.437 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.438 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.438 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.438 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.438 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.438 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.438 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.438 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.438 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.438 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.438 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.438 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.439 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.439 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snap_schedule", 2024-09-13T16:13:07.439 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.439 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.439 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.439 INFO:teuthology.orchestra.run.smithi086.stdout: "allow_m_granularity": { 2024-09-13T16:13:07.439 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "allow_m_granularity", 2024-09-13T16:13:07.439 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.439 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.439 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.440 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.440 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.440 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.440 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.440 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T16:13:07.440 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.440 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.440 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.440 INFO:teuthology.orchestra.run.smithi086.stdout: "dump_on_update": { 2024-09-13T16:13:07.440 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "dump_on_update", 2024-09-13T16:13:07.441 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.441 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.441 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.441 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.441 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.441 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.441 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.441 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "dump database to debug log on update", 2024-09-13T16:13:07.441 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.441 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.441 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.442 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.442 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.442 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.442 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.442 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.442 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.442 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.442 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.442 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.442 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.442 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.443 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.443 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.443 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.443 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.443 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.443 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.443 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.443 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.443 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.443 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.444 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.444 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.444 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.444 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.444 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.444 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.444 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.444 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.444 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.444 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.444 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.444 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.445 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.445 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.445 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.445 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.445 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.445 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.446 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.446 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.446 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.446 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.446 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.446 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.446 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.446 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.446 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.446 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.446 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.446 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.447 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.447 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.447 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.447 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.447 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.447 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.447 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.447 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.448 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.448 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.448 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.448 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.448 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.448 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.448 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.448 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.448 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.448 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "stats", 2024-09-13T16:13:07.449 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.449 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.449 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.449 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.449 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.449 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.449 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.449 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.450 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.450 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.450 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.450 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.450 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.450 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.450 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.450 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.450 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.450 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.451 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.451 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.451 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.451 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.451 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.451 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.451 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.451 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.452 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.452 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.452 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.452 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.452 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.452 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.452 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.452 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.452 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.452 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.453 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.453 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.453 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.453 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.453 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.453 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.453 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.454 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.454 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.454 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.454 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.454 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.454 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.454 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.454 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.454 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.454 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.455 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.455 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.455 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.455 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.455 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.455 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.455 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.455 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.456 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.456 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.456 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.456 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.456 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.456 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.456 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.456 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.457 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.457 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.457 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "status", 2024-09-13T16:13:07.457 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.457 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.457 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.458 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.458 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.460 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.460 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.460 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.460 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.460 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.460 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.461 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.461 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.461 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.461 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.461 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.461 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.461 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.461 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.461 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.461 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.461 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.462 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.462 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.462 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.462 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.462 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.462 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.462 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.462 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.462 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.462 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.462 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.463 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.463 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.463 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.463 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.463 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.463 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.463 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.463 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.463 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.463 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.463 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.464 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.464 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.464 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.464 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.464 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.464 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.464 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.464 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.464 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.464 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.464 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.464 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.465 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.465 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.465 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.465 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.465 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.465 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.465 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.465 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.465 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.465 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.465 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.466 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.466 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.466 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.466 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.466 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "telegraf", 2024-09-13T16:13:07.466 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.466 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.466 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.466 INFO:teuthology.orchestra.run.smithi086.stdout: "address": { 2024-09-13T16:13:07.466 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "address", 2024-09-13T16:13:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T16:13:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-09-13T16:13:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-09-13T16:13:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "15", 2024-09-13T16:13:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "telemetry", 2024-09-13T16:13:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_basic": { 2024-09-13T16:13:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_basic", 2024-09-13T16:13:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T16:13:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_crash": { 2024-09-13T16:13:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_crash", 2024-09-13T16:13:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T16:13:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_device": { 2024-09-13T16:13:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_device", 2024-09-13T16:13:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T16:13:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_ident": { 2024-09-13T16:13:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_ident", 2024-09-13T16:13:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T16:13:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "channel_perf": { 2024-09-13T16:13:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "channel_perf", 2024-09-13T16:13:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.483 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.483 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T16:13:07.483 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.483 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.483 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.483 INFO:teuthology.orchestra.run.smithi086.stdout: "contact": { 2024-09-13T16:13:07.483 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "contact", 2024-09-13T16:13:07.483 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: "description": { 2024-09-13T16:13:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "description", 2024-09-13T16:13:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: "device_url": { 2024-09-13T16:13:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "device_url", 2024-09-13T16:13:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T16:13:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: "enabled": { 2024-09-13T16:13:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "enabled", 2024-09-13T16:13:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-09-13T16:13:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-09-13T16:13:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "24", 2024-09-13T16:13:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "8", 2024-09-13T16:13:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "last_opt_revision": { 2024-09-13T16:13:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "last_opt_revision", 2024-09-13T16:13:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "1", 2024-09-13T16:13:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: "leaderboard": { 2024-09-13T16:13:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "leaderboard", 2024-09-13T16:13:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "leaderboard_description": { 2024-09-13T16:13:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "leaderboard_description", 2024-09-13T16:13:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.495 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.495 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.495 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.495 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.495 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.495 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.495 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.495 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.501 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.501 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.501 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.501 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.501 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.501 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.501 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.501 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.501 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.501 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.502 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.502 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.502 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.502 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.502 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.502 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.502 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.502 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.502 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.502 INFO:teuthology.orchestra.run.smithi086.stdout: "organization": { 2024-09-13T16:13:07.502 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "organization", 2024-09-13T16:13:07.503 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.503 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.503 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.503 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.503 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.503 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.503 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.503 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.503 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.503 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.503 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.504 INFO:teuthology.orchestra.run.smithi086.stdout: "proxy": { 2024-09-13T16:13:07.504 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "proxy", 2024-09-13T16:13:07.504 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.504 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.504 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.504 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.504 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.504 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.504 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.504 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.505 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.505 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.505 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.505 INFO:teuthology.orchestra.run.smithi086.stdout: "url": { 2024-09-13T16:13:07.505 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "url", 2024-09-13T16:13:07.505 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.505 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.505 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.505 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T16:13:07.505 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.506 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.506 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.506 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.506 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.506 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.506 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.506 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.506 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.506 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "test_orchestrator", 2024-09-13T16:13:07.506 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.507 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.507 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.507 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.507 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.507 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.507 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.507 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.507 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.507 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.507 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.507 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.507 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.508 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.508 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.508 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.508 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.508 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.508 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.508 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.508 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.508 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.508 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.509 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.509 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.509 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.509 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.509 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.509 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.509 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.509 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.509 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.509 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.509 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.509 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.510 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.510 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.510 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.510 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.510 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.510 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.510 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.510 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.510 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.510 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.510 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.510 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.511 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.511 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.511 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.511 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.511 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.511 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.511 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.511 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.511 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.511 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.512 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.512 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.512 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.512 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.512 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.512 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.512 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.512 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.512 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.512 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.512 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.513 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.513 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.513 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.513 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "volumes", 2024-09-13T16:13:07.513 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.513 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.513 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.513 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.513 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.514 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.514 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.514 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.514 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.514 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.514 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.514 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.514 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.514 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.514 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.514 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.514 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.515 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.515 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.515 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.515 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.515 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.515 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.515 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.515 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.515 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.515 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.516 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.516 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.516 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.516 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.516 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.516 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.516 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.516 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.516 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.516 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.516 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.517 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.517 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.517 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.517 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.517 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.517 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.517 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.517 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.517 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.517 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.517 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.518 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.518 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.518 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.518 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.518 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.518 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.518 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.518 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.518 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.519 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.519 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.519 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.519 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.519 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.519 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.519 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.519 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.519 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.519 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.519 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.520 INFO:teuthology.orchestra.run.smithi086.stdout: "max_concurrent_clones": { 2024-09-13T16:13:07.520 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "max_concurrent_clones", 2024-09-13T16:13:07.520 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.520 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.520 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.520 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "4", 2024-09-13T16:13:07.520 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.520 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.520 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.521 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T16:13:07.521 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.521 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.521 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.521 INFO:teuthology.orchestra.run.smithi086.stdout: "snapshot_clone_delay": { 2024-09-13T16:13:07.521 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snapshot_clone_delay", 2024-09-13T16:13:07.521 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.521 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.521 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.521 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "0", 2024-09-13T16:13:07.521 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.522 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.522 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.522 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T16:13:07.522 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.522 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.522 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.522 INFO:teuthology.orchestra.run.smithi086.stdout: "snapshot_clone_no_wait": { 2024-09-13T16:13:07.522 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T16:13:07.523 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.523 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.523 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.523 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "True", 2024-09-13T16:13:07.523 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.523 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.523 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.523 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T16:13:07.523 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.523 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.524 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.524 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.524 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.524 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix", 2024-09-13T16:13:07.524 INFO:teuthology.orchestra.run.smithi086.stdout: "can_run": true, 2024-09-13T16:13:07.524 INFO:teuthology.orchestra.run.smithi086.stdout: "error_string": "", 2024-09-13T16:13:07.524 INFO:teuthology.orchestra.run.smithi086.stdout: "module_options": { 2024-09-13T16:13:07.524 INFO:teuthology.orchestra.run.smithi086.stdout: "discovery_interval": { 2024-09-13T16:13:07.525 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "discovery_interval", 2024-09-13T16:13:07.525 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "uint", 2024-09-13T16:13:07.525 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.525 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.525 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "100", 2024-09-13T16:13:07.525 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.525 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.526 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.526 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.526 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.526 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.526 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.526 INFO:teuthology.orchestra.run.smithi086.stdout: "identifier": { 2024-09-13T16:13:07.526 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "identifier", 2024-09-13T16:13:07.526 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.526 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.526 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.527 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.527 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.527 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.527 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.527 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.527 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.527 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.527 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.527 INFO:teuthology.orchestra.run.smithi086.stdout: "interval": { 2024-09-13T16:13:07.527 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "interval", 2024-09-13T16:13:07.528 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "secs", 2024-09-13T16:13:07.528 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.528 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.528 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "60", 2024-09-13T16:13:07.528 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.528 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.528 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.528 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.528 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.528 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.528 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.529 INFO:teuthology.orchestra.run.smithi086.stdout: "log_level": { 2024-09-13T16:13:07.529 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_level", 2024-09-13T16:13:07.529 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.529 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.529 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.529 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.529 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.529 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.529 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.529 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.530 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.530 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.530 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.530 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.530 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.530 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.530 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.530 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.530 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.530 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.530 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster": { 2024-09-13T16:13:07.531 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster", 2024-09-13T16:13:07.531 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.531 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.531 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.531 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.531 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.531 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.531 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.531 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.531 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.531 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.531 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.532 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_cluster_level": { 2024-09-13T16:13:07.532 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:07.532 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.532 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.532 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.532 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "info", 2024-09-13T16:13:07.532 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.532 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.532 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [ 2024-09-13T16:13:07.532 INFO:teuthology.orchestra.run.smithi086.stdout: "", 2024-09-13T16:13:07.533 INFO:teuthology.orchestra.run.smithi086.stdout: "critical", 2024-09-13T16:13:07.533 INFO:teuthology.orchestra.run.smithi086.stdout: "debug", 2024-09-13T16:13:07.533 INFO:teuthology.orchestra.run.smithi086.stdout: "error", 2024-09-13T16:13:07.533 INFO:teuthology.orchestra.run.smithi086.stdout: "info", 2024-09-13T16:13:07.533 INFO:teuthology.orchestra.run.smithi086.stdout: "warning" 2024-09-13T16:13:07.533 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.533 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.533 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.533 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.533 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.533 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": { 2024-09-13T16:13:07.534 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "log_to_file", 2024-09-13T16:13:07.534 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "bool", 2024-09-13T16:13:07.534 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.534 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 1, 2024-09-13T16:13:07.534 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "False", 2024-09-13T16:13:07.534 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.534 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.534 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.534 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.534 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.534 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.534 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.535 INFO:teuthology.orchestra.run.smithi086.stdout: "zabbix_host": { 2024-09-13T16:13:07.535 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix_host", 2024-09-13T16:13:07.535 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.535 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.535 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.535 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "", 2024-09-13T16:13:07.535 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.535 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.535 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.535 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.535 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.536 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.536 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.536 INFO:teuthology.orchestra.run.smithi086.stdout: "zabbix_port": { 2024-09-13T16:13:07.536 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix_port", 2024-09-13T16:13:07.536 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "int", 2024-09-13T16:13:07.536 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.536 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.536 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "10051", 2024-09-13T16:13:07.536 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.536 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.536 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.537 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.537 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.537 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.537 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.537 INFO:teuthology.orchestra.run.smithi086.stdout: "zabbix_sender": { 2024-09-13T16:13:07.537 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "zabbix_sender", 2024-09-13T16:13:07.537 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "str", 2024-09-13T16:13:07.537 INFO:teuthology.orchestra.run.smithi086.stdout: "level": "advanced", 2024-09-13T16:13:07.537 INFO:teuthology.orchestra.run.smithi086.stdout: "flags": 0, 2024-09-13T16:13:07.537 INFO:teuthology.orchestra.run.smithi086.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T16:13:07.537 INFO:teuthology.orchestra.run.smithi086.stdout: "min": "", 2024-09-13T16:13:07.538 INFO:teuthology.orchestra.run.smithi086.stdout: "max": "", 2024-09-13T16:13:07.538 INFO:teuthology.orchestra.run.smithi086.stdout: "enum_allowed": [], 2024-09-13T16:13:07.538 INFO:teuthology.orchestra.run.smithi086.stdout: "desc": "", 2024-09-13T16:13:07.538 INFO:teuthology.orchestra.run.smithi086.stdout: "long_desc": "", 2024-09-13T16:13:07.538 INFO:teuthology.orchestra.run.smithi086.stdout: "tags": [], 2024-09-13T16:13:07.538 INFO:teuthology.orchestra.run.smithi086.stdout: "see_also": [] 2024-09-13T16:13:07.538 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.538 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.538 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.538 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.538 INFO:teuthology.orchestra.run.smithi086.stdout: "services": { 2024-09-13T16:13:07.538 INFO:teuthology.orchestra.run.smithi086.stdout: "dashboard": "https://172.21.15.86:8443/" 2024-09-13T16:13:07.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.539 INFO:teuthology.orchestra.run.smithi086.stdout: "always_on_modules": { 2024-09-13T16:13:07.539 INFO:teuthology.orchestra.run.smithi086.stdout: "octopus": [ 2024-09-13T16:13:07.539 INFO:teuthology.orchestra.run.smithi086.stdout: "balancer", 2024-09-13T16:13:07.539 INFO:teuthology.orchestra.run.smithi086.stdout: "crash", 2024-09-13T16:13:07.539 INFO:teuthology.orchestra.run.smithi086.stdout: "devicehealth", 2024-09-13T16:13:07.539 INFO:teuthology.orchestra.run.smithi086.stdout: "orchestrator", 2024-09-13T16:13:07.539 INFO:teuthology.orchestra.run.smithi086.stdout: "pg_autoscaler", 2024-09-13T16:13:07.539 INFO:teuthology.orchestra.run.smithi086.stdout: "progress", 2024-09-13T16:13:07.539 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_support", 2024-09-13T16:13:07.539 INFO:teuthology.orchestra.run.smithi086.stdout: "status", 2024-09-13T16:13:07.539 INFO:teuthology.orchestra.run.smithi086.stdout: "telemetry", 2024-09-13T16:13:07.540 INFO:teuthology.orchestra.run.smithi086.stdout: "volumes" 2024-09-13T16:13:07.540 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.540 INFO:teuthology.orchestra.run.smithi086.stdout: "pacific": [ 2024-09-13T16:13:07.540 INFO:teuthology.orchestra.run.smithi086.stdout: "balancer", 2024-09-13T16:13:07.540 INFO:teuthology.orchestra.run.smithi086.stdout: "crash", 2024-09-13T16:13:07.540 INFO:teuthology.orchestra.run.smithi086.stdout: "devicehealth", 2024-09-13T16:13:07.540 INFO:teuthology.orchestra.run.smithi086.stdout: "orchestrator", 2024-09-13T16:13:07.540 INFO:teuthology.orchestra.run.smithi086.stdout: "pg_autoscaler", 2024-09-13T16:13:07.540 INFO:teuthology.orchestra.run.smithi086.stdout: "progress", 2024-09-13T16:13:07.540 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_support", 2024-09-13T16:13:07.540 INFO:teuthology.orchestra.run.smithi086.stdout: "status", 2024-09-13T16:13:07.540 INFO:teuthology.orchestra.run.smithi086.stdout: "telemetry", 2024-09-13T16:13:07.541 INFO:teuthology.orchestra.run.smithi086.stdout: "volumes" 2024-09-13T16:13:07.541 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.541 INFO:teuthology.orchestra.run.smithi086.stdout: "quincy": [ 2024-09-13T16:13:07.541 INFO:teuthology.orchestra.run.smithi086.stdout: "balancer", 2024-09-13T16:13:07.541 INFO:teuthology.orchestra.run.smithi086.stdout: "crash", 2024-09-13T16:13:07.541 INFO:teuthology.orchestra.run.smithi086.stdout: "devicehealth", 2024-09-13T16:13:07.541 INFO:teuthology.orchestra.run.smithi086.stdout: "orchestrator", 2024-09-13T16:13:07.541 INFO:teuthology.orchestra.run.smithi086.stdout: "pg_autoscaler", 2024-09-13T16:13:07.541 INFO:teuthology.orchestra.run.smithi086.stdout: "progress", 2024-09-13T16:13:07.541 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_support", 2024-09-13T16:13:07.541 INFO:teuthology.orchestra.run.smithi086.stdout: "status", 2024-09-13T16:13:07.541 INFO:teuthology.orchestra.run.smithi086.stdout: "telemetry", 2024-09-13T16:13:07.542 INFO:teuthology.orchestra.run.smithi086.stdout: "volumes" 2024-09-13T16:13:07.542 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-13T16:13:07.542 INFO:teuthology.orchestra.run.smithi086.stdout: "reef": [ 2024-09-13T16:13:07.542 INFO:teuthology.orchestra.run.smithi086.stdout: "balancer", 2024-09-13T16:13:07.542 INFO:teuthology.orchestra.run.smithi086.stdout: "crash", 2024-09-13T16:13:07.542 INFO:teuthology.orchestra.run.smithi086.stdout: "devicehealth", 2024-09-13T16:13:07.542 INFO:teuthology.orchestra.run.smithi086.stdout: "orchestrator", 2024-09-13T16:13:07.542 INFO:teuthology.orchestra.run.smithi086.stdout: "pg_autoscaler", 2024-09-13T16:13:07.542 INFO:teuthology.orchestra.run.smithi086.stdout: "progress", 2024-09-13T16:13:07.542 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_support", 2024-09-13T16:13:07.542 INFO:teuthology.orchestra.run.smithi086.stdout: "status", 2024-09-13T16:13:07.542 INFO:teuthology.orchestra.run.smithi086.stdout: "telemetry", 2024-09-13T16:13:07.543 INFO:teuthology.orchestra.run.smithi086.stdout: "volumes" 2024-09-13T16:13:07.543 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T16:13:07.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.543 INFO:teuthology.orchestra.run.smithi086.stdout: "last_failure_osd_epoch": 3, 2024-09-13T16:13:07.543 INFO:teuthology.orchestra.run.smithi086.stdout: "active_clients": [ 2024-09-13T16:13:07.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.543 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "devicehealth", 2024-09-13T16:13:07.543 INFO:teuthology.orchestra.run.smithi086.stdout: "addrvec": [ 2024-09-13T16:13:07.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.543 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v2", 2024-09-13T16:13:07.543 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "172.21.15.86:0", 2024-09-13T16:13:07.544 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 3918454201 2024-09-13T16:13:07.544 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.544 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T16:13:07.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.544 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "libcephsqlite", 2024-09-13T16:13:07.544 INFO:teuthology.orchestra.run.smithi086.stdout: "addrvec": [ 2024-09-13T16:13:07.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.544 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v2", 2024-09-13T16:13:07.544 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "172.21.15.86:0", 2024-09-13T16:13:07.544 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 3724876715 2024-09-13T16:13:07.544 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.545 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T16:13:07.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.545 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "rbd_support", 2024-09-13T16:13:07.545 INFO:teuthology.orchestra.run.smithi086.stdout: "addrvec": [ 2024-09-13T16:13:07.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.545 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v2", 2024-09-13T16:13:07.545 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "172.21.15.86:0", 2024-09-13T16:13:07.545 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 68660500 2024-09-13T16:13:07.545 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.545 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T16:13:07.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:07.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.546 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "volumes", 2024-09-13T16:13:07.546 INFO:teuthology.orchestra.run.smithi086.stdout: "addrvec": [ 2024-09-13T16:13:07.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T16:13:07.546 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v2", 2024-09-13T16:13:07.546 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "172.21.15.86:0", 2024-09-13T16:13:07.546 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 316649138 2024-09-13T16:13:07.546 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.546 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T16:13:07.546 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:07.546 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T16:13:07.546 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T16:13:07.548 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:06 smithi194 ceph-mon[35694]: pgmap v447: 129 pgs: 129 active+clean; 17 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 951 op/s 2024-09-13T16:13:07.548 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:06 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3831064254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:13:07.548 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:06 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3607727822' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-13T16:13:07.548 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:06 smithi139 ceph-mon[35320]: pgmap v447: 129 pgs: 129 active+clean; 17 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 951 op/s 2024-09-13T16:13:07.549 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:06 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3831064254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:13:07.549 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:06 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3607727822' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-13T16:13:07.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:06.175+0000 7f19fdc00640 1 -- 172.21.15.86:0/3607727822 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f19dc0a1110 msgr2=0x7f19dc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:07.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:06.175+0000 7f19fdc00640 1 --2- 172.21.15.86:0/3607727822 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f19dc0a1110 0x7f19dc0a35d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009fc0 tx=0x7f19e8005f90 comp rx=0 tx=0).stop 2024-09-13T16:13:07.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:06.175+0000 7f19fdc00640 1 -- 172.21.15.86:0/3607727822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19f80ff790 msgr2=0x7f19f819f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:07.549 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:06.175+0000 7f19fdc00640 1 --2- 172.21.15.86:0/3607727822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19f80ff790 0x7f19f819f680 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f19f000eb10 tx=0x7f19f000c2d0 comp rx=0 tx=0).stop 2024-09-13T16:13:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:06.175+0000 7f19fdc00640 1 -- 172.21.15.86:0/3607727822 shutdown_connections 2024-09-13T16:13:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:06.175+0000 7f19fdc00640 1 --2- 172.21.15.86:0/3607727822 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f19dc0a1110 0x7f19dc0a35d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:06.175+0000 7f19fdc00640 1 --2- 172.21.15.86:0/3607727822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19f80ff790 0x7f19f819f680 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:06.175+0000 7f19fdc00640 1 --2- 172.21.15.86:0/3607727822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f80fedd0 0x7f19f8198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:06.175+0000 7f19fdc00640 1 --2- 172.21.15.86:0/3607727822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19f80fe070 0x7f19f81980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:06.175+0000 7f19fdc00640 1 -- 172.21.15.86:0/3607727822 >> 172.21.15.86:0/3607727822 conn(0x7f19f80f9bb0 msgr2=0x7f19f80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:06.175+0000 7f19fdc00640 1 -- 172.21.15.86:0/3607727822 shutdown_connections 2024-09-13T16:13:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:06.175+0000 7f19fdc00640 1 -- 172.21.15.86:0/3607727822 wait complete. 2024-09-13T16:13:07.610 DEBUG:tasks.check_counter:Getting stats from a 2024-09-13T16:13:07.611 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-13T16:13:07.611 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:06 smithi086 ceph-mon[30379]: pgmap v447: 129 pgs: 129 active+clean; 17 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 951 op/s 2024-09-13T16:13:07.611 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:06 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3831064254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:13:07.611 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:06 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3607727822' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-13T16:13:07.933 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:13:08.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:08 smithi086 ceph-mon[30379]: pgmap v448: 129 pgs: 129 active+clean; 16 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 968 op/s 2024-09-13T16:13:08.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:08 smithi139 ceph-mon[35320]: pgmap v448: 129 pgs: 129 active+clean; 16 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 968 op/s 2024-09-13T16:13:09.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:08 smithi194 ceph-mon[35694]: pgmap v448: 129 pgs: 129 active+clean; 16 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 968 op/s 2024-09-13T16:13:10.110 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T16:13:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 4, 2024-09-13T16:13:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 4, 2024-09-13T16:13:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 3040, 2024-09-13T16:13:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 448, 2024-09-13T16:13:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 0, 2024-09-13T16:13:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.006235868, 2024-09-13T16:13:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.000072086, 2024-09-13T16:13:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.003343300, 2024-09-13T16:13:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 3, 2024-09-13T16:13:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.005943782, 2024-09-13T16:13:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.001981260 2024-09-13T16:13:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-13T16:13:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 448 2024-09-13T16:13:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 1, 2024-09-13T16:13:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 65, 2024-09-13T16:13:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 160, 2024-09-13T16:13:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 87632, 2024-09-13T16:13:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 3, 2024-09-13T16:13:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.007647948, 2024-09-13T16:13:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.005445086, 2024-09-13T16:13:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.001267850, 2024-09-13T16:13:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 63, 2024-09-13T16:13:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.004754834, 2024-09-13T16:13:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000075473 2024-09-13T16:13:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T16:13:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 87632 2024-09-13T16:13:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 92, 2024-09-13T16:13:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 87, 2024-09-13T16:13:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 707248, 2024-09-13T16:13:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 48432, 2024-09-13T16:13:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 2, 2024-09-13T16:13:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 1, 2024-09-13T16:13:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.020817075, 2024-09-13T16:13:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.008285345, 2024-09-13T16:13:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.018883923, 2024-09-13T16:13:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 86, 2024-09-13T16:13:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.005784201, 2024-09-13T16:13:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000067258 2024-09-13T16:13:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 707248, 2024-09-13T16:13:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 48432 2024-09-13T16:13:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "cct": { 2024-09-13T16:13:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "total_workers": 0, 2024-09-13T16:13:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "unhealthy_workers": 0 2024-09-13T16:13:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "mempool": { 2024-09-13T16:13:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_items": 0, 2024-09-13T16:13:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_bytes": 148823, 2024-09-13T16:13:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_items": 27, 2024-09-13T16:13:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_bytes": 0, 2024-09-13T16:13:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_items": 0, 2024-09-13T16:13:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_bytes": 0, 2024-09-13T16:13:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_items": 0, 2024-09-13T16:13:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_bytes": 0, 2024-09-13T16:13:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_items": 0, 2024-09-13T16:13:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_items": 0, 2024-09-13T16:13:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_bytes": 928, 2024-09-13T16:13:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_items": 2, 2024-09-13T16:13:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_items": 0, 2024-09-13T16:13:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_items": 0 2024-09-13T16:13:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-13T16:13:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 104857600, 2024-09-13T16:13:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-13T16:13:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 93, 2024-09-13T16:13:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 694264, 2024-09-13T16:13:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 93, 2024-09-13T16:13:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-09-13T16:13:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-09-13T16:13:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 93, 2024-09-13T16:13:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 694264, 2024-09-13T16:13:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-13T16:13:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:10.122 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:10.122 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:10.122 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:10.122 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:10.122 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T16:13:10.839 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:10 smithi086 ceph-mon[30379]: pgmap v449: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 942 KiB/s wr, 864 op/s 2024-09-13T16:13:10.870 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-13T16:13:10.871 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-13T16:13:10.871 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-13T16:13:10.871 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-13T16:13:10.871 DEBUG:tasks.check_counter:Getting stats from d 2024-09-13T16:13:10.872 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-13T16:13:10.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:10 smithi139 ceph-mon[35320]: pgmap v449: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 942 KiB/s wr, 864 op/s 2024-09-13T16:13:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:10 smithi194 ceph-mon[35694]: pgmap v449: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 942 KiB/s wr, 864 op/s 2024-09-13T16:13:11.185 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:13:12.749 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:12 smithi086 ceph-mon[30379]: pgmap v450: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 729 KiB/s wr, 726 op/s 2024-09-13T16:13:12.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:12 smithi139 ceph-mon[35320]: pgmap v450: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 729 KiB/s wr, 726 op/s 2024-09-13T16:13:13.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:12 smithi194 ceph-mon[35694]: pgmap v450: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 729 KiB/s wr, 726 op/s 2024-09-13T16:13:13.200 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T16:13:13.200 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:13.201 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 0, 2024-09-13T16:13:13.201 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 2, 2024-09-13T16:13:13.201 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 0, 2024-09-13T16:13:13.201 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 0, 2024-09-13T16:13:13.201 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:13.201 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 0, 2024-09-13T16:13:13.201 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.003160522, 2024-09-13T16:13:13.201 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.000000000, 2024-09-13T16:13:13.201 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.000582980, 2024-09-13T16:13:13.202 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:13.202 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:13.202 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:13.202 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:13.202 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:13.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:13.202 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:13.202 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:13.202 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:13.202 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:13.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:13.202 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T16:13:13.203 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T16:13:13.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:13.203 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:13.203 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 97, 2024-09-13T16:13:13.203 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 92, 2024-09-13T16:13:13.203 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 708608, 2024-09-13T16:13:13.203 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 51392, 2024-09-13T16:13:13.203 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 2, 2024-09-13T16:13:13.203 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 1, 2024-09-13T16:13:13.204 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.019703976, 2024-09-13T16:13:13.204 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.006060690, 2024-09-13T16:13:13.204 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.020040127, 2024-09-13T16:13:13.204 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:13.204 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:13.204 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 91, 2024-09-13T16:13:13.204 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.007086784, 2024-09-13T16:13:13.204 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000077876 2024-09-13T16:13:13.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:13.204 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:13.204 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:13.204 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:13.205 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:13.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:13.205 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 708608, 2024-09-13T16:13:13.205 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 51392 2024-09-13T16:13:13.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:13.205 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:13.205 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 5, 2024-09-13T16:13:13.205 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 72, 2024-09-13T16:13:13.205 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 3200, 2024-09-13T16:13:13.206 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 88960, 2024-09-13T16:13:13.206 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 3, 2024-09-13T16:13:13.206 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:13.206 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.010908509, 2024-09-13T16:13:13.206 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.005884607, 2024-09-13T16:13:13.206 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.004145502, 2024-09-13T16:13:13.206 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:13.206 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:13.206 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 71, 2024-09-13T16:13:13.206 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.010714935, 2024-09-13T16:13:13.207 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000150914 2024-09-13T16:13:13.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:13.207 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:13.207 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:13.207 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:13.207 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:13.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:13.207 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-13T16:13:13.207 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 88960 2024-09-13T16:13:13.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:13.208 INFO:teuthology.orchestra.run.smithi086.stdout: "cct": { 2024-09-13T16:13:13.208 INFO:teuthology.orchestra.run.smithi086.stdout: "total_workers": 0, 2024-09-13T16:13:13.208 INFO:teuthology.orchestra.run.smithi086.stdout: "unhealthy_workers": 0 2024-09-13T16:13:13.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:13.208 INFO:teuthology.orchestra.run.smithi086.stdout: "mempool": { 2024-09-13T16:13:13.208 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:13.208 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:13.208 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:13.208 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:13.208 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_items": 0, 2024-09-13T16:13:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_bytes": 149854, 2024-09-13T16:13:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_items": 28, 2024-09-13T16:13:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_bytes": 0, 2024-09-13T16:13:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_items": 0, 2024-09-13T16:13:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_bytes": 0, 2024-09-13T16:13:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_items": 0, 2024-09-13T16:13:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_bytes": 0, 2024-09-13T16:13:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_items": 0, 2024-09-13T16:13:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_items": 0, 2024-09-13T16:13:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_bytes": 928, 2024-09-13T16:13:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_items": 2, 2024-09-13T16:13:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_items": 0, 2024-09-13T16:13:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_items": 0 2024-09-13T16:13:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-13T16:13:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 104857600, 2024-09-13T16:13:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-13T16:13:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 98, 2024-09-13T16:13:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 694914, 2024-09-13T16:13:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 98, 2024-09-13T16:13:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-09-13T16:13:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-09-13T16:13:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 98, 2024-09-13T16:13:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 694914, 2024-09-13T16:13:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-13T16:13:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:13.214 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T16:13:13.958 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-13T16:13:13.958 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-13T16:13:13.958 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-13T16:13:13.958 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-13T16:13:13.959 DEBUG:tasks.check_counter:Getting stats from g 2024-09-13T16:13:13.959 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-13T16:13:14.275 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:13:14.721 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:14 smithi086 ceph-mon[30379]: pgmap v451: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 465 KiB/s wr, 492 op/s 2024-09-13T16:13:14.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:14 smithi139 ceph-mon[35320]: pgmap v451: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 465 KiB/s wr, 492 op/s 2024-09-13T16:13:15.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:14 smithi194 ceph-mon[35694]: pgmap v451: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 465 KiB/s wr, 492 op/s 2024-09-13T16:13:16.306 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T16:13:16.306 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:16.306 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 0, 2024-09-13T16:13:16.306 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 2, 2024-09-13T16:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 0, 2024-09-13T16:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 0, 2024-09-13T16:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 0, 2024-09-13T16:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.003386643, 2024-09-13T16:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.000000000, 2024-09-13T16:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.000629511, 2024-09-13T16:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T16:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T16:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 1, 2024-09-13T16:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 67, 2024-09-13T16:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 160, 2024-09-13T16:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 87984, 2024-09-13T16:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 3, 2024-09-13T16:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.008045277, 2024-09-13T16:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.005634690, 2024-09-13T16:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.001469104, 2024-09-13T16:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 65, 2024-09-13T16:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.005984841, 2024-09-13T16:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000092074 2024-09-13T16:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T16:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 87984 2024-09-13T16:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 98, 2024-09-13T16:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 91, 2024-09-13T16:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 710832, 2024-09-13T16:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 50064, 2024-09-13T16:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 2, 2024-09-13T16:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 1, 2024-09-13T16:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.024189958, 2024-09-13T16:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.008223701, 2024-09-13T16:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.022592794, 2024-09-13T16:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 91, 2024-09-13T16:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.013978086, 2024-09-13T16:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000153605 2024-09-13T16:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 710832, 2024-09-13T16:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 50064 2024-09-13T16:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: "cct": { 2024-09-13T16:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: "total_workers": 0, 2024-09-13T16:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: "unhealthy_workers": 0 2024-09-13T16:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: "mempool": { 2024-09-13T16:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_items": 0, 2024-09-13T16:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_bytes": 148823, 2024-09-13T16:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_items": 27, 2024-09-13T16:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_bytes": 0, 2024-09-13T16:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_items": 0, 2024-09-13T16:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_bytes": 0, 2024-09-13T16:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_items": 0, 2024-09-13T16:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_bytes": 0, 2024-09-13T16:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_items": 0, 2024-09-13T16:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_items": 0, 2024-09-13T16:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_bytes": 928, 2024-09-13T16:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_items": 2, 2024-09-13T16:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_items": 0, 2024-09-13T16:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_items": 0 2024-09-13T16:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-13T16:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 104857600, 2024-09-13T16:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-13T16:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 95, 2024-09-13T16:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 694524, 2024-09-13T16:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 95, 2024-09-13T16:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-09-13T16:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-09-13T16:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 95, 2024-09-13T16:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 694524, 2024-09-13T16:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-13T16:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:16.319 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:16.319 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T16:13:16.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:16 smithi086 ceph-mon[30379]: pgmap v452: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 256 KiB/s wr, 293 op/s 2024-09-13T16:13:16.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:16 smithi139 ceph-mon[35320]: pgmap v452: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 256 KiB/s wr, 293 op/s 2024-09-13T16:13:17.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:16 smithi194 ceph-mon[35694]: pgmap v452: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 256 KiB/s wr, 293 op/s 2024-09-13T16:13:17.202 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-13T16:13:17.202 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-13T16:13:17.202 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-13T16:13:17.202 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-13T16:13:17.202 DEBUG:tasks.check_counter:Getting stats from j 2024-09-13T16:13:17.202 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-13T16:13:17.526 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:13:18.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:18 smithi086 ceph-mon[30379]: pgmap v453: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 147 KiB/s wr, 82 op/s 2024-09-13T16:13:18.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:18 smithi139 ceph-mon[35320]: pgmap v453: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 147 KiB/s wr, 82 op/s 2024-09-13T16:13:19.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:18 smithi194 ceph-mon[35694]: pgmap v453: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 147 KiB/s wr, 82 op/s 2024-09-13T16:13:19.621 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T16:13:19.621 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:19.621 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 0, 2024-09-13T16:13:19.621 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 2, 2024-09-13T16:13:19.621 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 0, 2024-09-13T16:13:19.621 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 0, 2024-09-13T16:13:19.622 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:19.622 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 0, 2024-09-13T16:13:19.622 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.003005982, 2024-09-13T16:13:19.622 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.000000000, 2024-09-13T16:13:19.622 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.000520440, 2024-09-13T16:13:19.622 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:19.622 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:19.622 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:19.622 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.622 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:19.622 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:19.622 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:19.622 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.623 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:19.623 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T16:13:19.623 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T16:13:19.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:19.623 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:19.623 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 104, 2024-09-13T16:13:19.623 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 97, 2024-09-13T16:13:19.623 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 712464, 2024-09-13T16:13:19.623 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 53616, 2024-09-13T16:13:19.623 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 2, 2024-09-13T16:13:19.623 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 1, 2024-09-13T16:13:19.623 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.025677784, 2024-09-13T16:13:19.624 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.009368332, 2024-09-13T16:13:19.624 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.023115024, 2024-09-13T16:13:19.624 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:19.624 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:19.624 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 97, 2024-09-13T16:13:19.624 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.013012960, 2024-09-13T16:13:19.624 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000134154 2024-09-13T16:13:19.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:19.624 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:19.624 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:19.624 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.624 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:19.625 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 712464, 2024-09-13T16:13:19.625 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 53616 2024-09-13T16:13:19.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:19.625 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:19.625 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 1, 2024-09-13T16:13:19.625 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 72, 2024-09-13T16:13:19.625 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 160, 2024-09-13T16:13:19.625 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 88864, 2024-09-13T16:13:19.625 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 3, 2024-09-13T16:13:19.625 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:19.625 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.008936516, 2024-09-13T16:13:19.626 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.006168503, 2024-09-13T16:13:19.626 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.001712332, 2024-09-13T16:13:19.626 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:19.626 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:19.626 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 70, 2024-09-13T16:13:19.626 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.004209097, 2024-09-13T16:13:19.626 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000060129 2024-09-13T16:13:19.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:19.626 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:19.626 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:19.626 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.627 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:19.627 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T16:13:19.627 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 88864 2024-09-13T16:13:19.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:19.627 INFO:teuthology.orchestra.run.smithi086.stdout: "cct": { 2024-09-13T16:13:19.627 INFO:teuthology.orchestra.run.smithi086.stdout: "total_workers": 0, 2024-09-13T16:13:19.627 INFO:teuthology.orchestra.run.smithi086.stdout: "unhealthy_workers": 0 2024-09-13T16:13:19.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:19.627 INFO:teuthology.orchestra.run.smithi086.stdout: "mempool": { 2024-09-13T16:13:19.627 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:19.627 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:19.627 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:19.627 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:19.627 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:19.628 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:19.628 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:19.628 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:19.628 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:19.628 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:19.628 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:19.628 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:19.628 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:19.628 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:19.628 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:19.628 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:19.628 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:19.628 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:19.629 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:19.630 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:19.630 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:19.630 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:19.630 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:19.630 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:19.630 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:19.630 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:19.630 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:19.630 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:19.630 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:19.631 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:19.631 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:19.631 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_items": 0, 2024-09-13T16:13:19.631 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:19.631 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:19.631 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:19.631 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:19.631 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_bytes": 148840, 2024-09-13T16:13:19.631 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_items": 28, 2024-09-13T16:13:19.631 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_bytes": 0, 2024-09-13T16:13:19.631 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_items": 0, 2024-09-13T16:13:19.631 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_bytes": 0, 2024-09-13T16:13:19.631 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_items": 0, 2024-09-13T16:13:19.632 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:19.632 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:19.632 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:19.632 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:19.632 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_bytes": 0, 2024-09-13T16:13:19.632 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_items": 0, 2024-09-13T16:13:19.632 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:19.632 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:19.632 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:19.632 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_items": 0, 2024-09-13T16:13:19.632 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_bytes": 928, 2024-09-13T16:13:19.632 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_items": 2, 2024-09-13T16:13:19.632 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:19.633 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_items": 0, 2024-09-13T16:13:19.633 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:19.633 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_items": 0 2024-09-13T16:13:19.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T16:13:19.633 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:19.633 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-13T16:13:19.633 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 104857600, 2024-09-13T16:13:19.633 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-13T16:13:19.633 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 101, 2024-09-13T16:13:19.633 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 695304, 2024-09-13T16:13:19.633 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:19.634 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 101, 2024-09-13T16:13:19.634 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-09-13T16:13:19.634 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-09-13T16:13:19.634 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 101, 2024-09-13T16:13:19.634 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 695304, 2024-09-13T16:13:19.634 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-13T16:13:19.634 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-13T16:13:19.634 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.634 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.634 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:19.634 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T16:13:19.635 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T16:13:20.342 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-13T16:13:20.342 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-13T16:13:20.342 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-13T16:13:20.342 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-13T16:13:20.342 DEBUG:tasks.check_counter:Getting stats from b 2024-09-13T16:13:20.343 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-13T16:13:20.552 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:13:20.673 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:20 smithi139 ceph-mon[35320]: pgmap v454: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 20 op/s 2024-09-13T16:13:20.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:20 smithi086 ceph-mon[30379]: pgmap v454: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 20 op/s 2024-09-13T16:13:21.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:20 smithi194 ceph-mon[35694]: pgmap v454: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 20 op/s 2024-09-13T16:13:22.362 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T16:13:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 22243, 2024-09-13T16:13:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 29688, 2024-09-13T16:13:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 5655976, 2024-09-13T16:13:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 71972177, 2024-09-13T16:13:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 20, 2024-09-13T16:13:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 7, 2024-09-13T16:13:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 1.738263922, 2024-09-13T16:13:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.705030245, 2024-09-13T16:13:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.478776668, 2024-09-13T16:13:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.482968034, 2024-09-13T16:13:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 29686, 2024-09-13T16:13:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 13.778304382, 2024-09-13T16:13:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000464134 2024-09-13T16:13:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 20254, 2024-09-13T16:13:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.003761391, 2024-09-13T16:13:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000185 2024-09-13T16:13:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 36992, 2024-09-13T16:13:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 1456 2024-09-13T16:13:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 23373, 2024-09-13T16:13:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 30870, 2024-09-13T16:13:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 7192634, 2024-09-13T16:13:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 54826181, 2024-09-13T16:13:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 18, 2024-09-13T16:13:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 5, 2024-09-13T16:13:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 1.770349862, 2024-09-13T16:13:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.696314737, 2024-09-13T16:13:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.519364692, 2024-09-13T16:13:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.505318729, 2024-09-13T16:13:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 30870, 2024-09-13T16:13:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 14.145944862, 2024-09-13T16:13:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000458242 2024-09-13T16:13:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 20396, 2024-09-13T16:13:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.004141693, 2024-09-13T16:13:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000203 2024-09-13T16:13:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T16:13:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 197776 2024-09-13T16:13:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 57603, 2024-09-13T16:13:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 101296, 2024-09-13T16:13:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 19710037, 2024-09-13T16:13:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 65515958, 2024-09-13T16:13:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 17, 2024-09-13T16:13:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 6, 2024-09-13T16:13:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 3.391158401, 2024-09-13T16:13:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 1.563000784, 2024-09-13T16:13:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 2.148153425, 2024-09-13T16:13:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.534723736, 2024-09-13T16:13:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 101294, 2024-09-13T16:13:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 21.785067753, 2024-09-13T16:13:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000215067 2024-09-13T16:13:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 66898, 2024-09-13T16:13:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.018031948, 2024-09-13T16:13:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000269 2024-09-13T16:13:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 827232, 2024-09-13T16:13:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 89040 2024-09-13T16:13:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2024-09-13T16:13:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 1, 2024-09-13T16:13:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2024-09-13T16:13:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-MDSRank": { 2024-09-13T16:13:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-09-13T16:13:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-09-13T16:13:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 3014, 2024-09-13T16:13:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 21.924776293, 2024-09-13T16:13:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.007274311 2024-09-13T16:13:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-PurgeQueue": { 2024-09-13T16:13:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-09-13T16:13:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-09-13T16:13:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 18598, 2024-09-13T16:13:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 3.435215980, 2024-09-13T16:13:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000184708 2024-09-13T16:13:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": { 2024-09-13T16:13:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: "request": 23924, 2024-09-13T16:13:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: "reply": 23892, 2024-09-13T16:13:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: "reply_latency": { 2024-09-13T16:13:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 23892, 2024-09-13T16:13:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 43.639283957, 2024-09-13T16:13:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001826522 2024-09-13T16:13:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_reply": 0, 2024-09-13T16:13:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: "forward": 32, 2024-09-13T16:13:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_complete": 0, 2024-09-13T16:13:22.371 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_keys": 0, 2024-09-13T16:13:22.371 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_commit": 1356, 2024-09-13T16:13:22.371 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_split": 17, 2024-09-13T16:13:22.371 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_merge": 7, 2024-09-13T16:13:22.371 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes": 837, 2024-09-13T16:13:22.371 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_top": 288, 2024-09-13T16:13:22.371 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_bottom": 539, 2024-09-13T16:13:22.371 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pin_tail": 10, 2024-09-13T16:13:22.371 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pinned": 425, 2024-09-13T16:13:22.371 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_expired": 436, 2024-09-13T16:13:22.371 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_with_caps": 2, 2024-09-13T16:13:22.371 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": 2, 2024-09-13T16:13:22.371 INFO:teuthology.orchestra.run.smithi139.stdout: "subtrees": 4, 2024-09-13T16:13:22.372 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse": 24769, 2024-09-13T16:13:22.372 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_hit": 24123, 2024-09-13T16:13:22.372 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_forward": 0, 2024-09-13T16:13:22.372 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_discover": 1, 2024-09-13T16:13:22.372 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_dir_fetch": 0, 2024-09-13T16:13:22.372 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_remote_ino": 0, 2024-09-13T16:13:22.372 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_lock": 0, 2024-09-13T16:13:22.372 INFO:teuthology.orchestra.run.smithi139.stdout: "load_cent": 0, 2024-09-13T16:13:22.372 INFO:teuthology.orchestra.run.smithi139.stdout: "q": 0, 2024-09-13T16:13:22.372 INFO:teuthology.orchestra.run.smithi139.stdout: "exported": 32, 2024-09-13T16:13:22.373 INFO:teuthology.orchestra.run.smithi139.stdout: "exported_inodes": 412, 2024-09-13T16:13:22.373 INFO:teuthology.orchestra.run.smithi139.stdout: "imported": 32, 2024-09-13T16:13:22.373 INFO:teuthology.orchestra.run.smithi139.stdout: "imported_inodes": 12, 2024-09-13T16:13:22.373 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_dir_fetch": 0, 2024-09-13T16:13:22.373 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_backtrace_fetch": 0, 2024-09-13T16:13:22.373 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_peer_discover": 0, 2024-09-13T16:13:22.373 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rfiles": 4, 2024-09-13T16:13:22.373 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rbytes": 234, 2024-09-13T16:13:22.373 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rsnaps": 0, 2024-09-13T16:13:22.373 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T16:13:22.373 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_set_tag": 0, 2024-09-13T16:13:22.373 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T16:13:22.374 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_inotable_repaired": 0, 2024-09-13T16:13:22.374 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_inodes": 0, 2024-09-13T16:13:22.374 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T16:13:22.374 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T16:13:22.374 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_file_inodes": 0, 2024-09-13T16:13:22.374 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_inode_file_caps": 64, 2024-09-13T16:13:22.374 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_revoke": 2099, 2024-09-13T16:13:22.374 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_grant": 23721, 2024-09-13T16:13:22.374 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T16:13:22.374 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T16:13:22.374 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T16:13:22.374 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps": 16543, 2024-09-13T16:13:22.374 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps_dirty": 11583, 2024-09-13T16:13:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_cap_release": 123, 2024-09-13T16:13:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: "process_request_cap_release": 12977 2024-09-13T16:13:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_cache": { 2024-09-13T16:13:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update": 1266, 2024-09-13T16:13:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update_receipt": 3, 2024-09-13T16:13:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_try_discover": 2, 2024-09-13T16:13:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_send_discover": 2, 2024-09-13T16:13:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_handle_discover": 2515, 2024-09-13T16:13:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays": 20, 2024-09-13T16:13:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_delayed": 0, 2024-09-13T16:13:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_enqueuing": 0, 2024-09-13T16:13:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_created": 11125, 2024-09-13T16:13:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_enqueued": 11105, 2024-09-13T16:13:22.376 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_reintegrated": 0, 2024-09-13T16:13:22.376 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_migrated": 0, 2024-09-13T16:13:22.376 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_processing": 0, 2024-09-13T16:13:22.376 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_enqueued": 0, 2024-09-13T16:13:22.376 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_prioritized": 0, 2024-09-13T16:13:22.376 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_started": 0, 2024-09-13T16:13:22.376 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_completed": 0, 2024-09-13T16:13:22.376 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T16:13:22.376 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_exportdir": 32, 2024-09-13T16:13:22.376 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_flush": 0, 2024-09-13T16:13:22.376 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragmentdir": 24, 2024-09-13T16:13:22.376 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragstats": 0, 2024-09-13T16:13:22.376 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_inodestats": 0 2024-09-13T16:13:22.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.377 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_log": { 2024-09-13T16:13:22.377 INFO:teuthology.orchestra.run.smithi139.stdout: "evadd": 53879, 2024-09-13T16:13:22.377 INFO:teuthology.orchestra.run.smithi139.stdout: "evex": 50587, 2024-09-13T16:13:22.377 INFO:teuthology.orchestra.run.smithi139.stdout: "evtrm": 50587, 2024-09-13T16:13:22.377 INFO:teuthology.orchestra.run.smithi139.stdout: "ev": 3292, 2024-09-13T16:13:22.377 INFO:teuthology.orchestra.run.smithi139.stdout: "evexg": 0, 2024-09-13T16:13:22.377 INFO:teuthology.orchestra.run.smithi139.stdout: "evexd": 11265, 2024-09-13T16:13:22.377 INFO:teuthology.orchestra.run.smithi139.stdout: "segadd": 74, 2024-09-13T16:13:22.377 INFO:teuthology.orchestra.run.smithi139.stdout: "segex": 69, 2024-09-13T16:13:22.377 INFO:teuthology.orchestra.run.smithi139.stdout: "segtrm": 69, 2024-09-13T16:13:22.377 INFO:teuthology.orchestra.run.smithi139.stdout: "seg": 5, 2024-09-13T16:13:22.377 INFO:teuthology.orchestra.run.smithi139.stdout: "segexg": 0, 2024-09-13T16:13:22.377 INFO:teuthology.orchestra.run.smithi139.stdout: "segexd": 14, 2024-09-13T16:13:22.378 INFO:teuthology.orchestra.run.smithi139.stdout: "expos": 107884706, 2024-09-13T16:13:22.378 INFO:teuthology.orchestra.run.smithi139.stdout: "wrpos": 114158057, 2024-09-13T16:13:22.378 INFO:teuthology.orchestra.run.smithi139.stdout: "rdpos": 0, 2024-09-13T16:13:22.378 INFO:teuthology.orchestra.run.smithi139.stdout: "jlat": { 2024-09-13T16:13:22.378 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1528, 2024-09-13T16:13:22.378 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 80.127274022, 2024-09-13T16:13:22.378 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.052439315 2024-09-13T16:13:22.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.378 INFO:teuthology.orchestra.run.smithi139.stdout: "replayed": 0 2024-09-13T16:13:22.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.378 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_mem": { 2024-09-13T16:13:22.378 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 45, 2024-09-13T16:13:22.378 INFO:teuthology.orchestra.run.smithi139.stdout: "ino+": 11566, 2024-09-13T16:13:22.379 INFO:teuthology.orchestra.run.smithi139.stdout: "ino-": 11521, 2024-09-13T16:13:22.379 INFO:teuthology.orchestra.run.smithi139.stdout: "dir": 52, 2024-09-13T16:13:22.379 INFO:teuthology.orchestra.run.smithi139.stdout: "dir+": 784, 2024-09-13T16:13:22.379 INFO:teuthology.orchestra.run.smithi139.stdout: "dir-": 732, 2024-09-13T16:13:22.379 INFO:teuthology.orchestra.run.smithi139.stdout: "dn": 837, 2024-09-13T16:13:22.379 INFO:teuthology.orchestra.run.smithi139.stdout: "dn+": 19221, 2024-09-13T16:13:22.379 INFO:teuthology.orchestra.run.smithi139.stdout: "dn-": 18384, 2024-09-13T16:13:22.379 INFO:teuthology.orchestra.run.smithi139.stdout: "cap": 2, 2024-09-13T16:13:22.379 INFO:teuthology.orchestra.run.smithi139.stdout: "cap+": 11552, 2024-09-13T16:13:22.379 INFO:teuthology.orchestra.run.smithi139.stdout: "cap-": 11550, 2024-09-13T16:13:22.379 INFO:teuthology.orchestra.run.smithi139.stdout: "rss": 101680, 2024-09-13T16:13:22.379 INFO:teuthology.orchestra.run.smithi139.stdout: "heap": 207124 2024-09-13T16:13:22.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.379 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_server": { 2024-09-13T16:13:22.380 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_client_request": 29139, 2024-09-13T16:13:22.380 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_server_request": 81, 2024-09-13T16:13:22.380 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_request": 23924, 2024-09-13T16:13:22.380 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_session": 49, 2024-09-13T16:13:22.380 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_peer_request": 346, 2024-09-13T16:13:22.380 INFO:teuthology.orchestra.run.smithi139.stdout: "req_create_latency": { 2024-09-13T16:13:22.380 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 10924, 2024-09-13T16:13:22.380 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 16.125557426, 2024-09-13T16:13:22.380 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001476158 2024-09-13T16:13:22.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.380 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getattr_latency": { 2024-09-13T16:13:22.380 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 76, 2024-09-13T16:13:22.380 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.033009224, 2024-09-13T16:13:22.381 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000434331 2024-09-13T16:13:22.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.381 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getfilelock_latency": { 2024-09-13T16:13:22.381 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.381 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.381 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.381 INFO:teuthology.orchestra.run.smithi139.stdout: "req_link_latency": { 2024-09-13T16:13:22.381 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.381 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.381 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.381 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookup_latency": { 2024-09-13T16:13:22.382 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 131, 2024-09-13T16:13:22.382 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.044874333, 2024-09-13T16:13:22.382 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000342552 2024-09-13T16:13:22.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.382 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookuphash_latency": { 2024-09-13T16:13:22.382 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.382 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.382 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.382 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupino_latency": { 2024-09-13T16:13:22.382 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1, 2024-09-13T16:13:22.382 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000137697, 2024-09-13T16:13:22.382 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000137697 2024-09-13T16:13:22.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.383 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupname_latency": { 2024-09-13T16:13:22.383 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.383 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.383 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.383 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupparent_latency": { 2024-09-13T16:13:22.383 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.383 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.383 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.383 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupsnap_latency": { 2024-09-13T16:13:22.383 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.383 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.384 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.384 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lssnap_latency": { 2024-09-13T16:13:22.384 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.384 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.384 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.384 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mkdir_latency": { 2024-09-13T16:13:22.384 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 623, 2024-09-13T16:13:22.384 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.507096959, 2024-09-13T16:13:22.384 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000813959 2024-09-13T16:13:22.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.384 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mknod_latency": { 2024-09-13T16:13:22.385 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.385 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.385 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.385 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mksnap_latency": { 2024-09-13T16:13:22.385 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.385 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.385 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.385 INFO:teuthology.orchestra.run.smithi139.stdout: "req_open_latency": { 2024-09-13T16:13:22.385 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.385 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.385 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.386 INFO:teuthology.orchestra.run.smithi139.stdout: "req_readdir_latency": { 2024-09-13T16:13:22.386 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 977, 2024-09-13T16:13:22.386 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 1.323358911, 2024-09-13T16:13:22.386 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001354512 2024-09-13T16:13:22.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.386 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rename_latency": { 2024-09-13T16:13:22.386 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2, 2024-09-13T16:13:22.386 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.001984054, 2024-09-13T16:13:22.386 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000992027 2024-09-13T16:13:22.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.386 INFO:teuthology.orchestra.run.smithi139.stdout: "req_renamesnap_latency": { 2024-09-13T16:13:22.386 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.386 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.387 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.387 INFO:teuthology.orchestra.run.smithi139.stdout: "req_snapdiff_latency": { 2024-09-13T16:13:22.387 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.387 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.387 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.387 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmdir_latency": { 2024-09-13T16:13:22.387 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 605, 2024-09-13T16:13:22.387 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 10.023218240, 2024-09-13T16:13:22.387 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.016567302 2024-09-13T16:13:22.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.387 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmsnap_latency": { 2024-09-13T16:13:22.387 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.388 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.388 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.388 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmxattr_latency": { 2024-09-13T16:13:22.388 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.388 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.388 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.388 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setattr_latency": { 2024-09-13T16:13:22.388 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 24, 2024-09-13T16:13:22.388 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 2.200582361, 2024-09-13T16:13:22.388 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.091690931 2024-09-13T16:13:22.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.389 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setdirlayout_latency": { 2024-09-13T16:13:22.389 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.389 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.389 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.389 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setfilelock_latency": { 2024-09-13T16:13:22.389 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.389 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.389 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.389 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setlayout_latency": { 2024-09-13T16:13:22.389 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.389 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.389 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.390 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setxattr_latency": { 2024-09-13T16:13:22.390 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 9, 2024-09-13T16:13:22.390 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.018925530, 2024-09-13T16:13:22.390 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.002102836 2024-09-13T16:13:22.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.390 INFO:teuthology.orchestra.run.smithi139.stdout: "req_symlink_latency": { 2024-09-13T16:13:22.390 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.390 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.390 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.390 INFO:teuthology.orchestra.run.smithi139.stdout: "req_unlink_latency": { 2024-09-13T16:13:22.391 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 10520, 2024-09-13T16:13:22.391 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 13.360539222, 2024-09-13T16:13:22.391 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001270013 2024-09-13T16:13:22.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.391 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_revoke_eviction": 0, 2024-09-13T16:13:22.391 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_acquisition_throttle": 0, 2024-09-13T16:13:22.391 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getvxattr_latency": { 2024-09-13T16:13:22.391 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.391 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.391 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.391 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:22.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.392 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_sessions": { 2024-09-13T16:13:22.392 INFO:teuthology.orchestra.run.smithi139.stdout: "session_count": 1, 2024-09-13T16:13:22.392 INFO:teuthology.orchestra.run.smithi139.stdout: "session_add": 4, 2024-09-13T16:13:22.392 INFO:teuthology.orchestra.run.smithi139.stdout: "session_remove": 3, 2024-09-13T16:13:22.392 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_open": 1, 2024-09-13T16:13:22.392 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_stale": 0, 2024-09-13T16:13:22.392 INFO:teuthology.orchestra.run.smithi139.stdout: "total_load": 16259, 2024-09-13T16:13:22.392 INFO:teuthology.orchestra.run.smithi139.stdout: "average_load": 16259, 2024-09-13T16:13:22.392 INFO:teuthology.orchestra.run.smithi139.stdout: "avg_session_uptime": 159, 2024-09-13T16:13:22.392 INFO:teuthology.orchestra.run.smithi139.stdout: "mdthresh_evicted": 0 2024-09-13T16:13:22.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.392 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2024-09-13T16:13:22.392 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 120, 2024-09-13T16:13:22.393 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 120, 2024-09-13T16:13:22.393 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:22.393 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:22.393 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:22.393 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:22.397 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:22.397 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:22.397 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:22.397 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:22.397 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:22.397 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:22.397 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:22.397 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:22.397 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:22.397 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:22.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:22.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:22.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:22.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:22.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:22.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:22.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:22.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:22.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:22.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:22.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:22.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:22.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:22.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:22.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:22.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2024-09-13T16:13:22.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:22.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:22.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:22.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:22.399 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 292877, 2024-09-13T16:13:22.399 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 155, 2024-09-13T16:13:22.399 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 1672, 2024-09-13T16:13:22.399 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 19, 2024-09-13T16:13:22.399 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2024-09-13T16:13:22.399 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2024-09-13T16:13:22.400 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:22.400 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:22.400 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:22.400 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:22.400 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 9240, 2024-09-13T16:13:22.400 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 174, 2024-09-13T16:13:22.400 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:22.400 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:22.400 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:22.400 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2024-09-13T16:13:22.400 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 807841, 2024-09-13T16:13:22.400 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 11719, 2024-09-13T16:13:22.400 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:22.400 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2024-09-13T16:13:22.401 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:22.401 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2024-09-13T16:13:22.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.401 INFO:teuthology.orchestra.run.smithi139.stdout: "objecter": { 2024-09-13T16:13:22.401 INFO:teuthology.orchestra.run.smithi139.stdout: "op_active": 0, 2024-09-13T16:13:22.401 INFO:teuthology.orchestra.run.smithi139.stdout: "op_laggy": 0, 2024-09-13T16:13:22.401 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send": 48862, 2024-09-13T16:13:22.401 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send_bytes": 134903894, 2024-09-13T16:13:22.401 INFO:teuthology.orchestra.run.smithi139.stdout: "op_resend": 37, 2024-09-13T16:13:22.401 INFO:teuthology.orchestra.run.smithi139.stdout: "op_reply": 48862, 2024-09-13T16:13:22.401 INFO:teuthology.orchestra.run.smithi139.stdout: "op_latency": { 2024-09-13T16:13:22.401 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 48862, 2024-09-13T16:13:22.401 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 9314.438149581, 2024-09-13T16:13:22.402 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.190627443 2024-09-13T16:13:22.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.402 INFO:teuthology.orchestra.run.smithi139.stdout: "op_inflight": 0, 2024-09-13T16:13:22.402 INFO:teuthology.orchestra.run.smithi139.stdout: "oplen_avg": { 2024-09-13T16:13:22.402 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 48862, 2024-09-13T16:13:22.402 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 86575 2024-09-13T16:13:22.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.402 INFO:teuthology.orchestra.run.smithi139.stdout: "op": 48862, 2024-09-13T16:13:22.402 INFO:teuthology.orchestra.run.smithi139.stdout: "op_r": 151, 2024-09-13T16:13:22.402 INFO:teuthology.orchestra.run.smithi139.stdout: "op_w": 48711, 2024-09-13T16:13:22.402 INFO:teuthology.orchestra.run.smithi139.stdout: "op_rmw": 0, 2024-09-13T16:13:22.402 INFO:teuthology.orchestra.run.smithi139.stdout: "op_pg": 0, 2024-09-13T16:13:22.402 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_stat": 614, 2024-09-13T16:13:22.403 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_create": 23154, 2024-09-13T16:13:22.403 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_read": 151, 2024-09-13T16:13:22.403 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_write": 1679, 2024-09-13T16:13:22.403 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writefull": 103, 2024-09-13T16:13:22.403 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writesame": 0, 2024-09-13T16:13:22.403 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_append": 0, 2024-09-13T16:13:22.403 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_zero": 0, 2024-09-13T16:13:22.403 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_truncate": 17, 2024-09-13T16:13:22.403 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_delete": 22362, 2024-09-13T16:13:22.403 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_mapext": 0, 2024-09-13T16:13:22.403 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_sparse_read": 0, 2024-09-13T16:13:22.403 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_clonerange": 0, 2024-09-13T16:13:22.403 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_getxattr": 0, 2024-09-13T16:13:22.403 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_setxattr": 35712, 2024-09-13T16:13:22.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_cmpxattr": 0, 2024-09-13T16:13:22.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_rmxattr": 0, 2024-09-13T16:13:22.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_resetxattrs": 0, 2024-09-13T16:13:22.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_call": 0, 2024-09-13T16:13:22.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_watch": 0, 2024-09-13T16:13:22.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_notify": 0, 2024-09-13T16:13:22.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T16:13:22.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls": 0, 2024-09-13T16:13:22.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls_filter": 0, 2024-09-13T16:13:22.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_other": 0, 2024-09-13T16:13:22.404 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_active": 0, 2024-09-13T16:13:22.404 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_send": 0, 2024-09-13T16:13:22.404 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_resend": 0, 2024-09-13T16:13:22.404 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_ping": 0, 2024-09-13T16:13:22.405 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_active": 0, 2024-09-13T16:13:22.405 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_send": 0, 2024-09-13T16:13:22.405 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_resend": 0, 2024-09-13T16:13:22.405 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_active": 0, 2024-09-13T16:13:22.405 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_send": 0, 2024-09-13T16:13:22.405 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_resend": 0, 2024-09-13T16:13:22.405 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_active": 0, 2024-09-13T16:13:22.405 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_send": 0, 2024-09-13T16:13:22.405 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_resend": 0, 2024-09-13T16:13:22.405 INFO:teuthology.orchestra.run.smithi139.stdout: "command_active": 0, 2024-09-13T16:13:22.405 INFO:teuthology.orchestra.run.smithi139.stdout: "command_send": 0, 2024-09-13T16:13:22.405 INFO:teuthology.orchestra.run.smithi139.stdout: "command_resend": 0, 2024-09-13T16:13:22.406 INFO:teuthology.orchestra.run.smithi139.stdout: "map_epoch": 94, 2024-09-13T16:13:22.406 INFO:teuthology.orchestra.run.smithi139.stdout: "map_full": 0, 2024-09-13T16:13:22.406 INFO:teuthology.orchestra.run.smithi139.stdout: "map_inc": 9, 2024-09-13T16:13:22.406 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_sessions": 12, 2024-09-13T16:13:22.406 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_open": 12, 2024-09-13T16:13:22.406 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_close": 0, 2024-09-13T16:13:22.406 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_laggy": 0, 2024-09-13T16:13:22.406 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_wr": 2688, 2024-09-13T16:13:22.406 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_rd": 0, 2024-09-13T16:13:22.406 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_del": 95 2024-09-13T16:13:22.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.406 INFO:teuthology.orchestra.run.smithi139.stdout: "oft": { 2024-09-13T16:13:22.406 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_objs": 1, 2024-09-13T16:13:22.407 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_kv_pairs": 0, 2024-09-13T16:13:22.407 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_updates": 0, 2024-09-13T16:13:22.407 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_removes": 0 2024-09-13T16:13:22.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.407 INFO:teuthology.orchestra.run.smithi139.stdout: "osd-slow-ops": { 2024-09-13T16:13:22.407 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_ops_count": 0 2024-09-13T16:13:22.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.407 INFO:teuthology.orchestra.run.smithi139.stdout: "purge_queue": { 2024-09-13T16:13:22.407 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops": 0, 2024-09-13T16:13:22.407 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops_high_water": 41, 2024-09-13T16:13:22.407 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing": 0, 2024-09-13T16:13:22.407 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_high_water": 16, 2024-09-13T16:13:22.407 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed_ops": 21752, 2024-09-13T16:13:22.407 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed": 11105, 2024-09-13T16:13:22.408 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_item_in_journal": 0 2024-09-13T16:13:22.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.408 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:22.408 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-13T16:13:22.408 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-09-13T16:13:22.408 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-13T16:13:22.408 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 103215, 2024-09-13T16:13:22.408 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 23896449, 2024-09-13T16:13:22.408 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:22.408 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 103215, 2024-09-13T16:13:22.408 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-13T16:13:22.408 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-13T16:13:22.408 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 103215, 2024-09-13T16:13:22.409 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 23896449, 2024-09-13T16:13:22.409 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-13T16:13:22.409 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.409 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.409 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.409 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:22.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.409 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_bytes": { 2024-09-13T16:13:22.409 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-13T16:13:22.409 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-09-13T16:13:22.409 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-13T16:13:22.409 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-13T16:13:22.409 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-13T16:13:22.410 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:22.410 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:22.410 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 48862, 2024-09-13T16:13:22.410 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 136109747, 2024-09-13T16:13:22.410 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 48862, 2024-09-13T16:13:22.410 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 136109747, 2024-09-13T16:13:22.410 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-13T16:13:22.410 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.410 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.410 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_ops": { 2024-09-13T16:13:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-13T16:13:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 1024, 2024-09-13T16:13:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-13T16:13:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-13T16:13:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-13T16:13:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 48862, 2024-09-13T16:13:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 48862, 2024-09-13T16:13:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 48862, 2024-09-13T16:13:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 48862, 2024-09-13T16:13:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-13T16:13:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle": { 2024-09-13T16:13:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-13T16:13:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-09-13T16:13:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-13T16:13:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 11105, 2024-09-13T16:13:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 1205853, 2024-09-13T16:13:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 11105, 2024-09-13T16:13:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-13T16:13:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-13T16:13:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 151, 2024-09-13T16:13:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 1205853, 2024-09-13T16:13:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-13T16:13:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle-0x55e78baa0500": { 2024-09-13T16:13:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-13T16:13:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-09-13T16:13:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-13T16:13:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 53879, 2024-09-13T16:13:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 109963753, 2024-09-13T16:13:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 53879, 2024-09-13T16:13:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-13T16:13:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-13T16:13:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 1528, 2024-09-13T16:13:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 109963753, 2024-09-13T16:13:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-13T16:13:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:22.415 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.415 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.415 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:22.415 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:22.415 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T16:13:22.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:22 smithi086 ceph-mon[30379]: pgmap v455: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-13T16:13:22.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:22 smithi139 ceph-mon[35320]: pgmap v455: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-13T16:13:23.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:22 smithi194 ceph-mon[35694]: pgmap v455: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-13T16:13:23.155 INFO:tasks.check_counter:Daemon mds.b mds.exported=32 2024-09-13T16:13:23.156 INFO:tasks.check_counter:Daemon mds.b mds.imported=32 2024-09-13T16:13:23.156 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=1266 2024-09-13T16:13:23.156 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=3 2024-09-13T16:13:23.156 DEBUG:tasks.check_counter:Getting stats from e 2024-09-13T16:13:23.156 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-13T16:13:23.358 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:13:24.819 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:24 smithi139 ceph-mon[35320]: pgmap v456: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-13T16:13:24.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:24 smithi086 ceph-mon[30379]: pgmap v456: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-13T16:13:25.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:24 smithi194 ceph-mon[35694]: pgmap v456: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-13T16:13:25.053 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T16:13:25.053 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:25.053 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 338, 2024-09-13T16:13:25.053 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 338, 2024-09-13T16:13:25.053 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 2295559, 2024-09-13T16:13:25.054 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 104386, 2024-09-13T16:13:25.054 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 6, 2024-09-13T16:13:25.054 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:25.054 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.032982108, 2024-09-13T16:13:25.054 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.011199333, 2024-09-13T16:13:25.054 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.010799381, 2024-09-13T16:13:25.054 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.007639841, 2024-09-13T16:13:25.054 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:25.054 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 337, 2024-09-13T16:13:25.054 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.016898261, 2024-09-13T16:13:25.054 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000050143 2024-09-13T16:13:25.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.055 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:25.055 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.055 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.055 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.055 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-13T16:13:25.055 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 448 2024-09-13T16:13:25.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.055 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:25.056 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 320, 2024-09-13T16:13:25.056 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 310, 2024-09-13T16:13:25.056 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 795162, 2024-09-13T16:13:25.056 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 118775, 2024-09-13T16:13:25.056 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:25.056 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 3, 2024-09-13T16:13:25.056 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.036291498, 2024-09-13T16:13:25.056 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.011443059, 2024-09-13T16:13:25.056 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.024363561, 2024-09-13T16:13:25.056 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.006548592, 2024-09-13T16:13:25.056 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:25.056 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 309, 2024-09-13T16:13:25.057 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.015994846, 2024-09-13T16:13:25.057 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000051763 2024-09-13T16:13:25.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.057 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:25.057 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.057 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.057 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.057 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 744464, 2024-09-13T16:13:25.057 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 54704 2024-09-13T16:13:25.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.057 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:25.057 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 292, 2024-09-13T16:13:25.058 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 363, 2024-09-13T16:13:25.058 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 97936, 2024-09-13T16:13:25.058 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 281829, 2024-09-13T16:13:25.058 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:25.058 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 3, 2024-09-13T16:13:25.058 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.038171186, 2024-09-13T16:13:25.058 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.012823040, 2024-09-13T16:13:25.058 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.009787414, 2024-09-13T16:13:25.058 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.011836463, 2024-09-13T16:13:25.058 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:25.058 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 361, 2024-09-13T16:13:25.059 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.019310133, 2024-09-13T16:13:25.059 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000053490 2024-09-13T16:13:25.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.059 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:25.059 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.059 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.059 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.059 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T16:13:25.059 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 191328 2024-09-13T16:13:25.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.059 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2024-09-13T16:13:25.060 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 1, 2024-09-13T16:13:25.060 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2024-09-13T16:13:25.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.060 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-MDSRank": { 2024-09-13T16:13:25.060 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-09-13T16:13:25.060 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-09-13T16:13:25.060 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1440, 2024-09-13T16:13:25.060 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.038870272, 2024-09-13T16:13:25.060 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000026993 2024-09-13T16:13:25.061 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:25.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.061 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-PurgeQueue": { 2024-09-13T16:13:25.061 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-09-13T16:13:25.061 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-09-13T16:13:25.061 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.061 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.061 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.062 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:25.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.062 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": { 2024-09-13T16:13:25.062 INFO:teuthology.orchestra.run.smithi139.stdout: "request": 0, 2024-09-13T16:13:25.062 INFO:teuthology.orchestra.run.smithi139.stdout: "reply": 0, 2024-09-13T16:13:25.062 INFO:teuthology.orchestra.run.smithi139.stdout: "reply_latency": { 2024-09-13T16:13:25.062 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.062 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.062 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.062 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_reply": 0, 2024-09-13T16:13:25.062 INFO:teuthology.orchestra.run.smithi139.stdout: "forward": 0, 2024-09-13T16:13:25.062 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_complete": 0, 2024-09-13T16:13:25.063 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_keys": 0, 2024-09-13T16:13:25.063 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_commit": 0, 2024-09-13T16:13:25.063 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_split": 0, 2024-09-13T16:13:25.063 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_merge": 0, 2024-09-13T16:13:25.063 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes": 275, 2024-09-13T16:13:25.063 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_top": 0, 2024-09-13T16:13:25.063 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_bottom": 275, 2024-09-13T16:13:25.063 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pin_tail": 0, 2024-09-13T16:13:25.064 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pinned": 275, 2024-09-13T16:13:25.064 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_expired": 0, 2024-09-13T16:13:25.064 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_with_caps": 0, 2024-09-13T16:13:25.064 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": 0, 2024-09-13T16:13:25.064 INFO:teuthology.orchestra.run.smithi139.stdout: "subtrees": 1, 2024-09-13T16:13:25.064 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse": 0, 2024-09-13T16:13:25.064 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_hit": 0, 2024-09-13T16:13:25.064 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_forward": 0, 2024-09-13T16:13:25.064 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_discover": 0, 2024-09-13T16:13:25.064 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_dir_fetch": 0, 2024-09-13T16:13:25.064 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_remote_ino": 0, 2024-09-13T16:13:25.064 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_lock": 0, 2024-09-13T16:13:25.065 INFO:teuthology.orchestra.run.smithi139.stdout: "load_cent": 0, 2024-09-13T16:13:25.065 INFO:teuthology.orchestra.run.smithi139.stdout: "q": 0, 2024-09-13T16:13:25.065 INFO:teuthology.orchestra.run.smithi139.stdout: "exported": 0, 2024-09-13T16:13:25.065 INFO:teuthology.orchestra.run.smithi139.stdout: "exported_inodes": 0, 2024-09-13T16:13:25.065 INFO:teuthology.orchestra.run.smithi139.stdout: "imported": 0, 2024-09-13T16:13:25.066 INFO:teuthology.orchestra.run.smithi139.stdout: "imported_inodes": 0, 2024-09-13T16:13:25.066 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_dir_fetch": 0, 2024-09-13T16:13:25.066 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_backtrace_fetch": 0, 2024-09-13T16:13:25.066 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_peer_discover": 0, 2024-09-13T16:13:25.066 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rfiles": 0, 2024-09-13T16:13:25.067 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rbytes": 0, 2024-09-13T16:13:25.067 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rsnaps": 0, 2024-09-13T16:13:25.067 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T16:13:25.067 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_set_tag": 0, 2024-09-13T16:13:25.067 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T16:13:25.067 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_inotable_repaired": 0, 2024-09-13T16:13:25.067 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_inodes": 0, 2024-09-13T16:13:25.067 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T16:13:25.068 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T16:13:25.068 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_file_inodes": 0, 2024-09-13T16:13:25.068 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_inode_file_caps": 0, 2024-09-13T16:13:25.068 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T16:13:25.069 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_grant": 0, 2024-09-13T16:13:25.069 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T16:13:25.069 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T16:13:25.069 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T16:13:25.069 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps": 0, 2024-09-13T16:13:25.069 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps_dirty": 0, 2024-09-13T16:13:25.070 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_cap_release": 0, 2024-09-13T16:13:25.070 INFO:teuthology.orchestra.run.smithi139.stdout: "process_request_cap_release": 0 2024-09-13T16:13:25.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.070 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_cache": { 2024-09-13T16:13:25.070 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update": 0, 2024-09-13T16:13:25.070 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update_receipt": 0, 2024-09-13T16:13:25.070 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_try_discover": 0, 2024-09-13T16:13:25.070 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_send_discover": 0, 2024-09-13T16:13:25.071 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_handle_discover": 0, 2024-09-13T16:13:25.071 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays": 0, 2024-09-13T16:13:25.071 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_delayed": 0, 2024-09-13T16:13:25.071 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_enqueuing": 0, 2024-09-13T16:13:25.071 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_created": 0, 2024-09-13T16:13:25.071 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_enqueued": 0, 2024-09-13T16:13:25.071 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_reintegrated": 0, 2024-09-13T16:13:25.071 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_migrated": 0, 2024-09-13T16:13:25.071 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_processing": 0, 2024-09-13T16:13:25.071 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_enqueued": 0, 2024-09-13T16:13:25.071 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_prioritized": 0, 2024-09-13T16:13:25.071 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_started": 0, 2024-09-13T16:13:25.071 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_completed": 0, 2024-09-13T16:13:25.071 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T16:13:25.072 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_exportdir": 0, 2024-09-13T16:13:25.072 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_flush": 0, 2024-09-13T16:13:25.072 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragmentdir": 0, 2024-09-13T16:13:25.072 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragstats": 0, 2024-09-13T16:13:25.072 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_inodestats": 0 2024-09-13T16:13:25.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.072 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_log": { 2024-09-13T16:13:25.072 INFO:teuthology.orchestra.run.smithi139.stdout: "evadd": 0, 2024-09-13T16:13:25.072 INFO:teuthology.orchestra.run.smithi139.stdout: "evex": 0, 2024-09-13T16:13:25.072 INFO:teuthology.orchestra.run.smithi139.stdout: "evtrm": 0, 2024-09-13T16:13:25.072 INFO:teuthology.orchestra.run.smithi139.stdout: "ev": 1287, 2024-09-13T16:13:25.072 INFO:teuthology.orchestra.run.smithi139.stdout: "evexg": 0, 2024-09-13T16:13:25.073 INFO:teuthology.orchestra.run.smithi139.stdout: "evexd": 0, 2024-09-13T16:13:25.073 INFO:teuthology.orchestra.run.smithi139.stdout: "segadd": 0, 2024-09-13T16:13:25.073 INFO:teuthology.orchestra.run.smithi139.stdout: "segex": 0, 2024-09-13T16:13:25.073 INFO:teuthology.orchestra.run.smithi139.stdout: "segtrm": 0, 2024-09-13T16:13:25.073 INFO:teuthology.orchestra.run.smithi139.stdout: "seg": 2, 2024-09-13T16:13:25.073 INFO:teuthology.orchestra.run.smithi139.stdout: "segexg": 0, 2024-09-13T16:13:25.073 INFO:teuthology.orchestra.run.smithi139.stdout: "segexd": 0, 2024-09-13T16:13:25.073 INFO:teuthology.orchestra.run.smithi139.stdout: "expos": 4194304, 2024-09-13T16:13:25.073 INFO:teuthology.orchestra.run.smithi139.stdout: "wrpos": 6399316, 2024-09-13T16:13:25.074 INFO:teuthology.orchestra.run.smithi139.stdout: "rdpos": 6398178, 2024-09-13T16:13:25.074 INFO:teuthology.orchestra.run.smithi139.stdout: "jlat": { 2024-09-13T16:13:25.074 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.074 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.074 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.074 INFO:teuthology.orchestra.run.smithi139.stdout: "replayed": 1287 2024-09-13T16:13:25.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.075 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_mem": { 2024-09-13T16:13:25.075 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 5, 2024-09-13T16:13:25.075 INFO:teuthology.orchestra.run.smithi139.stdout: "ino+": 341, 2024-09-13T16:13:25.075 INFO:teuthology.orchestra.run.smithi139.stdout: "ino-": 336, 2024-09-13T16:13:25.075 INFO:teuthology.orchestra.run.smithi139.stdout: "dir": 3, 2024-09-13T16:13:25.075 INFO:teuthology.orchestra.run.smithi139.stdout: "dir+": 82, 2024-09-13T16:13:25.075 INFO:teuthology.orchestra.run.smithi139.stdout: "dir-": 79, 2024-09-13T16:13:25.075 INFO:teuthology.orchestra.run.smithi139.stdout: "dn": 275, 2024-09-13T16:13:25.075 INFO:teuthology.orchestra.run.smithi139.stdout: "dn+": 505, 2024-09-13T16:13:25.075 INFO:teuthology.orchestra.run.smithi139.stdout: "dn-": 230, 2024-09-13T16:13:25.076 INFO:teuthology.orchestra.run.smithi139.stdout: "cap": 0, 2024-09-13T16:13:25.076 INFO:teuthology.orchestra.run.smithi139.stdout: "cap+": 0, 2024-09-13T16:13:25.076 INFO:teuthology.orchestra.run.smithi139.stdout: "cap-": 0, 2024-09-13T16:13:25.076 INFO:teuthology.orchestra.run.smithi139.stdout: "rss": 48832, 2024-09-13T16:13:25.076 INFO:teuthology.orchestra.run.smithi139.stdout: "heap": 207124 2024-09-13T16:13:25.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.076 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_server": { 2024-09-13T16:13:25.076 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_client_request": 0, 2024-09-13T16:13:25.076 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_server_request": 0, 2024-09-13T16:13:25.076 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_request": 0, 2024-09-13T16:13:25.076 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_session": 0, 2024-09-13T16:13:25.076 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_peer_request": 0, 2024-09-13T16:13:25.076 INFO:teuthology.orchestra.run.smithi139.stdout: "req_create_latency": { 2024-09-13T16:13:25.076 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.077 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.077 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.077 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getattr_latency": { 2024-09-13T16:13:25.077 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.077 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.077 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.077 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getfilelock_latency": { 2024-09-13T16:13:25.077 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.077 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.077 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.078 INFO:teuthology.orchestra.run.smithi139.stdout: "req_link_latency": { 2024-09-13T16:13:25.078 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.078 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.078 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.078 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookup_latency": { 2024-09-13T16:13:25.078 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.078 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.078 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.078 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookuphash_latency": { 2024-09-13T16:13:25.078 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.078 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.079 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.079 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupino_latency": { 2024-09-13T16:13:25.079 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.079 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.079 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.079 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupname_latency": { 2024-09-13T16:13:25.079 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.079 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.079 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.079 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupparent_latency": { 2024-09-13T16:13:25.079 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.080 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.080 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.080 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupsnap_latency": { 2024-09-13T16:13:25.080 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.080 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.080 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.080 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lssnap_latency": { 2024-09-13T16:13:25.080 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.080 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.080 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.080 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mkdir_latency": { 2024-09-13T16:13:25.081 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.081 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.081 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.082 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mknod_latency": { 2024-09-13T16:13:25.082 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.082 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.082 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.082 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mksnap_latency": { 2024-09-13T16:13:25.082 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.082 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.082 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.082 INFO:teuthology.orchestra.run.smithi139.stdout: "req_open_latency": { 2024-09-13T16:13:25.082 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.083 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.083 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.083 INFO:teuthology.orchestra.run.smithi139.stdout: "req_readdir_latency": { 2024-09-13T16:13:25.083 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.083 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.083 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.083 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rename_latency": { 2024-09-13T16:13:25.083 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.083 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.083 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.084 INFO:teuthology.orchestra.run.smithi139.stdout: "req_renamesnap_latency": { 2024-09-13T16:13:25.084 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.084 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.084 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.084 INFO:teuthology.orchestra.run.smithi139.stdout: "req_snapdiff_latency": { 2024-09-13T16:13:25.084 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.084 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.084 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.084 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmdir_latency": { 2024-09-13T16:13:25.084 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.084 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.085 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.085 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmsnap_latency": { 2024-09-13T16:13:25.085 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.085 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.085 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.085 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmxattr_latency": { 2024-09-13T16:13:25.085 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.085 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.085 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.085 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setattr_latency": { 2024-09-13T16:13:25.085 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.086 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.086 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.086 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setdirlayout_latency": { 2024-09-13T16:13:25.086 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.086 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.086 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.087 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setfilelock_latency": { 2024-09-13T16:13:25.087 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.087 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.087 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.087 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setlayout_latency": { 2024-09-13T16:13:25.087 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.087 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.087 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.088 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setxattr_latency": { 2024-09-13T16:13:25.088 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.088 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.088 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.088 INFO:teuthology.orchestra.run.smithi139.stdout: "req_symlink_latency": { 2024-09-13T16:13:25.088 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.088 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.088 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.089 INFO:teuthology.orchestra.run.smithi139.stdout: "req_unlink_latency": { 2024-09-13T16:13:25.089 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.089 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.089 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.089 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_revoke_eviction": 0, 2024-09-13T16:13:25.089 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_acquisition_throttle": 0, 2024-09-13T16:13:25.089 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getvxattr_latency": { 2024-09-13T16:13:25.089 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.089 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.089 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.089 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:25.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.090 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_sessions": { 2024-09-13T16:13:25.090 INFO:teuthology.orchestra.run.smithi139.stdout: "session_count": 1, 2024-09-13T16:13:25.090 INFO:teuthology.orchestra.run.smithi139.stdout: "session_add": 3, 2024-09-13T16:13:25.090 INFO:teuthology.orchestra.run.smithi139.stdout: "session_remove": 2, 2024-09-13T16:13:25.090 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_open": 2, 2024-09-13T16:13:25.090 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_stale": 0, 2024-09-13T16:13:25.090 INFO:teuthology.orchestra.run.smithi139.stdout: "total_load": 0, 2024-09-13T16:13:25.090 INFO:teuthology.orchestra.run.smithi139.stdout: "average_load": 0, 2024-09-13T16:13:25.090 INFO:teuthology.orchestra.run.smithi139.stdout: "avg_session_uptime": 2812, 2024-09-13T16:13:25.090 INFO:teuthology.orchestra.run.smithi139.stdout: "mdthresh_evicted": 0 2024-09-13T16:13:25.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.090 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2024-09-13T16:13:25.090 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:25.090 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:25.091 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:25.091 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:25.091 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:25.091 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:25.091 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:25.091 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:25.091 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:25.091 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:25.091 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:25.091 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:25.091 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:25.091 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:25.091 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:25.092 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:25.092 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:25.092 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:25.092 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:25.092 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:25.092 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:25.092 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:25.092 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:25.092 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:25.092 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:25.092 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:25.092 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:25.092 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:25.093 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:25.093 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:25.093 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:25.093 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2024-09-13T16:13:25.093 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:25.093 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:25.093 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:25.093 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:25.093 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 189256, 2024-09-13T16:13:25.093 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 49, 2024-09-13T16:13:25.093 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 0, 2024-09-13T16:13:25.093 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 0, 2024-09-13T16:13:25.093 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2024-09-13T16:13:25.094 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2024-09-13T16:13:25.094 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:25.094 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:25.094 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:25.094 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:25.094 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 9240, 2024-09-13T16:13:25.094 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 174, 2024-09-13T16:13:25.094 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:25.094 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:25.094 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:25.094 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2024-09-13T16:13:25.094 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 208920, 2024-09-13T16:13:25.094 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 1140, 2024-09-13T16:13:25.094 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:25.095 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2024-09-13T16:13:25.095 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:25.095 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2024-09-13T16:13:25.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.095 INFO:teuthology.orchestra.run.smithi139.stdout: "objecter": { 2024-09-13T16:13:25.095 INFO:teuthology.orchestra.run.smithi139.stdout: "op_active": 0, 2024-09-13T16:13:25.095 INFO:teuthology.orchestra.run.smithi139.stdout: "op_laggy": 0, 2024-09-13T16:13:25.095 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send": 831, 2024-09-13T16:13:25.095 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send_bytes": 21, 2024-09-13T16:13:25.095 INFO:teuthology.orchestra.run.smithi139.stdout: "op_resend": 3, 2024-09-13T16:13:25.095 INFO:teuthology.orchestra.run.smithi139.stdout: "op_reply": 831, 2024-09-13T16:13:25.095 INFO:teuthology.orchestra.run.smithi139.stdout: "op_latency": { 2024-09-13T16:13:25.095 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 831, 2024-09-13T16:13:25.096 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 1.983956371, 2024-09-13T16:13:25.096 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.002387432 2024-09-13T16:13:25.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.096 INFO:teuthology.orchestra.run.smithi139.stdout: "op_inflight": 0, 2024-09-13T16:13:25.096 INFO:teuthology.orchestra.run.smithi139.stdout: "oplen_avg": { 2024-09-13T16:13:25.096 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 831, 2024-09-13T16:13:25.096 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 832 2024-09-13T16:13:25.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.096 INFO:teuthology.orchestra.run.smithi139.stdout: "op": 831, 2024-09-13T16:13:25.096 INFO:teuthology.orchestra.run.smithi139.stdout: "op_r": 831, 2024-09-13T16:13:25.096 INFO:teuthology.orchestra.run.smithi139.stdout: "op_w": 0, 2024-09-13T16:13:25.096 INFO:teuthology.orchestra.run.smithi139.stdout: "op_rmw": 0, 2024-09-13T16:13:25.096 INFO:teuthology.orchestra.run.smithi139.stdout: "op_pg": 0, 2024-09-13T16:13:25.097 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_stat": 495, 2024-09-13T16:13:25.097 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_create": 0, 2024-09-13T16:13:25.097 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_read": 334, 2024-09-13T16:13:25.097 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_write": 0, 2024-09-13T16:13:25.097 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writefull": 0, 2024-09-13T16:13:25.097 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writesame": 0, 2024-09-13T16:13:25.097 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_append": 0, 2024-09-13T16:13:25.097 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_zero": 0, 2024-09-13T16:13:25.097 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_truncate": 0, 2024-09-13T16:13:25.098 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_delete": 0, 2024-09-13T16:13:25.098 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_mapext": 0, 2024-09-13T16:13:25.098 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_sparse_read": 0, 2024-09-13T16:13:25.098 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_clonerange": 0, 2024-09-13T16:13:25.098 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_getxattr": 1, 2024-09-13T16:13:25.098 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_setxattr": 0, 2024-09-13T16:13:25.098 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_cmpxattr": 0, 2024-09-13T16:13:25.098 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_rmxattr": 0, 2024-09-13T16:13:25.098 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_resetxattrs": 0, 2024-09-13T16:13:25.098 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_call": 0, 2024-09-13T16:13:25.098 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_watch": 0, 2024-09-13T16:13:25.098 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_notify": 0, 2024-09-13T16:13:25.099 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T16:13:25.099 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls": 0, 2024-09-13T16:13:25.099 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls_filter": 0, 2024-09-13T16:13:25.099 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_other": 0, 2024-09-13T16:13:25.099 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_active": 0, 2024-09-13T16:13:25.099 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_send": 0, 2024-09-13T16:13:25.099 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_resend": 0, 2024-09-13T16:13:25.099 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_ping": 0, 2024-09-13T16:13:25.099 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_active": 0, 2024-09-13T16:13:25.099 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_send": 0, 2024-09-13T16:13:25.100 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_resend": 0, 2024-09-13T16:13:25.100 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_active": 0, 2024-09-13T16:13:25.100 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_send": 0, 2024-09-13T16:13:25.100 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_resend": 0, 2024-09-13T16:13:25.100 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_active": 0, 2024-09-13T16:13:25.100 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_send": 0, 2024-09-13T16:13:25.100 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_resend": 0, 2024-09-13T16:13:25.100 INFO:teuthology.orchestra.run.smithi139.stdout: "command_active": 0, 2024-09-13T16:13:25.100 INFO:teuthology.orchestra.run.smithi139.stdout: "command_send": 0, 2024-09-13T16:13:25.100 INFO:teuthology.orchestra.run.smithi139.stdout: "command_resend": 0, 2024-09-13T16:13:25.100 INFO:teuthology.orchestra.run.smithi139.stdout: "map_epoch": 94, 2024-09-13T16:13:25.100 INFO:teuthology.orchestra.run.smithi139.stdout: "map_full": 0, 2024-09-13T16:13:25.101 INFO:teuthology.orchestra.run.smithi139.stdout: "map_inc": 4, 2024-09-13T16:13:25.101 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_sessions": 5, 2024-09-13T16:13:25.101 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_open": 5, 2024-09-13T16:13:25.101 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_close": 0, 2024-09-13T16:13:25.101 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_laggy": 0, 2024-09-13T16:13:25.101 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_wr": 0, 2024-09-13T16:13:25.101 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_rd": 2, 2024-09-13T16:13:25.101 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_del": 0 2024-09-13T16:13:25.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.101 INFO:teuthology.orchestra.run.smithi139.stdout: "oft": { 2024-09-13T16:13:25.101 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_objs": 0, 2024-09-13T16:13:25.102 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_kv_pairs": 0, 2024-09-13T16:13:25.102 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_updates": 0, 2024-09-13T16:13:25.102 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_removes": 0 2024-09-13T16:13:25.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.102 INFO:teuthology.orchestra.run.smithi139.stdout: "osd-slow-ops": { 2024-09-13T16:13:25.102 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_ops_count": 0 2024-09-13T16:13:25.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.102 INFO:teuthology.orchestra.run.smithi139.stdout: "purge_queue": { 2024-09-13T16:13:25.102 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops": 0, 2024-09-13T16:13:25.102 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T16:13:25.102 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing": 0, 2024-09-13T16:13:25.103 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_high_water": 0, 2024-09-13T16:13:25.103 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed_ops": 0, 2024-09-13T16:13:25.103 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed": 0, 2024-09-13T16:13:25.103 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_item_in_journal": 0 2024-09-13T16:13:25.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.103 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:25.103 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-13T16:13:25.103 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-09-13T16:13:25.103 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-13T16:13:25.103 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 946, 2024-09-13T16:13:25.103 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 3094643, 2024-09-13T16:13:25.103 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:25.104 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 946, 2024-09-13T16:13:25.104 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-13T16:13:25.104 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-13T16:13:25.104 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 946, 2024-09-13T16:13:25.104 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 3094643, 2024-09-13T16:13:25.104 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-13T16:13:25.104 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.104 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.104 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.104 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:25.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.105 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_bytes": { 2024-09-13T16:13:25.105 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-13T16:13:25.105 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-09-13T16:13:25.105 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-13T16:13:25.105 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-13T16:13:25.105 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-13T16:13:25.105 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:25.105 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:25.105 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 831, 2024-09-13T16:13:25.105 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 2205017, 2024-09-13T16:13:25.106 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 831, 2024-09-13T16:13:25.106 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 2205017, 2024-09-13T16:13:25.106 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-13T16:13:25.106 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.106 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.106 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.106 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:25.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.106 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_ops": { 2024-09-13T16:13:25.106 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-13T16:13:25.106 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 1024, 2024-09-13T16:13:25.107 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-13T16:13:25.107 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-13T16:13:25.107 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-13T16:13:25.107 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:25.107 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:25.107 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 831, 2024-09-13T16:13:25.107 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 831, 2024-09-13T16:13:25.107 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 831, 2024-09-13T16:13:25.107 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 831, 2024-09-13T16:13:25.107 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-13T16:13:25.108 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.108 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.108 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.108 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:25.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.108 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle": { 2024-09-13T16:13:25.108 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-13T16:13:25.108 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-09-13T16:13:25.108 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-13T16:13:25.108 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-13T16:13:25.109 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-13T16:13:25.109 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:25.109 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:25.109 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-13T16:13:25.109 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-13T16:13:25.109 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2024-09-13T16:13:25.109 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2024-09-13T16:13:25.109 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-13T16:13:25.110 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.110 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.110 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.110 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:25.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:25.111 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle-0x5624b4aec8c0": { 2024-09-13T16:13:25.111 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-13T16:13:25.111 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-09-13T16:13:25.111 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-13T16:13:25.111 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-13T16:13:25.111 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-13T16:13:25.111 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:25.111 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:25.111 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-13T16:13:25.111 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-13T16:13:25.111 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2024-09-13T16:13:25.111 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2024-09-13T16:13:25.111 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-13T16:13:25.112 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:25.112 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.112 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.112 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:25.112 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:25.112 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T16:13:25.858 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-13T16:13:25.858 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-13T16:13:25.858 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-13T16:13:25.858 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-13T16:13:25.858 DEBUG:tasks.check_counter:Getting stats from h 2024-09-13T16:13:25.858 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-13T16:13:26.056 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:13:26.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:26 smithi139 ceph-mon[35320]: pgmap v457: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-13T16:13:26.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:26 smithi086 ceph-mon[30379]: pgmap v457: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-13T16:13:27.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:26 smithi194 ceph-mon[35694]: pgmap v457: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-13T16:13:27.732 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T16:13:27.732 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:27.732 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 736, 2024-09-13T16:13:27.733 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 773, 2024-09-13T16:13:27.733 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 921289, 2024-09-13T16:13:27.733 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 2523241, 2024-09-13T16:13:27.733 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 15, 2024-09-13T16:13:27.733 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 7, 2024-09-13T16:13:27.733 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.060730929, 2024-09-13T16:13:27.733 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.021946509, 2024-09-13T16:13:27.733 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.038321430, 2024-09-13T16:13:27.733 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.007644371, 2024-09-13T16:13:27.733 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:27.734 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 772, 2024-09-13T16:13:27.734 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.040900226, 2024-09-13T16:13:27.734 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000052979 2024-09-13T16:13:27.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.734 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:27.734 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 640, 2024-09-13T16:13:27.734 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000111937, 2024-09-13T16:13:27.734 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000174 2024-09-13T16:13:27.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.734 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 755808, 2024-09-13T16:13:27.734 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 62192 2024-09-13T16:13:27.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.734 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:27.734 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 1361, 2024-09-13T16:13:27.735 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 2322, 2024-09-13T16:13:27.735 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 439336, 2024-09-13T16:13:27.735 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 1246273, 2024-09-13T16:13:27.735 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 8, 2024-09-13T16:13:27.735 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 6, 2024-09-13T16:13:27.735 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.076593635, 2024-09-13T16:13:27.735 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.034148441, 2024-09-13T16:13:27.735 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.054943112, 2024-09-13T16:13:27.735 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.005412424, 2024-09-13T16:13:27.735 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:27.735 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2321, 2024-09-13T16:13:27.735 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.227856154, 2024-09-13T16:13:27.735 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000098171 2024-09-13T16:13:27.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.736 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:27.736 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1294, 2024-09-13T16:13:27.736 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000374295, 2024-09-13T16:13:27.736 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000289 2024-09-13T16:13:27.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.737 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-13T16:13:27.737 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 193184 2024-09-13T16:13:27.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.737 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:27.737 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 14407, 2024-09-13T16:13:27.737 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 6974, 2024-09-13T16:13:27.737 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 5964128, 2024-09-13T16:13:27.738 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 1377629, 2024-09-13T16:13:27.738 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 8, 2024-09-13T16:13:27.738 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 6, 2024-09-13T16:13:27.738 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.539659113, 2024-09-13T16:13:27.738 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.231627149, 2024-09-13T16:13:27.738 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.416159543, 2024-09-13T16:13:27.738 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.009204954, 2024-09-13T16:13:27.738 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:27.738 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 6972, 2024-09-13T16:13:27.738 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.136359607, 2024-09-13T16:13:27.738 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000019558 2024-09-13T16:13:27.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.739 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:27.739 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 20657, 2024-09-13T16:13:27.739 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.002237808, 2024-09-13T16:13:27.739 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000108 2024-09-13T16:13:27.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.739 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T16:13:27.739 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T16:13:27.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.739 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2024-09-13T16:13:27.739 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 1, 2024-09-13T16:13:27.740 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2024-09-13T16:13:27.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.740 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-MDSRank": { 2024-09-13T16:13:27.740 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-09-13T16:13:27.740 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-09-13T16:13:27.740 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 297, 2024-09-13T16:13:27.740 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.288548623, 2024-09-13T16:13:27.740 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000971544 2024-09-13T16:13:27.740 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:27.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.740 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-PurgeQueue": { 2024-09-13T16:13:27.741 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-09-13T16:13:27.741 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-09-13T16:13:27.741 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 563, 2024-09-13T16:13:27.741 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.033699933, 2024-09-13T16:13:27.741 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000059857 2024-09-13T16:13:27.741 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:27.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.741 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": { 2024-09-13T16:13:27.741 INFO:teuthology.orchestra.run.smithi139.stdout: "request": 537, 2024-09-13T16:13:27.741 INFO:teuthology.orchestra.run.smithi139.stdout: "reply": 536, 2024-09-13T16:13:27.742 INFO:teuthology.orchestra.run.smithi139.stdout: "reply_latency": { 2024-09-13T16:13:27.742 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 536, 2024-09-13T16:13:27.742 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.497751308, 2024-09-13T16:13:27.742 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000928640 2024-09-13T16:13:27.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.742 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_reply": 0, 2024-09-13T16:13:27.742 INFO:teuthology.orchestra.run.smithi139.stdout: "forward": 1, 2024-09-13T16:13:27.742 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_complete": 0, 2024-09-13T16:13:27.742 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_keys": 0, 2024-09-13T16:13:27.742 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_commit": 11, 2024-09-13T16:13:27.742 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_split": 0, 2024-09-13T16:13:27.743 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_merge": 0, 2024-09-13T16:13:27.743 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes": 23, 2024-09-13T16:13:27.743 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_top": 5, 2024-09-13T16:13:27.743 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_bottom": 8, 2024-09-13T16:13:27.743 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pin_tail": 10, 2024-09-13T16:13:27.743 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pinned": 13, 2024-09-13T16:13:27.743 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_expired": 1223, 2024-09-13T16:13:27.743 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_with_caps": 1, 2024-09-13T16:13:27.743 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": 1, 2024-09-13T16:13:27.744 INFO:teuthology.orchestra.run.smithi139.stdout: "subtrees": 3, 2024-09-13T16:13:27.744 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse": 2051, 2024-09-13T16:13:27.744 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_hit": 1374, 2024-09-13T16:13:27.744 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_forward": 0, 2024-09-13T16:13:27.744 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_discover": 605, 2024-09-13T16:13:27.744 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_dir_fetch": 0, 2024-09-13T16:13:27.744 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_remote_ino": 0, 2024-09-13T16:13:27.744 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_lock": 0, 2024-09-13T16:13:27.744 INFO:teuthology.orchestra.run.smithi139.stdout: "load_cent": 0, 2024-09-13T16:13:27.744 INFO:teuthology.orchestra.run.smithi139.stdout: "q": 0, 2024-09-13T16:13:27.744 INFO:teuthology.orchestra.run.smithi139.stdout: "exported": 13, 2024-09-13T16:13:27.745 INFO:teuthology.orchestra.run.smithi139.stdout: "exported_inodes": 9, 2024-09-13T16:13:27.745 INFO:teuthology.orchestra.run.smithi139.stdout: "imported": 13, 2024-09-13T16:13:27.745 INFO:teuthology.orchestra.run.smithi139.stdout: "imported_inodes": 164, 2024-09-13T16:13:27.745 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_dir_fetch": 0, 2024-09-13T16:13:27.745 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_backtrace_fetch": 0, 2024-09-13T16:13:27.745 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_peer_discover": 0, 2024-09-13T16:13:27.745 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rfiles": 4, 2024-09-13T16:13:27.745 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rbytes": 234, 2024-09-13T16:13:27.745 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rsnaps": 0, 2024-09-13T16:13:27.745 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T16:13:27.746 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_set_tag": 0, 2024-09-13T16:13:27.746 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T16:13:27.746 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_inotable_repaired": 0, 2024-09-13T16:13:27.746 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_inodes": 0, 2024-09-13T16:13:27.746 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T16:13:27.746 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T16:13:27.746 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_file_inodes": 0, 2024-09-13T16:13:27.746 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_inode_file_caps": 0, 2024-09-13T16:13:27.746 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_revoke": 48, 2024-09-13T16:13:27.746 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_grant": 526, 2024-09-13T16:13:27.747 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T16:13:27.747 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T16:13:27.747 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T16:13:27.747 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps": 412, 2024-09-13T16:13:27.747 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps_dirty": 274, 2024-09-13T16:13:27.747 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_cap_release": 88, 2024-09-13T16:13:27.747 INFO:teuthology.orchestra.run.smithi139.stdout: "process_request_cap_release": 522 2024-09-13T16:13:27.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.747 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_cache": { 2024-09-13T16:13:27.747 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update": 39, 2024-09-13T16:13:27.747 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update_receipt": 1932, 2024-09-13T16:13:27.747 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_try_discover": 1261, 2024-09-13T16:13:27.748 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_send_discover": 1303, 2024-09-13T16:13:27.748 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_handle_discover": 48, 2024-09-13T16:13:27.748 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays": 0, 2024-09-13T16:13:27.748 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_delayed": 0, 2024-09-13T16:13:27.748 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_enqueuing": 0, 2024-09-13T16:13:27.748 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_created": 273, 2024-09-13T16:13:27.748 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_enqueued": 273, 2024-09-13T16:13:27.748 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_reintegrated": 0, 2024-09-13T16:13:27.748 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_migrated": 0, 2024-09-13T16:13:27.749 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_processing": 0, 2024-09-13T16:13:27.749 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_enqueued": 0, 2024-09-13T16:13:27.749 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_prioritized": 0, 2024-09-13T16:13:27.749 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_started": 0, 2024-09-13T16:13:27.749 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_completed": 0, 2024-09-13T16:13:27.749 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T16:13:27.749 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_exportdir": 13, 2024-09-13T16:13:27.749 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_flush": 0, 2024-09-13T16:13:27.750 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragmentdir": 0, 2024-09-13T16:13:27.750 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragstats": 0, 2024-09-13T16:13:27.750 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_inodestats": 0 2024-09-13T16:13:27.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.750 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_log": { 2024-09-13T16:13:27.750 INFO:teuthology.orchestra.run.smithi139.stdout: "evadd": 1287, 2024-09-13T16:13:27.750 INFO:teuthology.orchestra.run.smithi139.stdout: "evex": 0, 2024-09-13T16:13:27.750 INFO:teuthology.orchestra.run.smithi139.stdout: "evtrm": 0, 2024-09-13T16:13:27.750 INFO:teuthology.orchestra.run.smithi139.stdout: "ev": 1287, 2024-09-13T16:13:27.750 INFO:teuthology.orchestra.run.smithi139.stdout: "evexg": 0, 2024-09-13T16:13:27.750 INFO:teuthology.orchestra.run.smithi139.stdout: "evexd": 0, 2024-09-13T16:13:27.751 INFO:teuthology.orchestra.run.smithi139.stdout: "segadd": 2, 2024-09-13T16:13:27.751 INFO:teuthology.orchestra.run.smithi139.stdout: "segex": 0, 2024-09-13T16:13:27.751 INFO:teuthology.orchestra.run.smithi139.stdout: "segtrm": 0, 2024-09-13T16:13:27.751 INFO:teuthology.orchestra.run.smithi139.stdout: "seg": 2, 2024-09-13T16:13:27.751 INFO:teuthology.orchestra.run.smithi139.stdout: "segexg": 0, 2024-09-13T16:13:27.751 INFO:teuthology.orchestra.run.smithi139.stdout: "segexd": 0, 2024-09-13T16:13:27.751 INFO:teuthology.orchestra.run.smithi139.stdout: "expos": 4194304, 2024-09-13T16:13:27.751 INFO:teuthology.orchestra.run.smithi139.stdout: "wrpos": 6399316, 2024-09-13T16:13:27.751 INFO:teuthology.orchestra.run.smithi139.stdout: "rdpos": 0, 2024-09-13T16:13:27.751 INFO:teuthology.orchestra.run.smithi139.stdout: "jlat": { 2024-09-13T16:13:27.751 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 108, 2024-09-13T16:13:27.751 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.352316628, 2024-09-13T16:13:27.752 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.003262191 2024-09-13T16:13:27.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.752 INFO:teuthology.orchestra.run.smithi139.stdout: "replayed": 0 2024-09-13T16:13:27.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.752 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_mem": { 2024-09-13T16:13:27.752 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 28, 2024-09-13T16:13:27.752 INFO:teuthology.orchestra.run.smithi139.stdout: "ino+": 913, 2024-09-13T16:13:27.752 INFO:teuthology.orchestra.run.smithi139.stdout: "ino-": 885, 2024-09-13T16:13:27.752 INFO:teuthology.orchestra.run.smithi139.stdout: "dir": 26, 2024-09-13T16:13:27.752 INFO:teuthology.orchestra.run.smithi139.stdout: "dir+": 774, 2024-09-13T16:13:27.752 INFO:teuthology.orchestra.run.smithi139.stdout: "dir-": 748, 2024-09-13T16:13:27.752 INFO:teuthology.orchestra.run.smithi139.stdout: "dn": 23, 2024-09-13T16:13:27.753 INFO:teuthology.orchestra.run.smithi139.stdout: "dn+": 1674, 2024-09-13T16:13:27.753 INFO:teuthology.orchestra.run.smithi139.stdout: "dn-": 1651, 2024-09-13T16:13:27.753 INFO:teuthology.orchestra.run.smithi139.stdout: "cap": 1, 2024-09-13T16:13:27.753 INFO:teuthology.orchestra.run.smithi139.stdout: "cap+": 290, 2024-09-13T16:13:27.753 INFO:teuthology.orchestra.run.smithi139.stdout: "cap-": 289, 2024-09-13T16:13:27.753 INFO:teuthology.orchestra.run.smithi139.stdout: "rss": 55964, 2024-09-13T16:13:27.753 INFO:teuthology.orchestra.run.smithi139.stdout: "heap": 198932 2024-09-13T16:13:27.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.754 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_server": { 2024-09-13T16:13:27.754 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_client_request": 670, 2024-09-13T16:13:27.754 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_server_request": 46, 2024-09-13T16:13:27.754 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_request": 537, 2024-09-13T16:13:27.754 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_session": 11, 2024-09-13T16:13:27.754 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_peer_request": 127, 2024-09-13T16:13:27.754 INFO:teuthology.orchestra.run.smithi139.stdout: "req_create_latency": { 2024-09-13T16:13:27.754 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 109, 2024-09-13T16:13:27.754 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.065579221, 2024-09-13T16:13:27.754 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000601644 2024-09-13T16:13:27.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.755 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getattr_latency": { 2024-09-13T16:13:27.755 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1, 2024-09-13T16:13:27.755 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.001472449, 2024-09-13T16:13:27.755 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001472449 2024-09-13T16:13:27.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.755 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getfilelock_latency": { 2024-09-13T16:13:27.755 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.755 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.755 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.756 INFO:teuthology.orchestra.run.smithi139.stdout: "req_link_latency": { 2024-09-13T16:13:27.756 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.756 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.756 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.756 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookup_latency": { 2024-09-13T16:13:27.756 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 121, 2024-09-13T16:13:27.756 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.033587423, 2024-09-13T16:13:27.756 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000277582 2024-09-13T16:13:27.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.757 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookuphash_latency": { 2024-09-13T16:13:27.757 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.757 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.757 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.757 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupino_latency": { 2024-09-13T16:13:27.757 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1, 2024-09-13T16:13:27.758 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000124341, 2024-09-13T16:13:27.758 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000124341 2024-09-13T16:13:27.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.758 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupname_latency": { 2024-09-13T16:13:27.758 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.758 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.758 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.759 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupparent_latency": { 2024-09-13T16:13:27.759 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.759 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.759 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.759 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupsnap_latency": { 2024-09-13T16:13:27.760 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.760 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.760 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.760 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lssnap_latency": { 2024-09-13T16:13:27.760 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.760 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.761 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.761 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mkdir_latency": { 2024-09-13T16:13:27.761 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.761 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.762 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.762 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mknod_latency": { 2024-09-13T16:13:27.762 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.762 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.762 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.763 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mksnap_latency": { 2024-09-13T16:13:27.763 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.763 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.763 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.763 INFO:teuthology.orchestra.run.smithi139.stdout: "req_open_latency": { 2024-09-13T16:13:27.764 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.764 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.764 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.764 INFO:teuthology.orchestra.run.smithi139.stdout: "req_readdir_latency": { 2024-09-13T16:13:27.765 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 31, 2024-09-13T16:13:27.765 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.016045285, 2024-09-13T16:13:27.765 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000517589 2024-09-13T16:13:27.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.765 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rename_latency": { 2024-09-13T16:13:27.765 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.765 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.766 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.766 INFO:teuthology.orchestra.run.smithi139.stdout: "req_renamesnap_latency": { 2024-09-13T16:13:27.766 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.766 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.766 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.767 INFO:teuthology.orchestra.run.smithi139.stdout: "req_snapdiff_latency": { 2024-09-13T16:13:27.767 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.767 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.767 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.768 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmdir_latency": { 2024-09-13T16:13:27.768 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 9, 2024-09-13T16:13:27.768 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.074280335, 2024-09-13T16:13:27.768 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.008253370 2024-09-13T16:13:27.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.769 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmsnap_latency": { 2024-09-13T16:13:27.769 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.769 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.769 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.770 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmxattr_latency": { 2024-09-13T16:13:27.770 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.770 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.770 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.771 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setattr_latency": { 2024-09-13T16:13:27.771 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.771 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.771 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.772 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setdirlayout_latency": { 2024-09-13T16:13:27.772 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.772 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.772 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.772 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setfilelock_latency": { 2024-09-13T16:13:27.772 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.773 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.773 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.773 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setlayout_latency": { 2024-09-13T16:13:27.773 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.774 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.774 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.774 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setxattr_latency": { 2024-09-13T16:13:27.774 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.774 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.774 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.775 INFO:teuthology.orchestra.run.smithi139.stdout: "req_symlink_latency": { 2024-09-13T16:13:27.775 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.775 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.775 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.775 INFO:teuthology.orchestra.run.smithi139.stdout: "req_unlink_latency": { 2024-09-13T16:13:27.775 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 264, 2024-09-13T16:13:27.775 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.306662254, 2024-09-13T16:13:27.775 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001161599 2024-09-13T16:13:27.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.776 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_revoke_eviction": 0, 2024-09-13T16:13:27.776 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_acquisition_throttle": 0, 2024-09-13T16:13:27.776 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getvxattr_latency": { 2024-09-13T16:13:27.776 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.776 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.776 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.776 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:27.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.776 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_sessions": { 2024-09-13T16:13:27.777 INFO:teuthology.orchestra.run.smithi139.stdout: "session_count": 1, 2024-09-13T16:13:27.777 INFO:teuthology.orchestra.run.smithi139.stdout: "session_add": 3, 2024-09-13T16:13:27.777 INFO:teuthology.orchestra.run.smithi139.stdout: "session_remove": 2, 2024-09-13T16:13:27.777 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_open": 1, 2024-09-13T16:13:27.777 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_stale": 0, 2024-09-13T16:13:27.777 INFO:teuthology.orchestra.run.smithi139.stdout: "total_load": 373, 2024-09-13T16:13:27.777 INFO:teuthology.orchestra.run.smithi139.stdout: "average_load": 373, 2024-09-13T16:13:27.777 INFO:teuthology.orchestra.run.smithi139.stdout: "avg_session_uptime": 165, 2024-09-13T16:13:27.777 INFO:teuthology.orchestra.run.smithi139.stdout: "mdthresh_evicted": 0 2024-09-13T16:13:27.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.777 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2024-09-13T16:13:27.778 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:27.778 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:27.778 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:27.778 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:27.778 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:27.778 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:27.778 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:27.778 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:27.778 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:27.778 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:27.779 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:27.779 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:27.779 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:27.779 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:27.779 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:27.779 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:27.779 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:27.779 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:27.779 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:27.779 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:27.779 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:27.780 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:27.780 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:27.780 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:27.780 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:27.780 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:27.780 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:27.780 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:27.780 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:27.780 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:27.780 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:27.780 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2024-09-13T16:13:27.781 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:27.781 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:27.781 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:27.781 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:27.781 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 296296, 2024-09-13T16:13:27.781 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 129, 2024-09-13T16:13:27.781 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 792, 2024-09-13T16:13:27.781 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 9, 2024-09-13T16:13:27.781 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2024-09-13T16:13:27.781 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2024-09-13T16:13:27.781 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:27.782 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:27.782 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:27.782 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:27.782 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 9240, 2024-09-13T16:13:27.782 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 174, 2024-09-13T16:13:27.782 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:27.782 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:27.782 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:27.782 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2024-09-13T16:13:27.782 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 112221, 2024-09-13T16:13:27.782 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 462, 2024-09-13T16:13:27.782 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2024-09-13T16:13:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2024-09-13T16:13:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "objecter": { 2024-09-13T16:13:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "op_active": 0, 2024-09-13T16:13:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "op_laggy": 0, 2024-09-13T16:13:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send": 776, 2024-09-13T16:13:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send_bytes": 2280389, 2024-09-13T16:13:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "op_resend": 27, 2024-09-13T16:13:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "op_reply": 776, 2024-09-13T16:13:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: "op_latency": { 2024-09-13T16:13:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 776, 2024-09-13T16:13:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 4.469901663, 2024-09-13T16:13:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.005760182 2024-09-13T16:13:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: "op_inflight": 0, 2024-09-13T16:13:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: "oplen_avg": { 2024-09-13T16:13:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 776, 2024-09-13T16:13:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 822 2024-09-13T16:13:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: "op": 776, 2024-09-13T16:13:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: "op_r": 28, 2024-09-13T16:13:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: "op_w": 748, 2024-09-13T16:13:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: "op_rmw": 0, 2024-09-13T16:13:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: "op_pg": 0, 2024-09-13T16:13:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_stat": 0, 2024-09-13T16:13:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_create": 10, 2024-09-13T16:13:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_read": 28, 2024-09-13T16:13:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_write": 136, 2024-09-13T16:13:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writefull": 25, 2024-09-13T16:13:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writesame": 0, 2024-09-13T16:13:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_append": 0, 2024-09-13T16:13:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_zero": 0, 2024-09-13T16:13:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_truncate": 0, 2024-09-13T16:13:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_delete": 549, 2024-09-13T16:13:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_mapext": 0, 2024-09-13T16:13:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_sparse_read": 0, 2024-09-13T16:13:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_clonerange": 0, 2024-09-13T16:13:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_getxattr": 0, 2024-09-13T16:13:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_setxattr": 20, 2024-09-13T16:13:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_cmpxattr": 0, 2024-09-13T16:13:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_rmxattr": 0, 2024-09-13T16:13:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_resetxattrs": 0, 2024-09-13T16:13:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_call": 0, 2024-09-13T16:13:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_watch": 0, 2024-09-13T16:13:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_notify": 0, 2024-09-13T16:13:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T16:13:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls": 0, 2024-09-13T16:13:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls_filter": 0, 2024-09-13T16:13:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_other": 0, 2024-09-13T16:13:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_active": 0, 2024-09-13T16:13:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_send": 0, 2024-09-13T16:13:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_resend": 0, 2024-09-13T16:13:27.788 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_ping": 0, 2024-09-13T16:13:27.788 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_active": 0, 2024-09-13T16:13:27.788 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_send": 0, 2024-09-13T16:13:27.788 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_resend": 0, 2024-09-13T16:13:27.788 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_active": 0, 2024-09-13T16:13:27.788 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_send": 0, 2024-09-13T16:13:27.788 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_resend": 0, 2024-09-13T16:13:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_active": 0, 2024-09-13T16:13:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_send": 0, 2024-09-13T16:13:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_resend": 0, 2024-09-13T16:13:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: "command_active": 0, 2024-09-13T16:13:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: "command_send": 0, 2024-09-13T16:13:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: "command_resend": 0, 2024-09-13T16:13:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: "map_epoch": 94, 2024-09-13T16:13:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: "map_full": 0, 2024-09-13T16:13:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: "map_inc": 4, 2024-09-13T16:13:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_sessions": 12, 2024-09-13T16:13:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_open": 12, 2024-09-13T16:13:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_close": 0, 2024-09-13T16:13:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_laggy": 0, 2024-09-13T16:13:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_wr": 43, 2024-09-13T16:13:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_rd": 0, 2024-09-13T16:13:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_del": 11 2024-09-13T16:13:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: "oft": { 2024-09-13T16:13:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_objs": 1, 2024-09-13T16:13:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_kv_pairs": 0, 2024-09-13T16:13:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_updates": 0, 2024-09-13T16:13:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_removes": 0 2024-09-13T16:13:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: "osd-slow-ops": { 2024-09-13T16:13:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_ops_count": 0 2024-09-13T16:13:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: "purge_queue": { 2024-09-13T16:13:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops": 0, 2024-09-13T16:13:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops_high_water": 17, 2024-09-13T16:13:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing": 0, 2024-09-13T16:13:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_high_water": 10, 2024-09-13T16:13:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed_ops": 537, 2024-09-13T16:13:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed": 273, 2024-09-13T16:13:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_item_in_journal": 0 2024-09-13T16:13:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-13T16:13:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-09-13T16:13:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-13T16:13:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 16500, 2024-09-13T16:13:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 5847380, 2024-09-13T16:13:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 16500, 2024-09-13T16:13:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-13T16:13:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-13T16:13:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 16500, 2024-09-13T16:13:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 5847380, 2024-09-13T16:13:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-13T16:13:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_bytes": { 2024-09-13T16:13:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-13T16:13:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-09-13T16:13:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-13T16:13:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-13T16:13:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-13T16:13:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 776, 2024-09-13T16:13:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 2310074, 2024-09-13T16:13:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 776, 2024-09-13T16:13:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 2310074, 2024-09-13T16:13:27.795 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-13T16:13:27.795 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.795 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.795 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_ops": { 2024-09-13T16:13:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-13T16:13:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 1024, 2024-09-13T16:13:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-13T16:13:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-13T16:13:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-13T16:13:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 776, 2024-09-13T16:13:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 776, 2024-09-13T16:13:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 776, 2024-09-13T16:13:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 776, 2024-09-13T16:13:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-13T16:13:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle": { 2024-09-13T16:13:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-13T16:13:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-09-13T16:13:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-13T16:13:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 273, 2024-09-13T16:13:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 29685, 2024-09-13T16:13:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 273, 2024-09-13T16:13:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-13T16:13:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-13T16:13:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 28, 2024-09-13T16:13:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 29685, 2024-09-13T16:13:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-13T16:13:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle-0x557fcde86500": { 2024-09-13T16:13:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-13T16:13:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-09-13T16:13:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-13T16:13:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 1287, 2024-09-13T16:13:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 2205012, 2024-09-13T16:13:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 1287, 2024-09-13T16:13:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-13T16:13:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-13T16:13:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 108, 2024-09-13T16:13:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 2205012, 2024-09-13T16:13:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-13T16:13:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:27.802 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:27.802 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:27.802 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T16:13:28.516 INFO:tasks.check_counter:Daemon mds.h mds.exported=13 2024-09-13T16:13:28.516 INFO:tasks.check_counter:Daemon mds.h mds.imported=13 2024-09-13T16:13:28.516 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=39 2024-09-13T16:13:28.516 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=1932 2024-09-13T16:13:28.517 DEBUG:tasks.check_counter:Getting stats from k 2024-09-13T16:13:28.517 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-13T16:13:28.715 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:13:28.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:28 smithi139 ceph-mon[35320]: pgmap v458: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-13T16:13:29.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:28 smithi194 ceph-mon[35694]: pgmap v458: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-13T16:13:29.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:28 smithi086 ceph-mon[30379]: pgmap v458: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-13T16:13:30.299 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T16:13:30.300 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:30.300 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 103, 2024-09-13T16:13:30.300 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 98, 2024-09-13T16:13:30.300 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 710240, 2024-09-13T16:13:30.300 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 54944, 2024-09-13T16:13:30.300 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:30.300 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 0, 2024-09-13T16:13:30.300 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.018949101, 2024-09-13T16:13:30.300 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.006191677, 2024-09-13T16:13:30.300 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.017901288, 2024-09-13T16:13:30.301 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:30.301 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:30.301 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 97, 2024-09-13T16:13:30.301 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.005810058, 2024-09-13T16:13:30.301 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000059897 2024-09-13T16:13:30.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:30.301 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:30.301 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:30.301 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:30.301 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:30.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:30.301 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 710240, 2024-09-13T16:13:30.302 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 54944 2024-09-13T16:13:30.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:30.302 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:30.302 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 1, 2024-09-13T16:13:30.302 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 74, 2024-09-13T16:13:30.302 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 160, 2024-09-13T16:13:30.302 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 89216, 2024-09-13T16:13:30.302 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 3, 2024-09-13T16:13:30.302 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:30.302 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.005117166, 2024-09-13T16:13:30.302 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.003329608, 2024-09-13T16:13:30.302 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.000809885, 2024-09-13T16:13:30.302 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:30.302 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:30.303 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 72, 2024-09-13T16:13:30.303 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.004572123, 2024-09-13T16:13:30.303 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000063501 2024-09-13T16:13:30.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:30.303 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:30.303 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:30.303 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:30.303 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:30.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:30.303 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T16:13:30.303 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 89216 2024-09-13T16:13:30.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:30.303 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:30.304 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 4, 2024-09-13T16:13:30.304 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 4, 2024-09-13T16:13:30.304 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 3040, 2024-09-13T16:13:30.304 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 448, 2024-09-13T16:13:30.304 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 2, 2024-09-13T16:13:30.304 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 1, 2024-09-13T16:13:30.304 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.002263970, 2024-09-13T16:13:30.304 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.000044160, 2024-09-13T16:13:30.304 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.002222512, 2024-09-13T16:13:30.304 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:30.305 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:30.305 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 3, 2024-09-13T16:13:30.305 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.004013587, 2024-09-13T16:13:30.305 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001337862 2024-09-13T16:13:30.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:30.305 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:30.305 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:30.305 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:30.305 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:30.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:30.305 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-13T16:13:30.305 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 448 2024-09-13T16:13:30.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:30.306 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2024-09-13T16:13:30.306 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 0, 2024-09-13T16:13:30.306 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2024-09-13T16:13:30.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:30.306 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2024-09-13T16:13:30.306 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:30.306 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:30.306 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:30.306 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:30.306 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:30.306 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:30.306 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:30.307 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:30.307 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:30.307 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:30.307 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:30.307 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:30.307 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:30.307 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:30.307 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:30.307 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:30.307 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:30.307 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:30.307 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:30.307 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:30.307 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:30.308 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:30.308 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:30.308 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:30.308 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:30.308 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:30.308 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:30.308 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:30.308 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:30.308 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:30.308 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:30.308 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2024-09-13T16:13:30.308 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:30.308 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:30.309 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:30.309 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:30.309 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 148840, 2024-09-13T16:13:30.309 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 28, 2024-09-13T16:13:30.309 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 0, 2024-09-13T16:13:30.309 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 0, 2024-09-13T16:13:30.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2024-09-13T16:13:30.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2024-09-13T16:13:30.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:30.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:30.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:30.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:30.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 0, 2024-09-13T16:13:30.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 0, 2024-09-13T16:13:30.310 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:30.310 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:30.310 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:30.310 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2024-09-13T16:13:30.310 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 928, 2024-09-13T16:13:30.310 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 2, 2024-09-13T16:13:30.310 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:30.310 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2024-09-13T16:13:30.310 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:30.310 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2024-09-13T16:13:30.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T16:13:30.310 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:30.310 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-13T16:13:30.311 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-09-13T16:13:30.311 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-13T16:13:30.311 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 104, 2024-09-13T16:13:30.311 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 695694, 2024-09-13T16:13:30.311 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:30.311 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 104, 2024-09-13T16:13:30.311 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-13T16:13:30.311 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-13T16:13:30.311 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 104, 2024-09-13T16:13:30.311 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 695694, 2024-09-13T16:13:30.311 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-13T16:13:30.311 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-13T16:13:30.311 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-13T16:13:30.311 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-13T16:13:30.312 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:30.312 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T16:13:30.312 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T16:13:30.938 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:30 smithi139 ceph-mon[35320]: pgmap v459: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T16:13:30.960 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-13T16:13:30.960 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-13T16:13:30.960 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-13T16:13:30.960 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-13T16:13:30.960 DEBUG:tasks.check_counter:Getting stats from c 2024-09-13T16:13:30.960 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-13T16:13:30.989 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:30 smithi194 ceph-mon[35694]: pgmap v459: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T16:13:31.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:30 smithi086 ceph-mon[30379]: pgmap v459: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T16:13:31.171 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:13:32.903 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:32 smithi194 ceph-mon[35694]: pgmap v460: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T16:13:32.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:32 smithi139 ceph-mon[35320]: pgmap v460: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T16:13:33.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:32 smithi086 ceph-mon[30379]: pgmap v460: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T16:13:33.141 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-13T16:13:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 774, 2024-09-13T16:13:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 764, 2024-09-13T16:13:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 39605300, 2024-09-13T16:13:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 259817, 2024-09-13T16:13:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 7, 2024-09-13T16:13:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 3, 2024-09-13T16:13:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.101930987, 2024-09-13T16:13:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.024466637, 2024-09-13T16:13:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.056980351, 2024-09-13T16:13:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.020152100, 2024-09-13T16:13:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 763, 2024-09-13T16:13:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.029929475, 2024-09-13T16:13:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000039226 2024-09-13T16:13:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 744624, 2024-09-13T16:13:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 54864 2024-09-13T16:13:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 152, 2024-09-13T16:13:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 221, 2024-09-13T16:13:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 41989444, 2024-09-13T16:13:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 239143, 2024-09-13T16:13:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 6, 2024-09-13T16:13:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 5, 2024-09-13T16:13:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.037538118, 2024-09-13T16:13:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.006166353, 2024-09-13T16:13:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.026525657, 2024-09-13T16:13:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.003333653, 2024-09-13T16:13:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 220, 2024-09-13T16:13:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.015495171, 2024-09-13T16:13:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000070432 2024-09-13T16:13:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-13T16:13:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 193360 2024-09-13T16:13:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 317, 2024-09-13T16:13:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 319, 2024-09-13T16:13:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 29440427, 2024-09-13T16:13:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 98594, 2024-09-13T16:13:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 6, 2024-09-13T16:13:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 5, 2024-09-13T16:13:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.038985581, 2024-09-13T16:13:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.009540984, 2024-09-13T16:13:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.017857791, 2024-09-13T16:13:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.009110746, 2024-09-13T16:13:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 317, 2024-09-13T16:13:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.012480335, 2024-09-13T16:13:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000039370 2024-09-13T16:13:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T16:13:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T16:13:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2024-09-13T16:13:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 1, 2024-09-13T16:13:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2024-09-13T16:13:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-MDSRank": { 2024-09-13T16:13:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-09-13T16:13:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-09-13T16:13:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 1774, 2024-09-13T16:13:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.147920772, 2024-09-13T16:13:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000083382 2024-09-13T16:13:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-PurgeQueue": { 2024-09-13T16:13:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-09-13T16:13:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-09-13T16:13:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: "mds": { 2024-09-13T16:13:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: "request": 0, 2024-09-13T16:13:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "reply": 0, 2024-09-13T16:13:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "reply_latency": { 2024-09-13T16:13:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_reply": 0, 2024-09-13T16:13:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "forward": 0, 2024-09-13T16:13:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_complete": 0, 2024-09-13T16:13:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_keys": 0, 2024-09-13T16:13:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_commit": 0, 2024-09-13T16:13:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_split": 0, 2024-09-13T16:13:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_merge": 0, 2024-09-13T16:13:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes": 11949, 2024-09-13T16:13:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_top": 6683, 2024-09-13T16:13:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_bottom": 5266, 2024-09-13T16:13:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pin_tail": 0, 2024-09-13T16:13:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pinned": 2401, 2024-09-13T16:13:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_expired": 0, 2024-09-13T16:13:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_with_caps": 0, 2024-09-13T16:13:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "caps": 0, 2024-09-13T16:13:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "subtrees": 2, 2024-09-13T16:13:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse": 0, 2024-09-13T16:13:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_hit": 0, 2024-09-13T16:13:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_forward": 0, 2024-09-13T16:13:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_discover": 0, 2024-09-13T16:13:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_dir_fetch": 0, 2024-09-13T16:13:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_remote_ino": 0, 2024-09-13T16:13:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_lock": 0, 2024-09-13T16:13:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "load_cent": 0, 2024-09-13T16:13:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "q": 0, 2024-09-13T16:13:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "exported": 0, 2024-09-13T16:13:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "exported_inodes": 0, 2024-09-13T16:13:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "imported": 0, 2024-09-13T16:13:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "imported_inodes": 0, 2024-09-13T16:13:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_dir_fetch": 0, 2024-09-13T16:13:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_backtrace_fetch": 0, 2024-09-13T16:13:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_peer_discover": 0, 2024-09-13T16:13:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rfiles": 4, 2024-09-13T16:13:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rbytes": 234, 2024-09-13T16:13:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rsnaps": 0, 2024-09-13T16:13:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T16:13:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_set_tag": 0, 2024-09-13T16:13:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T16:13:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_inotable_repaired": 0, 2024-09-13T16:13:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_inodes": 0, 2024-09-13T16:13:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T16:13:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T16:13:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_file_inodes": 0, 2024-09-13T16:13:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_inode_file_caps": 0, 2024-09-13T16:13:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T16:13:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_grant": 0, 2024-09-13T16:13:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T16:13:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T16:13:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T16:13:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps": 0, 2024-09-13T16:13:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps_dirty": 0, 2024-09-13T16:13:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_cap_release": 0, 2024-09-13T16:13:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "process_request_cap_release": 0 2024-09-13T16:13:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_cache": { 2024-09-13T16:13:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update": 0, 2024-09-13T16:13:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update_receipt": 0, 2024-09-13T16:13:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_try_discover": 0, 2024-09-13T16:13:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_send_discover": 0, 2024-09-13T16:13:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_handle_discover": 0, 2024-09-13T16:13:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays": 0, 2024-09-13T16:13:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_delayed": 0, 2024-09-13T16:13:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_enqueuing": 0, 2024-09-13T16:13:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_created": 0, 2024-09-13T16:13:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_enqueued": 0, 2024-09-13T16:13:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_reintegrated": 0, 2024-09-13T16:13:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_migrated": 0, 2024-09-13T16:13:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_processing": 0, 2024-09-13T16:13:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_enqueued": 0, 2024-09-13T16:13:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_prioritized": 0, 2024-09-13T16:13:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_started": 0, 2024-09-13T16:13:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_completed": 0, 2024-09-13T16:13:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T16:13:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_exportdir": 0, 2024-09-13T16:13:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_flush": 0, 2024-09-13T16:13:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragmentdir": 0, 2024-09-13T16:13:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragstats": 0, 2024-09-13T16:13:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_inodestats": 0 2024-09-13T16:13:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_log": { 2024-09-13T16:13:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: "evadd": 0, 2024-09-13T16:13:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: "evex": 0, 2024-09-13T16:13:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: "evtrm": 0, 2024-09-13T16:13:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: "ev": 53881, 2024-09-13T16:13:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "evexg": 0, 2024-09-13T16:13:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "evexd": 0, 2024-09-13T16:13:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "segadd": 0, 2024-09-13T16:13:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "segex": 0, 2024-09-13T16:13:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "segtrm": 0, 2024-09-13T16:13:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "seg": 5, 2024-09-13T16:13:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "segexg": 0, 2024-09-13T16:13:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "segexd": 0, 2024-09-13T16:13:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "expos": 107884706, 2024-09-13T16:13:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "wrpos": 114162546, 2024-09-13T16:13:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "rdpos": 114159709, 2024-09-13T16:13:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: "jlat": { 2024-09-13T16:13:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: "replayed": 53881 2024-09-13T16:13:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_mem": { 2024-09-13T16:13:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: "ino": 43, 2024-09-13T16:13:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: "ino+": 11560, 2024-09-13T16:13:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: "ino-": 11517, 2024-09-13T16:13:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "dir": 49, 2024-09-13T16:13:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "dir+": 778, 2024-09-13T16:13:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "dir-": 729, 2024-09-13T16:13:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "dn": 11949, 2024-09-13T16:13:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "dn+": 19205, 2024-09-13T16:13:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "dn-": 7256, 2024-09-13T16:13:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "cap": 0, 2024-09-13T16:13:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "cap+": 0, 2024-09-13T16:13:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "cap-": 0, 2024-09-13T16:13:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "rss": 67808, 2024-09-13T16:13:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "heap": 207124 2024-09-13T16:13:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_server": { 2024-09-13T16:13:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_client_request": 0, 2024-09-13T16:13:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_server_request": 0, 2024-09-13T16:13:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_request": 0, 2024-09-13T16:13:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_session": 0, 2024-09-13T16:13:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_peer_request": 0, 2024-09-13T16:13:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "req_create_latency": { 2024-09-13T16:13:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getattr_latency": { 2024-09-13T16:13:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getfilelock_latency": { 2024-09-13T16:13:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: "req_link_latency": { 2024-09-13T16:13:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookup_latency": { 2024-09-13T16:13:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookuphash_latency": { 2024-09-13T16:13:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupino_latency": { 2024-09-13T16:13:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupname_latency": { 2024-09-13T16:13:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupparent_latency": { 2024-09-13T16:13:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupsnap_latency": { 2024-09-13T16:13:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lssnap_latency": { 2024-09-13T16:13:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mkdir_latency": { 2024-09-13T16:13:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mknod_latency": { 2024-09-13T16:13:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mksnap_latency": { 2024-09-13T16:13:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "req_open_latency": { 2024-09-13T16:13:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "req_readdir_latency": { 2024-09-13T16:13:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rename_latency": { 2024-09-13T16:13:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: "req_renamesnap_latency": { 2024-09-13T16:13:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: "req_snapdiff_latency": { 2024-09-13T16:13:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmdir_latency": { 2024-09-13T16:13:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmsnap_latency": { 2024-09-13T16:13:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmxattr_latency": { 2024-09-13T16:13:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setattr_latency": { 2024-09-13T16:13:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setdirlayout_latency": { 2024-09-13T16:13:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setfilelock_latency": { 2024-09-13T16:13:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setlayout_latency": { 2024-09-13T16:13:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setxattr_latency": { 2024-09-13T16:13:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: "req_symlink_latency": { 2024-09-13T16:13:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: "req_unlink_latency": { 2024-09-13T16:13:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_revoke_eviction": 0, 2024-09-13T16:13:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_acquisition_throttle": 0, 2024-09-13T16:13:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getvxattr_latency": { 2024-09-13T16:13:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_sessions": { 2024-09-13T16:13:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: "session_count": 1, 2024-09-13T16:13:33.174 INFO:teuthology.orchestra.run.smithi194.stdout: "session_add": 4, 2024-09-13T16:13:33.174 INFO:teuthology.orchestra.run.smithi194.stdout: "session_remove": 3, 2024-09-13T16:13:33.174 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_open": 2, 2024-09-13T16:13:33.174 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_stale": 0, 2024-09-13T16:13:33.174 INFO:teuthology.orchestra.run.smithi194.stdout: "total_load": 0, 2024-09-13T16:13:33.174 INFO:teuthology.orchestra.run.smithi194.stdout: "average_load": 0, 2024-09-13T16:13:33.174 INFO:teuthology.orchestra.run.smithi194.stdout: "avg_session_uptime": 2807, 2024-09-13T16:13:33.174 INFO:teuthology.orchestra.run.smithi194.stdout: "mdthresh_evicted": 0 2024-09-13T16:13:33.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.174 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2024-09-13T16:13:33.174 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:33.174 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:33.175 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:33.175 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:33.175 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:33.175 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:33.175 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:33.175 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:33.175 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:33.175 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:33.175 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:33.175 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:33.175 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:33.176 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:33.176 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:33.176 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:33.176 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:33.176 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:33.176 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:33.176 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:33.176 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:33.176 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:33.176 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:33.176 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:33.177 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:33.177 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:33.177 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:33.177 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:33.177 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:33.177 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:33.177 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:33.177 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2024-09-13T16:13:33.177 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:33.177 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:33.177 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:33.178 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:33.178 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 230397, 2024-09-13T16:13:33.178 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 89, 2024-09-13T16:13:33.178 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 0, 2024-09-13T16:13:33.178 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 0, 2024-09-13T16:13:33.178 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2024-09-13T16:13:33.178 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2024-09-13T16:13:33.178 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:33.178 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:33.178 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:33.178 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:33.178 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 9240, 2024-09-13T16:13:33.179 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 174, 2024-09-13T16:13:33.179 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:33.179 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:33.179 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:33.179 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2024-09-13T16:13:33.179 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 8579837, 2024-09-13T16:13:33.179 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 54173, 2024-09-13T16:13:33.179 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:33.179 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2024-09-13T16:13:33.179 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:33.179 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2024-09-13T16:13:33.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.180 INFO:teuthology.orchestra.run.smithi194.stdout: "objecter": { 2024-09-13T16:13:33.180 INFO:teuthology.orchestra.run.smithi194.stdout: "op_active": 0, 2024-09-13T16:13:33.180 INFO:teuthology.orchestra.run.smithi194.stdout: "op_laggy": 0, 2024-09-13T16:13:33.180 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send": 1123, 2024-09-13T16:13:33.180 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send_bytes": 26, 2024-09-13T16:13:33.180 INFO:teuthology.orchestra.run.smithi194.stdout: "op_resend": 4, 2024-09-13T16:13:33.180 INFO:teuthology.orchestra.run.smithi194.stdout: "op_reply": 1123, 2024-09-13T16:13:33.180 INFO:teuthology.orchestra.run.smithi194.stdout: "op_latency": { 2024-09-13T16:13:33.180 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 1123, 2024-09-13T16:13:33.180 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 1.565968736, 2024-09-13T16:13:33.180 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.001394451 2024-09-13T16:13:33.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.181 INFO:teuthology.orchestra.run.smithi194.stdout: "op_inflight": 0, 2024-09-13T16:13:33.181 INFO:teuthology.orchestra.run.smithi194.stdout: "oplen_avg": { 2024-09-13T16:13:33.181 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 1123, 2024-09-13T16:13:33.181 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 1124 2024-09-13T16:13:33.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.181 INFO:teuthology.orchestra.run.smithi194.stdout: "op": 1123, 2024-09-13T16:13:33.181 INFO:teuthology.orchestra.run.smithi194.stdout: "op_r": 1123, 2024-09-13T16:13:33.181 INFO:teuthology.orchestra.run.smithi194.stdout: "op_w": 0, 2024-09-13T16:13:33.181 INFO:teuthology.orchestra.run.smithi194.stdout: "op_rmw": 0, 2024-09-13T16:13:33.181 INFO:teuthology.orchestra.run.smithi194.stdout: "op_pg": 0, 2024-09-13T16:13:33.182 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_stat": 712, 2024-09-13T16:13:33.182 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_create": 0, 2024-09-13T16:13:33.182 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_read": 408, 2024-09-13T16:13:33.182 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_write": 0, 2024-09-13T16:13:33.182 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writefull": 0, 2024-09-13T16:13:33.182 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writesame": 0, 2024-09-13T16:13:33.182 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_append": 0, 2024-09-13T16:13:33.182 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_zero": 0, 2024-09-13T16:13:33.182 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_truncate": 0, 2024-09-13T16:13:33.182 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_delete": 0, 2024-09-13T16:13:33.182 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_mapext": 0, 2024-09-13T16:13:33.183 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_sparse_read": 0, 2024-09-13T16:13:33.183 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_clonerange": 0, 2024-09-13T16:13:33.183 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_getxattr": 2, 2024-09-13T16:13:33.183 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_setxattr": 0, 2024-09-13T16:13:33.183 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_cmpxattr": 0, 2024-09-13T16:13:33.183 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_rmxattr": 0, 2024-09-13T16:13:33.183 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_resetxattrs": 0, 2024-09-13T16:13:33.183 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_call": 0, 2024-09-13T16:13:33.183 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_watch": 0, 2024-09-13T16:13:33.183 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_notify": 0, 2024-09-13T16:13:33.183 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T16:13:33.183 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls": 0, 2024-09-13T16:13:33.184 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls_filter": 0, 2024-09-13T16:13:33.184 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_other": 0, 2024-09-13T16:13:33.184 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_active": 0, 2024-09-13T16:13:33.184 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_send": 0, 2024-09-13T16:13:33.184 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_resend": 0, 2024-09-13T16:13:33.184 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_ping": 0, 2024-09-13T16:13:33.184 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_active": 0, 2024-09-13T16:13:33.184 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_send": 0, 2024-09-13T16:13:33.184 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_resend": 0, 2024-09-13T16:13:33.184 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_active": 0, 2024-09-13T16:13:33.184 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_send": 0, 2024-09-13T16:13:33.185 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_resend": 0, 2024-09-13T16:13:33.185 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_active": 0, 2024-09-13T16:13:33.185 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_send": 0, 2024-09-13T16:13:33.185 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_resend": 0, 2024-09-13T16:13:33.185 INFO:teuthology.orchestra.run.smithi194.stdout: "command_active": 0, 2024-09-13T16:13:33.185 INFO:teuthology.orchestra.run.smithi194.stdout: "command_send": 0, 2024-09-13T16:13:33.185 INFO:teuthology.orchestra.run.smithi194.stdout: "command_resend": 0, 2024-09-13T16:13:33.185 INFO:teuthology.orchestra.run.smithi194.stdout: "map_epoch": 94, 2024-09-13T16:13:33.185 INFO:teuthology.orchestra.run.smithi194.stdout: "map_full": 0, 2024-09-13T16:13:33.185 INFO:teuthology.orchestra.run.smithi194.stdout: "map_inc": 4, 2024-09-13T16:13:33.185 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_sessions": 10, 2024-09-13T16:13:33.185 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_open": 10, 2024-09-13T16:13:33.186 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_close": 0, 2024-09-13T16:13:33.186 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_laggy": 0, 2024-09-13T16:13:33.186 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_wr": 0, 2024-09-13T16:13:33.186 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_rd": 2, 2024-09-13T16:13:33.186 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_del": 0 2024-09-13T16:13:33.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.186 INFO:teuthology.orchestra.run.smithi194.stdout: "oft": { 2024-09-13T16:13:33.186 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_objs": 0, 2024-09-13T16:13:33.186 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_kv_pairs": 0, 2024-09-13T16:13:33.186 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_updates": 0, 2024-09-13T16:13:33.186 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_removes": 0 2024-09-13T16:13:33.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.187 INFO:teuthology.orchestra.run.smithi194.stdout: "osd-slow-ops": { 2024-09-13T16:13:33.187 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_ops_count": 0 2024-09-13T16:13:33.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.187 INFO:teuthology.orchestra.run.smithi194.stdout: "purge_queue": { 2024-09-13T16:13:33.187 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops": 0, 2024-09-13T16:13:33.187 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T16:13:33.187 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing": 0, 2024-09-13T16:13:33.187 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_high_water": 0, 2024-09-13T16:13:33.187 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed_ops": 0, 2024-09-13T16:13:33.187 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed": 0, 2024-09-13T16:13:33.187 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_item_in_journal": 0 2024-09-13T16:13:33.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.188 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:33.188 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-13T16:13:33.188 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-13T16:13:33.188 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-13T16:13:33.188 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 1239, 2024-09-13T16:13:33.188 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 110914741, 2024-09-13T16:13:33.188 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:33.188 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 1239, 2024-09-13T16:13:33.188 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-13T16:13:33.188 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-13T16:13:33.189 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 1239, 2024-09-13T16:13:33.189 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 110914741, 2024-09-13T16:13:33.189 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-13T16:13:33.189 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.189 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.189 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:33.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.189 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_bytes": { 2024-09-13T16:13:33.189 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-13T16:13:33.189 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-13T16:13:33.189 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-13T16:13:33.190 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-13T16:13:33.190 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-13T16:13:33.190 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:33.190 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:33.190 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 1123, 2024-09-13T16:13:33.190 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 109975601, 2024-09-13T16:13:33.190 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 1123, 2024-09-13T16:13:33.190 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 109975601, 2024-09-13T16:13:33.190 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-13T16:13:33.190 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.190 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.191 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.191 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:33.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.191 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_ops": { 2024-09-13T16:13:33.191 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-13T16:13:33.191 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 1024, 2024-09-13T16:13:33.191 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-13T16:13:33.191 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-13T16:13:33.191 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-13T16:13:33.191 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:33.191 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:33.192 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 1123, 2024-09-13T16:13:33.192 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 1123, 2024-09-13T16:13:33.192 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 1123, 2024-09-13T16:13:33.192 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 1123, 2024-09-13T16:13:33.192 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-13T16:13:33.192 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.192 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.192 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.192 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:33.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.192 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle": { 2024-09-13T16:13:33.192 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-13T16:13:33.193 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-09-13T16:13:33.193 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-13T16:13:33.193 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-13T16:13:33.193 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-13T16:13:33.193 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:33.193 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:33.193 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-13T16:13:33.193 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-13T16:13:33.193 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 0, 2024-09-13T16:13:33.193 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 0, 2024-09-13T16:13:33.193 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-13T16:13:33.193 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.194 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.194 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.194 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:33.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:33.194 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle-0x555b9fffc8c0": { 2024-09-13T16:13:33.194 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-13T16:13:33.194 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-09-13T16:13:33.194 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-13T16:13:33.194 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-13T16:13:33.194 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-13T16:13:33.194 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:33.195 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:33.195 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-13T16:13:33.195 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-13T16:13:33.195 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 0, 2024-09-13T16:13:33.195 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 0, 2024-09-13T16:13:33.195 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-13T16:13:33.195 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:33.195 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:33.195 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:33.195 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:33.195 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:33.195 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-13T16:13:33.953 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-13T16:13:33.953 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-13T16:13:33.953 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-13T16:13:33.953 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-13T16:13:33.954 DEBUG:tasks.check_counter:Getting stats from f 2024-09-13T16:13:33.954 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-13T16:13:34.197 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:13:34.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:34 smithi139 ceph-mon[35320]: pgmap v461: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T16:13:35.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:34 smithi194 ceph-mon[35694]: pgmap v461: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T16:13:35.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:34 smithi086 ceph-mon[30379]: pgmap v461: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T16:13:35.927 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-13T16:13:35.927 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:35.927 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 818, 2024-09-13T16:13:35.927 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 820, 2024-09-13T16:13:35.927 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 3025738, 2024-09-13T16:13:35.927 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 254405, 2024-09-13T16:13:35.928 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 6, 2024-09-13T16:13:35.928 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:35.928 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.073218115, 2024-09-13T16:13:35.928 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.023826196, 2024-09-13T16:13:35.928 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.019912954, 2024-09-13T16:13:35.928 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.023137981, 2024-09-13T16:13:35.928 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:35.928 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 818, 2024-09-13T16:13:35.928 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.031037361, 2024-09-13T16:13:35.928 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000037942 2024-09-13T16:13:35.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.928 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:35.929 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.929 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.929 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.929 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T16:13:35.929 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T16:13:35.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.929 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:35.929 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 7, 2024-09-13T16:13:35.929 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 77, 2024-09-13T16:13:35.929 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 3756, 2024-09-13T16:13:35.929 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 195804, 2024-09-13T16:13:35.929 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:35.929 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 3, 2024-09-13T16:13:35.930 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.006859695, 2024-09-13T16:13:35.930 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.003017477, 2024-09-13T16:13:35.930 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.003043212, 2024-09-13T16:13:35.930 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000055437, 2024-09-13T16:13:35.930 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:35.930 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 76, 2024-09-13T16:13:35.930 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.008783121, 2024-09-13T16:13:35.930 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000115567 2024-09-13T16:13:35.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.930 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:35.930 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.930 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.930 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.931 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-13T16:13:35.931 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 195120 2024-09-13T16:13:35.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.931 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:35.931 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 117, 2024-09-13T16:13:35.931 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 107, 2024-09-13T16:13:35.931 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 745276, 2024-09-13T16:13:35.931 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 56199, 2024-09-13T16:13:35.931 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 3, 2024-09-13T16:13:35.931 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:35.931 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.019215979, 2024-09-13T16:13:35.931 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.006906925, 2024-09-13T16:13:35.931 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.018229895, 2024-09-13T16:13:35.932 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000016118, 2024-09-13T16:13:35.932 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:35.932 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 106, 2024-09-13T16:13:35.932 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.007490421, 2024-09-13T16:13:35.932 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000070664 2024-09-13T16:13:35.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.932 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:35.932 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.932 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.932 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.932 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 745008, 2024-09-13T16:13:35.932 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 55888 2024-09-13T16:13:35.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.933 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2024-09-13T16:13:35.933 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 1, 2024-09-13T16:13:35.933 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2024-09-13T16:13:35.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.933 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-MDSRank": { 2024-09-13T16:13:35.933 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-09-13T16:13:35.933 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-09-13T16:13:35.933 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 1455, 2024-09-13T16:13:35.933 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.037443902, 2024-09-13T16:13:35.933 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000025734 2024-09-13T16:13:35.933 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:35.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.933 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-PurgeQueue": { 2024-09-13T16:13:35.934 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-09-13T16:13:35.934 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-09-13T16:13:35.934 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.934 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.934 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.934 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:35.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.934 INFO:teuthology.orchestra.run.smithi194.stdout: "mds": { 2024-09-13T16:13:35.934 INFO:teuthology.orchestra.run.smithi194.stdout: "request": 0, 2024-09-13T16:13:35.934 INFO:teuthology.orchestra.run.smithi194.stdout: "reply": 0, 2024-09-13T16:13:35.934 INFO:teuthology.orchestra.run.smithi194.stdout: "reply_latency": { 2024-09-13T16:13:35.934 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.935 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.935 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.935 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_reply": 0, 2024-09-13T16:13:35.935 INFO:teuthology.orchestra.run.smithi194.stdout: "forward": 0, 2024-09-13T16:13:35.935 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_complete": 0, 2024-09-13T16:13:35.935 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_keys": 0, 2024-09-13T16:13:35.935 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_commit": 0, 2024-09-13T16:13:35.935 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_split": 0, 2024-09-13T16:13:35.935 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_merge": 0, 2024-09-13T16:13:35.935 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes": 365, 2024-09-13T16:13:35.935 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_top": 0, 2024-09-13T16:13:35.935 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_bottom": 365, 2024-09-13T16:13:35.935 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pin_tail": 0, 2024-09-13T16:13:35.936 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pinned": 365, 2024-09-13T16:13:35.936 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_expired": 0, 2024-09-13T16:13:35.936 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_with_caps": 0, 2024-09-13T16:13:35.936 INFO:teuthology.orchestra.run.smithi194.stdout: "caps": 0, 2024-09-13T16:13:35.936 INFO:teuthology.orchestra.run.smithi194.stdout: "subtrees": 1, 2024-09-13T16:13:35.936 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse": 0, 2024-09-13T16:13:35.936 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_hit": 0, 2024-09-13T16:13:35.936 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_forward": 0, 2024-09-13T16:13:35.936 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_discover": 0, 2024-09-13T16:13:35.936 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_dir_fetch": 0, 2024-09-13T16:13:35.936 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_remote_ino": 0, 2024-09-13T16:13:35.936 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_lock": 0, 2024-09-13T16:13:35.936 INFO:teuthology.orchestra.run.smithi194.stdout: "load_cent": 0, 2024-09-13T16:13:35.937 INFO:teuthology.orchestra.run.smithi194.stdout: "q": 0, 2024-09-13T16:13:35.937 INFO:teuthology.orchestra.run.smithi194.stdout: "exported": 0, 2024-09-13T16:13:35.937 INFO:teuthology.orchestra.run.smithi194.stdout: "exported_inodes": 0, 2024-09-13T16:13:35.937 INFO:teuthology.orchestra.run.smithi194.stdout: "imported": 0, 2024-09-13T16:13:35.937 INFO:teuthology.orchestra.run.smithi194.stdout: "imported_inodes": 0, 2024-09-13T16:13:35.937 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_dir_fetch": 0, 2024-09-13T16:13:35.937 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_backtrace_fetch": 0, 2024-09-13T16:13:35.937 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_peer_discover": 0, 2024-09-13T16:13:35.937 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rfiles": 0, 2024-09-13T16:13:35.937 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rbytes": 0, 2024-09-13T16:13:35.937 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rsnaps": 0, 2024-09-13T16:13:35.937 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T16:13:35.937 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_set_tag": 0, 2024-09-13T16:13:35.937 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T16:13:35.938 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_inotable_repaired": 0, 2024-09-13T16:13:35.938 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_inodes": 0, 2024-09-13T16:13:35.938 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T16:13:35.938 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T16:13:35.938 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_file_inodes": 0, 2024-09-13T16:13:35.938 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_inode_file_caps": 0, 2024-09-13T16:13:35.938 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T16:13:35.938 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_grant": 0, 2024-09-13T16:13:35.938 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T16:13:35.938 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T16:13:35.938 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T16:13:35.938 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps": 0, 2024-09-13T16:13:35.938 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps_dirty": 0, 2024-09-13T16:13:35.938 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_cap_release": 0, 2024-09-13T16:13:35.939 INFO:teuthology.orchestra.run.smithi194.stdout: "process_request_cap_release": 0 2024-09-13T16:13:35.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.939 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_cache": { 2024-09-13T16:13:35.939 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update": 0, 2024-09-13T16:13:35.939 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update_receipt": 0, 2024-09-13T16:13:35.939 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_try_discover": 0, 2024-09-13T16:13:35.939 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_send_discover": 0, 2024-09-13T16:13:35.939 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_handle_discover": 0, 2024-09-13T16:13:35.939 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays": 0, 2024-09-13T16:13:35.939 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_delayed": 0, 2024-09-13T16:13:35.939 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_enqueuing": 0, 2024-09-13T16:13:35.939 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_created": 0, 2024-09-13T16:13:35.939 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_enqueued": 0, 2024-09-13T16:13:35.939 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_reintegrated": 0, 2024-09-13T16:13:35.940 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_migrated": 0, 2024-09-13T16:13:35.940 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_processing": 0, 2024-09-13T16:13:35.940 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_enqueued": 0, 2024-09-13T16:13:35.940 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_prioritized": 0, 2024-09-13T16:13:35.940 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_started": 0, 2024-09-13T16:13:35.940 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_completed": 0, 2024-09-13T16:13:35.940 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T16:13:35.940 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_exportdir": 0, 2024-09-13T16:13:35.940 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_flush": 0, 2024-09-13T16:13:35.940 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragmentdir": 0, 2024-09-13T16:13:35.940 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragstats": 0, 2024-09-13T16:13:35.940 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_inodestats": 0 2024-09-13T16:13:35.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.940 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_log": { 2024-09-13T16:13:35.941 INFO:teuthology.orchestra.run.smithi194.stdout: "evadd": 0, 2024-09-13T16:13:35.941 INFO:teuthology.orchestra.run.smithi194.stdout: "evex": 0, 2024-09-13T16:13:35.941 INFO:teuthology.orchestra.run.smithi194.stdout: "evtrm": 0, 2024-09-13T16:13:35.941 INFO:teuthology.orchestra.run.smithi194.stdout: "ev": 1652, 2024-09-13T16:13:35.941 INFO:teuthology.orchestra.run.smithi194.stdout: "evexg": 0, 2024-09-13T16:13:35.941 INFO:teuthology.orchestra.run.smithi194.stdout: "evexd": 0, 2024-09-13T16:13:35.941 INFO:teuthology.orchestra.run.smithi194.stdout: "segadd": 0, 2024-09-13T16:13:35.941 INFO:teuthology.orchestra.run.smithi194.stdout: "segex": 0, 2024-09-13T16:13:35.941 INFO:teuthology.orchestra.run.smithi194.stdout: "segtrm": 0, 2024-09-13T16:13:35.941 INFO:teuthology.orchestra.run.smithi194.stdout: "seg": 2, 2024-09-13T16:13:35.941 INFO:teuthology.orchestra.run.smithi194.stdout: "segexg": 0, 2024-09-13T16:13:35.941 INFO:teuthology.orchestra.run.smithi194.stdout: "segexd": 0, 2024-09-13T16:13:35.941 INFO:teuthology.orchestra.run.smithi194.stdout: "expos": 4194304, 2024-09-13T16:13:35.942 INFO:teuthology.orchestra.run.smithi194.stdout: "wrpos": 6986073, 2024-09-13T16:13:35.942 INFO:teuthology.orchestra.run.smithi194.stdout: "rdpos": 6984935, 2024-09-13T16:13:35.942 INFO:teuthology.orchestra.run.smithi194.stdout: "jlat": { 2024-09-13T16:13:35.942 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.942 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.942 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.942 INFO:teuthology.orchestra.run.smithi194.stdout: "replayed": 1652 2024-09-13T16:13:35.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.942 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_mem": { 2024-09-13T16:13:35.942 INFO:teuthology.orchestra.run.smithi194.stdout: "ino": 5, 2024-09-13T16:13:35.942 INFO:teuthology.orchestra.run.smithi194.stdout: "ino+": 444, 2024-09-13T16:13:35.942 INFO:teuthology.orchestra.run.smithi194.stdout: "ino-": 439, 2024-09-13T16:13:35.942 INFO:teuthology.orchestra.run.smithi194.stdout: "dir": 3, 2024-09-13T16:13:35.943 INFO:teuthology.orchestra.run.smithi194.stdout: "dir+": 88, 2024-09-13T16:13:35.943 INFO:teuthology.orchestra.run.smithi194.stdout: "dir-": 85, 2024-09-13T16:13:35.943 INFO:teuthology.orchestra.run.smithi194.stdout: "dn": 365, 2024-09-13T16:13:35.943 INFO:teuthology.orchestra.run.smithi194.stdout: "dn+": 698, 2024-09-13T16:13:35.943 INFO:teuthology.orchestra.run.smithi194.stdout: "dn-": 333, 2024-09-13T16:13:35.943 INFO:teuthology.orchestra.run.smithi194.stdout: "cap": 0, 2024-09-13T16:13:35.943 INFO:teuthology.orchestra.run.smithi194.stdout: "cap+": 0, 2024-09-13T16:13:35.943 INFO:teuthology.orchestra.run.smithi194.stdout: "cap-": 0, 2024-09-13T16:13:35.943 INFO:teuthology.orchestra.run.smithi194.stdout: "rss": 51420, 2024-09-13T16:13:35.943 INFO:teuthology.orchestra.run.smithi194.stdout: "heap": 207124 2024-09-13T16:13:35.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.943 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_server": { 2024-09-13T16:13:35.943 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_client_request": 0, 2024-09-13T16:13:35.943 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_server_request": 0, 2024-09-13T16:13:35.944 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_request": 0, 2024-09-13T16:13:35.944 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_session": 0, 2024-09-13T16:13:35.944 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_peer_request": 0, 2024-09-13T16:13:35.944 INFO:teuthology.orchestra.run.smithi194.stdout: "req_create_latency": { 2024-09-13T16:13:35.944 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.944 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.944 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.944 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getattr_latency": { 2024-09-13T16:13:35.944 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.944 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.944 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.945 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getfilelock_latency": { 2024-09-13T16:13:35.945 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.945 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.945 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.945 INFO:teuthology.orchestra.run.smithi194.stdout: "req_link_latency": { 2024-09-13T16:13:35.945 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.945 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.945 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.945 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookup_latency": { 2024-09-13T16:13:35.945 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.945 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.945 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.946 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookuphash_latency": { 2024-09-13T16:13:35.946 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.946 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.946 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.946 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupino_latency": { 2024-09-13T16:13:35.946 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.946 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.946 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.946 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupname_latency": { 2024-09-13T16:13:35.946 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.947 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.947 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.947 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupparent_latency": { 2024-09-13T16:13:35.947 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.947 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.947 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.947 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupsnap_latency": { 2024-09-13T16:13:35.947 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.947 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.947 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.947 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lssnap_latency": { 2024-09-13T16:13:35.948 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.948 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.948 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.948 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mkdir_latency": { 2024-09-13T16:13:35.948 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.948 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.948 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.948 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mknod_latency": { 2024-09-13T16:13:35.949 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.949 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.949 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.949 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mksnap_latency": { 2024-09-13T16:13:35.949 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.949 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.949 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.950 INFO:teuthology.orchestra.run.smithi194.stdout: "req_open_latency": { 2024-09-13T16:13:35.950 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.950 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.950 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.950 INFO:teuthology.orchestra.run.smithi194.stdout: "req_readdir_latency": { 2024-09-13T16:13:35.950 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.950 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.950 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.950 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rename_latency": { 2024-09-13T16:13:35.950 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.950 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.951 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.951 INFO:teuthology.orchestra.run.smithi194.stdout: "req_renamesnap_latency": { 2024-09-13T16:13:35.951 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.951 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.951 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.951 INFO:teuthology.orchestra.run.smithi194.stdout: "req_snapdiff_latency": { 2024-09-13T16:13:35.951 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.951 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.951 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.951 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmdir_latency": { 2024-09-13T16:13:35.951 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.952 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.952 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.952 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmsnap_latency": { 2024-09-13T16:13:35.952 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.952 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.952 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.952 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmxattr_latency": { 2024-09-13T16:13:35.952 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.952 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.952 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.952 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setattr_latency": { 2024-09-13T16:13:35.953 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.953 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.953 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.953 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setdirlayout_latency": { 2024-09-13T16:13:35.953 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.953 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.953 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.953 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setfilelock_latency": { 2024-09-13T16:13:35.953 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.953 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.953 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.954 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setlayout_latency": { 2024-09-13T16:13:35.954 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.954 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.954 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.954 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setxattr_latency": { 2024-09-13T16:13:35.954 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.954 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.954 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.954 INFO:teuthology.orchestra.run.smithi194.stdout: "req_symlink_latency": { 2024-09-13T16:13:35.954 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.955 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.955 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.955 INFO:teuthology.orchestra.run.smithi194.stdout: "req_unlink_latency": { 2024-09-13T16:13:35.955 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.955 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.955 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.955 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_revoke_eviction": 0, 2024-09-13T16:13:35.955 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_acquisition_throttle": 0, 2024-09-13T16:13:35.955 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getvxattr_latency": { 2024-09-13T16:13:35.955 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.955 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_sessions": { 2024-09-13T16:13:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: "session_count": 1, 2024-09-13T16:13:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: "session_add": 1, 2024-09-13T16:13:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: "session_remove": 0, 2024-09-13T16:13:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_open": 1, 2024-09-13T16:13:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_stale": 0, 2024-09-13T16:13:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: "total_load": 0, 2024-09-13T16:13:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: "average_load": 0, 2024-09-13T16:13:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: "avg_session_uptime": 1489, 2024-09-13T16:13:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: "mdthresh_evicted": 0 2024-09-13T16:13:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2024-09-13T16:13:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:35.958 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:35.958 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:35.958 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:35.958 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:35.958 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:35.958 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:35.958 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:35.958 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:35.958 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:35.958 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:35.958 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:35.958 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:35.958 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:35.958 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:35.959 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:35.959 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:35.959 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:35.959 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:35.959 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:35.959 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2024-09-13T16:13:35.959 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:35.959 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:35.959 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:35.959 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:35.959 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 181199, 2024-09-13T16:13:35.959 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 45, 2024-09-13T16:13:35.959 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 0, 2024-09-13T16:13:35.959 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 0, 2024-09-13T16:13:35.960 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2024-09-13T16:13:35.960 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2024-09-13T16:13:35.960 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:35.960 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:35.960 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:35.960 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:35.960 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 9240, 2024-09-13T16:13:35.960 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 174, 2024-09-13T16:13:35.960 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:35.960 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:35.960 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:35.960 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2024-09-13T16:13:35.960 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 272280, 2024-09-13T16:13:35.960 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 1500, 2024-09-13T16:13:35.961 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:35.961 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2024-09-13T16:13:35.961 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:35.961 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2024-09-13T16:13:35.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.961 INFO:teuthology.orchestra.run.smithi194.stdout: "objecter": { 2024-09-13T16:13:35.961 INFO:teuthology.orchestra.run.smithi194.stdout: "op_active": 0, 2024-09-13T16:13:35.961 INFO:teuthology.orchestra.run.smithi194.stdout: "op_laggy": 0, 2024-09-13T16:13:35.961 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send": 821, 2024-09-13T16:13:35.961 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send_bytes": 21, 2024-09-13T16:13:35.961 INFO:teuthology.orchestra.run.smithi194.stdout: "op_resend": 3, 2024-09-13T16:13:35.961 INFO:teuthology.orchestra.run.smithi194.stdout: "op_reply": 821, 2024-09-13T16:13:35.961 INFO:teuthology.orchestra.run.smithi194.stdout: "op_latency": { 2024-09-13T16:13:35.961 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 821, 2024-09-13T16:13:35.962 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.795984097, 2024-09-13T16:13:35.962 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000969529 2024-09-13T16:13:35.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.962 INFO:teuthology.orchestra.run.smithi194.stdout: "op_inflight": 0, 2024-09-13T16:13:35.962 INFO:teuthology.orchestra.run.smithi194.stdout: "oplen_avg": { 2024-09-13T16:13:35.962 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 821, 2024-09-13T16:13:35.962 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 822 2024-09-13T16:13:35.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.962 INFO:teuthology.orchestra.run.smithi194.stdout: "op": 821, 2024-09-13T16:13:35.962 INFO:teuthology.orchestra.run.smithi194.stdout: "op_r": 821, 2024-09-13T16:13:35.962 INFO:teuthology.orchestra.run.smithi194.stdout: "op_w": 0, 2024-09-13T16:13:35.962 INFO:teuthology.orchestra.run.smithi194.stdout: "op_rmw": 0, 2024-09-13T16:13:35.962 INFO:teuthology.orchestra.run.smithi194.stdout: "op_pg": 0, 2024-09-13T16:13:35.963 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_stat": 479, 2024-09-13T16:13:35.963 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_create": 0, 2024-09-13T16:13:35.963 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_read": 340, 2024-09-13T16:13:35.963 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_write": 0, 2024-09-13T16:13:35.963 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writefull": 0, 2024-09-13T16:13:35.963 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writesame": 0, 2024-09-13T16:13:35.963 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_append": 0, 2024-09-13T16:13:35.963 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_zero": 0, 2024-09-13T16:13:35.963 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_truncate": 0, 2024-09-13T16:13:35.963 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_delete": 0, 2024-09-13T16:13:35.963 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_mapext": 0, 2024-09-13T16:13:35.963 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_sparse_read": 0, 2024-09-13T16:13:35.963 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_clonerange": 0, 2024-09-13T16:13:35.963 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_getxattr": 1, 2024-09-13T16:13:35.963 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_setxattr": 0, 2024-09-13T16:13:35.964 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_cmpxattr": 0, 2024-09-13T16:13:35.964 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_rmxattr": 0, 2024-09-13T16:13:35.964 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_resetxattrs": 0, 2024-09-13T16:13:35.964 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_call": 0, 2024-09-13T16:13:35.964 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_watch": 0, 2024-09-13T16:13:35.964 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_notify": 0, 2024-09-13T16:13:35.964 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T16:13:35.964 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls": 0, 2024-09-13T16:13:35.964 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls_filter": 0, 2024-09-13T16:13:35.964 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_other": 0, 2024-09-13T16:13:35.964 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_active": 0, 2024-09-13T16:13:35.964 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_send": 0, 2024-09-13T16:13:35.964 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_resend": 0, 2024-09-13T16:13:35.964 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_ping": 0, 2024-09-13T16:13:35.965 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_active": 0, 2024-09-13T16:13:35.965 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_send": 0, 2024-09-13T16:13:35.965 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_resend": 0, 2024-09-13T16:13:35.965 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_active": 0, 2024-09-13T16:13:35.965 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_send": 0, 2024-09-13T16:13:35.965 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_resend": 0, 2024-09-13T16:13:35.965 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_active": 0, 2024-09-13T16:13:35.965 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_send": 0, 2024-09-13T16:13:35.965 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_resend": 0, 2024-09-13T16:13:35.965 INFO:teuthology.orchestra.run.smithi194.stdout: "command_active": 0, 2024-09-13T16:13:35.965 INFO:teuthology.orchestra.run.smithi194.stdout: "command_send": 0, 2024-09-13T16:13:35.965 INFO:teuthology.orchestra.run.smithi194.stdout: "command_resend": 0, 2024-09-13T16:13:35.965 INFO:teuthology.orchestra.run.smithi194.stdout: "map_epoch": 94, 2024-09-13T16:13:35.966 INFO:teuthology.orchestra.run.smithi194.stdout: "map_full": 0, 2024-09-13T16:13:35.966 INFO:teuthology.orchestra.run.smithi194.stdout: "map_inc": 4, 2024-09-13T16:13:35.966 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_sessions": 4, 2024-09-13T16:13:35.966 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_open": 4, 2024-09-13T16:13:35.966 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_close": 0, 2024-09-13T16:13:35.966 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_laggy": 0, 2024-09-13T16:13:35.966 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_wr": 0, 2024-09-13T16:13:35.966 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_rd": 2, 2024-09-13T16:13:35.966 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_del": 0 2024-09-13T16:13:35.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.966 INFO:teuthology.orchestra.run.smithi194.stdout: "oft": { 2024-09-13T16:13:35.966 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_objs": 0, 2024-09-13T16:13:35.966 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_kv_pairs": 0, 2024-09-13T16:13:35.966 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_updates": 0, 2024-09-13T16:13:35.967 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_removes": 0 2024-09-13T16:13:35.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.967 INFO:teuthology.orchestra.run.smithi194.stdout: "osd-slow-ops": { 2024-09-13T16:13:35.967 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_ops_count": 0 2024-09-13T16:13:35.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.967 INFO:teuthology.orchestra.run.smithi194.stdout: "purge_queue": { 2024-09-13T16:13:35.967 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops": 0, 2024-09-13T16:13:35.967 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T16:13:35.967 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing": 0, 2024-09-13T16:13:35.967 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_high_water": 0, 2024-09-13T16:13:35.967 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed_ops": 0, 2024-09-13T16:13:35.967 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed": 0, 2024-09-13T16:13:35.967 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_item_in_journal": 0 2024-09-13T16:13:35.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.968 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:35.968 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-13T16:13:35.968 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-13T16:13:35.968 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-13T16:13:35.968 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 938, 2024-09-13T16:13:35.968 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 3681372, 2024-09-13T16:13:35.968 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:35.968 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 938, 2024-09-13T16:13:35.968 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-13T16:13:35.968 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-13T16:13:35.968 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 938, 2024-09-13T16:13:35.968 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 3681372, 2024-09-13T16:13:35.968 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-13T16:13:35.968 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.969 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.969 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.969 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:35.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.969 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_bytes": { 2024-09-13T16:13:35.969 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-13T16:13:35.969 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-13T16:13:35.969 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-13T16:13:35.969 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-13T16:13:35.969 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-13T16:13:35.969 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:35.969 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:35.969 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 821, 2024-09-13T16:13:35.969 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 2791774, 2024-09-13T16:13:35.970 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 821, 2024-09-13T16:13:35.970 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 2791774, 2024-09-13T16:13:35.970 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-13T16:13:35.970 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.970 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.970 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.970 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:35.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.970 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_ops": { 2024-09-13T16:13:35.970 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-13T16:13:35.970 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 1024, 2024-09-13T16:13:35.970 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-13T16:13:35.970 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-13T16:13:35.970 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-13T16:13:35.971 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:35.971 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:35.971 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 821, 2024-09-13T16:13:35.971 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 821, 2024-09-13T16:13:35.971 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 821, 2024-09-13T16:13:35.971 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 821, 2024-09-13T16:13:35.971 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-13T16:13:35.971 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.971 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.971 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.971 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:35.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.971 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle": { 2024-09-13T16:13:35.971 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-13T16:13:35.972 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-09-13T16:13:35.972 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-13T16:13:35.972 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-13T16:13:35.972 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-13T16:13:35.972 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:35.972 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:35.972 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-13T16:13:35.972 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-13T16:13:35.972 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 0, 2024-09-13T16:13:35.972 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 0, 2024-09-13T16:13:35.972 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-13T16:13:35.972 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.972 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.972 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle-0x55fd70fa0820": { 2024-09-13T16:13:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-13T16:13:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-09-13T16:13:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-13T16:13:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-13T16:13:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-13T16:13:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-13T16:13:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-13T16:13:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 0, 2024-09-13T16:13:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 0, 2024-09-13T16:13:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-13T16:13:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:35.974 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-13T16:13:36.745 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-13T16:13:36.745 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-13T16:13:36.745 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-13T16:13:36.745 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-13T16:13:36.746 DEBUG:tasks.check_counter:Getting stats from i 2024-09-13T16:13:36.746 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-13T16:13:36.946 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:13:36.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:36 smithi139 ceph-mon[35320]: pgmap v462: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-13T16:13:37.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:36 smithi194 ceph-mon[35694]: pgmap v462: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-13T16:13:37.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:36 smithi086 ceph-mon[30379]: pgmap v462: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-13T16:13:38.745 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-13T16:13:38.745 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:38.745 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 1756, 2024-09-13T16:13:38.745 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 2879, 2024-09-13T16:13:38.745 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 570519, 2024-09-13T16:13:38.745 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 4172494, 2024-09-13T16:13:38.746 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 14, 2024-09-13T16:13:38.746 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 7, 2024-09-13T16:13:38.746 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.113644930, 2024-09-13T16:13:38.746 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.051525390, 2024-09-13T16:13:38.746 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.062676933, 2024-09-13T16:13:38.746 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.010943363, 2024-09-13T16:13:38.746 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:38.746 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 2875, 2024-09-13T16:13:38.746 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.135402516, 2024-09-13T16:13:38.746 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000047096 2024-09-13T16:13:38.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.746 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:38.746 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 1761, 2024-09-13T16:13:38.746 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000409310, 2024-09-13T16:13:38.747 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000232 2024-09-13T16:13:38.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.747 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T16:13:38.747 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T16:13:38.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.747 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:38.747 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 14507, 2024-09-13T16:13:38.747 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 7054, 2024-09-13T16:13:38.747 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 6054641, 2024-09-13T16:13:38.747 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 1504846, 2024-09-13T16:13:38.747 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 8, 2024-09-13T16:13:38.747 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 5, 2024-09-13T16:13:38.748 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.513553269, 2024-09-13T16:13:38.748 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.191770037, 2024-09-13T16:13:38.748 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.445674580, 2024-09-13T16:13:38.748 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.009315769, 2024-09-13T16:13:38.748 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:38.748 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 7055, 2024-09-13T16:13:38.748 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.163935025, 2024-09-13T16:13:38.748 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000023236 2024-09-13T16:13:38.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.748 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:38.748 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 20832, 2024-09-13T16:13:38.748 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.002413723, 2024-09-13T16:13:38.748 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000115 2024-09-13T16:13:38.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.749 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-13T16:13:38.749 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 196528 2024-09-13T16:13:38.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.749 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:38.749 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 822, 2024-09-13T16:13:38.749 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 762, 2024-09-13T16:13:38.749 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 1006495, 2024-09-13T16:13:38.749 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 354295, 2024-09-13T16:13:38.749 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 7, 2024-09-13T16:13:38.749 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 6, 2024-09-13T16:13:38.749 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.060968352, 2024-09-13T16:13:38.749 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.020161039, 2024-09-13T16:13:38.749 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.039132738, 2024-09-13T16:13:38.750 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.009849517, 2024-09-13T16:13:38.750 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:38.750 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 761, 2024-09-13T16:13:38.750 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.040096001, 2024-09-13T16:13:38.750 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000052688 2024-09-13T16:13:38.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.750 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:38.750 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 621, 2024-09-13T16:13:38.750 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000083161, 2024-09-13T16:13:38.750 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000133 2024-09-13T16:13:38.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.750 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 757792, 2024-09-13T16:13:38.750 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 60448 2024-09-13T16:13:38.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.751 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2024-09-13T16:13:38.751 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 1, 2024-09-13T16:13:38.751 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2024-09-13T16:13:38.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.751 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-MDSRank": { 2024-09-13T16:13:38.751 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-09-13T16:13:38.751 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-09-13T16:13:38.751 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 314, 2024-09-13T16:13:38.751 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.446501836, 2024-09-13T16:13:38.751 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.001421980 2024-09-13T16:13:38.751 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:38.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.751 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-PurgeQueue": { 2024-09-13T16:13:38.752 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-09-13T16:13:38.752 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-09-13T16:13:38.752 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 693, 2024-09-13T16:13:38.752 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.048860942, 2024-09-13T16:13:38.752 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000070506 2024-09-13T16:13:38.752 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:38.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.752 INFO:teuthology.orchestra.run.smithi194.stdout: "mds": { 2024-09-13T16:13:38.752 INFO:teuthology.orchestra.run.smithi194.stdout: "request": 734, 2024-09-13T16:13:38.752 INFO:teuthology.orchestra.run.smithi194.stdout: "reply": 733, 2024-09-13T16:13:38.752 INFO:teuthology.orchestra.run.smithi194.stdout: "reply_latency": { 2024-09-13T16:13:38.752 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 733, 2024-09-13T16:13:38.753 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.623801862, 2024-09-13T16:13:38.753 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000851025 2024-09-13T16:13:38.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.753 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_reply": 0, 2024-09-13T16:13:38.753 INFO:teuthology.orchestra.run.smithi194.stdout: "forward": 1, 2024-09-13T16:13:38.753 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_complete": 0, 2024-09-13T16:13:38.753 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_keys": 0, 2024-09-13T16:13:38.753 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_commit": 11, 2024-09-13T16:13:38.753 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_split": 0, 2024-09-13T16:13:38.753 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_merge": 0, 2024-09-13T16:13:38.753 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes": 26, 2024-09-13T16:13:38.753 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_top": 7, 2024-09-13T16:13:38.753 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_bottom": 9, 2024-09-13T16:13:38.754 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pin_tail": 10, 2024-09-13T16:13:38.754 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pinned": 13, 2024-09-13T16:13:38.754 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_expired": 1229, 2024-09-13T16:13:38.754 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_with_caps": 0, 2024-09-13T16:13:38.754 INFO:teuthology.orchestra.run.smithi194.stdout: "caps": 0, 2024-09-13T16:13:38.754 INFO:teuthology.orchestra.run.smithi194.stdout: "subtrees": 4, 2024-09-13T16:13:38.754 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse": 2379, 2024-09-13T16:13:38.754 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_hit": 1676, 2024-09-13T16:13:38.754 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_forward": 1, 2024-09-13T16:13:38.754 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_discover": 618, 2024-09-13T16:13:38.754 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_dir_fetch": 0, 2024-09-13T16:13:38.754 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_remote_ino": 0, 2024-09-13T16:13:38.754 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_lock": 0, 2024-09-13T16:13:38.754 INFO:teuthology.orchestra.run.smithi194.stdout: "load_cent": 0, 2024-09-13T16:13:38.755 INFO:teuthology.orchestra.run.smithi194.stdout: "q": 0, 2024-09-13T16:13:38.755 INFO:teuthology.orchestra.run.smithi194.stdout: "exported": 19, 2024-09-13T16:13:38.755 INFO:teuthology.orchestra.run.smithi194.stdout: "exported_inodes": 3, 2024-09-13T16:13:38.755 INFO:teuthology.orchestra.run.smithi194.stdout: "imported": 19, 2024-09-13T16:13:38.755 INFO:teuthology.orchestra.run.smithi194.stdout: "imported_inodes": 248, 2024-09-13T16:13:38.755 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_dir_fetch": 0, 2024-09-13T16:13:38.755 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_backtrace_fetch": 0, 2024-09-13T16:13:38.755 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_peer_discover": 0, 2024-09-13T16:13:38.755 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rfiles": 4, 2024-09-13T16:13:38.755 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rbytes": 234, 2024-09-13T16:13:38.755 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rsnaps": 0, 2024-09-13T16:13:38.756 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T16:13:38.756 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_set_tag": 0, 2024-09-13T16:13:38.756 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T16:13:38.756 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_inotable_repaired": 0, 2024-09-13T16:13:38.756 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_inodes": 0, 2024-09-13T16:13:38.756 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T16:13:38.756 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T16:13:38.756 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_file_inodes": 0, 2024-09-13T16:13:38.756 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_inode_file_caps": 0, 2024-09-13T16:13:38.756 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_revoke": 51, 2024-09-13T16:13:38.756 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_grant": 515, 2024-09-13T16:13:38.756 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T16:13:38.757 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T16:13:38.757 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T16:13:38.757 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps": 491, 2024-09-13T16:13:38.757 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps_dirty": 334, 2024-09-13T16:13:38.757 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_cap_release": 15, 2024-09-13T16:13:38.757 INFO:teuthology.orchestra.run.smithi194.stdout: "process_request_cap_release": 726 2024-09-13T16:13:38.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.757 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_cache": { 2024-09-13T16:13:38.757 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update": 42, 2024-09-13T16:13:38.757 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update_receipt": 1944, 2024-09-13T16:13:38.757 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_try_discover": 1269, 2024-09-13T16:13:38.757 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_send_discover": 1304, 2024-09-13T16:13:38.757 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_handle_discover": 46, 2024-09-13T16:13:38.758 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays": 0, 2024-09-13T16:13:38.758 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_delayed": 0, 2024-09-13T16:13:38.758 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_enqueuing": 0, 2024-09-13T16:13:38.758 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_created": 363, 2024-09-13T16:13:38.758 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_enqueued": 363, 2024-09-13T16:13:38.758 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_reintegrated": 0, 2024-09-13T16:13:38.758 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_migrated": 0, 2024-09-13T16:13:38.758 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_processing": 0, 2024-09-13T16:13:38.758 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_enqueued": 0, 2024-09-13T16:13:38.758 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_prioritized": 0, 2024-09-13T16:13:38.758 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_started": 0, 2024-09-13T16:13:38.758 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_completed": 0, 2024-09-13T16:13:38.758 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T16:13:38.758 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_exportdir": 19, 2024-09-13T16:13:38.759 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_flush": 0, 2024-09-13T16:13:38.759 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragmentdir": 0, 2024-09-13T16:13:38.759 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragstats": 0, 2024-09-13T16:13:38.759 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_inodestats": 0 2024-09-13T16:13:38.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.759 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_log": { 2024-09-13T16:13:38.759 INFO:teuthology.orchestra.run.smithi194.stdout: "evadd": 1652, 2024-09-13T16:13:38.759 INFO:teuthology.orchestra.run.smithi194.stdout: "evex": 0, 2024-09-13T16:13:38.759 INFO:teuthology.orchestra.run.smithi194.stdout: "evtrm": 0, 2024-09-13T16:13:38.759 INFO:teuthology.orchestra.run.smithi194.stdout: "ev": 1652, 2024-09-13T16:13:38.759 INFO:teuthology.orchestra.run.smithi194.stdout: "evexg": 0, 2024-09-13T16:13:38.759 INFO:teuthology.orchestra.run.smithi194.stdout: "evexd": 0, 2024-09-13T16:13:38.759 INFO:teuthology.orchestra.run.smithi194.stdout: "segadd": 2, 2024-09-13T16:13:38.759 INFO:teuthology.orchestra.run.smithi194.stdout: "segex": 0, 2024-09-13T16:13:38.760 INFO:teuthology.orchestra.run.smithi194.stdout: "segtrm": 0, 2024-09-13T16:13:38.760 INFO:teuthology.orchestra.run.smithi194.stdout: "seg": 2, 2024-09-13T16:13:38.760 INFO:teuthology.orchestra.run.smithi194.stdout: "segexg": 0, 2024-09-13T16:13:38.760 INFO:teuthology.orchestra.run.smithi194.stdout: "segexd": 0, 2024-09-13T16:13:38.760 INFO:teuthology.orchestra.run.smithi194.stdout: "expos": 4194304, 2024-09-13T16:13:38.760 INFO:teuthology.orchestra.run.smithi194.stdout: "wrpos": 6986073, 2024-09-13T16:13:38.760 INFO:teuthology.orchestra.run.smithi194.stdout: "rdpos": 0, 2024-09-13T16:13:38.760 INFO:teuthology.orchestra.run.smithi194.stdout: "jlat": { 2024-09-13T16:13:38.760 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 133, 2024-09-13T16:13:38.760 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.642486397, 2024-09-13T16:13:38.760 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.004830724 2024-09-13T16:13:38.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.760 INFO:teuthology.orchestra.run.smithi194.stdout: "replayed": 0 2024-09-13T16:13:38.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.761 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_mem": { 2024-09-13T16:13:38.761 INFO:teuthology.orchestra.run.smithi194.stdout: "ino": 31, 2024-09-13T16:13:38.761 INFO:teuthology.orchestra.run.smithi194.stdout: "ino+": 1009, 2024-09-13T16:13:38.761 INFO:teuthology.orchestra.run.smithi194.stdout: "ino-": 978, 2024-09-13T16:13:38.761 INFO:teuthology.orchestra.run.smithi194.stdout: "dir": 30, 2024-09-13T16:13:38.761 INFO:teuthology.orchestra.run.smithi194.stdout: "dir+": 773, 2024-09-13T16:13:38.761 INFO:teuthology.orchestra.run.smithi194.stdout: "dir-": 743, 2024-09-13T16:13:38.761 INFO:teuthology.orchestra.run.smithi194.stdout: "dn": 26, 2024-09-13T16:13:38.761 INFO:teuthology.orchestra.run.smithi194.stdout: "dn+": 1863, 2024-09-13T16:13:38.761 INFO:teuthology.orchestra.run.smithi194.stdout: "dn-": 1837, 2024-09-13T16:13:38.761 INFO:teuthology.orchestra.run.smithi194.stdout: "cap": 0, 2024-09-13T16:13:38.761 INFO:teuthology.orchestra.run.smithi194.stdout: "cap+": 382, 2024-09-13T16:13:38.762 INFO:teuthology.orchestra.run.smithi194.stdout: "cap-": 382, 2024-09-13T16:13:38.762 INFO:teuthology.orchestra.run.smithi194.stdout: "rss": 59612, 2024-09-13T16:13:38.762 INFO:teuthology.orchestra.run.smithi194.stdout: "heap": 198932 2024-09-13T16:13:38.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.762 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_server": { 2024-09-13T16:13:38.763 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_client_request": 848, 2024-09-13T16:13:38.764 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_server_request": 46, 2024-09-13T16:13:38.764 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_request": 734, 2024-09-13T16:13:38.764 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_session": 3, 2024-09-13T16:13:38.764 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_peer_request": 138, 2024-09-13T16:13:38.764 INFO:teuthology.orchestra.run.smithi194.stdout: "req_create_latency": { 2024-09-13T16:13:38.764 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 115, 2024-09-13T16:13:38.764 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.078907718, 2024-09-13T16:13:38.764 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000686154 2024-09-13T16:13:38.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.764 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getattr_latency": { 2024-09-13T16:13:38.764 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.764 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.764 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.765 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getfilelock_latency": { 2024-09-13T16:13:38.765 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.765 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.765 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.765 INFO:teuthology.orchestra.run.smithi194.stdout: "req_link_latency": { 2024-09-13T16:13:38.765 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.765 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.765 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.765 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookup_latency": { 2024-09-13T16:13:38.766 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 222, 2024-09-13T16:13:38.766 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.072291693, 2024-09-13T16:13:38.766 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000325638 2024-09-13T16:13:38.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.766 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookuphash_latency": { 2024-09-13T16:13:38.766 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.766 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.766 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.766 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupino_latency": { 2024-09-13T16:13:38.766 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.766 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.766 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.767 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupname_latency": { 2024-09-13T16:13:38.767 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.767 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.767 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.767 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupparent_latency": { 2024-09-13T16:13:38.767 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.767 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.767 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.767 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupsnap_latency": { 2024-09-13T16:13:38.767 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.767 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.767 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.768 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lssnap_latency": { 2024-09-13T16:13:38.768 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.768 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.768 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.768 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mkdir_latency": { 2024-09-13T16:13:38.768 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.768 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.768 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.768 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mknod_latency": { 2024-09-13T16:13:38.768 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.768 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.768 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.769 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mksnap_latency": { 2024-09-13T16:13:38.769 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.769 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.769 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.769 INFO:teuthology.orchestra.run.smithi194.stdout: "req_open_latency": { 2024-09-13T16:13:38.769 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.769 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.769 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.769 INFO:teuthology.orchestra.run.smithi194.stdout: "req_readdir_latency": { 2024-09-13T16:13:38.770 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 33, 2024-09-13T16:13:38.770 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.021180212, 2024-09-13T16:13:38.770 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000641824 2024-09-13T16:13:38.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.770 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rename_latency": { 2024-09-13T16:13:38.770 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.770 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.770 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.770 INFO:teuthology.orchestra.run.smithi194.stdout: "req_renamesnap_latency": { 2024-09-13T16:13:38.770 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.770 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.771 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.771 INFO:teuthology.orchestra.run.smithi194.stdout: "req_snapdiff_latency": { 2024-09-13T16:13:38.771 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.771 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.771 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.771 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmdir_latency": { 2024-09-13T16:13:38.771 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 3, 2024-09-13T16:13:38.771 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.019869084, 2024-09-13T16:13:38.772 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.006623028 2024-09-13T16:13:38.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.772 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmsnap_latency": { 2024-09-13T16:13:38.772 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.772 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.772 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.772 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmxattr_latency": { 2024-09-13T16:13:38.772 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.772 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.773 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.773 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setattr_latency": { 2024-09-13T16:13:38.773 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.773 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.773 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.773 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setdirlayout_latency": { 2024-09-13T16:13:38.773 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.773 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.773 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.774 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setfilelock_latency": { 2024-09-13T16:13:38.774 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.774 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.774 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.774 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setlayout_latency": { 2024-09-13T16:13:38.774 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.774 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.774 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.774 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setxattr_latency": { 2024-09-13T16:13:38.774 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.774 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.774 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.775 INFO:teuthology.orchestra.run.smithi194.stdout: "req_symlink_latency": { 2024-09-13T16:13:38.775 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.775 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.775 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.775 INFO:teuthology.orchestra.run.smithi194.stdout: "req_unlink_latency": { 2024-09-13T16:13:38.775 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 360, 2024-09-13T16:13:38.775 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.431553155, 2024-09-13T16:13:38.776 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.001198758 2024-09-13T16:13:38.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.776 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_revoke_eviction": 0, 2024-09-13T16:13:38.776 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_acquisition_throttle": 0, 2024-09-13T16:13:38.776 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getvxattr_latency": { 2024-09-13T16:13:38.776 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.776 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.776 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.776 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:38.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.777 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_sessions": { 2024-09-13T16:13:38.777 INFO:teuthology.orchestra.run.smithi194.stdout: "session_count": 1, 2024-09-13T16:13:38.777 INFO:teuthology.orchestra.run.smithi194.stdout: "session_add": 1, 2024-09-13T16:13:38.777 INFO:teuthology.orchestra.run.smithi194.stdout: "session_remove": 0, 2024-09-13T16:13:38.777 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_open": 1, 2024-09-13T16:13:38.777 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_stale": 0, 2024-09-13T16:13:38.777 INFO:teuthology.orchestra.run.smithi194.stdout: "total_load": 529, 2024-09-13T16:13:38.777 INFO:teuthology.orchestra.run.smithi194.stdout: "average_load": 529, 2024-09-13T16:13:38.778 INFO:teuthology.orchestra.run.smithi194.stdout: "avg_session_uptime": 175, 2024-09-13T16:13:38.778 INFO:teuthology.orchestra.run.smithi194.stdout: "mdthresh_evicted": 0 2024-09-13T16:13:38.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.778 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2024-09-13T16:13:38.778 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:38.778 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:38.778 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:38.778 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:38.778 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:38.778 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:38.779 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:38.779 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:38.779 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:38.779 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:38.779 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:38.779 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:38.779 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:38.779 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:38.779 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:38.779 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:38.779 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:38.779 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:38.779 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:38.780 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:38.780 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:38.780 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:38.780 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:38.780 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:38.780 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:38.780 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:38.780 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:38.780 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:38.780 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:38.780 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:38.780 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:38.781 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2024-09-13T16:13:38.781 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:38.781 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:38.781 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:38.781 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:38.781 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 294607, 2024-09-13T16:13:38.781 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 117, 2024-09-13T16:13:38.781 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 616, 2024-09-13T16:13:38.781 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 7, 2024-09-13T16:13:38.781 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2024-09-13T16:13:38.781 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2024-09-13T16:13:38.781 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:38.782 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:38.782 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:38.782 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:38.782 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 9240, 2024-09-13T16:13:38.782 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 174, 2024-09-13T16:13:38.782 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:38.782 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:38.782 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:38.782 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2024-09-13T16:13:38.782 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 125149, 2024-09-13T16:13:38.782 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 475, 2024-09-13T16:13:38.782 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:38.783 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2024-09-13T16:13:38.783 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:38.783 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2024-09-13T16:13:38.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.783 INFO:teuthology.orchestra.run.smithi194.stdout: "objecter": { 2024-09-13T16:13:38.783 INFO:teuthology.orchestra.run.smithi194.stdout: "op_active": 0, 2024-09-13T16:13:38.783 INFO:teuthology.orchestra.run.smithi194.stdout: "op_laggy": 0, 2024-09-13T16:13:38.783 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send": 980, 2024-09-13T16:13:38.783 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send_bytes": 2892322, 2024-09-13T16:13:38.783 INFO:teuthology.orchestra.run.smithi194.stdout: "op_resend": 33, 2024-09-13T16:13:38.783 INFO:teuthology.orchestra.run.smithi194.stdout: "op_reply": 980, 2024-09-13T16:13:38.784 INFO:teuthology.orchestra.run.smithi194.stdout: "op_latency": { 2024-09-13T16:13:38.784 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 980, 2024-09-13T16:13:38.784 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 6.202876078, 2024-09-13T16:13:38.784 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.006329465 2024-09-13T16:13:38.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.784 INFO:teuthology.orchestra.run.smithi194.stdout: "op_inflight": 0, 2024-09-13T16:13:38.784 INFO:teuthology.orchestra.run.smithi194.stdout: "oplen_avg": { 2024-09-13T16:13:38.784 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 980, 2024-09-13T16:13:38.784 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 1020 2024-09-13T16:13:38.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.784 INFO:teuthology.orchestra.run.smithi194.stdout: "op": 980, 2024-09-13T16:13:38.784 INFO:teuthology.orchestra.run.smithi194.stdout: "op_r": 26, 2024-09-13T16:13:38.784 INFO:teuthology.orchestra.run.smithi194.stdout: "op_w": 954, 2024-09-13T16:13:38.785 INFO:teuthology.orchestra.run.smithi194.stdout: "op_rmw": 0, 2024-09-13T16:13:38.785 INFO:teuthology.orchestra.run.smithi194.stdout: "op_pg": 0, 2024-09-13T16:13:38.785 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_stat": 0, 2024-09-13T16:13:38.785 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_create": 10, 2024-09-13T16:13:38.785 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_read": 26, 2024-09-13T16:13:38.785 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_write": 159, 2024-09-13T16:13:38.785 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writefull": 24, 2024-09-13T16:13:38.785 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writesame": 0, 2024-09-13T16:13:38.785 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_append": 0, 2024-09-13T16:13:38.785 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_zero": 0, 2024-09-13T16:13:38.785 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_truncate": 0, 2024-09-13T16:13:38.785 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_delete": 735, 2024-09-13T16:13:38.786 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_mapext": 0, 2024-09-13T16:13:38.786 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_sparse_read": 0, 2024-09-13T16:13:38.786 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_clonerange": 0, 2024-09-13T16:13:38.786 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_getxattr": 0, 2024-09-13T16:13:38.786 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_setxattr": 20, 2024-09-13T16:13:38.786 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_cmpxattr": 0, 2024-09-13T16:13:38.786 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_rmxattr": 0, 2024-09-13T16:13:38.786 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_resetxattrs": 0, 2024-09-13T16:13:38.786 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_call": 0, 2024-09-13T16:13:38.786 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_watch": 0, 2024-09-13T16:13:38.786 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_notify": 0, 2024-09-13T16:13:38.786 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T16:13:38.786 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls": 0, 2024-09-13T16:13:38.787 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls_filter": 0, 2024-09-13T16:13:38.787 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_other": 0, 2024-09-13T16:13:38.787 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_active": 0, 2024-09-13T16:13:38.787 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_send": 0, 2024-09-13T16:13:38.787 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_resend": 0, 2024-09-13T16:13:38.787 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_ping": 0, 2024-09-13T16:13:38.787 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_active": 0, 2024-09-13T16:13:38.787 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_send": 0, 2024-09-13T16:13:38.787 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_resend": 0, 2024-09-13T16:13:38.787 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_active": 0, 2024-09-13T16:13:38.787 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_send": 0, 2024-09-13T16:13:38.787 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_resend": 0, 2024-09-13T16:13:38.787 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_active": 0, 2024-09-13T16:13:38.788 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_send": 0, 2024-09-13T16:13:38.788 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_resend": 0, 2024-09-13T16:13:38.788 INFO:teuthology.orchestra.run.smithi194.stdout: "command_active": 0, 2024-09-13T16:13:38.788 INFO:teuthology.orchestra.run.smithi194.stdout: "command_send": 0, 2024-09-13T16:13:38.788 INFO:teuthology.orchestra.run.smithi194.stdout: "command_resend": 0, 2024-09-13T16:13:38.788 INFO:teuthology.orchestra.run.smithi194.stdout: "map_epoch": 94, 2024-09-13T16:13:38.788 INFO:teuthology.orchestra.run.smithi194.stdout: "map_full": 0, 2024-09-13T16:13:38.788 INFO:teuthology.orchestra.run.smithi194.stdout: "map_inc": 4, 2024-09-13T16:13:38.788 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_sessions": 12, 2024-09-13T16:13:38.788 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_open": 12, 2024-09-13T16:13:38.788 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_close": 0, 2024-09-13T16:13:38.788 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_laggy": 0, 2024-09-13T16:13:38.788 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_wr": 36, 2024-09-13T16:13:38.789 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_rd": 0, 2024-09-13T16:13:38.789 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_del": 10 2024-09-13T16:13:38.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.789 INFO:teuthology.orchestra.run.smithi194.stdout: "oft": { 2024-09-13T16:13:38.789 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_objs": 1, 2024-09-13T16:13:38.789 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_kv_pairs": 0, 2024-09-13T16:13:38.789 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_updates": 0, 2024-09-13T16:13:38.789 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_removes": 0 2024-09-13T16:13:38.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.789 INFO:teuthology.orchestra.run.smithi194.stdout: "osd-slow-ops": { 2024-09-13T16:13:38.789 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_ops_count": 0 2024-09-13T16:13:38.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.790 INFO:teuthology.orchestra.run.smithi194.stdout: "purge_queue": { 2024-09-13T16:13:38.790 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops": 0, 2024-09-13T16:13:38.790 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops_high_water": 17, 2024-09-13T16:13:38.790 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing": 0, 2024-09-13T16:13:38.790 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_high_water": 9, 2024-09-13T16:13:38.790 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed_ops": 723, 2024-09-13T16:13:38.790 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed": 363, 2024-09-13T16:13:38.790 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_item_in_journal": 0 2024-09-13T16:13:38.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.790 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:38.790 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-13T16:13:38.790 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-13T16:13:38.790 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-13T16:13:38.790 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 17081, 2024-09-13T16:13:38.790 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 6105481, 2024-09-13T16:13:38.791 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:38.791 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 17081, 2024-09-13T16:13:38.791 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-13T16:13:38.791 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-13T16:13:38.791 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 17081, 2024-09-13T16:13:38.791 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 6105481, 2024-09-13T16:13:38.791 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-13T16:13:38.791 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.791 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.791 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.791 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:38.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.791 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_bytes": { 2024-09-13T16:13:38.791 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-13T16:13:38.792 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-13T16:13:38.792 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-13T16:13:38.792 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-13T16:13:38.792 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-13T16:13:38.792 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:38.792 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:38.792 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 980, 2024-09-13T16:13:38.792 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 2931865, 2024-09-13T16:13:38.792 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 980, 2024-09-13T16:13:38.792 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 2931865, 2024-09-13T16:13:38.792 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-13T16:13:38.792 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.792 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.792 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:38.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.793 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_ops": { 2024-09-13T16:13:38.793 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-13T16:13:38.793 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 1024, 2024-09-13T16:13:38.793 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-13T16:13:38.793 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-13T16:13:38.793 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-13T16:13:38.793 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:38.793 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:38.793 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 980, 2024-09-13T16:13:38.793 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 980, 2024-09-13T16:13:38.793 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 980, 2024-09-13T16:13:38.794 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 980, 2024-09-13T16:13:38.794 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-13T16:13:38.794 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.794 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.794 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.794 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:38.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.794 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle": { 2024-09-13T16:13:38.794 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-13T16:13:38.794 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-09-13T16:13:38.794 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-13T16:13:38.794 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 363, 2024-09-13T16:13:38.794 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 39543, 2024-09-13T16:13:38.795 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:38.795 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 363, 2024-09-13T16:13:38.795 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-13T16:13:38.795 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-13T16:13:38.795 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 26, 2024-09-13T16:13:38.795 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 39543, 2024-09-13T16:13:38.795 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-13T16:13:38.795 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.795 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.795 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.795 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:38.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:38.795 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle-0x55c77b38a500": { 2024-09-13T16:13:38.796 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-13T16:13:38.796 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-09-13T16:13:38.796 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-13T16:13:38.796 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 1652, 2024-09-13T16:13:38.796 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 2791769, 2024-09-13T16:13:38.796 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:38.796 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 1652, 2024-09-13T16:13:38.796 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-13T16:13:38.796 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-13T16:13:38.796 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 133, 2024-09-13T16:13:38.796 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 2791769, 2024-09-13T16:13:38.796 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-13T16:13:38.796 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:38.796 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:38.797 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:38.797 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:38.797 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:38.797 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-13T16:13:38.797 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:38 smithi194 ceph-mon[35694]: pgmap v463: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:13:38.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:38 smithi139 ceph-mon[35320]: pgmap v463: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:13:39.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:38 smithi086 ceph-mon[30379]: pgmap v463: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:13:39.523 INFO:tasks.check_counter:Daemon mds.i mds.exported=19 2024-09-13T16:13:39.523 INFO:tasks.check_counter:Daemon mds.i mds.imported=19 2024-09-13T16:13:39.523 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=42 2024-09-13T16:13:39.523 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=1944 2024-09-13T16:13:39.523 DEBUG:tasks.check_counter:Getting stats from l 2024-09-13T16:13:39.524 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-13T16:13:39.723 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:13:40.943 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:40 smithi194 ceph-mon[35694]: pgmap v464: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T16:13:40.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:40 smithi139 ceph-mon[35320]: pgmap v464: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T16:13:41.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:40 smithi086 ceph-mon[30379]: pgmap v464: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T16:13:41.513 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-13T16:13:41.513 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:41.513 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 108, 2024-09-13T16:13:41.513 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 103, 2024-09-13T16:13:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 712224, 2024-09-13T16:13:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 57648, 2024-09-13T16:13:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 0, 2024-09-13T16:13:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.019758792, 2024-09-13T16:13:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.007259257, 2024-09-13T16:13:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.017779691, 2024-09-13T16:13:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 102, 2024-09-13T16:13:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.008458745, 2024-09-13T16:13:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000082928 2024-09-13T16:13:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 712224, 2024-09-13T16:13:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 57648 2024-09-13T16:13:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 1, 2024-09-13T16:13:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 77, 2024-09-13T16:13:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 160, 2024-09-13T16:13:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 89744, 2024-09-13T16:13:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 3, 2024-09-13T16:13:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.005098554, 2024-09-13T16:13:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.003498971, 2024-09-13T16:13:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.000636353, 2024-09-13T16:13:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 75, 2024-09-13T16:13:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.005307988, 2024-09-13T16:13:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000070773 2024-09-13T16:13:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T16:13:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 89744 2024-09-13T16:13:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 4, 2024-09-13T16:13:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 4, 2024-09-13T16:13:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 3040, 2024-09-13T16:13:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 448, 2024-09-13T16:13:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 2, 2024-09-13T16:13:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 1, 2024-09-13T16:13:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.002177210, 2024-09-13T16:13:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.000040464, 2024-09-13T16:13:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.002116386, 2024-09-13T16:13:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 3, 2024-09-13T16:13:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.003991792, 2024-09-13T16:13:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.001330597 2024-09-13T16:13:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-13T16:13:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 448 2024-09-13T16:13:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2024-09-13T16:13:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 0, 2024-09-13T16:13:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2024-09-13T16:13:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2024-09-13T16:13:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2024-09-13T16:13:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 148823, 2024-09-13T16:13:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 27, 2024-09-13T16:13:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 0, 2024-09-13T16:13:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 0, 2024-09-13T16:13:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2024-09-13T16:13:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2024-09-13T16:13:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 0, 2024-09-13T16:13:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 0, 2024-09-13T16:13:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2024-09-13T16:13:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 928, 2024-09-13T16:13:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 2, 2024-09-13T16:13:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2024-09-13T16:13:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2024-09-13T16:13:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-13T16:13:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-13T16:13:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-13T16:13:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-13T16:13:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 109, 2024-09-13T16:13:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 696981, 2024-09-13T16:13:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 109, 2024-09-13T16:13:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-13T16:13:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-13T16:13:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 109, 2024-09-13T16:13:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 696981, 2024-09-13T16:13:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-13T16:13:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-13T16:13:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-13T16:13:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-13T16:13:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-13T16:13:41.525 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-13T16:13:42.326 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-13T16:13:42.326 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-13T16:13:42.326 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-13T16:13:42.326 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-13T16:13:42.326 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T16:13:42.338 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T16:13:42.338 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T16:13:42.338 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:13:42.381 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T16:13:42.382 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:13:42.460 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:13:42.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.662+0000 7fe931000640 1 -- 172.21.15.86:0/3927221843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe92c0744f0 msgr2=0x7fe92c072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.662+0000 7fe931000640 1 --2- 172.21.15.86:0/3927221843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe92c0744f0 0x7fe92c072940 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009900 tx=0x7fe91c02a410 comp rx=0 tx=0).stop 2024-09-13T16:13:42.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.662+0000 7fe931000640 1 -- 172.21.15.86:0/3927221843 shutdown_connections 2024-09-13T16:13:42.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.662+0000 7fe931000640 1 --2- 172.21.15.86:0/3927221843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe92c107a20 0x7fe92c109ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.662+0000 7fe931000640 1 --2- 172.21.15.86:0/3927221843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe92c072f10 0x7fe92c073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.663+0000 7fe931000640 1 --2- 172.21.15.86:0/3927221843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe92c0744f0 0x7fe92c072940 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.663+0000 7fe931000640 1 -- 172.21.15.86:0/3927221843 >> 172.21.15.86:0/3927221843 conn(0x7fe92c0fb330 msgr2=0x7fe92c0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:42.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.663+0000 7fe931000640 1 -- 172.21.15.86:0/3927221843 shutdown_connections 2024-09-13T16:13:42.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.663+0000 7fe931000640 1 -- 172.21.15.86:0/3927221843 wait complete. 2024-09-13T16:13:42.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.664+0000 7fe931000640 1 Processor -- start 2024-09-13T16:13:42.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.664+0000 7fe931000640 1 -- start start 2024-09-13T16:13:42.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.664+0000 7fe931000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe92c072f10 0x7fe92c197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:42.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.664+0000 7fe931000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe92c0744f0 0x7fe92c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:42.666 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.664+0000 7fe931000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe92c107a20 0x7fe92c19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:42.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.664+0000 7fe931000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c19f9d0 con 0x7fe92c107a20 2024-09-13T16:13:42.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.664+0000 7fe931000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c19fb40 con 0x7fe92c0744f0 2024-09-13T16:13:42.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.664+0000 7fe931000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c19fd00 con 0x7fe92c072f10 2024-09-13T16:13:42.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.664+0000 7fe92aa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe92c0744f0 0x7fe92c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:42.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.664+0000 7fe92aa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe92c0744f0 0x7fe92c198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:55340/0 (socket says 172.21.15.86:55340) 2024-09-13T16:13:42.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.664+0000 7fe92aa00640 1 -- 172.21.15.86:0/4223122423 learned_addr learned my addr 172.21.15.86:0/4223122423 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:42.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.664+0000 7fe92b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe92c072f10 0x7fe92c197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:42.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.664+0000 7fe92be00640 1 --2- 172.21.15.86:0/4223122423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe92c107a20 0x7fe92c19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:42.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.665+0000 7fe92aa00640 1 -- 172.21.15.86:0/4223122423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe92c072f10 msgr2=0x7fe92c197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.665+0000 7fe92aa00640 1 --2- 172.21.15.86:0/4223122423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe92c072f10 0x7fe92c197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.665+0000 7fe92aa00640 1 -- 172.21.15.86:0/4223122423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe92c107a20 msgr2=0x7fe92c19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.665+0000 7fe92aa00640 1 --2- 172.21.15.86:0/4223122423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe92c107a20 0x7fe92c19f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.665+0000 7fe92aa00640 1 -- 172.21.15.86:0/4223122423 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c009560 con 0x7fe92c0744f0 2024-09-13T16:13:42.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.665+0000 7fe92aa00640 1 --2- 172.21.15.86:0/4223122423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe92c0744f0 0x7fe92c198470 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe91800d950 tx=0x7fe91800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:42.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.665+0000 7fe923e00640 1 -- 172.21.15.86:0/4223122423 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918009c30 con 0x7fe92c0744f0 2024-09-13T16:13:42.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.665+0000 7fe931000640 1 -- 172.21.15.86:0/4223122423 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92c19ffe0 con 0x7fe92c0744f0 2024-09-13T16:13:42.668 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.665+0000 7fe923e00640 1 -- 172.21.15.86:0/4223122423 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe918009d90 con 0x7fe92c0744f0 2024-09-13T16:13:42.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.665+0000 7fe923e00640 1 -- 172.21.15.86:0/4223122423 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91800f7e0 con 0x7fe92c0744f0 2024-09-13T16:13:42.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.666+0000 7fe931000640 1 -- 172.21.15.86:0/4223122423 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92c1a04b0 con 0x7fe92c0744f0 2024-09-13T16:13:42.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.667+0000 7fe931000640 1 -- 172.21.15.86:0/4223122423 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92c1067a0 con 0x7fe92c0744f0 2024-09-13T16:13:42.669 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.668+0000 7fe923e00640 1 -- 172.21.15.86:0/4223122423 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe918010ad0 con 0x7fe92c0744f0 2024-09-13T16:13:42.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.670+0000 7fe923e00640 1 --2- 172.21.15.86:0/4223122423 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe9100a1090 0x7fe9100a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:42.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.670+0000 7fe923e00640 1 -- 172.21.15.86:0/4223122423 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fe9180cc890 con 0x7fe92c0744f0 2024-09-13T16:13:42.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.670+0000 7fe92b400640 1 --2- 172.21.15.86:0/4223122423 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe9100a1090 0x7fe9100a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:42.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.671+0000 7fe92b400640 1 --2- 172.21.15.86:0/4223122423 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe9100a1090 0x7fe9100a3550 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe91c005ab0 tx=0x7fe91c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:42.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.674+0000 7fe923e00640 1 -- 172.21.15.86:0/4223122423 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe918095cb0 con 0x7fe92c0744f0 2024-09-13T16:13:42.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.863+0000 7fe931000640 1 -- 172.21.15.86:0/4223122423 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe92c10d810 con 0x7fe92c0744f0 2024-09-13T16:13:42.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:42 smithi086 ceph-mon[30379]: pgmap v465: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T16:13:42.865 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.865+0000 7fe923e00640 1 -- 172.21.15.86:0/4223122423 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24703 (secure 0 0 0) 0x7fe918017090 con 0x7fe92c0744f0 2024-09-13T16:13:42.868 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:13:42.869 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":94,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:10:00.680229+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":7}]},{"pgid":"3.19","mappings":[{"from":3,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2f","mappings":[{"from":1,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:13:42.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.867+0000 7fe931000640 1 -- 172.21.15.86:0/4223122423 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe9100a1090 msgr2=0x7fe9100a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.869 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.867+0000 7fe931000640 1 --2- 172.21.15.86:0/4223122423 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe9100a1090 0x7fe9100a3550 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe91c005ab0 tx=0x7fe91c005a20 comp rx=0 tx=0).stop 2024-09-13T16:13:42.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.867+0000 7fe931000640 1 -- 172.21.15.86:0/4223122423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe92c0744f0 msgr2=0x7fe92c198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.867+0000 7fe931000640 1 --2- 172.21.15.86:0/4223122423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe92c0744f0 0x7fe92c198470 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe91800d950 tx=0x7fe91800de10 comp rx=0 tx=0).stop 2024-09-13T16:13:42.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.867+0000 7fe931000640 1 -- 172.21.15.86:0/4223122423 shutdown_connections 2024-09-13T16:13:42.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.867+0000 7fe931000640 1 --2- 172.21.15.86:0/4223122423 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe9100a1090 0x7fe9100a3550 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.867+0000 7fe931000640 1 --2- 172.21.15.86:0/4223122423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe92c107a20 0x7fe92c19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.867+0000 7fe931000640 1 --2- 172.21.15.86:0/4223122423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe92c0744f0 0x7fe92c198470 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.867+0000 7fe931000640 1 --2- 172.21.15.86:0/4223122423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe92c072f10 0x7fe92c197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.867+0000 7fe931000640 1 -- 172.21.15.86:0/4223122423 >> 172.21.15.86:0/4223122423 conn(0x7fe92c0fb330 msgr2=0x7fe92c103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:42.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.867+0000 7fe931000640 1 -- 172.21.15.86:0/4223122423 shutdown_connections 2024-09-13T16:13:42.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:42.867+0000 7fe931000640 1 -- 172.21.15.86:0/4223122423 wait complete. 2024-09-13T16:13:42.885 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:03:27.830423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:08:07.732536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:08:08.742145+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T16:08:11.721740+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T16:13:42.885 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:13:42.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:42 smithi139 ceph-mon[35320]: pgmap v465: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T16:13:43.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:42 smithi194 ceph-mon[35694]: pgmap v465: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T16:13:43.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.049+0000 7f89c7e00640 1 -- 172.21.15.86:0/2569662104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89c80ffc30 msgr2=0x7f89c8100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.049+0000 7f89c7e00640 1 --2- 172.21.15.86:0/2569662104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89c80ffc30 0x7f89c8100030 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009900 tx=0x7f89b802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.050 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.049+0000 7f89c7e00640 1 -- 172.21.15.86:0/2569662104 shutdown_connections 2024-09-13T16:13:43.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.049+0000 7f89c7e00640 1 --2- 172.21.15.86:0/2569662104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c81017e0 0x7f89c8108070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.049+0000 7f89c7e00640 1 --2- 172.21.15.86:0/2569662104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89c8100e20 0x7f89c81012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.049+0000 7f89c7e00640 1 --2- 172.21.15.86:0/2569662104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89c80ffc30 0x7f89c8100030 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.049+0000 7f89c7e00640 1 -- 172.21.15.86:0/2569662104 >> 172.21.15.86:0/2569662104 conn(0x7f89c80fb390 msgr2=0x7f89c80fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:43.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.049+0000 7f89c7e00640 1 -- 172.21.15.86:0/2569662104 shutdown_connections 2024-09-13T16:13:43.051 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.049+0000 7f89c7e00640 1 -- 172.21.15.86:0/2569662104 wait complete. 2024-09-13T16:13:43.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.050+0000 7f89c7e00640 1 Processor -- start 2024-09-13T16:13:43.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.050+0000 7f89c7e00640 1 -- start start 2024-09-13T16:13:43.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.050+0000 7f89c7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89c80ffc30 0x7f89c8197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:43.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.050+0000 7f89c7e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89c8100e20 0x7f89c8198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:43.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.051+0000 7f89c7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c81017e0 0x7f89c819f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:43.053 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.051+0000 7f89c7e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c819f9d0 con 0x7f89c8100e20 2024-09-13T16:13:43.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.051+0000 7f89c7e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c819fb40 con 0x7f89c80ffc30 2024-09-13T16:13:43.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.051+0000 7f89c7e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c819fd00 con 0x7f89c81017e0 2024-09-13T16:13:43.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.051+0000 7f89c6000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89c8100e20 0x7f89c8198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:43.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.051+0000 7f89c6000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89c8100e20 0x7f89c8198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34722/0 (socket says 172.21.15.86:34722) 2024-09-13T16:13:43.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.051+0000 7f89c6000640 1 -- 172.21.15.86:0/4252971977 learned_addr learned my addr 172.21.15.86:0/4252971977 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:43.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.051+0000 7f89c7400640 1 --2- 172.21.15.86:0/4252971977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c81017e0 0x7f89c819f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:43.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.051+0000 7f89c6a00640 1 --2- 172.21.15.86:0/4252971977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89c80ffc30 0x7f89c8197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:43.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.051+0000 7f89c6000640 1 -- 172.21.15.86:0/4252971977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c81017e0 msgr2=0x7f89c819f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.051+0000 7f89c6000640 1 --2- 172.21.15.86:0/4252971977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c81017e0 0x7f89c819f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.051+0000 7f89c6000640 1 -- 172.21.15.86:0/4252971977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89c80ffc30 msgr2=0x7f89c8197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.051+0000 7f89c6000640 1 --2- 172.21.15.86:0/4252971977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89c80ffc30 0x7f89c8197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.051+0000 7f89c6000640 1 -- 172.21.15.86:0/4252971977 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b4009490 con 0x7f89c8100e20 2024-09-13T16:13:43.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.051+0000 7f89c6a00640 1 --2- 172.21.15.86:0/4252971977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89c80ffc30 0x7f89c8197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:13:43.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.052+0000 7f89c6000640 1 --2- 172.21.15.86:0/4252971977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89c8100e20 0x7f89c8198470 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f89b400ea60 tx=0x7f89b400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:43.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.052+0000 7f89bf400640 1 -- 172.21.15.86:0/4252971977 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b400cde0 con 0x7f89c8100e20 2024-09-13T16:13:43.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.052+0000 7f89bf400640 1 -- 172.21.15.86:0/4252971977 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f89b40035f0 con 0x7f89c8100e20 2024-09-13T16:13:43.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.052+0000 7f89c7e00640 1 -- 172.21.15.86:0/4252971977 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b8009560 con 0x7f89c8100e20 2024-09-13T16:13:43.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.052+0000 7f89bf400640 1 -- 172.21.15.86:0/4252971977 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4010690 con 0x7f89c8100e20 2024-09-13T16:13:43.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.052+0000 7f89c7e00640 1 -- 172.21.15.86:0/4252971977 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c81a02d0 con 0x7f89c8100e20 2024-09-13T16:13:43.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.053+0000 7f89c7e00640 1 -- 172.21.15.86:0/4252971977 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c8100030 con 0x7f89c8100e20 2024-09-13T16:13:43.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.055+0000 7f89bf400640 1 -- 172.21.15.86:0/4252971977 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f89b4003af0 con 0x7f89c8100e20 2024-09-13T16:13:43.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.056+0000 7f89bf400640 1 --2- 172.21.15.86:0/4252971977 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f89ac0a1090 0x7f89ac0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:43.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.056+0000 7f89bf400640 1 -- 172.21.15.86:0/4252971977 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f89b4014070 con 0x7f89c8100e20 2024-09-13T16:13:43.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.056+0000 7f89c6a00640 1 --2- 172.21.15.86:0/4252971977 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f89ac0a1090 0x7f89ac0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:43.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.057+0000 7f89c6a00640 1 --2- 172.21.15.86:0/4252971977 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f89ac0a1090 0x7f89ac0a3550 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f89b802a9e0 tx=0x7f89b8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:43.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.060+0000 7f89bf400640 1 -- 172.21.15.86:0/4252971977 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f89b40965b0 con 0x7f89c8100e20 2024-09-13T16:13:43.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.258+0000 7f89c7e00640 1 -- 172.21.15.86:0/4252971977 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89c810b890 con 0x7f89c8100e20 2024-09-13T16:13:43.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.258+0000 7f89bf400640 1 -- 172.21.15.86:0/4252971977 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89b4099bd0 con 0x7f89c8100e20 2024-09-13T16:13:43.259 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2024-09-13T16:13:43.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.261+0000 7f89c7e00640 1 -- 172.21.15.86:0/4252971977 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f89ac0a1090 msgr2=0x7f89ac0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.261+0000 7f89c7e00640 1 --2- 172.21.15.86:0/4252971977 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f89ac0a1090 0x7f89ac0a3550 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f89b802a9e0 tx=0x7f89b8000bc0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.261+0000 7f89c7e00640 1 -- 172.21.15.86:0/4252971977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89c8100e20 msgr2=0x7f89c8198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.261+0000 7f89c7e00640 1 --2- 172.21.15.86:0/4252971977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89c8100e20 0x7f89c8198470 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f89b400ea60 tx=0x7f89b400ef20 comp rx=0 tx=0).stop 2024-09-13T16:13:43.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.261+0000 7f89c7e00640 1 -- 172.21.15.86:0/4252971977 shutdown_connections 2024-09-13T16:13:43.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.261+0000 7f89c7e00640 1 --2- 172.21.15.86:0/4252971977 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f89ac0a1090 0x7f89ac0a3550 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.261+0000 7f89c7e00640 1 --2- 172.21.15.86:0/4252971977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c81017e0 0x7f89c819f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.261+0000 7f89c7e00640 1 --2- 172.21.15.86:0/4252971977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89c8100e20 0x7f89c8198470 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.261+0000 7f89c7e00640 1 --2- 172.21.15.86:0/4252971977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89c80ffc30 0x7f89c8197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.261+0000 7f89c7e00640 1 -- 172.21.15.86:0/4252971977 >> 172.21.15.86:0/4252971977 conn(0x7f89c80fb390 msgr2=0x7f89c80726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:43.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.261+0000 7f89c7e00640 1 -- 172.21.15.86:0/4252971977 shutdown_connections 2024-09-13T16:13:43.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.261+0000 7f89c7e00640 1 -- 172.21.15.86:0/4252971977 wait complete. 2024-09-13T16:13:43.278 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:13:43.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.448+0000 7f477da00640 1 -- 172.21.15.86:0/3524996823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4778103190 msgr2=0x7f4778103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.448+0000 7f477da00640 1 --2- 172.21.15.86:0/3524996823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4778103190 0x7f4778103610 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4760009900 tx=0x7f476002a410 comp rx=0 tx=0).stop 2024-09-13T16:13:43.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.448+0000 7f477da00640 1 -- 172.21.15.86:0/3524996823 shutdown_connections 2024-09-13T16:13:43.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.448+0000 7f477da00640 1 --2- 172.21.15.86:0/3524996823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4778103b50 0x7f477810a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.448+0000 7f477da00640 1 --2- 172.21.15.86:0/3524996823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4778103190 0x7f4778103610 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.448+0000 7f477da00640 1 --2- 172.21.15.86:0/3524996823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4778101fa0 0x7f47781023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.448+0000 7f477da00640 1 -- 172.21.15.86:0/3524996823 >> 172.21.15.86:0/3524996823 conn(0x7f47780fd700 msgr2=0x7f47780ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:43.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.448+0000 7f477da00640 1 -- 172.21.15.86:0/3524996823 shutdown_connections 2024-09-13T16:13:43.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.448+0000 7f477da00640 1 -- 172.21.15.86:0/3524996823 wait complete. 2024-09-13T16:13:43.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.449+0000 7f477da00640 1 Processor -- start 2024-09-13T16:13:43.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.449+0000 7f477da00640 1 -- start start 2024-09-13T16:13:43.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.449+0000 7f477da00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4778101fa0 0x7f4778198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:43.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.449+0000 7f477da00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4778103190 0x7f47781985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:43.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.449+0000 7f477da00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4778103b50 0x7f477819f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:43.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.449+0000 7f477da00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477819fb50 con 0x7f4778101fa0 2024-09-13T16:13:43.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.449+0000 7f477da00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477819fcc0 con 0x7f4778103b50 2024-09-13T16:13:43.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.449+0000 7f477da00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477819fe80 con 0x7f4778103190 2024-09-13T16:13:43.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.450+0000 7f4776a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4778101fa0 0x7f4778198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:43.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.450+0000 7f476e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4778103190 0x7f47781985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:43.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.450+0000 7f4777400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4778103b50 0x7f477819f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:43.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.450+0000 7f4776a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4778101fa0 0x7f4778198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34752/0 (socket says 172.21.15.86:34752) 2024-09-13T16:13:43.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.450+0000 7f4776a00640 1 -- 172.21.15.86:0/3486075259 learned_addr learned my addr 172.21.15.86:0/3486075259 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:43.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.450+0000 7f4777400640 1 -- 172.21.15.86:0/3486075259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4778103190 msgr2=0x7f47781985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.450+0000 7f4777400640 1 --2- 172.21.15.86:0/3486075259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4778103190 0x7f47781985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.450+0000 7f4777400640 1 -- 172.21.15.86:0/3486075259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4778101fa0 msgr2=0x7f4778198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.450+0000 7f4777400640 1 --2- 172.21.15.86:0/3486075259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4778101fa0 0x7f4778198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.450+0000 7f4777400640 1 -- 172.21.15.86:0/3486075259 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4770009840 con 0x7f4778103b50 2024-09-13T16:13:43.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.450+0000 7f4776a00640 1 --2- 172.21.15.86:0/3486075259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4778101fa0 0x7f4778198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:13:43.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.450+0000 7f4777400640 1 --2- 172.21.15.86:0/3486075259 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4778103b50 0x7f477819f610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f477000ec50 tx=0x7f477000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:43.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.451+0000 7f476fe00640 1 -- 172.21.15.86:0/3486075259 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770003b70 con 0x7f4778103b50 2024-09-13T16:13:43.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.451+0000 7f476fe00640 1 -- 172.21.15.86:0/3486075259 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f477000ce70 con 0x7f4778103b50 2024-09-13T16:13:43.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.451+0000 7f477da00640 1 -- 172.21.15.86:0/3486075259 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4760009560 con 0x7f4778103b50 2024-09-13T16:13:43.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.451+0000 7f476fe00640 1 -- 172.21.15.86:0/3486075259 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770010830 con 0x7f4778103b50 2024-09-13T16:13:43.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.451+0000 7f477da00640 1 -- 172.21.15.86:0/3486075259 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47781a04b0 con 0x7f4778103b50 2024-09-13T16:13:43.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.452+0000 7f477da00640 1 -- 172.21.15.86:0/3486075259 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4778109420 con 0x7f4778103b50 2024-09-13T16:13:43.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.454+0000 7f476fe00640 1 -- 172.21.15.86:0/3486075259 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4770004b40 con 0x7f4778103b50 2024-09-13T16:13:43.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.455+0000 7f476fe00640 1 --2- 172.21.15.86:0/3486075259 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f475c0a1110 0x7f475c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:43.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.455+0000 7f476fe00640 1 -- 172.21.15.86:0/3486075259 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f4770014070 con 0x7f4778103b50 2024-09-13T16:13:43.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.455+0000 7f4776a00640 1 --2- 172.21.15.86:0/3486075259 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f475c0a1110 0x7f475c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:43.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.456+0000 7f4776a00640 1 --2- 172.21.15.86:0/3486075259 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f475c0a1110 0x7f475c0a35d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f47680058c0 tx=0x7f4768005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:43.457 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.457+0000 7f476fe00640 1 -- 172.21.15.86:0/3486075259 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4770096ab0 con 0x7f4778103b50 2024-09-13T16:13:43.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.631+0000 7f477da00640 1 -- 172.21.15.86:0/3486075259 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4778108e90 con 0x7f4778103b50 2024-09-13T16:13:43.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.632+0000 7f476fe00640 1 -- 172.21.15.86:0/3486075259 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4770003e60 con 0x7f4778103b50 2024-09-13T16:13:43.632 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-09-13T16:13:43.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.634+0000 7f477da00640 1 -- 172.21.15.86:0/3486075259 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f475c0a1110 msgr2=0x7f475c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.634+0000 7f477da00640 1 --2- 172.21.15.86:0/3486075259 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f475c0a1110 0x7f475c0a35d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f47680058c0 tx=0x7f4768005f90 comp rx=0 tx=0).stop 2024-09-13T16:13:43.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.634+0000 7f477da00640 1 -- 172.21.15.86:0/3486075259 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4778103b50 msgr2=0x7f477819f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.634+0000 7f477da00640 1 --2- 172.21.15.86:0/3486075259 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4778103b50 0x7f477819f610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f477000ec50 tx=0x7f477000c6a0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.634+0000 7f477da00640 1 -- 172.21.15.86:0/3486075259 shutdown_connections 2024-09-13T16:13:43.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.634+0000 7f477da00640 1 --2- 172.21.15.86:0/3486075259 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f475c0a1110 0x7f475c0a35d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.634+0000 7f477da00640 1 --2- 172.21.15.86:0/3486075259 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4778103b50 0x7f477819f610 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.634+0000 7f477da00640 1 --2- 172.21.15.86:0/3486075259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4778103190 0x7f47781985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.634+0000 7f477da00640 1 --2- 172.21.15.86:0/3486075259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4778101fa0 0x7f4778198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.634+0000 7f477da00640 1 -- 172.21.15.86:0/3486075259 >> 172.21.15.86:0/3486075259 conn(0x7f47780fd700 msgr2=0x7f47781065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:43.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.634+0000 7f477da00640 1 -- 172.21.15.86:0/3486075259 shutdown_connections 2024-09-13T16:13:43.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.634+0000 7f477da00640 1 -- 172.21.15.86:0/3486075259 wait complete. 2024-09-13T16:13:43.653 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:13:43.811 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.810+0000 7f1888e00640 1 -- 172.21.15.86:0/323120340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1884101ea0 msgr2=0x7f18841022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.810+0000 7f1888e00640 1 --2- 172.21.15.86:0/323120340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1884101ea0 0x7f18841022a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1874009900 tx=0x7f187402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.811+0000 7f1888e00640 1 -- 172.21.15.86:0/323120340 shutdown_connections 2024-09-13T16:13:43.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.811+0000 7f1888e00640 1 --2- 172.21.15.86:0/323120340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1884103a40 0x7f188410a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.811+0000 7f1888e00640 1 --2- 172.21.15.86:0/323120340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1884103080 0x7f1884103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.811+0000 7f1888e00640 1 --2- 172.21.15.86:0/323120340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1884101ea0 0x7f18841022a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.811+0000 7f1888e00640 1 -- 172.21.15.86:0/323120340 >> 172.21.15.86:0/323120340 conn(0x7f18840fd650 msgr2=0x7f18840ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:43.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.811+0000 7f1888e00640 1 -- 172.21.15.86:0/323120340 shutdown_connections 2024-09-13T16:13:43.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.811+0000 7f1888e00640 1 -- 172.21.15.86:0/323120340 wait complete. 2024-09-13T16:13:43.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.812+0000 7f1888e00640 1 Processor -- start 2024-09-13T16:13:43.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.812+0000 7f1888e00640 1 -- start start 2024-09-13T16:13:43.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.812+0000 7f1888e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1884101ea0 0x7f1884197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:43.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.812+0000 7f1888e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1884103080 0x7f1884198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:43.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.812+0000 7f1888e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1884103a40 0x7f188419f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:43.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.812+0000 7f1888e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188419fad0 con 0x7f1884103080 2024-09-13T16:13:43.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.812+0000 7f1888e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188419fc40 con 0x7f1884103a40 2024-09-13T16:13:43.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.812+0000 7f1888e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188419fe00 con 0x7f1884101ea0 2024-09-13T16:13:43.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.812+0000 7f187aa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1884103080 0x7f1884198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:43.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.812+0000 7f187aa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1884103080 0x7f1884198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34784/0 (socket says 172.21.15.86:34784) 2024-09-13T16:13:43.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.812+0000 7f187aa00640 1 -- 172.21.15.86:0/3941581837 learned_addr learned my addr 172.21.15.86:0/3941581837 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:43.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.812+0000 7f1883400640 1 --2- 172.21.15.86:0/3941581837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1884101ea0 0x7f1884197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:43.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.812+0000 7f1883e00640 1 --2- 172.21.15.86:0/3941581837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1884103a40 0x7f188419f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:43.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.813+0000 7f187aa00640 1 -- 172.21.15.86:0/3941581837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1884101ea0 msgr2=0x7f1884197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.813+0000 7f187aa00640 1 --2- 172.21.15.86:0/3941581837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1884101ea0 0x7f1884197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.813+0000 7f187aa00640 1 -- 172.21.15.86:0/3941581837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1884103a40 msgr2=0x7f188419f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.813+0000 7f187aa00640 1 --2- 172.21.15.86:0/3941581837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1884103a40 0x7f188419f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.813+0000 7f187aa00640 1 -- 172.21.15.86:0/3941581837 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c009490 con 0x7f1884103080 2024-09-13T16:13:43.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.813+0000 7f187aa00640 1 --2- 172.21.15.86:0/3941581837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1884103080 0x7f1884198520 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f186c00ea60 tx=0x7f186c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:43.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.813+0000 7f1880c00640 1 -- 172.21.15.86:0/3941581837 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c00cde0 con 0x7f1884103080 2024-09-13T16:13:43.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.813+0000 7f1880c00640 1 -- 172.21.15.86:0/3941581837 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f186c0035f0 con 0x7f1884103080 2024-09-13T16:13:43.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.813+0000 7f1880c00640 1 -- 172.21.15.86:0/3941581837 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c010690 con 0x7f1884103080 2024-09-13T16:13:43.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.813+0000 7f1888e00640 1 -- 172.21.15.86:0/3941581837 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1874009560 con 0x7f1884103080 2024-09-13T16:13:43.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.813+0000 7f1888e00640 1 -- 172.21.15.86:0/3941581837 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18841a0460 con 0x7f1884103080 2024-09-13T16:13:43.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.814+0000 7f1888e00640 1 -- 172.21.15.86:0/3941581837 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1884109300 con 0x7f1884103080 2024-09-13T16:13:43.817 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.817+0000 7f1880c00640 1 -- 172.21.15.86:0/3941581837 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f186c003af0 con 0x7f1884103080 2024-09-13T16:13:43.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.818+0000 7f1880c00640 1 --2- 172.21.15.86:0/3941581837 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f18680a1110 0x7f18680a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:43.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.818+0000 7f1880c00640 1 -- 172.21.15.86:0/3941581837 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f186c014070 con 0x7f1884103080 2024-09-13T16:13:43.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.818+0000 7f1883400640 1 --2- 172.21.15.86:0/3941581837 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f18680a1110 0x7f18680a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:43.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.819+0000 7f1883400640 1 --2- 172.21.15.86:0/3941581837 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f18680a1110 0x7f18680a35d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1874009230 tx=0x7f1874005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:43.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.822+0000 7f1880c00640 1 -- 172.21.15.86:0/3941581837 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f186c096460 con 0x7f1884103080 2024-09-13T16:13:43.993 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.993+0000 7f1888e00640 1 -- 172.21.15.86:0/3941581837 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1884108d70 con 0x7f1884103080 2024-09-13T16:13:43.994 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.993+0000 7f1880c00640 1 -- 172.21.15.86:0/3941581837 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f186c099a80 con 0x7f1884103080 2024-09-13T16:13:43.994 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2024-09-13T16:13:43.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.995+0000 7f1888e00640 1 -- 172.21.15.86:0/3941581837 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f18680a1110 msgr2=0x7f18680a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.995+0000 7f1888e00640 1 --2- 172.21.15.86:0/3941581837 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f18680a1110 0x7f18680a35d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1874009230 tx=0x7f1874005a20 comp rx=0 tx=0).stop 2024-09-13T16:13:43.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.995+0000 7f1888e00640 1 -- 172.21.15.86:0/3941581837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1884103080 msgr2=0x7f1884198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.995+0000 7f1888e00640 1 --2- 172.21.15.86:0/3941581837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1884103080 0x7f1884198520 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f186c00ea60 tx=0x7f186c00ef20 comp rx=0 tx=0).stop 2024-09-13T16:13:43.996 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.995+0000 7f1888e00640 1 -- 172.21.15.86:0/3941581837 shutdown_connections 2024-09-13T16:13:43.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.995+0000 7f1888e00640 1 --2- 172.21.15.86:0/3941581837 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f18680a1110 0x7f18680a35d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.995+0000 7f1888e00640 1 --2- 172.21.15.86:0/3941581837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1884103a40 0x7f188419f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.995+0000 7f1888e00640 1 --2- 172.21.15.86:0/3941581837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1884103080 0x7f1884198520 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.995+0000 7f1888e00640 1 --2- 172.21.15.86:0/3941581837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1884101ea0 0x7f1884197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.995+0000 7f1888e00640 1 -- 172.21.15.86:0/3941581837 >> 172.21.15.86:0/3941581837 conn(0x7f18840fd650 msgr2=0x7f18841064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:43.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.995+0000 7f1888e00640 1 -- 172.21.15.86:0/3941581837 shutdown_connections 2024-09-13T16:13:43.997 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:43.995+0000 7f1888e00640 1 -- 172.21.15.86:0/3941581837 wait complete. 2024-09-13T16:13:43.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:43 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:13:43.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:43 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/4223122423' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:13:43.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:43 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/4252971977' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:13:43.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:43 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:13:43.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:43 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:13:43.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:43 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:13:43.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:43 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3486075259' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:13:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:43 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:13:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:43 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/4223122423' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:13:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:43 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/4252971977' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:13:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:43 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:13:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:43 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:13:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:43 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:13:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:43 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3486075259' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:13:44.010 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:43 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:13:44.010 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:43 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/4223122423' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:13:44.010 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:43 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/4252971977' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:13:44.010 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:43 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:13:44.010 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:43 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:13:44.010 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:43 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' 2024-09-13T16:13:44.011 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:43 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3486075259' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:13:44.013 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T16:13:44.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.172+0000 7f1199e00640 1 -- 172.21.15.86:0/767257469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1194103090 msgr2=0x7f1194105480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:44.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.172+0000 7f1199e00640 1 --2- 172.21.15.86:0/767257469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1194103090 0x7f1194105480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1180009900 tx=0x7f118002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.172+0000 7f1199e00640 1 -- 172.21.15.86:0/767257469 shutdown_connections 2024-09-13T16:13:44.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.172+0000 7f1199e00640 1 --2- 172.21.15.86:0/767257469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11941059c0 0x7f1194107e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.172+0000 7f1199e00640 1 --2- 172.21.15.86:0/767257469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1194103090 0x7f1194105480 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.172+0000 7f1199e00640 1 --2- 172.21.15.86:0/767257469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1194100760 0x7f1194102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.172+0000 7f1199e00640 1 -- 172.21.15.86:0/767257469 >> 172.21.15.86:0/767257469 conn(0x7f11940fa360 msgr2=0x7f11940fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:44.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.172+0000 7f1199e00640 1 -- 172.21.15.86:0/767257469 shutdown_connections 2024-09-13T16:13:44.173 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.172+0000 7f1199e00640 1 -- 172.21.15.86:0/767257469 wait complete. 2024-09-13T16:13:44.175 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.173+0000 7f1199e00640 1 Processor -- start 2024-09-13T16:13:44.175 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.173+0000 7f1199e00640 1 -- start start 2024-09-13T16:13:44.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.173+0000 7f1199e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1194100760 0x7f1194195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:44.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.173+0000 7f1199e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1194103090 0x7f1194196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:44.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.173+0000 7f1199e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11941059c0 0x7f119419d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:44.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.173+0000 7f1199e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119419d940 con 0x7f1194103090 2024-09-13T16:13:44.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.173+0000 7f1199e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119419dab0 con 0x7f1194100760 2024-09-13T16:13:44.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.173+0000 7f1199e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119419dc70 con 0x7f11941059c0 2024-09-13T16:13:44.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.174+0000 7f1193e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1194103090 0x7f1194196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:44.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.174+0000 7f1193e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1194103090 0x7f1194196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34808/0 (socket says 172.21.15.86:34808) 2024-09-13T16:13:44.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.174+0000 7f1193e00640 1 -- 172.21.15.86:0/3299949626 learned_addr learned my addr 172.21.15.86:0/3299949626 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:44.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.174+0000 7f1199400640 1 --2- 172.21.15.86:0/3299949626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11941059c0 0x7f119419d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:44.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.174+0000 7f1198a00640 1 --2- 172.21.15.86:0/3299949626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1194100760 0x7f1194195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:44.176 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.174+0000 7f1193e00640 1 -- 172.21.15.86:0/3299949626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11941059c0 msgr2=0x7f119419d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:44.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.174+0000 7f1193e00640 1 --2- 172.21.15.86:0/3299949626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11941059c0 0x7f119419d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.174+0000 7f1193e00640 1 -- 172.21.15.86:0/3299949626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1194100760 msgr2=0x7f1194195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:44.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.174+0000 7f1193e00640 1 --2- 172.21.15.86:0/3299949626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1194100760 0x7f1194195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.174+0000 7f1193e00640 1 -- 172.21.15.86:0/3299949626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1188009490 con 0x7f1194103090 2024-09-13T16:13:44.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.174+0000 7f1199400640 1 --2- 172.21.15.86:0/3299949626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11941059c0 0x7f119419d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:13:44.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.174+0000 7f1198a00640 1 --2- 172.21.15.86:0/3299949626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1194100760 0x7f1194195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:13:44.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.174+0000 7f1193e00640 1 --2- 172.21.15.86:0/3299949626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1194103090 0x7f1194196390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1180031510 tx=0x7f11800055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:44.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.175+0000 7f1191600640 1 -- 172.21.15.86:0/3299949626 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180004b50 con 0x7f1194103090 2024-09-13T16:13:44.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.175+0000 7f1191600640 1 -- 172.21.15.86:0/3299949626 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1180004cb0 con 0x7f1194103090 2024-09-13T16:13:44.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.175+0000 7f1199e00640 1 -- 172.21.15.86:0/3299949626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118c009840 con 0x7f1194103090 2024-09-13T16:13:44.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.175+0000 7f1191600640 1 -- 172.21.15.86:0/3299949626 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180031a70 con 0x7f1194103090 2024-09-13T16:13:44.177 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.175+0000 7f1199e00640 1 -- 172.21.15.86:0/3299949626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1180009560 con 0x7f1194103090 2024-09-13T16:13:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.176+0000 7f1199e00640 1 -- 172.21.15.86:0/3299949626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11940fbe50 con 0x7f1194103090 2024-09-13T16:13:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.178+0000 7f1191600640 1 -- 172.21.15.86:0/3299949626 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1180031bd0 con 0x7f1194103090 2024-09-13T16:13:44.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.179+0000 7f1191600640 1 --2- 172.21.15.86:0/3299949626 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f117c0a1090 0x7f117c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:44.179 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.179+0000 7f1191600640 1 -- 172.21.15.86:0/3299949626 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f11800edc30 con 0x7f1194103090 2024-09-13T16:13:44.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.179+0000 7f1198a00640 1 --2- 172.21.15.86:0/3299949626 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f117c0a1090 0x7f117c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:44.180 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.180+0000 7f1198a00640 1 --2- 172.21.15.86:0/3299949626 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f117c0a1090 0x7f117c0a3550 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1188011630 tx=0x7f1188005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:44.183 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.183+0000 7f1191600640 1 -- 172.21.15.86:0/3299949626 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f11800b6fa0 con 0x7f1194103090 2024-09-13T16:13:44.355 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.355+0000 7f1199e00640 1 -- 172.21.15.86:0/3299949626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f11940fb8c0 con 0x7f1194103090 2024-09-13T16:13:44.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.355+0000 7f1191600640 1 -- 172.21.15.86:0/3299949626 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f11800400a0 con 0x7f1194103090 2024-09-13T16:13:44.356 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2024-09-13T16:13:44.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.358+0000 7f1199e00640 1 -- 172.21.15.86:0/3299949626 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f117c0a1090 msgr2=0x7f117c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:44.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.358+0000 7f1199e00640 1 --2- 172.21.15.86:0/3299949626 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f117c0a1090 0x7f117c0a3550 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1188011630 tx=0x7f1188005f90 comp rx=0 tx=0).stop 2024-09-13T16:13:44.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.358+0000 7f1199e00640 1 -- 172.21.15.86:0/3299949626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1194103090 msgr2=0x7f1194196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:44.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.358+0000 7f1199e00640 1 --2- 172.21.15.86:0/3299949626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1194103090 0x7f1194196390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1180031510 tx=0x7f11800055a0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.358+0000 7f1199e00640 1 -- 172.21.15.86:0/3299949626 shutdown_connections 2024-09-13T16:13:44.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.358+0000 7f1199e00640 1 --2- 172.21.15.86:0/3299949626 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f117c0a1090 0x7f117c0a3550 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.358+0000 7f1199e00640 1 --2- 172.21.15.86:0/3299949626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11941059c0 0x7f119419d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.358+0000 7f1199e00640 1 --2- 172.21.15.86:0/3299949626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1194103090 0x7f1194196390 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.358+0000 7f1199e00640 1 --2- 172.21.15.86:0/3299949626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1194100760 0x7f1194195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.358+0000 7f1199e00640 1 -- 172.21.15.86:0/3299949626 >> 172.21.15.86:0/3299949626 conn(0x7f11940fa360 msgr2=0x7f11941010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:44.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.358+0000 7f1199e00640 1 -- 172.21.15.86:0/3299949626 shutdown_connections 2024-09-13T16:13:44.360 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.358+0000 7f1199e00640 1 -- 172.21.15.86:0/3299949626 wait complete. 2024-09-13T16:13:44.377 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T16:13:44.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.533+0000 7f49fd800640 1 -- 172.21.15.86:0/509701412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49f8101f90 msgr2=0x7f49f8102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:44.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.533+0000 7f49fd800640 1 --2- 172.21.15.86:0/509701412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49f8101f90 0x7f49f8102390 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009900 tx=0x7f49e802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.534+0000 7f49fd800640 1 -- 172.21.15.86:0/509701412 shutdown_connections 2024-09-13T16:13:44.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.534+0000 7f49fd800640 1 --2- 172.21.15.86:0/509701412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49f8103b40 0x7f49f810a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.534+0000 7f49fd800640 1 --2- 172.21.15.86:0/509701412 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49f8103180 0x7f49f8103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.534+0000 7f49fd800640 1 --2- 172.21.15.86:0/509701412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49f8101f90 0x7f49f8102390 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.534+0000 7f49fd800640 1 -- 172.21.15.86:0/509701412 >> 172.21.15.86:0/509701412 conn(0x7f49f80fd6d0 msgr2=0x7f49f80ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:44.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.534+0000 7f49fd800640 1 -- 172.21.15.86:0/509701412 shutdown_connections 2024-09-13T16:13:44.535 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.534+0000 7f49fd800640 1 -- 172.21.15.86:0/509701412 wait complete. 2024-09-13T16:13:44.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.535+0000 7f49fd800640 1 Processor -- start 2024-09-13T16:13:44.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.535+0000 7f49fd800640 1 -- start start 2024-09-13T16:13:44.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.535+0000 7f49fd800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49f8101f90 0x7f49f8198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:44.537 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.535+0000 7f49fd800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49f8103180 0x7f49f8198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:44.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.535+0000 7f49fd800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49f8103b40 0x7f49f819f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:44.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.535+0000 7f49fd800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f819fb20 con 0x7f49f8103180 2024-09-13T16:13:44.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.535+0000 7f49fd800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f819fc90 con 0x7f49f8103b40 2024-09-13T16:13:44.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.535+0000 7f49fd800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f819fe50 con 0x7f49f8101f90 2024-09-13T16:13:44.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.535+0000 7f49ee000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49f8103180 0x7f49f8198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:44.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.535+0000 7f49ee000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49f8103180 0x7f49f8198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34830/0 (socket says 172.21.15.86:34830) 2024-09-13T16:13:44.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.535+0000 7f49ee000640 1 -- 172.21.15.86:0/3945089553 learned_addr learned my addr 172.21.15.86:0/3945089553 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:44.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.535+0000 7f49f7400640 1 --2- 172.21.15.86:0/3945089553 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49f8103b40 0x7f49f819f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:44.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.535+0000 7f49f6a00640 1 --2- 172.21.15.86:0/3945089553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49f8101f90 0x7f49f8198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:44.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.536+0000 7f49ee000640 1 -- 172.21.15.86:0/3945089553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49f8101f90 msgr2=0x7f49f8198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:44.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.536+0000 7f49ee000640 1 --2- 172.21.15.86:0/3945089553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49f8101f90 0x7f49f8198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.536+0000 7f49ee000640 1 -- 172.21.15.86:0/3945089553 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49f8103b40 msgr2=0x7f49f819f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:44.538 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.536+0000 7f49ee000640 1 --2- 172.21.15.86:0/3945089553 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49f8103b40 0x7f49f819f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.536+0000 7f49ee000640 1 -- 172.21.15.86:0/3945089553 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e8009560 con 0x7f49f8103180 2024-09-13T16:13:44.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.536+0000 7f49ee000640 1 --2- 172.21.15.86:0/3945089553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49f8103180 0x7f49f8198570 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f49e000d950 tx=0x7f49e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:44.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.536+0000 7f49efe00640 1 -- 172.21.15.86:0/3945089553 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0009c30 con 0x7f49f8103180 2024-09-13T16:13:44.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.536+0000 7f49efe00640 1 -- 172.21.15.86:0/3945089553 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f49e0009d90 con 0x7f49f8103180 2024-09-13T16:13:44.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.536+0000 7f49fd800640 1 -- 172.21.15.86:0/3945089553 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f81a0130 con 0x7f49f8103180 2024-09-13T16:13:44.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.536+0000 7f49efe00640 1 -- 172.21.15.86:0/3945089553 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e000f7e0 con 0x7f49f8103180 2024-09-13T16:13:44.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.537+0000 7f49fd800640 1 -- 172.21.15.86:0/3945089553 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f81a0640 con 0x7f49f8103180 2024-09-13T16:13:44.539 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.538+0000 7f49fd800640 1 -- 172.21.15.86:0/3945089553 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f8109320 con 0x7f49f8103180 2024-09-13T16:13:44.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.540+0000 7f49efe00640 1 -- 172.21.15.86:0/3945089553 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f49e0010ad0 con 0x7f49f8103180 2024-09-13T16:13:44.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.541+0000 7f49efe00640 1 --2- 172.21.15.86:0/3945089553 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f49dc0a1090 0x7f49dc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:44.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.542+0000 7f49efe00640 1 -- 172.21.15.86:0/3945089553 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f49e00cc8f0 con 0x7f49f8103180 2024-09-13T16:13:44.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.542+0000 7f49f6a00640 1 --2- 172.21.15.86:0/3945089553 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f49dc0a1090 0x7f49dc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:44.543 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.542+0000 7f49f6a00640 1 --2- 172.21.15.86:0/3945089553 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f49dc0a1090 0x7f49dc0a3550 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009230 tx=0x7f49e8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:44.547 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.547+0000 7f49efe00640 1 -- 172.21.15.86:0/3945089553 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f49e0095d10 con 0x7f49f8103180 2024-09-13T16:13:44.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.743+0000 7f49fd800640 1 -- 172.21.15.86:0/3945089553 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f49f810d9f0 con 0x7f49f8103180 2024-09-13T16:13:44.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.744+0000 7f49efe00640 1 -- 172.21.15.86:0/3945089553 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v94) v1 ==== 81+0+591 (secure 0 0 0) 0x7f49e0017260 con 0x7f49f8103180 2024-09-13T16:13:44.745 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6801/3020585994 2024-09-14T16:00:59.245481+0000 2024-09-13T16:13:44.745 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6800/3020585994 2024-09-14T16:00:59.245481+0000 2024-09-13T16:13:44.745 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/3295688385 2024-09-14T16:00:32.423780+0000 2024-09-13T16:13:44.745 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/3012247455 2024-09-14T16:00:59.245481+0000 2024-09-13T16:13:44.745 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/4048858537 2024-09-14T16:00:32.423780+0000 2024-09-13T16:13:44.745 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/538861985 2024-09-14T16:00:59.245481+0000 2024-09-13T16:13:44.745 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/1103077747 2024-09-14T16:00:32.423780+0000 2024-09-13T16:13:44.745 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6801/2495317297 2024-09-14T16:00:32.423780+0000 2024-09-13T16:13:44.745 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:0/3038340163 2024-09-14T16:00:59.245481+0000 2024-09-13T16:13:44.745 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86:6800/2495317297 2024-09-14T16:00:32.423780+0000 2024-09-13T16:13:44.746 INFO:teuthology.orchestra.run.smithi086.stderr:listed 10 entries 2024-09-13T16:13:44.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.746+0000 7f49fd800640 1 -- 172.21.15.86:0/3945089553 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f49dc0a1090 msgr2=0x7f49dc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:44.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.746+0000 7f49fd800640 1 --2- 172.21.15.86:0/3945089553 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f49dc0a1090 0x7f49dc0a3550 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009230 tx=0x7f49e8005a20 comp rx=0 tx=0).stop 2024-09-13T16:13:44.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.746+0000 7f49fd800640 1 -- 172.21.15.86:0/3945089553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49f8103180 msgr2=0x7f49f8198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:44.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.746+0000 7f49fd800640 1 --2- 172.21.15.86:0/3945089553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49f8103180 0x7f49f8198570 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f49e000d950 tx=0x7f49e000de10 comp rx=0 tx=0).stop 2024-09-13T16:13:44.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.746+0000 7f49fd800640 1 -- 172.21.15.86:0/3945089553 shutdown_connections 2024-09-13T16:13:44.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.746+0000 7f49fd800640 1 --2- 172.21.15.86:0/3945089553 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f49dc0a1090 0x7f49dc0a3550 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.746+0000 7f49fd800640 1 --2- 172.21.15.86:0/3945089553 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49f8103b40 0x7f49f819f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.746+0000 7f49fd800640 1 --2- 172.21.15.86:0/3945089553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49f8103180 0x7f49f8198570 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.746+0000 7f49fd800640 1 --2- 172.21.15.86:0/3945089553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49f8101f90 0x7f49f8198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.746+0000 7f49fd800640 1 -- 172.21.15.86:0/3945089553 >> 172.21.15.86:0/3945089553 conn(0x7f49f80fd6d0 msgr2=0x7f49f81064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:44.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.746+0000 7f49fd800640 1 -- 172.21.15.86:0/3945089553 shutdown_connections 2024-09-13T16:13:44.747 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:44.746+0000 7f49fd800640 1 -- 172.21.15.86:0/3945089553 wait complete. 2024-09-13T16:13:44.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:44 smithi194 ceph-mon[35694]: pgmap v466: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T16:13:44.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:44 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3941581837' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:13:44.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:44 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3299949626' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:13:44.764 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T16:13:44.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:13:44.764 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T16:13:44.868 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T16:13:44.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:13:44.868 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T16:13:44.899 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:44 smithi139 ceph-mon[35320]: pgmap v466: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T16:13:44.899 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:44 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3941581837' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:13:44.900 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:44 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3299949626' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:13:44.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:13:44.937 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-09-13T16:13:45.003 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T16:13:45.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:13:45.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T16:13:45.051 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:44 smithi086 ceph-mon[30379]: pgmap v466: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T16:13:45.052 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:44 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3941581837' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:13:45.052 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:44 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3299949626' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:13:45.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:13:45.062 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2024-09-13T16:13:45.383 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-13T16:13:45.393 INFO:tasks.cephadm:Teardown begin 2024-09-13T16:13:45.394 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T16:13:45.394 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:13:45.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.550+0000 7fb701400640 1 -- 172.21.15.86:0/286001965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6fc105870 msgr2=0x7fb6fc107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.550+0000 7fb701400640 1 --2- 172.21.15.86:0/286001965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6fc105870 0x7fb6fc107ce0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4009ca0 tx=0x7fb6f402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.550+0000 7fb701400640 1 -- 172.21.15.86:0/286001965 shutdown_connections 2024-09-13T16:13:45.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.550+0000 7fb701400640 1 --2- 172.21.15.86:0/286001965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6fc105870 0x7fb6fc107ce0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.550+0000 7fb701400640 1 --2- 172.21.15.86:0/286001965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6fc102f40 0x7fb6fc105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.552 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.550+0000 7fb701400640 1 --2- 172.21.15.86:0/286001965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6fc100610 0x7fb6fc102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.550+0000 7fb701400640 1 -- 172.21.15.86:0/286001965 >> 172.21.15.86:0/286001965 conn(0x7fb6fc0fa1f0 msgr2=0x7fb6fc0fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:45.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.550+0000 7fb701400640 1 -- 172.21.15.86:0/286001965 shutdown_connections 2024-09-13T16:13:45.553 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.550+0000 7fb701400640 1 -- 172.21.15.86:0/286001965 wait complete. 2024-09-13T16:13:45.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.551+0000 7fb701400640 1 Processor -- start 2024-09-13T16:13:45.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.551+0000 7fb701400640 1 -- start start 2024-09-13T16:13:45.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.551+0000 7fb701400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6fc100610 0x7fb6fc197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:45.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.551+0000 7fb701400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6fc102f40 0x7fb6fc198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:45.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.551+0000 7fb701400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6fc105870 0x7fb6fc19f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:45.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.551+0000 7fb701400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc19f9c0 con 0x7fb6fc105870 2024-09-13T16:13:45.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.551+0000 7fb701400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc19fb30 con 0x7fb6fc102f40 2024-09-13T16:13:45.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.551+0000 7fb701400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc19fcf0 con 0x7fb6fc100610 2024-09-13T16:13:45.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.552+0000 7fb700a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6fc105870 0x7fb6fc19f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:45.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.552+0000 7fb6fbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6fc100610 0x7fb6fc197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:45.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.552+0000 7fb6fbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6fc100610 0x7fb6fc197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.86:37356/0 (socket says 172.21.15.86:37356) 2024-09-13T16:13:45.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.552+0000 7fb6fbe00640 1 -- 172.21.15.86:0/3697896924 learned_addr learned my addr 172.21.15.86:0/3697896924 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:45.555 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.552+0000 7fb700a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6fc105870 0x7fb6fc19f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34848/0 (socket says 172.21.15.86:34848) 2024-09-13T16:13:45.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.552+0000 7fb6fb400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6fc102f40 0x7fb6fc198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:45.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.552+0000 7fb6fbe00640 1 -- 172.21.15.86:0/3697896924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6fc102f40 msgr2=0x7fb6fc198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.552+0000 7fb6fbe00640 1 --2- 172.21.15.86:0/3697896924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6fc102f40 0x7fb6fc198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.552+0000 7fb6fbe00640 1 -- 172.21.15.86:0/3697896924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6fc105870 msgr2=0x7fb6fc19f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.552+0000 7fb6fbe00640 1 --2- 172.21.15.86:0/3697896924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6fc105870 0x7fb6fc19f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.552+0000 7fb6fbe00640 1 -- 172.21.15.86:0/3697896924 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f4009900 con 0x7fb6fc100610 2024-09-13T16:13:45.556 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.552+0000 7fb6fbe00640 1 --2- 172.21.15.86:0/3697896924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6fc100610 0x7fb6fc197ed0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00e9f0 tx=0x7fb6ec00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:45.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.553+0000 7fb6f8c00640 1 -- 172.21.15.86:0/3697896924 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec009720 con 0x7fb6fc100610 2024-09-13T16:13:45.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.553+0000 7fb6f8c00640 1 -- 172.21.15.86:0/3697896924 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb6ec00cd80 con 0x7fb6fc100610 2024-09-13T16:13:45.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.553+0000 7fb701400640 1 -- 172.21.15.86:0/3697896924 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6fc19ffd0 con 0x7fb6fc100610 2024-09-13T16:13:45.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.553+0000 7fb6f8c00640 1 -- 172.21.15.86:0/3697896924 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec010690 con 0x7fb6fc100610 2024-09-13T16:13:45.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.553+0000 7fb701400640 1 -- 172.21.15.86:0/3697896924 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6fc1a0390 con 0x7fb6fc100610 2024-09-13T16:13:45.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.554+0000 7fb701400640 1 -- 172.21.15.86:0/3697896924 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6fc107360 con 0x7fb6fc100610 2024-09-13T16:13:45.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.556+0000 7fb6f8c00640 1 -- 172.21.15.86:0/3697896924 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb6ec0046c0 con 0x7fb6fc100610 2024-09-13T16:13:45.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.557+0000 7fb6f8c00640 1 --2- 172.21.15.86:0/3697896924 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb6e00a1090 0x7fb6e00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:45.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.557+0000 7fb6f8c00640 1 -- 172.21.15.86:0/3697896924 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fb6ec014070 con 0x7fb6fc100610 2024-09-13T16:13:45.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.557+0000 7fb6fb400640 1 --2- 172.21.15.86:0/3697896924 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb6e00a1090 0x7fb6e00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:45.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.558+0000 7fb6fb400640 1 --2- 172.21.15.86:0/3697896924 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb6e00a1090 0x7fb6e00a3550 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc1993e0 tx=0x7fb6e800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:45.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.559+0000 7fb6f8c00640 1 -- 172.21.15.86:0/3697896924 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb6ec096b70 con 0x7fb6fc100610 2024-09-13T16:13:45.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.772+0000 7fb701400640 1 -- 172.21.15.86:0/3697896924 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6fc10b5c0 con 0x7fb6fc100610 2024-09-13T16:13:45.775 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.774+0000 7fb6f8c00640 1 -- 172.21.15.86:0/3697896924 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+10884 (secure 0 0 0) 0x7fb6ec09a190 con 0x7fb6fc100610 2024-09-13T16:13:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:13:45.775 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14508,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1509120923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1509120923},{"type":"v1","addr":"172.21.15.86:6839","nonce":1509120923}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6841/1971775519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":1971775519},{"type":"v1","addr":"172.21.15.86:6841","nonce":1971775519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T16:08:09.202262+0000","modified":"2024-09-13T16:12:59.562428+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24544,"mds_2":24530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/1370900762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1370900762},{"type":"v1","addr":"172.21.15.194:6835","nonce":1370900762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/2460451799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":2460451799},{"type":"v1","addr":"172.21.15.194:6837","nonce":2460451799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24530":{"gid":24530,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.139:6837/2399531832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2399531832},{"type":"v1","addr":"172.21.15.139:6837","nonce":2399531832}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6839/3799859182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3799859182},{"type":"v1","addr":"172.21.15.194:6839","nonce":3799859182}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.139:6839/3370280063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3370280063},{"type":"v1","addr":"172.21.15.139:6839","nonce":3370280063}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:13:45.776 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-09-13T16:13:45.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.776+0000 7fb701400640 1 -- 172.21.15.86:0/3697896924 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb6e00a1090 msgr2=0x7fb6e00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.776+0000 7fb701400640 1 --2- 172.21.15.86:0/3697896924 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb6e00a1090 0x7fb6e00a3550 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc1993e0 tx=0x7fb6e800b410 comp rx=0 tx=0).stop 2024-09-13T16:13:45.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.776+0000 7fb701400640 1 -- 172.21.15.86:0/3697896924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6fc100610 msgr2=0x7fb6fc197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.776+0000 7fb701400640 1 --2- 172.21.15.86:0/3697896924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6fc100610 0x7fb6fc197ed0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00e9f0 tx=0x7fb6ec00edf0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.776+0000 7fb701400640 1 -- 172.21.15.86:0/3697896924 shutdown_connections 2024-09-13T16:13:45.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.776+0000 7fb701400640 1 --2- 172.21.15.86:0/3697896924 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fb6e00a1090 0x7fb6e00a3550 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.776+0000 7fb701400640 1 --2- 172.21.15.86:0/3697896924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6fc105870 0x7fb6fc19f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.776+0000 7fb701400640 1 --2- 172.21.15.86:0/3697896924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6fc102f40 0x7fb6fc198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.776+0000 7fb701400640 1 --2- 172.21.15.86:0/3697896924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6fc100610 0x7fb6fc197ed0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.776+0000 7fb701400640 1 -- 172.21.15.86:0/3697896924 >> 172.21.15.86:0/3697896924 conn(0x7fb6fc0fa1f0 msgr2=0x7fb6fc0ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:45.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.776+0000 7fb701400640 1 -- 172.21.15.86:0/3697896924 shutdown_connections 2024-09-13T16:13:45.778 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.776+0000 7fb701400640 1 -- 172.21.15.86:0/3697896924 wait complete. 2024-09-13T16:13:45.793 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:13:45.917 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:45 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3945089553' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T16:13:45.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.946+0000 7f143f200640 1 -- 172.21.15.86:0/2192098984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14380ffda0 msgr2=0x7f14381001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.946+0000 7f143f200640 1 --2- 172.21.15.86:0/2192098984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14380ffda0 0x7f14381001a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1428009ca0 tx=0x7f142802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.948 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.946+0000 7f143f200640 1 -- 172.21.15.86:0/2192098984 shutdown_connections 2024-09-13T16:13:45.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.946+0000 7f143f200640 1 --2- 172.21.15.86:0/2192098984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1438101950 0x7f14381081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.946+0000 7f143f200640 1 --2- 172.21.15.86:0/2192098984 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1438100f90 0x7f1438101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.946+0000 7f143f200640 1 --2- 172.21.15.86:0/2192098984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14380ffda0 0x7f14381001a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.946+0000 7f143f200640 1 -- 172.21.15.86:0/2192098984 >> 172.21.15.86:0/2192098984 conn(0x7f14380fb520 msgr2=0x7f14380fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:45.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.946+0000 7f143f200640 1 -- 172.21.15.86:0/2192098984 shutdown_connections 2024-09-13T16:13:45.949 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.947+0000 7f143f200640 1 -- 172.21.15.86:0/2192098984 wait complete. 2024-09-13T16:13:45.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.947+0000 7f143f200640 1 Processor -- start 2024-09-13T16:13:45.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.948+0000 7f143f200640 1 -- start start 2024-09-13T16:13:45.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.948+0000 7f143f200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14380ffda0 0x7f1438195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:45.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.948+0000 7f143f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1438100f90 0x7f14381963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:45.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.948+0000 7f143f200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1438101950 0x7f143819d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:45.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.948+0000 7f143f200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143819d960 con 0x7f1438101950 2024-09-13T16:13:45.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.948+0000 7f143f200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143819dad0 con 0x7f14380ffda0 2024-09-13T16:13:45.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.948+0000 7f143f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143819dc90 con 0x7f1438100f90 2024-09-13T16:13:45.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.948+0000 7f143d200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1438101950 0x7f143819d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:45.951 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.948+0000 7f143d200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1438101950 0x7f143819d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34862/0 (socket says 172.21.15.86:34862) 2024-09-13T16:13:45.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.948+0000 7f143d200640 1 -- 172.21.15.86:0/4250435629 learned_addr learned my addr 172.21.15.86:0/4250435629 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:45.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.948+0000 7f1437e00640 1 --2- 172.21.15.86:0/4250435629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14380ffda0 0x7f1438195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:45.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.948+0000 7f1437400640 1 --2- 172.21.15.86:0/4250435629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1438100f90 0x7f14381963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:45.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.948+0000 7f143d200640 1 -- 172.21.15.86:0/4250435629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1438100f90 msgr2=0x7f14381963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.948+0000 7f143d200640 1 --2- 172.21.15.86:0/4250435629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1438100f90 0x7f14381963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.949+0000 7f143d200640 1 -- 172.21.15.86:0/4250435629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14380ffda0 msgr2=0x7f1438195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.949+0000 7f143d200640 1 --2- 172.21.15.86:0/4250435629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14380ffda0 0x7f1438195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.949+0000 7f143d200640 1 -- 172.21.15.86:0/4250435629 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1428009900 con 0x7f1438101950 2024-09-13T16:13:45.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.949+0000 7f143d200640 1 --2- 172.21.15.86:0/4250435629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1438101950 0x7f143819d420 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f143000e970 tx=0x7f143000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:45.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.949+0000 7f1434c00640 1 -- 172.21.15.86:0/4250435629 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430009720 con 0x7f1438101950 2024-09-13T16:13:45.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.949+0000 7f143f200640 1 -- 172.21.15.86:0/4250435629 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143819df70 con 0x7f1438101950 2024-09-13T16:13:45.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.949+0000 7f1434c00640 1 -- 172.21.15.86:0/4250435629 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1430005500 con 0x7f1438101950 2024-09-13T16:13:45.952 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.949+0000 7f1434c00640 1 -- 172.21.15.86:0/4250435629 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430010430 con 0x7f1438101950 2024-09-13T16:13:45.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.949+0000 7f143f200640 1 -- 172.21.15.86:0/4250435629 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143819e3f0 con 0x7f1438101950 2024-09-13T16:13:45.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.950+0000 7f143f200640 1 -- 172.21.15.86:0/4250435629 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1438107180 con 0x7f1438101950 2024-09-13T16:13:45.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.952+0000 7f1434c00640 1 -- 172.21.15.86:0/4250435629 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1430004fb0 con 0x7f1438101950 2024-09-13T16:13:45.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.953+0000 7f1434c00640 1 --2- 172.21.15.86:0/4250435629 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f141c0a1090 0x7f141c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:45.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.954+0000 7f1434c00640 1 -- 172.21.15.86:0/4250435629 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f1430014070 con 0x7f1438101950 2024-09-13T16:13:45.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.954+0000 7f1437e00640 1 --2- 172.21.15.86:0/4250435629 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f141c0a1090 0x7f141c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:45.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.954+0000 7f1437e00640 1 --2- 172.21.15.86:0/4250435629 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f141c0a1090 0x7f141c0a3550 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1428005e30 tx=0x7f1428030f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:45.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:45.955+0000 7f1434c00640 1 -- 172.21.15.86:0/4250435629 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1430096550 con 0x7f1438101950 2024-09-13T16:13:46.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:45 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3945089553' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T16:13:46.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:45 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3945089553' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T16:13:46.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.158+0000 7f143f200640 1 -- 172.21.15.86:0/4250435629 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f143810b7e0 con 0x7f1438101950 2024-09-13T16:13:46.160 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.159+0000 7f1434c00640 1 -- 172.21.15.86:0/4250435629 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+10884 (secure 0 0 0) 0x7f1430099b70 con 0x7f1438101950 2024-09-13T16:13:46.161 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:13:46.161 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14442,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3476661600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3476661600},{"type":"v1","addr":"172.21.15.86:6835","nonce":3476661600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14508,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1509120923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1509120923},{"type":"v1","addr":"172.21.15.86:6839","nonce":1509120923}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6841/1971775519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6840","nonce":1971775519},{"type":"v1","addr":"172.21.15.86:6841","nonce":1971775519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/750435531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":750435531},{"type":"v1","addr":"172.21.15.194:6833","nonce":750435531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/1329253837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":1329253837},{"type":"v1","addr":"172.21.15.139:6833","nonce":1329253837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/396399488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":396399488},{"type":"v1","addr":"172.21.15.86:6837","nonce":396399488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T16:08:09.202262+0000","modified":"2024-09-13T16:12:59.562428+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24544,"mds_2":24530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1036892520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1036892520},{"type":"v1","addr":"172.21.15.139:6835","nonce":1036892520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/1370900762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1370900762},{"type":"v1","addr":"172.21.15.194:6835","nonce":1370900762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/2460451799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":2460451799},{"type":"v1","addr":"172.21.15.194:6837","nonce":2460451799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24530":{"gid":24530,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.139:6837/2399531832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2399531832},{"type":"v1","addr":"172.21.15.139:6837","nonce":2399531832}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6839/3799859182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3799859182},{"type":"v1","addr":"172.21.15.194:6839","nonce":3799859182}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.139:6839/3370280063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3370280063},{"type":"v1","addr":"172.21.15.139:6839","nonce":3370280063}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:13:46.161 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 29 2024-09-13T16:13:46.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.161+0000 7f143f200640 1 -- 172.21.15.86:0/4250435629 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f141c0a1090 msgr2=0x7f141c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:46.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.161+0000 7f143f200640 1 --2- 172.21.15.86:0/4250435629 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f141c0a1090 0x7f141c0a3550 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1428005e30 tx=0x7f1428030f70 comp rx=0 tx=0).stop 2024-09-13T16:13:46.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.161+0000 7f143f200640 1 -- 172.21.15.86:0/4250435629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1438101950 msgr2=0x7f143819d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:46.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.161+0000 7f143f200640 1 --2- 172.21.15.86:0/4250435629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1438101950 0x7f143819d420 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f143000e970 tx=0x7f143000ed70 comp rx=0 tx=0).stop 2024-09-13T16:13:46.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.161+0000 7f143f200640 1 -- 172.21.15.86:0/4250435629 shutdown_connections 2024-09-13T16:13:46.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.161+0000 7f143f200640 1 --2- 172.21.15.86:0/4250435629 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f141c0a1090 0x7f141c0a3550 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.161+0000 7f143f200640 1 --2- 172.21.15.86:0/4250435629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1438101950 0x7f143819d420 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.161+0000 7f143f200640 1 --2- 172.21.15.86:0/4250435629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1438100f90 0x7f14381963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.163 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.161+0000 7f143f200640 1 --2- 172.21.15.86:0/4250435629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14380ffda0 0x7f1438195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.161+0000 7f143f200640 1 -- 172.21.15.86:0/4250435629 >> 172.21.15.86:0/4250435629 conn(0x7f14380fb520 msgr2=0x7f1438104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:46.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.161+0000 7f143f200640 1 -- 172.21.15.86:0/4250435629 shutdown_connections 2024-09-13T16:13:46.164 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.161+0000 7f143f200640 1 -- 172.21.15.86:0/4250435629 wait complete. 2024-09-13T16:13:46.179 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:13:46.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.332+0000 7f918e000640 1 -- 172.21.15.86:0/1398317484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9188100850 msgr2=0x7f9188102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:46.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.332+0000 7f918e000640 1 --2- 172.21.15.86:0/1398317484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9188100850 0x7f9188102c40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9178009900 tx=0x7f917802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.332+0000 7f918e000640 1 -- 172.21.15.86:0/1398317484 shutdown_connections 2024-09-13T16:13:46.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.332+0000 7f918e000640 1 --2- 172.21.15.86:0/1398317484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9188105ab0 0x7f9188107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.332+0000 7f918e000640 1 --2- 172.21.15.86:0/1398317484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9188103180 0x7f9188105570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.332+0000 7f918e000640 1 --2- 172.21.15.86:0/1398317484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9188100850 0x7f9188102c40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.332+0000 7f918e000640 1 -- 172.21.15.86:0/1398317484 >> 172.21.15.86:0/1398317484 conn(0x7f91880fa430 msgr2=0x7f91880fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:46.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.332+0000 7f918e000640 1 -- 172.21.15.86:0/1398317484 shutdown_connections 2024-09-13T16:13:46.335 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.332+0000 7f918e000640 1 -- 172.21.15.86:0/1398317484 wait complete. 2024-09-13T16:13:46.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.333+0000 7f918e000640 1 Processor -- start 2024-09-13T16:13:46.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.333+0000 7f918e000640 1 -- start start 2024-09-13T16:13:46.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.333+0000 7f918e000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9188100850 0x7f9188195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:46.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.333+0000 7f918e000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9188103180 0x7f9188196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:46.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.333+0000 7f918e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9188105ab0 0x7f918819d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:46.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.333+0000 7f918e000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918819d9f0 con 0x7f9188103180 2024-09-13T16:13:46.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.333+0000 7f918e000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918819db60 con 0x7f9188100850 2024-09-13T16:13:46.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.333+0000 7f918e000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918819dd20 con 0x7f9188105ab0 2024-09-13T16:13:46.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.334+0000 7f9187400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9188100850 0x7f9188195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:46.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.334+0000 7f917ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9188103180 0x7f9188196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:46.337 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.334+0000 7f9187400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9188100850 0x7f9188195f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:34814/0 (socket says 172.21.15.86:34814) 2024-09-13T16:13:46.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.334+0000 7f9187400640 1 -- 172.21.15.86:0/3258930083 learned_addr learned my addr 172.21.15.86:0/3258930083 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:46.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.334+0000 7f9187e00640 1 --2- 172.21.15.86:0/3258930083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9188105ab0 0x7f918819d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:46.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.334+0000 7f917ea00640 1 -- 172.21.15.86:0/3258930083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9188105ab0 msgr2=0x7f918819d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:46.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.334+0000 7f917ea00640 1 --2- 172.21.15.86:0/3258930083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9188105ab0 0x7f918819d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.334+0000 7f917ea00640 1 -- 172.21.15.86:0/3258930083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9188100850 msgr2=0x7f9188195f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:46.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.334+0000 7f917ea00640 1 --2- 172.21.15.86:0/3258930083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9188100850 0x7f9188195f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.334+0000 7f917ea00640 1 -- 172.21.15.86:0/3258930083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9170009490 con 0x7f9188103180 2024-09-13T16:13:46.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.334+0000 7f9187e00640 1 --2- 172.21.15.86:0/3258930083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9188105ab0 0x7f918819d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:13:46.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.334+0000 7f917ea00640 1 --2- 172.21.15.86:0/3258930083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9188103180 0x7f9188196440 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f917000e9c0 tx=0x7f917000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:46.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.335+0000 7f9184c00640 1 -- 172.21.15.86:0/3258930083 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917000cd80 con 0x7f9188103180 2024-09-13T16:13:46.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.335+0000 7f9184c00640 1 -- 172.21.15.86:0/3258930083 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f91700035f0 con 0x7f9188103180 2024-09-13T16:13:46.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.335+0000 7f918e000640 1 -- 172.21.15.86:0/3258930083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9178009560 con 0x7f9188103180 2024-09-13T16:13:46.338 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.335+0000 7f9184c00640 1 -- 172.21.15.86:0/3258930083 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170010690 con 0x7f9188103180 2024-09-13T16:13:46.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.335+0000 7f918e000640 1 -- 172.21.15.86:0/3258930083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918819e2f0 con 0x7f9188103180 2024-09-13T16:13:46.339 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.336+0000 7f918e000640 1 -- 172.21.15.86:0/3258930083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91880fbf20 con 0x7f9188103180 2024-09-13T16:13:46.340 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.338+0000 7f9184c00640 1 -- 172.21.15.86:0/3258930083 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9170003af0 con 0x7f9188103180 2024-09-13T16:13:46.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.339+0000 7f9184c00640 1 --2- 172.21.15.86:0/3258930083 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f916c0a1090 0x7f916c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:46.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.340+0000 7f9184c00640 1 -- 172.21.15.86:0/3258930083 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f9170014070 con 0x7f9188103180 2024-09-13T16:13:46.341 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.340+0000 7f9187400640 1 --2- 172.21.15.86:0/3258930083 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f916c0a1090 0x7f916c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:46.342 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.340+0000 7f9187400640 1 --2- 172.21.15.86:0/3258930083 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f916c0a1090 0x7f916c0a3550 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9178005ec0 tx=0x7f91780058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:46.345 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.343+0000 7f9184c00640 1 -- 172.21.15.86:0/3258930083 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9170096540 con 0x7f9188103180 2024-09-13T16:13:46.518 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.517+0000 7f918e000640 1 -- 172.21.15.86:0/3258930083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f918810b820 con 0x7f9188103180 2024-09-13T16:13:46.520 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.518+0000 7f9184c00640 1 -- 172.21.15.86:0/3258930083 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24703 (secure 0 0 0) 0x7f9170099b60 con 0x7f9188103180 2024-09-13T16:13:46.520 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T16:13:46.520 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":94,"fsid":"1ecdfbda-71e9-11ef-bceb-c7b262605968","created":"2024-09-13T16:00:07.737021+0000","modified":"2024-09-13T16:10:00.680229+0000","last_up_change":"2024-09-13T16:07:16.242521+0000","last_in_change":"2024-09-13T16:06:56.389232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:03:27.830423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:08:07.732536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:08:08.742145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:08:11.721740+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"12239385-09af-43d5-9d41-bd3c2a6a7c23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6803","nonce":4268534994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6805","nonce":4268534994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6809","nonce":4268534994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4268534994},{"type":"v1","addr":"172.21.15.86:6807","nonce":4268534994}]},"public_addr":"172.21.15.86:6803/4268534994","cluster_addr":"172.21.15.86:6805/4268534994","heartbeat_back_addr":"172.21.15.86:6809/4268534994","heartbeat_front_addr":"172.21.15.86:6807/4268534994","state":["exists","up"]},{"osd":1,"uuid":"ffcf9a5b-5119-4f86-9167-a0e04732f974","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6801","nonce":341901766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6803","nonce":341901766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6807","nonce":341901766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":341901766},{"type":"v1","addr":"172.21.15.139:6805","nonce":341901766}]},"public_addr":"172.21.15.139:6801/341901766","cluster_addr":"172.21.15.139:6803/341901766","heartbeat_back_addr":"172.21.15.139:6807/341901766","heartbeat_front_addr":"172.21.15.139:6805/341901766","state":["exists","up"]},{"osd":2,"uuid":"bbe88e68-9e6f-47d2-a401-ab8c02700099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6801","nonce":2776695129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6803","nonce":2776695129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6807","nonce":2776695129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2776695129},{"type":"v1","addr":"172.21.15.194:6805","nonce":2776695129}]},"public_addr":"172.21.15.194:6801/2776695129","cluster_addr":"172.21.15.194:6803/2776695129","heartbeat_back_addr":"172.21.15.194:6807/2776695129","heartbeat_front_addr":"172.21.15.194:6805/2776695129","state":["exists","up"]},{"osd":3,"uuid":"4fc18705-76a0-44bc-a402-abf53572dd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6811","nonce":942908096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6813","nonce":942908096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6817","nonce":942908096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":942908096},{"type":"v1","addr":"172.21.15.86:6815","nonce":942908096}]},"public_addr":"172.21.15.86:6811/942908096","cluster_addr":"172.21.15.86:6813/942908096","heartbeat_back_addr":"172.21.15.86:6817/942908096","heartbeat_front_addr":"172.21.15.86:6815/942908096","state":["exists","up"]},{"osd":4,"uuid":"c9e36a79-e2ce-4639-8aa0-5c231156fe58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6809","nonce":2161852608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6811","nonce":2161852608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6815","nonce":2161852608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2161852608},{"type":"v1","addr":"172.21.15.139:6813","nonce":2161852608}]},"public_addr":"172.21.15.139:6809/2161852608","cluster_addr":"172.21.15.139:6811/2161852608","heartbeat_back_addr":"172.21.15.139:6815/2161852608","heartbeat_front_addr":"172.21.15.139:6813/2161852608","state":["exists","up"]},{"osd":5,"uuid":"8564481f-4357-4cdb-ad3f-ce793ce8d590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6809","nonce":290656117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6811","nonce":290656117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6815","nonce":290656117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":290656117},{"type":"v1","addr":"172.21.15.194:6813","nonce":290656117}]},"public_addr":"172.21.15.194:6809/290656117","cluster_addr":"172.21.15.194:6811/290656117","heartbeat_back_addr":"172.21.15.194:6815/290656117","heartbeat_front_addr":"172.21.15.194:6813/290656117","state":["exists","up"]},{"osd":6,"uuid":"4b725bb8-2413-455e-bd91-56fb50a5903a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6819","nonce":2271757372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6821","nonce":2271757372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6825","nonce":2271757372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2271757372},{"type":"v1","addr":"172.21.15.86:6823","nonce":2271757372}]},"public_addr":"172.21.15.86:6819/2271757372","cluster_addr":"172.21.15.86:6821/2271757372","heartbeat_back_addr":"172.21.15.86:6825/2271757372","heartbeat_front_addr":"172.21.15.86:6823/2271757372","state":["exists","up"]},{"osd":7,"uuid":"16cd9e1d-c8b7-4aba-b735-f89cd340af5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6817","nonce":2698233714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6819","nonce":2698233714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6823","nonce":2698233714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2698233714},{"type":"v1","addr":"172.21.15.139:6821","nonce":2698233714}]},"public_addr":"172.21.15.139:6817/2698233714","cluster_addr":"172.21.15.139:6819/2698233714","heartbeat_back_addr":"172.21.15.139:6823/2698233714","heartbeat_front_addr":"172.21.15.139:6821/2698233714","state":["exists","up"]},{"osd":8,"uuid":"f925eb0e-8f3f-478d-a2f0-442d7c3a47f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6817","nonce":1203296705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6819","nonce":1203296705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6823","nonce":1203296705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1203296705},{"type":"v1","addr":"172.21.15.194:6821","nonce":1203296705}]},"public_addr":"172.21.15.194:6817/1203296705","cluster_addr":"172.21.15.194:6819/1203296705","heartbeat_back_addr":"172.21.15.194:6823/1203296705","heartbeat_front_addr":"172.21.15.194:6821/1203296705","state":["exists","up"]},{"osd":9,"uuid":"9c8594d9-50ac-433d-ba13-ad218f127bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6827","nonce":2812182980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6829","nonce":2812182980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6833","nonce":2812182980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2812182980},{"type":"v1","addr":"172.21.15.86:6831","nonce":2812182980}]},"public_addr":"172.21.15.86:6827/2812182980","cluster_addr":"172.21.15.86:6829/2812182980","heartbeat_back_addr":"172.21.15.86:6833/2812182980","heartbeat_front_addr":"172.21.15.86:6831/2812182980","state":["exists","up"]},{"osd":10,"uuid":"76100365-5171-4b49-86f5-6dafe8134186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6825","nonce":4290408323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6827","nonce":4290408323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6831","nonce":4290408323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":4290408323},{"type":"v1","addr":"172.21.15.139:6829","nonce":4290408323}]},"public_addr":"172.21.15.139:6825/4290408323","cluster_addr":"172.21.15.139:6827/4290408323","heartbeat_back_addr":"172.21.15.139:6831/4290408323","heartbeat_front_addr":"172.21.15.139:6829/4290408323","state":["exists","up"]},{"osd":11,"uuid":"fc3ff2ca-ee19-400d-90cf-3954079ab602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6825","nonce":886506943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6827","nonce":886506943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6831","nonce":886506943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":886506943},{"type":"v1","addr":"172.21.15.194:6829","nonce":886506943}]},"public_addr":"172.21.15.194:6825/886506943","cluster_addr":"172.21.15.194:6827/886506943","heartbeat_back_addr":"172.21.15.194:6831/886506943","heartbeat_front_addr":"172.21.15.194:6829/886506943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:02:39.574932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:02.729017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:24.287338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:03:52.228731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:16.255311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:04:38.968494+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:07.438623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:31.457910+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:05:55.030548+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:24.056209+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:06:49.434807+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:07:13.588255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":7}]},{"pgid":"3.19","mappings":[{"from":3,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2f","mappings":[{"from":1,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6801/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/3020585994":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/3295688385":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3012247455":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/4048858537":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/538861985":"2024-09-14T16:00:59.245481+0000","172.21.15.86:0/1103077747":"2024-09-14T16:00:32.423780+0000","172.21.15.86:6801/2495317297":"2024-09-14T16:00:32.423780+0000","172.21.15.86:0/3038340163":"2024-09-14T16:00:59.245481+0000","172.21.15.86:6800/2495317297":"2024-09-14T16:00:32.423780+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:13:46.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.521+0000 7f918e000640 1 -- 172.21.15.86:0/3258930083 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f916c0a1090 msgr2=0x7f916c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:46.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.521+0000 7f918e000640 1 --2- 172.21.15.86:0/3258930083 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f916c0a1090 0x7f916c0a3550 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9178005ec0 tx=0x7f91780058d0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.521+0000 7f918e000640 1 -- 172.21.15.86:0/3258930083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9188103180 msgr2=0x7f9188196440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:46.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.521+0000 7f918e000640 1 --2- 172.21.15.86:0/3258930083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9188103180 0x7f9188196440 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f917000e9c0 tx=0x7f917000ee80 comp rx=0 tx=0).stop 2024-09-13T16:13:46.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.521+0000 7f918e000640 1 -- 172.21.15.86:0/3258930083 shutdown_connections 2024-09-13T16:13:46.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.521+0000 7f918e000640 1 --2- 172.21.15.86:0/3258930083 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f916c0a1090 0x7f916c0a3550 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.521+0000 7f918e000640 1 --2- 172.21.15.86:0/3258930083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9188105ab0 0x7f918819d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.521+0000 7f918e000640 1 --2- 172.21.15.86:0/3258930083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9188103180 0x7f9188196440 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.521+0000 7f918e000640 1 --2- 172.21.15.86:0/3258930083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9188100850 0x7f9188195f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.521+0000 7f918e000640 1 -- 172.21.15.86:0/3258930083 >> 172.21.15.86:0/3258930083 conn(0x7f91880fa430 msgr2=0x7f91881012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:46.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.521+0000 7f918e000640 1 -- 172.21.15.86:0/3258930083 shutdown_connections 2024-09-13T16:13:46.523 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.521+0000 7f918e000640 1 -- 172.21.15.86:0/3258930083 wait complete. 2024-09-13T16:13:46.539 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T16:13:46.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.693+0000 7f2aee600640 1 -- 172.21.15.86:0/10465122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ae8101d90 msgr2=0x7f2ae8102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:46.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.693+0000 7f2aee600640 1 --2- 172.21.15.86:0/10465122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ae8101d90 0x7f2ae8102190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8009900 tx=0x7f2ad802a410 comp rx=0 tx=0).stop 2024-09-13T16:13:46.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.693+0000 7f2aee600640 1 -- 172.21.15.86:0/10465122 shutdown_connections 2024-09-13T16:13:46.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.693+0000 7f2aee600640 1 --2- 172.21.15.86:0/10465122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ae8103940 0x7f2ae810a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.693+0000 7f2aee600640 1 --2- 172.21.15.86:0/10465122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ae8102f80 0x7f2ae8103400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.693+0000 7f2aee600640 1 --2- 172.21.15.86:0/10465122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ae8101d90 0x7f2ae8102190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.693+0000 7f2aee600640 1 -- 172.21.15.86:0/10465122 >> 172.21.15.86:0/10465122 conn(0x7f2ae80fd530 msgr2=0x7f2ae80ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:46.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.693+0000 7f2aee600640 1 -- 172.21.15.86:0/10465122 shutdown_connections 2024-09-13T16:13:46.695 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.693+0000 7f2aee600640 1 -- 172.21.15.86:0/10465122 wait complete. 2024-09-13T16:13:46.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.694+0000 7f2aee600640 1 Processor -- start 2024-09-13T16:13:46.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.694+0000 7f2aee600640 1 -- start start 2024-09-13T16:13:46.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.694+0000 7f2aee600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ae8101d90 0x7f2ae8197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:46.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.694+0000 7f2aee600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ae8102f80 0x7f2ae8198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:46.697 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.694+0000 7f2aee600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ae8103940 0x7f2ae819f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:46.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.694+0000 7f2aee600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae819f900 con 0x7f2ae8101d90 2024-09-13T16:13:46.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.694+0000 7f2aee600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae819fa70 con 0x7f2ae8102f80 2024-09-13T16:13:46.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.694+0000 7f2aee600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae819fc30 con 0x7f2ae8103940 2024-09-13T16:13:46.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.694+0000 7f2aed200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ae8101d90 0x7f2ae8197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:46.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.694+0000 7f2ae7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ae8102f80 0x7f2ae8198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:46.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.694+0000 7f2aed200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ae8101d90 0x7f2ae8197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34902/0 (socket says 172.21.15.86:34902) 2024-09-13T16:13:46.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.694+0000 7f2aed200640 1 -- 172.21.15.86:0/124019642 learned_addr learned my addr 172.21.15.86:0/124019642 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:46.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.694+0000 7f2ae7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ae8102f80 0x7f2ae8198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:34832/0 (socket says 172.21.15.86:34832) 2024-09-13T16:13:46.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.694+0000 7f2aedc00640 1 --2- 172.21.15.86:0/124019642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ae8103940 0x7f2ae819f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:46.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.695+0000 7f2ae7e00640 1 -- 172.21.15.86:0/124019642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ae8103940 msgr2=0x7f2ae819f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:46.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.695+0000 7f2ae7e00640 1 --2- 172.21.15.86:0/124019642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ae8103940 0x7f2ae819f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.695+0000 7f2ae7e00640 1 -- 172.21.15.86:0/124019642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ae8101d90 msgr2=0x7f2ae8197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:46.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.695+0000 7f2ae7e00640 1 --2- 172.21.15.86:0/124019642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ae8101d90 0x7f2ae8197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.698 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.695+0000 7f2ae7e00640 1 -- 172.21.15.86:0/124019642 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad8009560 con 0x7f2ae8102f80 2024-09-13T16:13:46.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.695+0000 7f2aed200640 1 --2- 172.21.15.86:0/124019642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ae8101d90 0x7f2ae8197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:13:46.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.695+0000 7f2ae7e00640 1 --2- 172.21.15.86:0/124019642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ae8102f80 0x7f2ae8198350 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4005fd0 tx=0x7f2ad400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:46.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.695+0000 7f2ae5600640 1 -- 172.21.15.86:0/124019642 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4009c30 con 0x7f2ae8102f80 2024-09-13T16:13:46.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.695+0000 7f2ae5600640 1 -- 172.21.15.86:0/124019642 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2ad4004510 con 0x7f2ae8102f80 2024-09-13T16:13:46.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.695+0000 7f2aee600640 1 -- 172.21.15.86:0/124019642 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae819ff10 con 0x7f2ae8102f80 2024-09-13T16:13:46.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.695+0000 7f2ae5600640 1 -- 172.21.15.86:0/124019642 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4003e60 con 0x7f2ae8102f80 2024-09-13T16:13:46.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.695+0000 7f2aee600640 1 -- 172.21.15.86:0/124019642 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae81a0390 con 0x7f2ae8102f80 2024-09-13T16:13:46.699 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.696+0000 7f2aee600640 1 -- 172.21.15.86:0/124019642 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae8109270 con 0x7f2ae8102f80 2024-09-13T16:13:46.700 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.699+0000 7f2ae5600640 1 -- 172.21.15.86:0/124019642 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2ad4004000 con 0x7f2ae8102f80 2024-09-13T16:13:46.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.700+0000 7f2ae5600640 1 --2- 172.21.15.86:0/124019642 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2acc0a1090 0x7f2acc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:46.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.700+0000 7f2ae5600640 1 -- 172.21.15.86:0/124019642 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9194+0+0 (secure 0 0 0) 0x7f2ad40cc7e0 con 0x7f2ae8102f80 2024-09-13T16:13:46.701 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.700+0000 7f2aed200640 1 --2- 172.21.15.86:0/124019642 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2acc0a1090 0x7f2acc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:46.702 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.701+0000 7f2aed200640 1 --2- 172.21.15.86:0/124019642 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2acc0a1090 0x7f2acc0a3550 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8000c00 tx=0x7f2ad80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:46.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.704+0000 7f2ae5600640 1 -- 172.21.15.86:0/124019642 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2ad4095c00 con 0x7f2ae8102f80 2024-09-13T16:13:46.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:46 smithi086 ceph-mon[30379]: pgmap v467: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:13:46.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:46 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3697896924' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:13:46.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:46 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/4250435629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:13:46.865 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:46 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3258930083' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:13:46.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.907+0000 7f2aee600640 1 -- 172.21.15.86:0/124019642 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2ae810d7d0 con 0x7f2ae8102f80 2024-09-13T16:13:46.921 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.919+0000 7f2ae5600640 1 -- 172.21.15.86:0/124019642 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2ad4099220 con 0x7f2ae8102f80 2024-09-13T16:13:46.921 INFO:teuthology.orchestra.run.smithi086.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T16:13:46.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.922+0000 7f2aee600640 1 -- 172.21.15.86:0/124019642 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2acc0a1090 msgr2=0x7f2acc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:46.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.922+0000 7f2aee600640 1 --2- 172.21.15.86:0/124019642 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2acc0a1090 0x7f2acc0a3550 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8000c00 tx=0x7f2ad80058d0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.922+0000 7f2aee600640 1 -- 172.21.15.86:0/124019642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ae8102f80 msgr2=0x7f2ae8198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:46.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.922+0000 7f2aee600640 1 --2- 172.21.15.86:0/124019642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ae8102f80 0x7f2ae8198350 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4005fd0 tx=0x7f2ad400dde0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.922+0000 7f2aee600640 1 -- 172.21.15.86:0/124019642 shutdown_connections 2024-09-13T16:13:46.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.922+0000 7f2aee600640 1 --2- 172.21.15.86:0/124019642 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2acc0a1090 0x7f2acc0a3550 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.922+0000 7f2aee600640 1 --2- 172.21.15.86:0/124019642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ae8103940 0x7f2ae819f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.922+0000 7f2aee600640 1 --2- 172.21.15.86:0/124019642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ae8102f80 0x7f2ae8198350 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.924 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.922+0000 7f2aee600640 1 --2- 172.21.15.86:0/124019642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ae8101d90 0x7f2ae8197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.922+0000 7f2aee600640 1 -- 172.21.15.86:0/124019642 >> 172.21.15.86:0/124019642 conn(0x7f2ae80fd530 msgr2=0x7f2ae8106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:46.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.922+0000 7f2aee600640 1 -- 172.21.15.86:0/124019642 shutdown_connections 2024-09-13T16:13:46.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:46.922+0000 7f2aee600640 1 -- 172.21.15.86:0/124019642 wait complete. 2024-09-13T16:13:46.940 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T16:13:46.955 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:46 smithi139 ceph-mon[35320]: pgmap v467: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:13:46.955 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:46 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3697896924' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:13:46.955 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:46 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/4250435629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:13:46.955 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:46 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3258930083' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:13:46.960 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:46 smithi194 ceph-mon[35694]: pgmap v467: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:13:46.960 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:46 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3697896924' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:13:46.961 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:46 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/4250435629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:13:46.961 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:46 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3258930083' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:13:47.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.096+0000 7fe4ce000640 1 -- 172.21.15.86:0/474841930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4c80ffd70 msgr2=0x7fe4c8100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:47.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.096+0000 7fe4ce000640 1 --2- 172.21.15.86:0/474841930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4c80ffd70 0x7fe4c8100170 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009900 tx=0x7fe4b802a400 comp rx=0 tx=0).stop 2024-09-13T16:13:47.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.096+0000 7fe4ce000640 1 -- 172.21.15.86:0/474841930 shutdown_connections 2024-09-13T16:13:47.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.096+0000 7fe4ce000640 1 --2- 172.21.15.86:0/474841930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4c8101920 0x7fe4c81081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.096+0000 7fe4ce000640 1 --2- 172.21.15.86:0/474841930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4c8100f60 0x7fe4c81013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.096+0000 7fe4ce000640 1 --2- 172.21.15.86:0/474841930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4c80ffd70 0x7fe4c8100170 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.096+0000 7fe4ce000640 1 -- 172.21.15.86:0/474841930 >> 172.21.15.86:0/474841930 conn(0x7fe4c80fb4d0 msgr2=0x7fe4c80fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:47.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.096+0000 7fe4ce000640 1 -- 172.21.15.86:0/474841930 shutdown_connections 2024-09-13T16:13:47.098 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.096+0000 7fe4ce000640 1 -- 172.21.15.86:0/474841930 wait complete. 2024-09-13T16:13:47.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.097+0000 7fe4ce000640 1 Processor -- start 2024-09-13T16:13:47.100 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.097+0000 7fe4ce000640 1 -- start start 2024-09-13T16:13:47.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.097+0000 7fe4ce000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4c80ffd70 0x7fe4c8198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:47.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.097+0000 7fe4ce000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4c8100f60 0x7fe4c81985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:47.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.097+0000 7fe4ce000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4c8101920 0x7fe4c819f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:47.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.097+0000 7fe4ce000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c819fb50 con 0x7fe4c8100f60 2024-09-13T16:13:47.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.097+0000 7fe4ce000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c819fcc0 con 0x7fe4c80ffd70 2024-09-13T16:13:47.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.097+0000 7fe4ce000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c819fe80 con 0x7fe4c8101920 2024-09-13T16:13:47.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.097+0000 7fe4bfe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4c8100f60 0x7fe4c81985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:47.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.097+0000 7fe4c7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4c80ffd70 0x7fe4c8198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:47.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.098+0000 7fe4c7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4c80ffd70 0x7fe4c8198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.86:34862/0 (socket says 172.21.15.86:34862) 2024-09-13T16:13:47.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.098+0000 7fe4c7400640 1 -- 172.21.15.86:0/2095363119 learned_addr learned my addr 172.21.15.86:0/2095363119 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:47.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.098+0000 7fe4c7e00640 1 --2- 172.21.15.86:0/2095363119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4c8101920 0x7fe4c819f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:47.101 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.098+0000 7fe4c7400640 1 -- 172.21.15.86:0/2095363119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4c8101920 msgr2=0x7fe4c819f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:47.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.098+0000 7fe4c7400640 1 --2- 172.21.15.86:0/2095363119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4c8101920 0x7fe4c819f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.098+0000 7fe4c7400640 1 -- 172.21.15.86:0/2095363119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4c8100f60 msgr2=0x7fe4c81985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:47.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.098+0000 7fe4c7400640 1 --2- 172.21.15.86:0/2095363119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4c8100f60 0x7fe4c81985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.098+0000 7fe4c7400640 1 -- 172.21.15.86:0/2095363119 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b8009560 con 0x7fe4c80ffd70 2024-09-13T16:13:47.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.098+0000 7fe4bfe00640 1 --2- 172.21.15.86:0/2095363119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4c8100f60 0x7fe4c81985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:13:47.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.098+0000 7fe4c7400640 1 --2- 172.21.15.86:0/2095363119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4c80ffd70 0x7fe4c8198060 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8031510 tx=0x7fe4b80055a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:47.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.098+0000 7fe4c4c00640 1 -- 172.21.15.86:0/2095363119 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8004b50 con 0x7fe4c80ffd70 2024-09-13T16:13:47.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.099+0000 7fe4c4c00640 1 -- 172.21.15.86:0/2095363119 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe4b8004cb0 con 0x7fe4c80ffd70 2024-09-13T16:13:47.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.099+0000 7fe4ce000640 1 -- 172.21.15.86:0/2095363119 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c81a0100 con 0x7fe4c80ffd70 2024-09-13T16:13:47.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.099+0000 7fe4c4c00640 1 -- 172.21.15.86:0/2095363119 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8031ba0 con 0x7fe4c80ffd70 2024-09-13T16:13:47.102 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.099+0000 7fe4ce000640 1 -- 172.21.15.86:0/2095363119 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c81a05b0 con 0x7fe4c80ffd70 2024-09-13T16:13:47.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.100+0000 7fe4ce000640 1 -- 172.21.15.86:0/2095363119 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c810b800 con 0x7fe4c80ffd70 2024-09-13T16:13:47.103 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.102+0000 7fe4c4c00640 1 -- 172.21.15.86:0/2095363119 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe4b8031d00 con 0x7fe4c80ffd70 2024-09-13T16:13:47.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.103+0000 7fe4c4c00640 1 --2- 172.21.15.86:0/2095363119 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe4ac0a1090 0x7fe4ac0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:47.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.103+0000 7fe4c4c00640 1 -- 172.21.15.86:0/2095363119 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9452+0+0 (secure 0 0 0) 0x7fe4b80ee270 con 0x7fe4c80ffd70 2024-09-13T16:13:47.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.103+0000 7fe4bfe00640 1 --2- 172.21.15.86:0/2095363119 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe4ac0a1090 0x7fe4ac0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:47.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.104+0000 7fe4bfe00640 1 --2- 172.21.15.86:0/2095363119 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe4ac0a1090 0x7fe4ac0a3550 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8199570 tx=0x7fe4b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:47.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.104+0000 7fe4c4c00640 1 -- 172.21.15.86:0/2095363119 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe4b80b7590 con 0x7fe4c80ffd70 2024-09-13T16:13:47.248 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 13 16:13:46 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-e[64018]: ignoring --setuser ceph since I am not root 2024-09-13T16:13:47.249 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 13 16:13:46 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-e[64018]: ignoring --setgroup ceph since I am not root 2024-09-13T16:13:47.249 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 13 16:13:46 smithi139 ceph-mds[64022]: -- 172.21.15.139:0/503051759 <== mon.0 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55caf0650d00 con 0x55caf0625400 2024-09-13T16:13:47.249 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 13 16:13:46 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-e[64018]: starting mds.e at 2024-09-13T16:13:47.249 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:13:46 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-b[64629]: ignoring --setuser ceph since I am not root 2024-09-13T16:13:47.249 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:13:46 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-b[64629]: ignoring --setgroup ceph since I am not root 2024-09-13T16:13:47.249 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:13:46 smithi139 ceph-mds[64633]: -- 172.21.15.139:0/61801296 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55da99a78d00 con 0x55da99a4c800 2024-09-13T16:13:47.249 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:13:46 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-b[64629]: starting mds.b at 2024-09-13T16:13:47.250 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 13 16:13:46 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-h[64325]: ignoring --setuser ceph since I am not root 2024-09-13T16:13:47.250 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 13 16:13:46 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-h[64325]: ignoring --setgroup ceph since I am not root 2024-09-13T16:13:47.250 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 13 16:13:46 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-h[64325]: starting mds.h at 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:13:46 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-f[66128]: ignoring --setuser ceph since I am not root 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:13:46 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-f[66128]: ignoring --setgroup ceph since I am not root 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:13:46 smithi194 ceph-mds[66132]: -- 172.21.15.194:0/1337538494 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5559e5a18d00 con 0x5559e59ec800 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:13:46 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-f[66128]: starting mds.f at 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:13:46 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-i[66743]: ignoring --setuser ceph since I am not root 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:13:46 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-i[66743]: ignoring --setgroup ceph since I am not root 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:13:46 smithi194 ceph-mds[66747]: -- 172.21.15.194:0/3505303159 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562647a50d00 con 0x562647a24800 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:13:46 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-i[66743]: starting mds.i at 2024-09-13T16:13:47.256 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 13 16:13:46 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-c[66435]: ignoring --setuser ceph since I am not root 2024-09-13T16:13:47.256 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 13 16:13:46 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-c[66435]: ignoring --setgroup ceph since I am not root 2024-09-13T16:13:47.256 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 13 16:13:46 smithi194 ceph-mds[66439]: -- 172.21.15.194:0/1425160904 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b045418d00 con 0x55b0453ed000 2024-09-13T16:13:47.256 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 13 16:13:46 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-c[66435]: starting mds.c at 2024-09-13T16:13:47.312 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.310+0000 7fe4ce000640 1 -- 172.21.15.86:0/2095363119 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe4c81a0980 con 0x7fe4c80ffd70 2024-09-13T16:13:47.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:46 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-a[30375]: 2024-09-13T16:13:46.909+0000 7f7824600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T16:13:47.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.929+0000 7fe4c4c00640 1 -- 172.21.15.86:0/2095363119 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe4b80b5e60 con 0x7fe4c80ffd70 2024-09-13T16:13:47.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.932+0000 7fe4ce000640 1 -- 172.21.15.86:0/2095363119 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe4ac0a1090 msgr2=0x7fe4ac0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:47.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.932+0000 7fe4ce000640 1 --2- 172.21.15.86:0/2095363119 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe4ac0a1090 0x7fe4ac0a3550 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8199570 tx=0x7fe4b0005f90 comp rx=0 tx=0).stop 2024-09-13T16:13:47.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.932+0000 7fe4ce000640 1 -- 172.21.15.86:0/2095363119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4c80ffd70 msgr2=0x7fe4c8198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:47.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.932+0000 7fe4ce000640 1 --2- 172.21.15.86:0/2095363119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4c80ffd70 0x7fe4c8198060 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8031510 tx=0x7fe4b80055a0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.932+0000 7fe4ce000640 1 -- 172.21.15.86:0/2095363119 shutdown_connections 2024-09-13T16:13:47.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.932+0000 7fe4ce000640 1 --2- 172.21.15.86:0/2095363119 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7fe4ac0a1090 0x7fe4ac0a3550 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.932+0000 7fe4ce000640 1 --2- 172.21.15.86:0/2095363119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4c8101920 0x7fe4c819f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.932+0000 7fe4ce000640 1 --2- 172.21.15.86:0/2095363119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4c8100f60 0x7fe4c81985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.932+0000 7fe4ce000640 1 --2- 172.21.15.86:0/2095363119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4c80ffd70 0x7fe4c8198060 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.932+0000 7fe4ce000640 1 -- 172.21.15.86:0/2095363119 >> 172.21.15.86:0/2095363119 conn(0x7fe4c80fb4d0 msgr2=0x7fe4c80726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:47.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.932+0000 7fe4ce000640 1 -- 172.21.15.86:0/2095363119 shutdown_connections 2024-09-13T16:13:47.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:47.932+0000 7fe4ce000640 1 -- 172.21.15.86:0/2095363119 wait complete. 2024-09-13T16:13:47.949 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:47 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/124019642' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T16:13:47.949 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:47 smithi086 ceph-mon[30379]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T16:13:47.949 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:47 smithi086 ceph-mon[30379]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T16:13:47.949 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:47 smithi086 ceph-mon[30379]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T16:13:47.949 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:47 smithi086 ceph-mon[30379]: osdmap e95: 12 total, 12 up, 12 in 2024-09-13T16:13:47.949 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:47 smithi086 ceph-mon[30379]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T16:13:47.949 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:47 smithi086 ceph-mon[30379]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-13T16:13:47.950 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:47 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2095363119' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:13:47.950 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:47 smithi086 ceph-mon[30379]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:13:47.952 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T16:13:47.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:47 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/124019642' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T16:13:47.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:47 smithi139 ceph-mon[35320]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T16:13:47.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:47 smithi139 ceph-mon[35320]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T16:13:47.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:47 smithi139 ceph-mon[35320]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T16:13:47.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:47 smithi139 ceph-mon[35320]: osdmap e95: 12 total, 12 up, 12 in 2024-09-13T16:13:47.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:47 smithi139 ceph-mon[35320]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T16:13:47.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:47 smithi139 ceph-mon[35320]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-13T16:13:47.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:47 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2095363119' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:13:48.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:47 smithi139 ceph-mon[35320]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:13:48.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:47 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/124019642' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T16:13:48.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:47 smithi194 ceph-mon[35694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T16:13:48.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:47 smithi194 ceph-mon[35694]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T16:13:48.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:47 smithi194 ceph-mon[35694]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T16:13:48.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:47 smithi194 ceph-mon[35694]: osdmap e95: 12 total, 12 up, 12 in 2024-09-13T16:13:48.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:47 smithi194 ceph-mon[35694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T16:13:48.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:47 smithi194 ceph-mon[35694]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-13T16:13:48.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:47 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2095363119' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:13:48.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:47 smithi194 ceph-mon[35694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:13:48.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.109+0000 7f44d7000640 1 -- 172.21.15.86:0/1201299405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d0103080 msgr2=0x7f44d0103500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:48.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.109+0000 7f44d7000640 1 --2- 172.21.15.86:0/1201299405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d0103080 0x7f44d0103500 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009860 tx=0x7f44bc02a340 comp rx=0 tx=0).stop 2024-09-13T16:13:48.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.109+0000 7f44d7000640 1 -- 172.21.15.86:0/1201299405 shutdown_connections 2024-09-13T16:13:48.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.109+0000 7f44d7000640 1 --2- 172.21.15.86:0/1201299405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44d0103a40 0x7f44d010a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.109+0000 7f44d7000640 1 --2- 172.21.15.86:0/1201299405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d0103080 0x7f44d0103500 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.109+0000 7f44d7000640 1 --2- 172.21.15.86:0/1201299405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44d0101ea0 0x7f44d01022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.109+0000 7f44d7000640 1 -- 172.21.15.86:0/1201299405 >> 172.21.15.86:0/1201299405 conn(0x7f44d00fd670 msgr2=0x7f44d00ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:48.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.109+0000 7f44d7000640 1 -- 172.21.15.86:0/1201299405 shutdown_connections 2024-09-13T16:13:48.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.109+0000 7f44d7000640 1 -- 172.21.15.86:0/1201299405 wait complete. 2024-09-13T16:13:48.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.110+0000 7f44d7000640 1 Processor -- start 2024-09-13T16:13:48.113 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.110+0000 7f44d7000640 1 -- start start 2024-09-13T16:13:48.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.110+0000 7f44d7000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44d0101ea0 0x7f44d0197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:48.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.110+0000 7f44d7000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d0103080 0x7f44d01984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:48.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.110+0000 7f44d7000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44d0103a40 0x7f44d019f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:48.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.110+0000 7f44d7000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d019fa90 con 0x7f44d0103080 2024-09-13T16:13:48.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.110+0000 7f44d7000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d019fc00 con 0x7f44d0103a40 2024-09-13T16:13:48.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.110+0000 7f44d7000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d019fdc0 con 0x7f44d0101ea0 2024-09-13T16:13:48.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.110+0000 7f44d5200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d0103080 0x7f44d01984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:48.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.111+0000 7f44d5200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d0103080 0x7f44d01984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34920/0 (socket says 172.21.15.86:34920) 2024-09-13T16:13:48.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.111+0000 7f44d5200640 1 -- 172.21.15.86:0/3556379311 learned_addr learned my addr 172.21.15.86:0/3556379311 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:48.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.111+0000 7f44d6600640 1 --2- 172.21.15.86:0/3556379311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44d0103a40 0x7f44d019f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:48.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.111+0000 7f44d5c00640 1 --2- 172.21.15.86:0/3556379311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44d0101ea0 0x7f44d0197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:48.114 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.111+0000 7f44d5200640 1 -- 172.21.15.86:0/3556379311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44d0101ea0 msgr2=0x7f44d0197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:48.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.111+0000 7f44d5200640 1 --2- 172.21.15.86:0/3556379311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44d0101ea0 0x7f44d0197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.111+0000 7f44d5200640 1 -- 172.21.15.86:0/3556379311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44d0103a40 msgr2=0x7f44d019f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:48.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.111+0000 7f44d5200640 1 --2- 172.21.15.86:0/3556379311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44d0103a40 0x7f44d019f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.111+0000 7f44d5200640 1 -- 172.21.15.86:0/3556379311 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc009490 con 0x7f44d0103080 2024-09-13T16:13:48.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.111+0000 7f44d5200640 1 --2- 172.21.15.86:0/3556379311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d0103080 0x7f44d01984e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f44bc030590 tx=0x7f44bc0326f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:48.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.111+0000 7f44ce000640 1 -- 172.21.15.86:0/3556379311 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc03f070 con 0x7f44d0103080 2024-09-13T16:13:48.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.112+0000 7f44d7000640 1 -- 172.21.15.86:0/3556379311 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d01a0040 con 0x7f44d0103080 2024-09-13T16:13:48.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.112+0000 7f44ce000640 1 -- 172.21.15.86:0/3556379311 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f44bc030340 con 0x7f44d0103080 2024-09-13T16:13:48.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.112+0000 7f44ce000640 1 -- 172.21.15.86:0/3556379311 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc005590 con 0x7f44d0103080 2024-09-13T16:13:48.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.112+0000 7f44d7000640 1 -- 172.21.15.86:0/3556379311 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d01a0490 con 0x7f44d0103080 2024-09-13T16:13:48.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.113+0000 7f44d7000640 1 -- 172.21.15.86:0/3556379311 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d01093d0 con 0x7f44d0103080 2024-09-13T16:13:48.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.114+0000 7f44ce000640 1 -- 172.21.15.86:0/3556379311 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f44bc039040 con 0x7f44d0103080 2024-09-13T16:13:48.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.116+0000 7f44ce000640 1 --2- 172.21.15.86:0/3556379311 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f44b80a1090 0x7f44b80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:48.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.116+0000 7f44ce000640 1 -- 172.21.15.86:0/3556379311 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9452+0+0 (secure 0 0 0) 0x7f44bc0ecbd0 con 0x7f44d0103080 2024-09-13T16:13:48.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.116+0000 7f44d5c00640 1 --2- 172.21.15.86:0/3556379311 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f44b80a1090 0x7f44b80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:48.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.117+0000 7f44d5c00640 1 --2- 172.21.15.86:0/3556379311 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f44b80a1090 0x7f44b80a3550 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f44d0102bf0 tx=0x7f44c4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:48.121 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.119+0000 7f44ce000640 1 -- 172.21.15.86:0/3556379311 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f44bc0b5e40 con 0x7f44d0103080 2024-09-13T16:13:48.292 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.289+0000 7f44d7000640 1 -- 172.21.15.86:0/3556379311 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f44d0108e40 con 0x7f44d0103080 2024-09-13T16:13:48.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.929+0000 7f44ce000640 1 -- 172.21.15.86:0/3556379311 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v96) v1 ==== 181+0+0 (secure 0 0 0) 0x7f44bc0370d0 con 0x7f44d0103080 2024-09-13T16:13:48.932 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' removed 2024-09-13T16:13:48.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.933+0000 7f44d7000640 1 -- 172.21.15.86:0/3556379311 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f44b80a1090 msgr2=0x7f44b80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:48.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.933+0000 7f44d7000640 1 --2- 172.21.15.86:0/3556379311 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f44b80a1090 0x7f44b80a3550 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f44d0102bf0 tx=0x7f44c4009260 comp rx=0 tx=0).stop 2024-09-13T16:13:48.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.933+0000 7f44d7000640 1 -- 172.21.15.86:0/3556379311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d0103080 msgr2=0x7f44d01984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:48.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.933+0000 7f44d7000640 1 --2- 172.21.15.86:0/3556379311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d0103080 0x7f44d01984e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f44bc030590 tx=0x7f44bc0326f0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.933+0000 7f44d7000640 1 -- 172.21.15.86:0/3556379311 shutdown_connections 2024-09-13T16:13:48.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.933+0000 7f44d7000640 1 --2- 172.21.15.86:0/3556379311 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f44b80a1090 0x7f44b80a3550 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.933+0000 7f44d7000640 1 --2- 172.21.15.86:0/3556379311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44d0103a40 0x7f44d019f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.933+0000 7f44d7000640 1 --2- 172.21.15.86:0/3556379311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d0103080 0x7f44d01984e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.933+0000 7f44d7000640 1 --2- 172.21.15.86:0/3556379311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44d0101ea0 0x7f44d0197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.933+0000 7f44d7000640 1 -- 172.21.15.86:0/3556379311 >> 172.21.15.86:0/3556379311 conn(0x7f44d00fd670 msgr2=0x7f44d01065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:48.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.933+0000 7f44d7000640 1 -- 172.21.15.86:0/3556379311 shutdown_connections 2024-09-13T16:13:48.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:48.933+0000 7f44d7000640 1 -- 172.21.15.86:0/3556379311 wait complete. 2024-09-13T16:13:48.950 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: pgmap v469: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-13T16:13:48.951 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T16:13:48.951 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T16:13:48.951 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: Cluster is now healthy 2024-09-13T16:13:48.951 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.139:6834/1850054371,v1:172.21.15.139:6835/1850054371] up:boot 2024-09-13T16:13:48.951 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.139:6836/2954299094,v1:172.21.15.139:6837/2954299094] up:boot 2024-09-13T16:13:48.951 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.194:6834/1674755609,v1:172.21.15.194:6835/1674755609] up:boot 2024-09-13T16:13:48.951 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.194:6837/3394413210,v1:172.21.15.194:6839/3394413210] up:boot 2024-09-13T16:13:48.951 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.194:6836/2423768179,v1:172.21.15.194:6838/2423768179] up:boot 2024-09-13T16:13:48.951 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: mds.? [v2:172.21.15.139:6838/1895294815,v1:172.21.15.139:6839/1895294815] up:boot 2024-09-13T16:13:48.951 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-13T16:13:48.951 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: fsmap 12 up:standby 2024-09-13T16:13:48.951 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T16:13:48.952 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T16:13:48.952 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T16:13:48.952 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T16:13:48.952 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T16:13:48.952 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T16:13:48.952 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:48 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3556379311' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:48.953 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T16:13:48.998 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: pgmap v469: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-13T16:13:48.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T16:13:48.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T16:13:48.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: Cluster is now healthy 2024-09-13T16:13:48.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.139:6834/1850054371,v1:172.21.15.139:6835/1850054371] up:boot 2024-09-13T16:13:48.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.139:6836/2954299094,v1:172.21.15.139:6837/2954299094] up:boot 2024-09-13T16:13:48.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.194:6834/1674755609,v1:172.21.15.194:6835/1674755609] up:boot 2024-09-13T16:13:48.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.194:6837/3394413210,v1:172.21.15.194:6839/3394413210] up:boot 2024-09-13T16:13:48.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.194:6836/2423768179,v1:172.21.15.194:6838/2423768179] up:boot 2024-09-13T16:13:48.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: mds.? [v2:172.21.15.139:6838/1895294815,v1:172.21.15.139:6839/1895294815] up:boot 2024-09-13T16:13:48.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-13T16:13:48.999 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: fsmap 12 up:standby 2024-09-13T16:13:49.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T16:13:49.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T16:13:49.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T16:13:49.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T16:13:49.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T16:13:49.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T16:13:49.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:48 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3556379311' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:49.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: pgmap v469: 129 pgs: 129 active+clean; 15 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-13T16:13:49.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T16:13:49.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T16:13:49.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: Cluster is now healthy 2024-09-13T16:13:49.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.139:6834/1850054371,v1:172.21.15.139:6835/1850054371] up:boot 2024-09-13T16:13:49.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.139:6836/2954299094,v1:172.21.15.139:6837/2954299094] up:boot 2024-09-13T16:13:49.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.194:6834/1674755609,v1:172.21.15.194:6835/1674755609] up:boot 2024-09-13T16:13:49.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.194:6837/3394413210,v1:172.21.15.194:6839/3394413210] up:boot 2024-09-13T16:13:49.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.194:6836/2423768179,v1:172.21.15.194:6838/2423768179] up:boot 2024-09-13T16:13:49.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: mds.? [v2:172.21.15.139:6838/1895294815,v1:172.21.15.139:6839/1895294815] up:boot 2024-09-13T16:13:49.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-13T16:13:49.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: fsmap 12 up:standby 2024-09-13T16:13:49.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T16:13:49.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T16:13:49.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T16:13:49.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T16:13:49.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T16:13:49.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: from='mgr.14150 172.21.15.86:0/2512395574' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T16:13:49.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:48 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3556379311' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:49.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.113+0000 7f1845000640 1 -- 172.21.15.86:0/1054466503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1840100ed0 msgr2=0x7f1840101350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:49.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.113+0000 7f1845000640 1 --2- 172.21.15.86:0/1054466503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1840100ed0 0x7f1840101350 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f182c009900 tx=0x7f182c02a410 comp rx=0 tx=0).stop 2024-09-13T16:13:49.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.113+0000 7f1845000640 1 -- 172.21.15.86:0/1054466503 shutdown_connections 2024-09-13T16:13:49.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.113+0000 7f1845000640 1 --2- 172.21.15.86:0/1054466503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1840101890 0x7f1840108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.113+0000 7f1845000640 1 --2- 172.21.15.86:0/1054466503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1840100ed0 0x7f1840101350 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.113+0000 7f1845000640 1 --2- 172.21.15.86:0/1054466503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18400ffce0 0x7f18401000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.113+0000 7f1845000640 1 -- 172.21.15.86:0/1054466503 >> 172.21.15.86:0/1054466503 conn(0x7f18400fb440 msgr2=0x7f18400fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:49.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.113+0000 7f1845000640 1 -- 172.21.15.86:0/1054466503 shutdown_connections 2024-09-13T16:13:49.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.113+0000 7f1845000640 1 -- 172.21.15.86:0/1054466503 wait complete. 2024-09-13T16:13:49.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.114+0000 7f1845000640 1 Processor -- start 2024-09-13T16:13:49.117 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.114+0000 7f1845000640 1 -- start start 2024-09-13T16:13:49.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.114+0000 7f1845000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18400ffce0 0x7f1840195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:49.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.114+0000 7f1845000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1840100ed0 0x7f1840196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:49.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.114+0000 7f1845000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1840101890 0x7f184019d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:49.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.114+0000 7f1845000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184019d8c0 con 0x7f1840100ed0 2024-09-13T16:13:49.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.114+0000 7f1845000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184019da30 con 0x7f1840101890 2024-09-13T16:13:49.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.114+0000 7f1845000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184019dbf0 con 0x7f18400ffce0 2024-09-13T16:13:49.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.114+0000 7f183ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1840100ed0 0x7f1840196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:49.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.114+0000 7f183fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1840101890 0x7f184019d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:49.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.114+0000 7f183ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1840100ed0 0x7f1840196310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34930/0 (socket says 172.21.15.86:34930) 2024-09-13T16:13:49.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.114+0000 7f183ea00640 1 -- 172.21.15.86:0/2501196681 learned_addr learned my addr 172.21.15.86:0/2501196681 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:49.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.114+0000 7f183f400640 1 --2- 172.21.15.86:0/2501196681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18400ffce0 0x7f1840195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:49.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.115+0000 7f183fe00640 1 -- 172.21.15.86:0/2501196681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18400ffce0 msgr2=0x7f1840195dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:49.118 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.115+0000 7f183fe00640 1 --2- 172.21.15.86:0/2501196681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18400ffce0 0x7f1840195dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.115+0000 7f183fe00640 1 -- 172.21.15.86:0/2501196681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1840100ed0 msgr2=0x7f1840196310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:49.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.115+0000 7f183fe00640 1 --2- 172.21.15.86:0/2501196681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1840100ed0 0x7f1840196310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.115+0000 7f183fe00640 1 -- 172.21.15.86:0/2501196681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c009560 con 0x7f1840101890 2024-09-13T16:13:49.119 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.115+0000 7f183fe00640 1 --2- 172.21.15.86:0/2501196681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1840101890 0x7f184019d380 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1838009fd0 tx=0x7f183800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:49.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.115+0000 7f1837e00640 1 -- 172.21.15.86:0/2501196681 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183800ce20 con 0x7f1840101890 2024-09-13T16:13:49.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.115+0000 7f1837e00640 1 -- 172.21.15.86:0/2501196681 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1838005020 con 0x7f1840101890 2024-09-13T16:13:49.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.115+0000 7f1845000640 1 -- 172.21.15.86:0/2501196681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184019ded0 con 0x7f1840101890 2024-09-13T16:13:49.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.115+0000 7f1837e00640 1 -- 172.21.15.86:0/2501196681 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1838010690 con 0x7f1840101890 2024-09-13T16:13:49.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.116+0000 7f1845000640 1 -- 172.21.15.86:0/2501196681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184019e350 con 0x7f1840101890 2024-09-13T16:13:49.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.116+0000 7f1845000640 1 -- 172.21.15.86:0/2501196681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1840107120 con 0x7f1840101890 2024-09-13T16:13:49.120 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.119+0000 7f1837e00640 1 -- 172.21.15.86:0/2501196681 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1838005500 con 0x7f1840101890 2024-09-13T16:13:49.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.120+0000 7f1837e00640 1 --2- 172.21.15.86:0/2501196681 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f18240a1090 0x7f18240a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:49.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.120+0000 7f1837e00640 1 -- 172.21.15.86:0/2501196681 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8927+0+0 (secure 0 0 0) 0x7f1838014070 con 0x7f1840101890 2024-09-13T16:13:49.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.120+0000 7f183f400640 1 --2- 172.21.15.86:0/2501196681 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f18240a1090 0x7f18240a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:49.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.121+0000 7f183f400640 1 --2- 172.21.15.86:0/2501196681 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f18240a1090 0x7f18240a3550 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1840100d30 tx=0x7f1830005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:49.123 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.122+0000 7f1837e00640 1 -- 172.21.15.86:0/2501196681 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1838096720 con 0x7f1840101890 2024-09-13T16:13:49.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.306+0000 7f1845000640 1 -- 172.21.15.86:0/2501196681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f184010b770 con 0x7f1840101890 2024-09-13T16:13:49.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.938+0000 7f1837e00640 1 -- 172.21.15.86:0/2501196681 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v97) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1838005190 con 0x7f1840101890 2024-09-13T16:13:49.941 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' removed 2024-09-13T16:13:49.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.942+0000 7f1845000640 1 -- 172.21.15.86:0/2501196681 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f18240a1090 msgr2=0x7f18240a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:49.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.942+0000 7f1845000640 1 --2- 172.21.15.86:0/2501196681 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f18240a1090 0x7f18240a3550 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1840100d30 tx=0x7f1830005f90 comp rx=0 tx=0).stop 2024-09-13T16:13:49.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.942+0000 7f1845000640 1 -- 172.21.15.86:0/2501196681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1840101890 msgr2=0x7f184019d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:49.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.942+0000 7f1845000640 1 --2- 172.21.15.86:0/2501196681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1840101890 0x7f184019d380 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1838009fd0 tx=0x7f183800ef10 comp rx=0 tx=0).stop 2024-09-13T16:13:49.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.942+0000 7f1845000640 1 -- 172.21.15.86:0/2501196681 shutdown_connections 2024-09-13T16:13:49.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.942+0000 7f1845000640 1 --2- 172.21.15.86:0/2501196681 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f18240a1090 0x7f18240a3550 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.942+0000 7f1845000640 1 --2- 172.21.15.86:0/2501196681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1840101890 0x7f184019d380 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.942+0000 7f1845000640 1 --2- 172.21.15.86:0/2501196681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1840100ed0 0x7f1840196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.945 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.942+0000 7f1845000640 1 --2- 172.21.15.86:0/2501196681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18400ffce0 0x7f1840195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.942+0000 7f1845000640 1 -- 172.21.15.86:0/2501196681 >> 172.21.15.86:0/2501196681 conn(0x7f18400fb440 msgr2=0x7f18401042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:49.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.943+0000 7f1845000640 1 -- 172.21.15.86:0/2501196681 shutdown_connections 2024-09-13T16:13:49.947 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:49.943+0000 7f1845000640 1 -- 172.21.15.86:0/2501196681 wait complete. 2024-09-13T16:13:49.963 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-13T16:13:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.124+0000 7f3011400640 1 -- 172.21.15.86:0/2888724255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f300c074490 msgr2=0x7f300c0728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.124+0000 7f3011400640 1 --2- 172.21.15.86:0/2888724255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f300c074490 0x7f300c0728e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009900 tx=0x7f2ffc02a480 comp rx=0 tx=0).stop 2024-09-13T16:13:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.125+0000 7f3011400640 1 -- 172.21.15.86:0/2888724255 shutdown_connections 2024-09-13T16:13:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.125+0000 7f3011400640 1 --2- 172.21.15.86:0/2888724255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f300c107c00 0x7f300c10a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.125+0000 7f3011400640 1 --2- 172.21.15.86:0/2888724255 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f300c072eb0 0x7f300c073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.125+0000 7f3011400640 1 --2- 172.21.15.86:0/2888724255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f300c074490 0x7f300c0728e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.125+0000 7f3011400640 1 -- 172.21.15.86:0/2888724255 >> 172.21.15.86:0/2888724255 conn(0x7f300c0fb4d0 msgr2=0x7f300c0fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.125+0000 7f3011400640 1 -- 172.21.15.86:0/2888724255 shutdown_connections 2024-09-13T16:13:50.127 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.125+0000 7f3011400640 1 -- 172.21.15.86:0/2888724255 wait complete. 2024-09-13T16:13:50.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.126+0000 7f3011400640 1 Processor -- start 2024-09-13T16:13:50.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.126+0000 7f3011400640 1 -- start start 2024-09-13T16:13:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.126+0000 7f3011400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f300c072eb0 0x7f300c198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.126+0000 7f3011400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f300c074490 0x7f300c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.126+0000 7f3011400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f300c107c00 0x7f300c19f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.126+0000 7f3011400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c19fb50 con 0x7f300c074490 2024-09-13T16:13:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.126+0000 7f3011400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c19fcc0 con 0x7f300c072eb0 2024-09-13T16:13:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.126+0000 7f3011400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c19fe80 con 0x7f300c107c00 2024-09-13T16:13:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.126+0000 7f3001e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f300c074490 0x7f300c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.126+0000 7f3001e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f300c074490 0x7f300c1985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34952/0 (socket says 172.21.15.86:34952) 2024-09-13T16:13:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.126+0000 7f3001e00640 1 -- 172.21.15.86:0/2405662258 learned_addr learned my addr 172.21.15.86:0/2405662258 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T16:13:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.126+0000 7f300a800640 1 --2- 172.21.15.86:0/2405662258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f300c072eb0 0x7f300c198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.126+0000 7f300b200640 1 --2- 172.21.15.86:0/2405662258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f300c107c00 0x7f300c19f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:50.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.127+0000 7f3001e00640 1 -- 172.21.15.86:0/2405662258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f300c107c00 msgr2=0x7f300c19f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.127+0000 7f3001e00640 1 --2- 172.21.15.86:0/2405662258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f300c107c00 0x7f300c19f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.127+0000 7f3001e00640 1 -- 172.21.15.86:0/2405662258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f300c072eb0 msgr2=0x7f300c198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.127+0000 7f3001e00640 1 --2- 172.21.15.86:0/2405662258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f300c072eb0 0x7f300c198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.127+0000 7f3001e00640 1 -- 172.21.15.86:0/2405662258 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc009560 con 0x7f300c074490 2024-09-13T16:13:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.127+0000 7f3001e00640 1 --2- 172.21.15.86:0/2405662258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f300c074490 0x7f300c1985a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400e9f0 tx=0x7f2ff400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.127+0000 7f3003e00640 1 -- 172.21.15.86:0/2405662258 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4009700 con 0x7f300c074490 2024-09-13T16:13:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.127+0000 7f3003e00640 1 -- 172.21.15.86:0/2405662258 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2ff400cd80 con 0x7f300c074490 2024-09-13T16:13:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.127+0000 7f3011400640 1 -- 172.21.15.86:0/2405662258 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300c1a0160 con 0x7f300c074490 2024-09-13T16:13:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.127+0000 7f3003e00640 1 -- 172.21.15.86:0/2405662258 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4018920 con 0x7f300c074490 2024-09-13T16:13:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.127+0000 7f3011400640 1 -- 172.21.15.86:0/2405662258 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300c1a0670 con 0x7f300c074490 2024-09-13T16:13:50.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.128+0000 7f3011400640 1 -- 172.21.15.86:0/2405662258 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300c1069c0 con 0x7f300c074490 2024-09-13T16:13:50.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.131+0000 7f3003e00640 1 -- 172.21.15.86:0/2405662258 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2ff4018a80 con 0x7f300c074490 2024-09-13T16:13:50.134 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.133+0000 7f3003e00640 1 --2- 172.21.15.86:0/2405662258 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2ff00a1090 0x7f2ff00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:50.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.133+0000 7f3003e00640 1 -- 172.21.15.86:0/2405662258 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8252+0+0 (secure 0 0 0) 0x7f2ff4014070 con 0x7f300c074490 2024-09-13T16:13:50.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.133+0000 7f300a800640 1 --2- 172.21.15.86:0/2405662258 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2ff00a1090 0x7f2ff00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:50.135 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.134+0000 7f300a800640 1 --2- 172.21.15.86:0/2405662258 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2ff00a1090 0x7f2ff00a3550 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc031510 tx=0x7f2ffc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:50.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.135+0000 7f3003e00640 1 -- 172.21.15.86:0/2405662258 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2ff40968d0 con 0x7f300c074490 2024-09-13T16:13:50.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:49 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/3556379311' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T16:13:50.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:49 smithi139 ceph-mon[35320]: osdmap e96: 12 total, 12 up, 12 in 2024-09-13T16:13:50.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:49 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2501196681' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:50.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:49 smithi139 ceph-mon[35320]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:50.249 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:49 smithi139 ceph-mon[35320]: pgmap v471: 97 pgs: 97 active+clean; 577 KiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:13:50.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:49 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/3556379311' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T16:13:50.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:49 smithi194 ceph-mon[35694]: osdmap e96: 12 total, 12 up, 12 in 2024-09-13T16:13:50.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:49 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2501196681' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:50.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:49 smithi194 ceph-mon[35694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:50.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:49 smithi194 ceph-mon[35694]: pgmap v471: 97 pgs: 97 active+clean; 577 KiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:13:50.308 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.307+0000 7f3011400640 1 -- 172.21.15.86:0/2405662258 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f300c10d990 con 0x7f300c074490 2024-09-13T16:13:50.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:49 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/3556379311' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T16:13:50.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:49 smithi086 ceph-mon[30379]: osdmap e96: 12 total, 12 up, 12 in 2024-09-13T16:13:50.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:49 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2501196681' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:50.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:49 smithi086 ceph-mon[30379]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:50.365 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:49 smithi086 ceph-mon[30379]: pgmap v471: 97 pgs: 97 active+clean; 577 KiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:13:50.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.937+0000 7f3003e00640 1 -- 172.21.15.86:0/2405662258 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v98) v1 ==== 178+0+0 (secure 0 0 0) 0x7f2ff4099ef0 con 0x7f300c074490 2024-09-13T16:13:50.940 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data_ec' removed 2024-09-13T16:13:50.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.941+0000 7f3011400640 1 -- 172.21.15.86:0/2405662258 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2ff00a1090 msgr2=0x7f2ff00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:50.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.941+0000 7f3011400640 1 --2- 172.21.15.86:0/2405662258 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2ff00a1090 0x7f2ff00a3550 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc031510 tx=0x7f2ffc0058d0 comp rx=0 tx=0).stop 2024-09-13T16:13:50.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.941+0000 7f3011400640 1 -- 172.21.15.86:0/2405662258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f300c074490 msgr2=0x7f300c1985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:50.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.941+0000 7f3011400640 1 --2- 172.21.15.86:0/2405662258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f300c074490 0x7f300c1985a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400e9f0 tx=0x7f2ff400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:13:50.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.942+0000 7f3011400640 1 -- 172.21.15.86:0/2405662258 shutdown_connections 2024-09-13T16:13:50.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.942+0000 7f3011400640 1 --2- 172.21.15.86:0/2405662258 >> [v2:172.21.15.86:6800/1239909622,v1:172.21.15.86:6801/1239909622] conn(0x7f2ff00a1090 0x7f2ff00a3550 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:50.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.942+0000 7f3011400640 1 --2- 172.21.15.86:0/2405662258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f300c107c00 0x7f300c19f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:50.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.942+0000 7f3011400640 1 --2- 172.21.15.86:0/2405662258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f300c074490 0x7f300c1985a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:50.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.942+0000 7f3011400640 1 --2- 172.21.15.86:0/2405662258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f300c072eb0 0x7f300c198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:50.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.942+0000 7f3011400640 1 -- 172.21.15.86:0/2405662258 >> 172.21.15.86:0/2405662258 conn(0x7f300c0fb4d0 msgr2=0x7f300c103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:50.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.944+0000 7f3011400640 1 -- 172.21.15.86:0/2405662258 shutdown_connections 2024-09-13T16:13:50.946 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T16:13:50.945+0000 7f3011400640 1 -- 172.21.15.86:0/2405662258 wait complete. 2024-09-13T16:13:50.965 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:13:51.022 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:13:51.055 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:13:51.088 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-13T16:13:51.088 DEBUG:teuthology.orchestra.run.smithi086:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T16:13:51.123 DEBUG:teuthology.orchestra.run.smithi139:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T16:13:51.141 DEBUG:teuthology.orchestra.run.smithi194:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T16:13:51.158 INFO:tasks.cephadm:Stopping all daemons... 2024-09-13T16:13:51.158 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-13T16:13:51.158 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mon.a 2024-09-13T16:13:51.211 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:50 smithi086 ceph-mon[30379]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T16:13:51.211 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:50 smithi086 ceph-mon[30379]: osdmap e97: 12 total, 12 up, 12 in 2024-09-13T16:13:51.211 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:50 smithi086 ceph-mon[30379]: from='client.? 172.21.15.86:0/2405662258' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:51.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:50 smithi139 ceph-mon[35320]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T16:13:51.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:50 smithi139 ceph-mon[35320]: osdmap e97: 12 total, 12 up, 12 in 2024-09-13T16:13:51.248 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:50 smithi139 ceph-mon[35320]: from='client.? 172.21.15.86:0/2405662258' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:51.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:50 smithi194 ceph-mon[35694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T16:13:51.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:50 smithi194 ceph-mon[35694]: osdmap e97: 12 total, 12 up, 12 in 2024-09-13T16:13:51.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:50 smithi194 ceph-mon[35694]: from='client.? 172.21.15.86:0/2405662258' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:51.615 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:51 smithi086 systemd[1]: Stopping Ceph mon.a for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:13:52.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:51 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-a[30375]: 2024-09-13T16:13:51.614+0000 7f782b400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:13:52.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:51 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-a[30375]: 2024-09-13T16:13:51.614+0000 7f782b400640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-13T16:13:52.115 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:51 smithi086 podman[86257]: 2024-09-13 16:13:51.800295149 +0000 UTC m=+0.345850906 container died 6d473c2d7662a35a6caed15fd9d3cf74f8c8c03d64e870549c5a30afffc9d6dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:13:52.777 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:52 smithi086 podman[86257]: 2024-09-13 16:13:52.491508831 +0000 UTC m=+1.037064586 container cleanup 6d473c2d7662a35a6caed15fd9d3cf74f8c8c03d64e870549c5a30afffc9d6dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-13T16:13:52.778 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:52 smithi086 bash[86257]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-a 2024-09-13T16:13:52.998 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mon.a.service' 2024-09-13T16:13:53.046 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:52 smithi086 podman[86268]: 2024-09-13 16:13:52.776376616 +0000 UTC m=+0.966183401 container remove 6d473c2d7662a35a6caed15fd9d3cf74f8c8c03d64e870549c5a30afffc9d6dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-13T16:13:53.046 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:52 smithi086 systemd[1]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-13T16:13:53.047 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:52 smithi086 systemd[1]: Stopped Ceph mon.a for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:13:53.047 INFO:journalctl@ceph.mon.a.smithi086.stdout:Sep 13 16:13:52 smithi086 systemd[1]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mon.a.service: Consumed 18.404s CPU time. 2024-09-13T16:13:53.085 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:13:53.086 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-13T16:13:53.086 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-13T16:13:53.086 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mon.b 2024-09-13T16:13:53.408 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:53 smithi139 systemd[1]: Stopping Ceph mon.b for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:13:53.748 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:53 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-b[35313]: 2024-09-13T16:13:53.407+0000 7f015221a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:13:53.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:53 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-b[35313]: 2024-09-13T16:13:53.407+0000 7f015221a640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-13T16:13:53.749 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:53 smithi139 podman[67644]: 2024-09-13 16:13:53.478581678 +0000 UTC m=+0.195955719 container died 6542dd8d5c00ca320c8bad5d223662dce36d3a439c8451ac9d0168232865b4fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-b, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0) 2024-09-13T16:13:54.134 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:53 smithi139 podman[67644]: 2024-09-13 16:13:53.865739271 +0000 UTC m=+0.583113311 container cleanup 6542dd8d5c00ca320c8bad5d223662dce36d3a439c8451ac9d0168232865b4fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-13T16:13:54.135 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 16:13:53 smithi139 bash[67644]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-b 2024-09-13T16:13:54.293 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mon.b.service' 2024-09-13T16:13:54.336 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:13:54.336 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-13T16:13:54.336 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-13T16:13:54.336 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mon.c 2024-09-13T16:13:54.664 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:54 smithi194 systemd[1]: Stopping Ceph mon.c for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:13:55.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:54 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-c[35676]: 2024-09-13T16:13:54.662+0000 7f78762e3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:13:55.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:54 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-c[35676]: 2024-09-13T16:13:54.662+0000 7f78762e3640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-13T16:13:55.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:54 smithi194 podman[69840]: 2024-09-13 16:13:54.836886744 +0000 UTC m=+0.299212605 container died aff0ed55faf9bbf89b194b054d4034ae160e30e671231fc1d6dd8878c49cbe8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:13:55.474 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:55 smithi194 podman[69840]: 2024-09-13 16:13:55.238479556 +0000 UTC m=+0.700805412 container cleanup aff0ed55faf9bbf89b194b054d4034ae160e30e671231fc1d6dd8878c49cbe8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-c, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-13T16:13:55.474 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 13 16:13:55 smithi194 bash[69840]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mon-c 2024-09-13T16:13:55.616 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mon.c.service' 2024-09-13T16:13:55.666 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:13:55.667 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-13T16:13:55.667 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-13T16:13:55.667 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mgr.x 2024-09-13T16:13:56.115 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:13:55 smithi086 systemd[1]: Stopping Ceph mgr.x for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:13:56.515 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:13:56 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:13:56.115+0000 7f4c08600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:13:56.515 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:13:56 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x[30602]: 2024-09-13T16:13:56.115+0000 7f4c08600640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-13T16:13:56.516 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:13:56 smithi086 podman[86374]: 2024-09-13 16:13:56.198928659 +0000 UTC m=+0.243021300 container died 9cb9bd6a37a753038db23b6bd513c7d4e2cabac50478a676c6f761dca5b8a5d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-13T16:13:56.790 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:13:56 smithi086 podman[86374]: 2024-09-13 16:13:56.788963026 +0000 UTC m=+0.833055682 container cleanup 9cb9bd6a37a753038db23b6bd513c7d4e2cabac50478a676c6f761dca5b8a5d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-13T16:13:57.115 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:13:56 smithi086 bash[86374]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x 2024-09-13T16:13:57.401 INFO:journalctl@ceph.mgr.x.smithi086.stdout:Sep 13 16:13:57 smithi086 podman[86386]: 2024-09-13 16:13:57.128426176 +0000 UTC m=+0.924576177 container remove 9cb9bd6a37a753038db23b6bd513c7d4e2cabac50478a676c6f761dca5b8a5d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-13T16:13:57.419 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-13T16:13:57.494 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:13:57.494 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-13T16:13:57.494 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-13T16:13:57.495 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mgr.y 2024-09-13T16:13:57.834 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:13:57 smithi139 systemd[1]: Stopping Ceph mgr.y for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:13:58.123 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:13:57 smithi139 podman[67767]: 2024-09-13 16:13:57.833412105 +0000 UTC m=+0.152957209 container died 1ba50c639eb1c9c3a5390a30783ca3f51081c131e4806524c838285225681fef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:13:58.490 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:13:58 smithi139 podman[67767]: 2024-09-13 16:13:58.221404221 +0000 UTC m=+0.540949335 container cleanup 1ba50c639eb1c9c3a5390a30783ca3f51081c131e4806524c838285225681fef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-13T16:13:58.490 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 13 16:13:58 smithi139 bash[67767]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-y 2024-09-13T16:13:58.652 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-13T16:13:58.687 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:13:58.687 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-13T16:13:58.687 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-13T16:13:58.687 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mgr.z 2024-09-13T16:13:59.005 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:13:58 smithi194 systemd[1]: Stopping Ceph mgr.z for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:13:59.328 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:13:59 smithi194 podman[69963]: 2024-09-13 16:13:59.022772197 +0000 UTC m=+0.140948488 container died ede3a65d094820bc7fcd5bd44ae7136c5a68676468ad17d3e807aa37fb0ae22c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-13T16:13:59.746 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:13:59 smithi194 podman[69963]: 2024-09-13 16:13:59.427466521 +0000 UTC m=+0.545642801 container cleanup ede3a65d094820bc7fcd5bd44ae7136c5a68676468ad17d3e807aa37fb0ae22c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-13T16:13:59.746 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:13:59 smithi194 bash[69963]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z 2024-09-13T16:13:59.749 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 13 16:13:59 smithi194 podman[69977]: 2024-09-13 16:13:59.745799791 +0000 UTC m=+0.713084948 container remove ede3a65d094820bc7fcd5bd44ae7136c5a68676468ad17d3e807aa37fb0ae22c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mgr-z, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:13:59.907 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-13T16:13:59.942 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:13:59.942 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-13T16:13:59.942 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-13T16:13:59.942 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.0 2024-09-13T16:14:00.365 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:14:00 smithi086 systemd[1]: Stopping Ceph osd.0 for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:14:00.865 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:14:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-0[44638]: 2024-09-13T16:14:00.367+0000 7f3ae6800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:14:00.865 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:14:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-0[44638]: 2024-09-13T16:14:00.367+0000 7f3ae6800640 -1 osd.0 98 *** Got signal Terminated *** 2024-09-13T16:14:00.865 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:14:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-0[44638]: 2024-09-13T16:14:00.367+0000 7f3ae6800640 -1 osd.0 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:14:06.068 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:14:05 smithi086 podman[86492]: 2024-09-13 16:14:05.762263529 +0000 UTC m=+5.534241261 container died 6c50cfbf3df47732f2a13ef32ba27fb27d213f5d8ef50d8520873cd52e9b89d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True) 2024-09-13T16:14:06.615 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:14:06 smithi086 podman[86492]: 2024-09-13 16:14:06.332190763 +0000 UTC m=+6.104168502 container cleanup 6c50cfbf3df47732f2a13ef32ba27fb27d213f5d8ef50d8520873cd52e9b89d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:14:06.615 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:14:06 smithi086 bash[86492]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-0 2024-09-13T16:14:07.110 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:14:06 smithi086 podman[86512]: 2024-09-13 16:14:06.675866536 +0000 UTC m=+0.898262058 container remove 6c50cfbf3df47732f2a13ef32ba27fb27d213f5d8ef50d8520873cd52e9b89d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T16:14:07.365 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:14:07 smithi086 podman[86601]: 2024-09-13 16:14:07.014243947 +0000 UTC m=+0.026833258 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:14:07.366 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:14:07 smithi086 podman[86601]: 2024-09-13 16:14:07.126723588 +0000 UTC m=+0.139312898 container create 6534094922c82731281db35adf15dfe372d3abd7c2bd63b9ea5e752690430662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:14:07.654 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:14:07 smithi086 podman[86601]: 2024-09-13 16:14:07.396350947 +0000 UTC m=+0.408940259 container init 6534094922c82731281db35adf15dfe372d3abd7c2bd63b9ea5e752690430662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T16:14:07.655 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:14:07 smithi086 podman[86601]: 2024-09-13 16:14:07.403065869 +0000 UTC m=+0.415655180 container start 6534094922c82731281db35adf15dfe372d3abd7c2bd63b9ea5e752690430662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-09-13T16:14:07.655 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:14:07 smithi086 podman[86601]: 2024-09-13 16:14:07.520985583 +0000 UTC m=+0.533574895 container attach 6534094922c82731281db35adf15dfe372d3abd7c2bd63b9ea5e752690430662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T16:14:08.001 INFO:journalctl@ceph.osd.0.smithi086.stdout:Sep 13 16:14:07 smithi086 podman[86601]: 2024-09-13 16:14:07.654258066 +0000 UTC m=+0.666847395 container died 6534094922c82731281db35adf15dfe372d3abd7c2bd63b9ea5e752690430662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T16:14:08.494 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.0.service' 2024-09-13T16:14:08.570 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:14:08.570 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-13T16:14:08.571 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-13T16:14:08.571 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.1 2024-09-13T16:14:08.893 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:14:08 smithi139 systemd[1]: Stopping Ceph osd.1 for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:14:09.248 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:14:08 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-1[39802]: 2024-09-13T16:14:08.891+0000 7fbaafa63640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:14:09.248 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:14:08 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-1[39802]: 2024-09-13T16:14:08.891+0000 7fbaafa63640 -1 osd.1 98 *** Got signal Terminated *** 2024-09-13T16:14:09.249 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:14:08 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-1[39802]: 2024-09-13T16:14:08.891+0000 7fbaafa63640 -1 osd.1 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:14:14.748 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:14:14 smithi139 podman[67891]: 2024-09-13 16:14:14.447749386 +0000 UTC m=+5.673763162 container died 11746891050dc59a9c5b0f4d3981c45e2a541f69fe836da1ee0a66c75487b001 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-13T16:14:15.086 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:14:14 smithi139 podman[67891]: 2024-09-13 16:14:14.859122133 +0000 UTC m=+6.085135907 container cleanup 11746891050dc59a9c5b0f4d3981c45e2a541f69fe836da1ee0a66c75487b001 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T16:14:15.087 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:14:14 smithi139 bash[67891]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-1 2024-09-13T16:14:15.498 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:14:15 smithi139 podman[67906]: 2024-09-13 16:14:15.085876182 +0000 UTC m=+0.638301246 container remove 11746891050dc59a9c5b0f4d3981c45e2a541f69fe836da1ee0a66c75487b001 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-13T16:14:15.790 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:14:15 smithi139 podman[67994]: 2024-09-13 16:14:15.428437122 +0000 UTC m=+0.015651749 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:14:15.790 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:14:15 smithi139 podman[67994]: 2024-09-13 16:14:15.536813201 +0000 UTC m=+0.124027820 container create 158d91daf32b65dda9d4ec686aa924c10e9c37a66e41c69d33f7dc18c89f54f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731) 2024-09-13T16:14:15.791 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:14:15 smithi139 podman[67994]: 2024-09-13 16:14:15.789595113 +0000 UTC m=+0.376809741 container init 158d91daf32b65dda9d4ec686aa924c10e9c37a66e41c69d33f7dc18c89f54f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T16:14:16.248 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:14:15 smithi139 podman[67994]: 2024-09-13 16:14:15.793382553 +0000 UTC m=+0.380597180 container start 158d91daf32b65dda9d4ec686aa924c10e9c37a66e41c69d33f7dc18c89f54f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:14:16.249 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:14:15 smithi139 podman[67994]: 2024-09-13 16:14:15.889332035 +0000 UTC m=+0.476546661 container attach 158d91daf32b65dda9d4ec686aa924c10e9c37a66e41c69d33f7dc18c89f54f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-13T16:14:16.249 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 13 16:14:15 smithi139 podman[67994]: 2024-09-13 16:14:15.974014912 +0000 UTC m=+0.561229531 container died 158d91daf32b65dda9d4ec686aa924c10e9c37a66e41c69d33f7dc18c89f54f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:14:16.694 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.1.service' 2024-09-13T16:14:16.734 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:14:16.735 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-13T16:14:16.735 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-13T16:14:16.735 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.2 2024-09-13T16:14:17.074 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:14:16 smithi194 systemd[1]: Stopping Ceph osd.2 for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:14:17.505 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:14:17 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-2[40705]: 2024-09-13T16:14:17.072+0000 7f54dcf9b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:14:17.505 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:14:17 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-2[40705]: 2024-09-13T16:14:17.072+0000 7f54dcf9b640 -1 osd.2 98 *** Got signal Terminated *** 2024-09-13T16:14:17.505 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:14:17 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-2[40705]: 2024-09-13T16:14:17.072+0000 7f54dcf9b640 -1 osd.2 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:14:22.866 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:14:22 smithi194 podman[70101]: 2024-09-13 16:14:22.521719225 +0000 UTC m=+5.585038852 container died 4955d8a7766b8ca62feaf265e118d954bac8c06c9af3a6286416ae044b274e51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-13T16:14:23.184 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:14:22 smithi194 podman[70101]: 2024-09-13 16:14:22.964757977 +0000 UTC m=+6.028077583 container cleanup 4955d8a7766b8ca62feaf265e118d954bac8c06c9af3a6286416ae044b274e51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-13T16:14:23.184 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:14:22 smithi194 bash[70101]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-2 2024-09-13T16:14:23.504 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:14:23 smithi194 podman[70117]: 2024-09-13 16:14:23.183271538 +0000 UTC m=+0.655405081 container remove 4955d8a7766b8ca62feaf265e118d954bac8c06c9af3a6286416ae044b274e51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-13T16:14:23.920 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:14:23 smithi194 podman[70206]: 2024-09-13 16:14:23.528201988 +0000 UTC m=+0.016416382 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:14:23.920 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:14:23 smithi194 podman[70206]: 2024-09-13 16:14:23.64244311 +0000 UTC m=+0.130657534 container create b8c11f20efd7fed6e1101eede516a3f7966e0dc2f97144c997f5bb2330433ca5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T16:14:24.255 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:14:23 smithi194 podman[70206]: 2024-09-13 16:14:23.920068169 +0000 UTC m=+0.408282552 container init b8c11f20efd7fed6e1101eede516a3f7966e0dc2f97144c997f5bb2330433ca5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-09-13T16:14:24.255 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:14:23 smithi194 podman[70206]: 2024-09-13 16:14:23.924137984 +0000 UTC m=+0.412352371 container start b8c11f20efd7fed6e1101eede516a3f7966e0dc2f97144c997f5bb2330433ca5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T16:14:24.255 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:14:24 smithi194 podman[70206]: 2024-09-13 16:14:24.011649752 +0000 UTC m=+0.499864147 container attach b8c11f20efd7fed6e1101eede516a3f7966e0dc2f97144c997f5bb2330433ca5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-09-13T16:14:24.255 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 13 16:14:24 smithi194 podman[70206]: 2024-09-13 16:14:24.109829844 +0000 UTC m=+0.598044237 container died b8c11f20efd7fed6e1101eede516a3f7966e0dc2f97144c997f5bb2330433ca5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T16:14:24.816 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.2.service' 2024-09-13T16:14:24.856 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:14:24.856 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-13T16:14:24.856 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-13T16:14:24.857 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.3 2024-09-13T16:14:25.291 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:14:24 smithi086 systemd[1]: Stopping Ceph osd.3 for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:14:25.615 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:14:25 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-3[51069]: 2024-09-13T16:14:25.290+0000 7f26b7200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:14:25.615 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:14:25 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-3[51069]: 2024-09-13T16:14:25.290+0000 7f26b7200640 -1 osd.3 98 *** Got signal Terminated *** 2024-09-13T16:14:25.615 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:14:25 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-3[51069]: 2024-09-13T16:14:25.290+0000 7f26b7200640 -1 osd.3 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:14:27.615 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:14:27 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-3[51069]: 2024-09-13T16:14:27.334+0000 7f26b2c00640 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:01.925786+0000 front 2024-09-13T16:14:01.925813+0000 (oldest deadline 2024-09-13T16:14:26.626071+0000) 2024-09-13T16:14:28.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:27 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:27.545+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:28.865 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:14:28 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-3[51069]: 2024-09-13T16:14:28.373+0000 7f26b2c00640 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:01.925786+0000 front 2024-09-13T16:14:01.925813+0000 (oldest deadline 2024-09-13T16:14:26.626071+0000) 2024-09-13T16:14:28.996 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:28 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:28.506+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:29.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:28 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:28.995+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:29.498 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:29 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:29.114+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:29.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:29 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:29.458+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:29.865 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:14:29 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-3[51069]: 2024-09-13T16:14:29.403+0000 7f26b2c00640 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:01.925786+0000 front 2024-09-13T16:14:01.925813+0000 (oldest deadline 2024-09-13T16:14:26.626071+0000) 2024-09-13T16:14:29.866 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:29 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:29.525+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:30.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:29 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:29.958+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:30.498 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:30 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:30.071+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:30.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:30 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:30.486+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:30.865 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:14:30 smithi086 podman[86703]: 2024-09-13 16:14:30.738838036 +0000 UTC m=+5.590223551 container died 64256fd7fc498886b9dc6c6365156e38090e12d5465d1e4188ddedadbf1ca40c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:14:30.866 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:30 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:30.526+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:31.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:30 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:30.923+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:31.498 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:31 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:31.121+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:31.615 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:14:31 smithi086 podman[86703]: 2024-09-13 16:14:31.31982371 +0000 UTC m=+6.171209225 container cleanup 64256fd7fc498886b9dc6c6365156e38090e12d5465d1e4188ddedadbf1ca40c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-13T16:14:31.615 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:14:31 smithi086 bash[86703]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-3 2024-09-13T16:14:31.616 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:14:31 smithi086 podman[86730]: 2024-09-13 16:14:31.529710396 +0000 UTC m=+0.782179886 container remove 64256fd7fc498886b9dc6c6365156e38090e12d5465d1e4188ddedadbf1ca40c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-13T16:14:31.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:31 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:31.490+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:31.754 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:31 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:31.502+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:32.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:31 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:31.911+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:32.363 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:14:32 smithi086 podman[86815]: 2024-09-13 16:14:31.983417459 +0000 UTC m=+0.027621506 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:14:32.363 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:14:32 smithi086 podman[86815]: 2024-09-13 16:14:32.080651447 +0000 UTC m=+0.124855492 container create 5159462b7dbf5cf056ce177a47e4340ee998fca396b41c2ea7851f861e1d3c86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:14:32.498 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:32 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:32.091+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:32.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:32 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:32.515+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:32.615 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:14:32 smithi086 podman[86815]: 2024-09-13 16:14:32.362751967 +0000 UTC m=+0.406956013 container init 5159462b7dbf5cf056ce177a47e4340ee998fca396b41c2ea7851f861e1d3c86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-13T16:14:32.616 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:14:32 smithi086 podman[86815]: 2024-09-13 16:14:32.369943607 +0000 UTC m=+0.414147654 container start 5159462b7dbf5cf056ce177a47e4340ee998fca396b41c2ea7851f861e1d3c86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T16:14:32.616 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:14:32 smithi086 podman[86815]: 2024-09-13 16:14:32.500138681 +0000 UTC m=+0.544342727 container attach 5159462b7dbf5cf056ce177a47e4340ee998fca396b41c2ea7851f861e1d3c86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-13T16:14:32.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:32 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:32.496+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:32.995 INFO:journalctl@ceph.osd.3.smithi086.stdout:Sep 13 16:14:32 smithi086 podman[86838]: 2024-09-13 16:14:32.666341377 +0000 UTC m=+0.025415293 container died 5159462b7dbf5cf056ce177a47e4340ee998fca396b41c2ea7851f861e1d3c86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:14:33.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:32 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:32.894+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:33.498 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:33 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:33.109+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:33.504 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.3.service' 2024-09-13T16:14:33.580 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:14:33.580 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-13T16:14:33.580 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-13T16:14:33.581 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.4 2024-09-13T16:14:33.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:33 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:33.462+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:33.865 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:33 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:33.489+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:33.913 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:14:33 smithi139 systemd[1]: Stopping Ceph osd.4 for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:14:34.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:34 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:34.080+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:34.249 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:14:33 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-4[46222]: 2024-09-13T16:14:33.911+0000 7f7cc7b35640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:14:34.249 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:14:33 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-4[46222]: 2024-09-13T16:14:33.911+0000 7f7cc7b35640 -1 osd.4 98 *** Got signal Terminated *** 2024-09-13T16:14:34.249 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:14:33 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-4[46222]: 2024-09-13T16:14:33.911+0000 7f7cc7b35640 -1 osd.4 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:14:34.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:33 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:33.932+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:34.865 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:34 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:34.509+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:34.956 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:34 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:34.504+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:35.078 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:14:34 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-4[46222]: 2024-09-13T16:14:34.964+0000 7f7cc0141640 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:11.302933+0000 front 2024-09-13T16:14:11.302904+0000 (oldest deadline 2024-09-13T16:14:34.803117+0000) 2024-09-13T16:14:35.078 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:34 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:34.820+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:35.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:34 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:34.954+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:35.498 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:35 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:35.076+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:35.865 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:35 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:35.517+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:35.959 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:35 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:35.522+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:36.248 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:14:35 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-4[46222]: 2024-09-13T16:14:35.967+0000 7f7cc0141640 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:11.302933+0000 front 2024-09-13T16:14:11.302904+0000 (oldest deadline 2024-09-13T16:14:34.803117+0000) 2024-09-13T16:14:36.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:36 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:36.055+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:36.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:35 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:35.830+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:36.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:35 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:35.958+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:36.865 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:36 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:36.484+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:36.865 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:36 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:36.484+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:36.992 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:36 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:36.559+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:37.248 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:14:36 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-4[46222]: 2024-09-13T16:14:36.998+0000 7f7cc0141640 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:11.302933+0000 front 2024-09-13T16:14:11.302904+0000 (oldest deadline 2024-09-13T16:14:34.803117+0000) 2024-09-13T16:14:37.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:36 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:36.868+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:37.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:37 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:37.055+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:37.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:36 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:36.991+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:37.865 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:37.451+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:37.865 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:37 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:37.451+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:37.968 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:37 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:37.544+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:38.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:37 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:37.864+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:38.249 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:14:37 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-4[46222]: 2024-09-13T16:14:37.997+0000 7f7cc0141640 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:11.302933+0000 front 2024-09-13T16:14:11.302904+0000 (oldest deadline 2024-09-13T16:14:34.803117+0000) 2024-09-13T16:14:38.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:38 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:38.067+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:38.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:38 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:38.067+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:38.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:37 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:37.967+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:38.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:38 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:38.413+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:38.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:38 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:38.413+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:38.616 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:38 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:38.317+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.590873+0000 front 2024-09-13T16:14:12.590926+0000 (oldest deadline 2024-09-13T16:14:37.891064+0000) 2024-09-13T16:14:38.953 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:38 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:38.586+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:39.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:38 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:38.908+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:39.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:39 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:39.097+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:39.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:39 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:39.097+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:39.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:38 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:38.952+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:39.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:39 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:39.311+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.590873+0000 front 2024-09-13T16:14:12.590926+0000 (oldest deadline 2024-09-13T16:14:37.891064+0000) 2024-09-13T16:14:39.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:39 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:39.368+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:39.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:39 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:39.368+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:39.664 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:14:39 smithi139 podman[68112]: 2024-09-13 16:14:39.339776838 +0000 UTC m=+5.554256622 container died 7fa50856c72bab71bfda442460ddd0529a0f225e0ee403f417a127a77f6e8a91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True) 2024-09-13T16:14:39.971 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:39 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:39.570+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:39.989 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:14:39 smithi139 podman[68112]: 2024-09-13 16:14:39.76199148 +0000 UTC m=+5.976471250 container cleanup 7fa50856c72bab71bfda442460ddd0529a0f225e0ee403f417a127a77f6e8a91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T16:14:39.989 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:14:39 smithi139 bash[68112]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-4 2024-09-13T16:14:39.989 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:39 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:39.895+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:40.248 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:14:39 smithi139 podman[68131]: 2024-09-13 16:14:39.98863828 +0000 UTC m=+0.649243322 container remove 7fa50856c72bab71bfda442460ddd0529a0f225e0ee403f417a127a77f6e8a91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-13T16:14:40.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:40 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:40.137+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:40.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:40 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:40.137+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:40.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:39 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:39.969+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:40.255 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:40 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5[47572]: 2024-09-13T16:14:40.071+0000 7f44d69e2640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:13.858790+0000 front 2024-09-13T16:14:13.858658+0000 (oldest deadline 2024-09-13T16:14:39.158545+0000) 2024-09-13T16:14:40.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:40 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:40.289+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.590873+0000 front 2024-09-13T16:14:12.590926+0000 (oldest deadline 2024-09-13T16:14:37.891064+0000) 2024-09-13T16:14:40.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:40 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:40.375+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:40.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:40 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:40.375+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:40.692 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:14:40 smithi139 podman[68220]: 2024-09-13 16:14:40.333930413 +0000 UTC m=+0.015947944 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:14:40.692 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:14:40 smithi139 podman[68220]: 2024-09-13 16:14:40.447775492 +0000 UTC m=+0.129793018 container create c2fe7c771bf1816cc9befd201aa68ad136dea2477cc523c086d53231e84c1515 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-13T16:14:40.692 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:14:40 smithi139 podman[68220]: 2024-09-13 16:14:40.69183118 +0000 UTC m=+0.373848710 container init c2fe7c771bf1816cc9befd201aa68ad136dea2477cc523c086d53231e84c1515 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:14:40.937 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:40 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:40.601+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:40.998 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:40 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:40.871+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:40.999 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:14:40 smithi139 podman[68220]: 2024-09-13 16:14:40.695108461 +0000 UTC m=+0.377125991 container start c2fe7c771bf1816cc9befd201aa68ad136dea2477cc523c086d53231e84c1515 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-13T16:14:40.999 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:14:40 smithi139 podman[68220]: 2024-09-13 16:14:40.775147409 +0000 UTC m=+0.457164938 container attach c2fe7c771bf1816cc9befd201aa68ad136dea2477cc523c086d53231e84c1515 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:14:40.999 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 13 16:14:40 smithi139 podman[68220]: 2024-09-13 16:14:40.877933132 +0000 UTC m=+0.559950654 container died c2fe7c771bf1816cc9befd201aa68ad136dea2477cc523c086d53231e84c1515 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-13T16:14:41.255 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:41 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5[47572]: 2024-09-13T16:14:41.103+0000 7f44d69e2640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:13.858790+0000 front 2024-09-13T16:14:13.858658+0000 (oldest deadline 2024-09-13T16:14:39.158545+0000) 2024-09-13T16:14:41.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:40 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:40.935+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:41.498 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:41 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:41.175+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:41.499 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:41 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:41.175+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:41.540 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.4.service' 2024-09-13T16:14:41.580 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:14:41.580 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-13T16:14:41.580 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-13T16:14:41.580 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.5 2024-09-13T16:14:41.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:41 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:41.313+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.590873+0000 front 2024-09-13T16:14:12.590926+0000 (oldest deadline 2024-09-13T16:14:37.891064+0000) 2024-09-13T16:14:41.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:41 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:41.368+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:41.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:41 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:41.368+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:41.903 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:41 smithi194 systemd[1]: Stopping Ceph osd.5 for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:14:41.903 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:41 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:41.610+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:42.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:41 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:41.898+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:42.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:42 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:42.131+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:42.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:42 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:42.131+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:42.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:41 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:41.922+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:42.255 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:41 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5[47572]: 2024-09-13T16:14:41.901+0000 7f44de3d6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:14:42.255 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:41 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5[47572]: 2024-09-13T16:14:41.901+0000 7f44de3d6640 -1 osd.5 98 *** Got signal Terminated *** 2024-09-13T16:14:42.255 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:41 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5[47572]: 2024-09-13T16:14:41.901+0000 7f44de3d6640 -1 osd.5 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:14:42.255 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:42 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5[47572]: 2024-09-13T16:14:42.087+0000 7f44d69e2640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:13.858790+0000 front 2024-09-13T16:14:13.858658+0000 (oldest deadline 2024-09-13T16:14:39.158545+0000) 2024-09-13T16:14:42.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:42 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:42.347+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.590873+0000 front 2024-09-13T16:14:12.590926+0000 (oldest deadline 2024-09-13T16:14:37.891064+0000) 2024-09-13T16:14:42.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:42 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:42.359+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:42.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:42 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:42.359+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:42.950 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:42 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:42.627+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:43.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:42 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:42.901+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:43.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:43 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:43.117+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:43.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:43 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:43.117+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:43.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:43 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:43.117+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:14:43.255 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:43 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5[47572]: 2024-09-13T16:14:43.135+0000 7f44d69e2640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:13.858790+0000 front 2024-09-13T16:14:13.858658+0000 (oldest deadline 2024-09-13T16:14:39.158545+0000) 2024-09-13T16:14:43.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:42 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:42.948+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:43.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:43 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:43.327+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:43.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:43 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:43.327+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:43.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:43 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:43.333+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.590873+0000 front 2024-09-13T16:14:12.590926+0000 (oldest deadline 2024-09-13T16:14:37.891064+0000) 2024-09-13T16:14:43.616 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:43 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:43.333+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.891421+0000 front 2024-09-13T16:14:17.891628+0000 (oldest deadline 2024-09-13T16:14:42.591542+0000) 2024-09-13T16:14:43.936 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:43 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:43.583+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:44.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:43 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:43.946+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:44.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:43 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:43.946+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:14:44.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:44 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:44.124+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:44.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:44 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:44.124+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:44.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:44 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:44.124+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:14:44.255 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:44 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5[47572]: 2024-09-13T16:14:44.169+0000 7f44d69e2640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:13.858790+0000 front 2024-09-13T16:14:13.858658+0000 (oldest deadline 2024-09-13T16:14:39.158545+0000) 2024-09-13T16:14:44.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:43 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:43.934+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:44.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:44 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:44.366+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:44.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:44 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:44.366+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:44.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:44 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:44.316+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.590873+0000 front 2024-09-13T16:14:12.590926+0000 (oldest deadline 2024-09-13T16:14:37.891064+0000) 2024-09-13T16:14:44.616 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:44 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:44.316+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.891421+0000 front 2024-09-13T16:14:17.891628+0000 (oldest deadline 2024-09-13T16:14:42.591542+0000) 2024-09-13T16:14:44.949 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:44 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:44.579+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:44.950 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:44 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:44.579+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:14:45.214 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:44 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:44.948+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:45.214 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:44 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:44.948+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:14:45.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:44 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:44.961+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:45.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:44 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:44.961+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:14:45.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:45 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:45.150+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:45.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:45 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:45.150+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:45.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:45 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:45.150+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:14:45.505 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:45 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5[47572]: 2024-09-13T16:14:45.213+0000 7f44d69e2640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:13.858790+0000 front 2024-09-13T16:14:13.858658+0000 (oldest deadline 2024-09-13T16:14:39.158545+0000) 2024-09-13T16:14:45.505 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:45 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5[47572]: 2024-09-13T16:14:45.213+0000 7f44d69e2640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.158862+0000 front 2024-09-13T16:14:19.159050+0000 (oldest deadline 2024-09-13T16:14:45.059000+0000) 2024-09-13T16:14:45.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:45 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:45.350+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:45.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:45 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:45.350+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:45.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:45 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:45.354+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.590873+0000 front 2024-09-13T16:14:12.590926+0000 (oldest deadline 2024-09-13T16:14:37.891064+0000) 2024-09-13T16:14:45.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:45 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:45.354+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.891421+0000 front 2024-09-13T16:14:17.891628+0000 (oldest deadline 2024-09-13T16:14:42.591542+0000) 2024-09-13T16:14:45.936 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:45 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:45.544+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:45.936 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:45 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:45.544+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:14:46.191 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:45 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:45.935+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:46.191 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:45 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:45.935+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:14:46.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:45 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:45.913+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:46.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:45 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:45.913+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:14:46.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:46 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:46.121+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:46.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:46 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:46.121+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:46.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:46 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:46.121+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:14:46.505 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:46 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5[47572]: 2024-09-13T16:14:46.189+0000 7f44d69e2640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:13.858790+0000 front 2024-09-13T16:14:13.858658+0000 (oldest deadline 2024-09-13T16:14:39.158545+0000) 2024-09-13T16:14:46.505 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:46 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5[47572]: 2024-09-13T16:14:46.189+0000 7f44d69e2640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.158862+0000 front 2024-09-13T16:14:19.159050+0000 (oldest deadline 2024-09-13T16:14:45.059000+0000) 2024-09-13T16:14:46.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:46 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:46.393+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:46.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:46 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:46.393+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:46.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:46 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:46.362+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.590873+0000 front 2024-09-13T16:14:12.590926+0000 (oldest deadline 2024-09-13T16:14:37.891064+0000) 2024-09-13T16:14:46.616 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:46 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:46.362+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.891421+0000 front 2024-09-13T16:14:17.891628+0000 (oldest deadline 2024-09-13T16:14:42.591542+0000) 2024-09-13T16:14:46.908 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:46 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:46.549+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:46.908 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:46 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:46.549+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:14:47.136 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:46 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:46.877+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:47.136 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:46 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:46.877+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:14:47.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:46 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:46.906+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:47.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:46 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:46.906+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:14:47.498 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:47 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:47.135+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:47.498 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:47 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:47.135+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:47.498 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:47 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:47.135+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:14:47.745 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:47 smithi194 podman[70321]: 2024-09-13 16:14:47.458579458 +0000 UTC m=+5.680750725 container died 3f2721dbfcae06fe598dc79d8ff29205b2dffc971d748b9a2e6ee03739e7ef9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-13T16:14:47.745 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:47 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:47.569+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:47.745 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:47 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:47.569+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:14:47.865 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:47 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:47.391+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.590873+0000 front 2024-09-13T16:14:12.590926+0000 (oldest deadline 2024-09-13T16:14:37.891064+0000) 2024-09-13T16:14:47.865 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:47 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:47.391+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.891421+0000 front 2024-09-13T16:14:17.891628+0000 (oldest deadline 2024-09-13T16:14:42.591542+0000) 2024-09-13T16:14:47.866 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:47 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:47.369+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:47.866 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:47 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:47.369+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:47.866 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:47 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:47.369+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:14:48.005 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:47 smithi194 podman[70321]: 2024-09-13 16:14:47.851987727 +0000 UTC m=+6.074159036 container cleanup 3f2721dbfcae06fe598dc79d8ff29205b2dffc971d748b9a2e6ee03739e7ef9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:14:48.005 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:47 smithi194 bash[70321]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5 2024-09-13T16:14:48.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:47 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:47.937+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:48.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:47 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:47.937+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:14:48.122 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:47 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:47.855+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:48.122 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:47 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:47.855+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:14:48.465 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:48 smithi194 podman[70336]: 2024-09-13 16:14:48.120000095 +0000 UTC m=+0.655606361 container remove 3f2721dbfcae06fe598dc79d8ff29205b2dffc971d748b9a2e6ee03739e7ef9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-13T16:14:48.498 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:48 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:48.121+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:48.498 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:48 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:48.121+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:48.498 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:48 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:48.121+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:14:48.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:48 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:48.558+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:48.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:48 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:48.558+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:14:48.755 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:48 smithi194 podman[70426]: 2024-09-13 16:14:48.36816754 +0000 UTC m=+0.015915180 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:14:48.755 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:48 smithi194 podman[70426]: 2024-09-13 16:14:48.479282705 +0000 UTC m=+0.127030374 container create 7eab383a7efe5832c7b5da86419b13eac8e5756aac6b3923e69dcf6c91de26a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-13T16:14:48.865 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:48 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:48.429+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.590873+0000 front 2024-09-13T16:14:12.590926+0000 (oldest deadline 2024-09-13T16:14:37.891064+0000) 2024-09-13T16:14:48.865 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:48 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:48.429+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.891421+0000 front 2024-09-13T16:14:17.891628+0000 (oldest deadline 2024-09-13T16:14:42.591542+0000) 2024-09-13T16:14:48.865 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:48 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:48.366+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:48.866 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:48 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:48.366+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:48.866 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:48 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:48.366+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:14:49.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:48 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:48.878+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:49.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:48 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:48.878+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:14:49.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:49 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:49.115+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:49.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:49 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:49.115+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:49.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:49 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:49.115+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:14:49.255 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:48 smithi194 podman[70426]: 2024-09-13 16:14:48.768873146 +0000 UTC m=+0.416620773 container init 7eab383a7efe5832c7b5da86419b13eac8e5756aac6b3923e69dcf6c91de26a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:14:49.255 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:48 smithi194 podman[70426]: 2024-09-13 16:14:48.772158875 +0000 UTC m=+0.419906510 container start 7eab383a7efe5832c7b5da86419b13eac8e5756aac6b3923e69dcf6c91de26a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T16:14:49.255 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:48 smithi194 podman[70426]: 2024-09-13 16:14:48.85681627 +0000 UTC m=+0.504563897 container attach 7eab383a7efe5832c7b5da86419b13eac8e5756aac6b3923e69dcf6c91de26a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-13T16:14:49.256 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 13 16:14:48 smithi194 podman[70426]: 2024-09-13 16:14:48.963023504 +0000 UTC m=+0.610771144 container died 7eab383a7efe5832c7b5da86419b13eac8e5756aac6b3923e69dcf6c91de26a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T16:14:49.256 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:48 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:48.950+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:49.256 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:48 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:48.950+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:14:49.590 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.5.service' 2024-09-13T16:14:49.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:49 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:49.430+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.590873+0000 front 2024-09-13T16:14:12.590926+0000 (oldest deadline 2024-09-13T16:14:37.891064+0000) 2024-09-13T16:14:49.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:49 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:49.430+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.891421+0000 front 2024-09-13T16:14:17.891628+0000 (oldest deadline 2024-09-13T16:14:42.591542+0000) 2024-09-13T16:14:49.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:49 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:49.340+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:49.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:49 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:49.340+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:49.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:49 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:49.340+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:14:49.629 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:14:49.629 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-13T16:14:49.630 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-13T16:14:49.630 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.6 2024-09-13T16:14:49.951 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:49 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:49.604+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:49.951 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:49 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:49.604+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:14:50.061 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:49 smithi086 systemd[1]: Stopping Ceph osd.6 for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:14:50.061 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:50 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:50.059+0000 7f3168600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:14:50.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:49 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:49.866+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:50.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:49 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:49.866+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:14:50.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:50 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:50.068+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:50.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:50 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:50.068+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:50.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:50 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:50.068+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:14:50.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:49 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:49.950+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:50.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:49 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:49.950+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:14:50.340 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:50 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:50.059+0000 7f3168600640 -1 osd.6 98 *** Got signal Terminated *** 2024-09-13T16:14:50.341 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:50 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:50.059+0000 7f3168600640 -1 osd.6 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:14:50.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:50 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:50.394+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.590873+0000 front 2024-09-13T16:14:12.590926+0000 (oldest deadline 2024-09-13T16:14:37.891064+0000) 2024-09-13T16:14:50.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:50 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:50.394+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.891421+0000 front 2024-09-13T16:14:17.891628+0000 (oldest deadline 2024-09-13T16:14:42.591542+0000) 2024-09-13T16:14:50.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:50 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:50.339+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:50.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:50 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:50.339+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:50.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:50 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:50.339+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:14:50.914 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:50 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:50.601+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:50.915 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:50 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:50.601+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:14:51.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:50 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:50.860+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:51.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:50 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:50.860+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:14:51.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:51 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:51.058+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:51.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:51 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:51.058+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:51.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:51 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:51.058+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:14:51.254 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:50 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:50.913+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:51.254 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:50 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:50.913+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:14:51.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:51 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:51.413+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.590873+0000 front 2024-09-13T16:14:12.590926+0000 (oldest deadline 2024-09-13T16:14:37.891064+0000) 2024-09-13T16:14:51.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:51 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:51.413+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.891421+0000 front 2024-09-13T16:14:17.891628+0000 (oldest deadline 2024-09-13T16:14:42.591542+0000) 2024-09-13T16:14:51.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:51 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:51.318+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:51.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:51 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:51.318+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:51.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:51 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:51.318+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:14:51.905 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:51 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:51.599+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:51.905 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:51 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:51.599+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:14:51.905 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:51 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:51.903+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:51.905 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:51 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:51.903+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:14:52.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:51 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:51.905+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:52.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:51 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:51.905+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:14:52.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:52 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:52.059+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:52.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:52 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:52.059+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:52.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:52 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:52.059+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:14:52.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:52 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:52.059+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:14:52.865 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:52 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:52.386+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.590873+0000 front 2024-09-13T16:14:12.590926+0000 (oldest deadline 2024-09-13T16:14:37.891064+0000) 2024-09-13T16:14:52.865 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:52 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:52.386+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.891421+0000 front 2024-09-13T16:14:17.891628+0000 (oldest deadline 2024-09-13T16:14:42.591542+0000) 2024-09-13T16:14:52.865 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:52 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:52.368+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:52.865 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:52 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:52.368+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:52.865 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:52 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:52.368+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:14:52.881 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:52 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:52.578+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:52.881 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:52 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:52.578+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:14:53.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:52 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:52.910+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:53.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:52 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:52.910+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:14:53.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:52 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:52.910+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:27.590591+0000 front 2024-09-13T16:14:27.590761+0000 (oldest deadline 2024-09-13T16:14:52.290749+0000) 2024-09-13T16:14:53.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:53 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:53.074+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:53.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:53 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:53.074+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:53.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:53 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:53.074+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:14:53.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:53 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:53.074+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:14:53.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:52 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:52.879+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:53.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:52 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:52.879+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:14:53.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:53 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:53.343+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.590873+0000 front 2024-09-13T16:14:12.590926+0000 (oldest deadline 2024-09-13T16:14:37.891064+0000) 2024-09-13T16:14:53.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:53 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:53.343+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.891421+0000 front 2024-09-13T16:14:17.891628+0000 (oldest deadline 2024-09-13T16:14:42.591542+0000) 2024-09-13T16:14:53.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:53 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:53.327+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:53.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:53 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:53.327+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:53.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:53 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:53.327+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:14:53.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:53 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:53.327+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:14:54.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:53 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:53.623+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:54.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:53 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:53.623+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:14:54.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:53 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:53.623+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:14:54.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:53 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:53.840+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:54.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:53 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:53.840+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:14:54.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:53 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:53.927+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:54.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:53 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:53.927+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:14:54.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:53 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:53.927+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:27.590591+0000 front 2024-09-13T16:14:27.590761+0000 (oldest deadline 2024-09-13T16:14:52.290749+0000) 2024-09-13T16:14:54.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:54 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:54.044+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:54.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:54 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:54.044+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:54.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:54 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:54.044+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:14:54.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:54 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:54.044+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:14:54.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:54 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:54.304+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.590873+0000 front 2024-09-13T16:14:12.590926+0000 (oldest deadline 2024-09-13T16:14:37.891064+0000) 2024-09-13T16:14:54.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:54 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6[57521]: 2024-09-13T16:14:54.304+0000 7f3164000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.891421+0000 front 2024-09-13T16:14:17.891628+0000 (oldest deadline 2024-09-13T16:14:42.591542+0000) 2024-09-13T16:14:54.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:54 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:54.306+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:54.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:54 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:54.306+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:54.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:54 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:54.306+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:14:54.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:54 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:54.306+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:14:55.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:54 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:54.861+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:55.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:54 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:54.861+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:14:55.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:54 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:54.640+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:55.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:54 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:54.640+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:14:55.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:54 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:54.640+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:14:55.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:54 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:54.964+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:55.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:54 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:54.964+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:14:55.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:54 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:54.964+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:27.590591+0000 front 2024-09-13T16:14:27.590761+0000 (oldest deadline 2024-09-13T16:14:52.290749+0000) 2024-09-13T16:14:55.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:55 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:55.007+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:55.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:55 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:55.007+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:55.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:55 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:55.007+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:14:55.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:55 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:55.007+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:14:55.616 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:55 smithi086 podman[86918]: 2024-09-13 16:14:55.45149546 +0000 UTC m=+5.530025729 container died b30e6ced2ebe409d003a3d64d20fa75e9e7657b1184c0c88a033df00f0144964 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T16:14:55.617 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:55 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:55.277+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:55.617 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:55 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:55.278+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:55.617 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:55 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:55.278+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:14:55.617 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:55 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:55.278+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:14:56.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:55 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:55.859+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:56.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:55 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:55.859+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:14:56.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:55 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:55.859+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:24.564196+0000 front 2024-09-13T16:14:24.564273+0000 (oldest deadline 2024-09-13T16:14:55.764492+0000) 2024-09-13T16:14:56.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:55 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:55.611+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:56.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:55 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:55.611+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:14:56.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:55 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:55.611+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:14:56.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:55 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:55.956+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:56.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:55 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:55.956+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:14:56.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:55 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:55.956+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:27.590591+0000 front 2024-09-13T16:14:27.590761+0000 (oldest deadline 2024-09-13T16:14:52.290749+0000) 2024-09-13T16:14:56.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:56 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:56.014+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:56.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:56 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:56.014+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:56.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:56 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:56.014+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:14:56.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:56 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:56.014+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:14:56.291 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:56 smithi086 podman[86918]: 2024-09-13 16:14:56.00721922 +0000 UTC m=+6.085749487 container cleanup b30e6ced2ebe409d003a3d64d20fa75e9e7657b1184c0c88a033df00f0144964 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:14:56.291 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:56 smithi086 bash[86918]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6 2024-09-13T16:14:56.615 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:56 smithi086 podman[86935]: 2024-09-13 16:14:56.359379025 +0000 UTC m=+0.894778212 container remove b30e6ced2ebe409d003a3d64d20fa75e9e7657b1184c0c88a033df00f0144964 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:14:56.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:56 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:56.289+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:56.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:56 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:56.289+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:56.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:56 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:56.289+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:14:56.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:56 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:56.289+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:14:56.838 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:56 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:56.564+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:56.839 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:56 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:56.564+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:14:56.839 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:56 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:56.564+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:14:57.219 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:56 smithi086 podman[87030]: 2024-09-13 16:14:56.862069362 +0000 UTC m=+0.028177824 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:14:57.219 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:56 smithi086 podman[87030]: 2024-09-13 16:14:56.960048357 +0000 UTC m=+0.126156819 container create 08739cb31441a0382c061fcbc57556b98957f93d144a7ff13f31a731bf5cac4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:14:57.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:56 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:56.971+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:57.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:56 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:56.971+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:14:57.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:56 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:56.971+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:27.590591+0000 front 2024-09-13T16:14:27.590761+0000 (oldest deadline 2024-09-13T16:14:52.290749+0000) 2024-09-13T16:14:57.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:57 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:57.039+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:57.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:57 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:57.039+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:57.252 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:57 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:57.039+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:14:57.252 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:57 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:57.039+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:14:57.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:56 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:56.837+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:57.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:56 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:56.837+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:14:57.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:56 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:56.837+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:24.564196+0000 front 2024-09-13T16:14:24.564273+0000 (oldest deadline 2024-09-13T16:14:55.764492+0000) 2024-09-13T16:14:57.495 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:57 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:57.268+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:57.495 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:57 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:57.268+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:57.495 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:57 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:57.268+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:14:57.495 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:57 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:57.268+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:14:57.495 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:57 smithi086 podman[87030]: 2024-09-13 16:14:57.229914174 +0000 UTC m=+0.396022650 container init 08739cb31441a0382c061fcbc57556b98957f93d144a7ff13f31a731bf5cac4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:14:57.495 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:57 smithi086 podman[87030]: 2024-09-13 16:14:57.237369404 +0000 UTC m=+0.403477862 container start 08739cb31441a0382c061fcbc57556b98957f93d144a7ff13f31a731bf5cac4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:14:57.496 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:57 smithi086 podman[87030]: 2024-09-13 16:14:57.329442862 +0000 UTC m=+0.495551328 container attach 08739cb31441a0382c061fcbc57556b98957f93d144a7ff13f31a731bf5cac4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-13T16:14:57.496 INFO:journalctl@ceph.osd.6.smithi086.stdout:Sep 13 16:14:57 smithi086 podman[87030]: 2024-09-13 16:14:57.494550973 +0000 UTC m=+0.660659439 container died 08739cb31441a0382c061fcbc57556b98957f93d144a7ff13f31a731bf5cac4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-6-deactivate, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:14:57.850 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:57 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:57.589+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:57.850 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:57 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:57.589+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:14:57.850 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:57 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:57.589+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:14:58.168 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.6.service' 2024-09-13T16:14:58.244 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:14:58.244 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-13T16:14:58.244 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-13T16:14:58.244 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.7 2024-09-13T16:14:58.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:57 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:57.951+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:58.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:57 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:57.951+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:14:58.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:57 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:57.951+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:27.590591+0000 front 2024-09-13T16:14:27.590761+0000 (oldest deadline 2024-09-13T16:14:52.290749+0000) 2024-09-13T16:14:58.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:58 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:58.017+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:58.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:58 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:58.017+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:58.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:58 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:58.017+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:14:58.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:58 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:58.017+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:14:58.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:57 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:57.848+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:58.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:57 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:57.848+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:14:58.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:57 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:57.848+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:24.564196+0000 front 2024-09-13T16:14:24.564273+0000 (oldest deadline 2024-09-13T16:14:55.764492+0000) 2024-09-13T16:14:58.574 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:58 smithi139 systemd[1]: Stopping Ceph osd.7 for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:14:58.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:58 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:58.265+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:58.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:58 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:58.265+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:58.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:58 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:58.265+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:14:58.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:58 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:58.265+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:14:58.857 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:58 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:58.550+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:58.857 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:58 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:58.550+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:14:58.857 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:58 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:58.550+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:14:58.905 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:58 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:58.571+0000 7f78d3ce9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:14:58.905 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:58 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:58.571+0000 7f78d3ce9640 -1 osd.7 98 *** Got signal Terminated *** 2024-09-13T16:14:58.905 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:58 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:58.571+0000 7f78d3ce9640 -1 osd.7 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:14:58.906 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:58 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:58.904+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:14:58.906 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:58 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:58.904+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:14:58.906 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:58 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:58.904+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:27.590591+0000 front 2024-09-13T16:14:27.590761+0000 (oldest deadline 2024-09-13T16:14:52.290749+0000) 2024-09-13T16:14:59.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:58 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:58.977+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:14:59.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:58 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:58.977+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:14:59.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:58 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:58.977+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:14:59.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:58 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:58.977+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:14:59.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:58 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:58.856+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:14:59.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:58 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:58.856+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:14:59.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:58 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:58.856+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:24.564196+0000 front 2024-09-13T16:14:24.564273+0000 (oldest deadline 2024-09-13T16:14:55.764492+0000) 2024-09-13T16:14:59.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:59 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:59.237+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:14:59.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:59 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:59.237+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:14:59.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:59 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:59.237+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:14:59.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:14:59 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:14:59.237+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:14:59.821 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:59 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:59.525+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:14:59.821 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:59 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:59.525+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:14:59.821 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:14:59 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:14:59.525+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:00.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:59 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:59.924+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:15:00.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:59 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:59.924+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:15:00.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:14:59 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:14:59.924+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:27.590591+0000 front 2024-09-13T16:14:27.590761+0000 (oldest deadline 2024-09-13T16:14:52.290749+0000) 2024-09-13T16:15:00.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:59 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:59.976+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:00.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:59 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:59.976+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:00.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:59 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:59.976+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:00.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:14:59 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:14:59.976+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:00.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:59 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:59.820+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:15:00.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:59 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:59.820+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:15:00.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:14:59 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:14:59.820+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:24.564196+0000 front 2024-09-13T16:14:24.564273+0000 (oldest deadline 2024-09-13T16:14:55.764492+0000) 2024-09-13T16:15:00.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:00.189+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:00.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:00.189+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:00.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:00.189+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:00.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:00 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:00.189+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:00.756 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:00 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:00.488+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:00.997 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:00 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:00.488+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:00.997 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:00 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:00.488+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:01.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:00 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:15:00.918+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:15:01.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:00 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:15:00.918+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:15:01.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:00 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:15:00.918+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:27.590591+0000 front 2024-09-13T16:14:27.590761+0000 (oldest deadline 2024-09-13T16:14:52.290749+0000) 2024-09-13T16:15:01.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:00 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:00.936+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:01.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:00 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:00.936+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:01.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:00 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:00.936+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:01.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:00 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:00.936+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:01.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:00 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:00.798+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:15:01.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:00 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:00.798+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:15:01.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:00 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:00.798+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:24.564196+0000 front 2024-09-13T16:14:24.564273+0000 (oldest deadline 2024-09-13T16:14:55.764492+0000) 2024-09-13T16:15:01.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:01 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:01.214+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:01.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:01 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:01.214+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:01.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:01 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:01.214+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:01.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:01 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:01.214+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:01.768 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:01 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:01.515+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:01.768 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:01 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:01.515+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:01.768 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:01 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:01.515+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:02.019 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:01 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:01.769+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:15:02.019 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:01 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:01.769+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:15:02.019 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:01 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:01.769+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:24.564196+0000 front 2024-09-13T16:14:24.564273+0000 (oldest deadline 2024-09-13T16:14:55.764492+0000) 2024-09-13T16:15:02.019 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:01 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:01.769+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.865668+0000 front 2024-09-13T16:14:36.865501+0000 (oldest deadline 2024-09-13T16:15:01.565557+0000) 2024-09-13T16:15:02.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:01 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:15:01.927+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:15:02.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:01 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:15:01.927+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:15:02.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:01 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:15:01.927+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:27.590591+0000 front 2024-09-13T16:14:27.590761+0000 (oldest deadline 2024-09-13T16:14:52.290749+0000) 2024-09-13T16:15:02.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:01 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:01.910+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:02.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:01 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:01.910+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:02.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:01 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:01.910+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:02.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:01 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:01.910+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:02.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:01 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:01.910+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:02.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:02 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:02.232+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:02.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:02 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:02.232+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:02.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:02 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:02.232+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:02.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:02 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:02.232+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:02.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:02 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:02.232+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.817646+0000 front 2024-09-13T16:14:36.817664+0000 (oldest deadline 2024-09-13T16:15:02.117630+0000) 2024-09-13T16:15:02.754 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:02 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:02.473+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:02.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:02 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:02.473+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:02.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:02 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:02.473+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:03.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:02 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:15:02.907+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:09.487713+0000 front 2024-09-13T16:14:09.487818+0000 (oldest deadline 2024-09-13T16:14:34.787887+0000) 2024-09-13T16:15:03.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:02 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:15:02.907+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.088998+0000 front 2024-09-13T16:14:17.089048+0000 (oldest deadline 2024-09-13T16:14:42.988839+0000) 2024-09-13T16:15:03.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:02 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:15:02.907+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:27.590591+0000 front 2024-09-13T16:14:27.590761+0000 (oldest deadline 2024-09-13T16:14:52.290749+0000) 2024-09-13T16:15:03.249 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:02 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7[52723]: 2024-09-13T16:15:02.907+0000 7f78cc2f5640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.591450+0000 front 2024-09-13T16:14:37.591469+0000 (oldest deadline 2024-09-13T16:15:02.291559+0000) 2024-09-13T16:15:03.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:02 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:02.881+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:03.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:02 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:02.881+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:03.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:02 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:02.881+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:03.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:02 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:02.881+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:03.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:02 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:02.881+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:03.254 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:02 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:02.782+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:15:03.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:02 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:02.782+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:15:03.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:02 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:02.782+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:24.564196+0000 front 2024-09-13T16:14:24.564273+0000 (oldest deadline 2024-09-13T16:14:55.764492+0000) 2024-09-13T16:15:03.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:02 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:02.782+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.865668+0000 front 2024-09-13T16:14:36.865501+0000 (oldest deadline 2024-09-13T16:15:01.565557+0000) 2024-09-13T16:15:03.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:03 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:03.252+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:03.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:03 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:03.252+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:03.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:03 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:03.252+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:03.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:03 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:03.252+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:03.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:03 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:03.252+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.817646+0000 front 2024-09-13T16:14:36.817664+0000 (oldest deadline 2024-09-13T16:15:02.117630+0000) 2024-09-13T16:15:03.774 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:03 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:03.507+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:03.775 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:03 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:03.507+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:03.775 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:03 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:03.507+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:03.775 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:03 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:03.507+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:04.248 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:04 smithi139 podman[68332]: 2024-09-13 16:15:04.049060291 +0000 UTC m=+5.601051523 container died 897df6a52d475cfbe2a96089a242518154edba23b9893862744350cf70d25890 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-13T16:15:04.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:03 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:03.839+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:04.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:03 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:03.839+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:04.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:03 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:03.839+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:04.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:03 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:03.839+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:04.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:03 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:03.839+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:04.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:03 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:03.773+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:15:04.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:03 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:03.773+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:15:04.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:03 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:03.773+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:24.564196+0000 front 2024-09-13T16:14:24.564273+0000 (oldest deadline 2024-09-13T16:14:55.764492+0000) 2024-09-13T16:15:04.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:03 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:03.773+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.865668+0000 front 2024-09-13T16:14:36.865501+0000 (oldest deadline 2024-09-13T16:15:01.565557+0000) 2024-09-13T16:15:04.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:04 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:04.219+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:04.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:04 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:04.219+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:04.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:04 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:04.219+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:04.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:04 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:04.219+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:04.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:04 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:04.219+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.817646+0000 front 2024-09-13T16:14:36.817664+0000 (oldest deadline 2024-09-13T16:15:02.117630+0000) 2024-09-13T16:15:04.698 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:04 smithi139 podman[68332]: 2024-09-13 16:15:04.430149876 +0000 UTC m=+5.982141183 container cleanup 897df6a52d475cfbe2a96089a242518154edba23b9893862744350cf70d25890 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:15:04.698 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:04 smithi139 bash[68332]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7 2024-09-13T16:15:04.732 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:04 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:04.458+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:04.732 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:04 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:04.458+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:04.732 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:04 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:04.458+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:04.732 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:04 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:04.458+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:04.998 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:04 smithi139 podman[68347]: 2024-09-13 16:15:04.697920141 +0000 UTC m=+0.646906550 container remove 897df6a52d475cfbe2a96089a242518154edba23b9893862744350cf70d25890 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T16:15:04.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:04 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:04.882+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:04.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:04 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:04.882+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:04.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:04 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:04.882+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:05.000 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:04 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:04.882+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:05.000 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:04 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:04.882+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:05.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:04 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:04.731+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:15:05.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:04 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:04.731+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:15:05.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:04 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:04.731+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:24.564196+0000 front 2024-09-13T16:14:24.564273+0000 (oldest deadline 2024-09-13T16:14:55.764492+0000) 2024-09-13T16:15:05.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:04 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:04.731+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.865668+0000 front 2024-09-13T16:14:36.865501+0000 (oldest deadline 2024-09-13T16:15:01.565557+0000) 2024-09-13T16:15:05.352 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:05 smithi139 podman[68433]: 2024-09-13 16:15:04.948872603 +0000 UTC m=+0.015709174 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:15:05.352 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:05 smithi139 podman[68433]: 2024-09-13 16:15:05.049193218 +0000 UTC m=+0.116029822 container create a40324d0e6528b5bf9608ef3a8ae1583f7e43d8df46990ce56b576ac0286541d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True) 2024-09-13T16:15:05.352 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:05 smithi139 podman[68433]: 2024-09-13 16:15:05.351568931 +0000 UTC m=+0.418405493 container init a40324d0e6528b5bf9608ef3a8ae1583f7e43d8df46990ce56b576ac0286541d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-13T16:15:05.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:05 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:05.223+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:05.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:05 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:05.223+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:05.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:05 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:05.223+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:05.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:05 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:05.223+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:05.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:05 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:05.223+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.817646+0000 front 2024-09-13T16:14:36.817664+0000 (oldest deadline 2024-09-13T16:15:02.117630+0000) 2024-09-13T16:15:05.748 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:05 smithi139 podman[68433]: 2024-09-13 16:15:05.355148641 +0000 UTC m=+0.421985203 container start a40324d0e6528b5bf9608ef3a8ae1583f7e43d8df46990ce56b576ac0286541d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:15:05.749 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:05 smithi139 podman[68433]: 2024-09-13 16:15:05.443153307 +0000 UTC m=+0.509989871 container attach a40324d0e6528b5bf9608ef3a8ae1583f7e43d8df46990ce56b576ac0286541d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-13T16:15:05.749 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 13 16:15:05 smithi139 podman[68433]: 2024-09-13 16:15:05.538898573 +0000 UTC m=+0.605735135 container died a40324d0e6528b5bf9608ef3a8ae1583f7e43d8df46990ce56b576ac0286541d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T16:15:05.754 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:05 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:05.439+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:05.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:05 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:05.439+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:05.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:05 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:05.439+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:05.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:05 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:05.439+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:05.755 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:05 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:05.687+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:15:05.755 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:05 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:05.687+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:15:05.755 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:05 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:05.687+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:24.564196+0000 front 2024-09-13T16:14:24.564273+0000 (oldest deadline 2024-09-13T16:14:55.764492+0000) 2024-09-13T16:15:05.755 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:05 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:05.687+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.865668+0000 front 2024-09-13T16:14:36.865501+0000 (oldest deadline 2024-09-13T16:15:01.565557+0000) 2024-09-13T16:15:06.139 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:05 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:05.912+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:06.139 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:05 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:05.912+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:06.139 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:05 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:05.912+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:06.139 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:05 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:05.912+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:06.139 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:05 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:05.912+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:06.158 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.7.service' 2024-09-13T16:15:06.239 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:06.239 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-13T16:15:06.239 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-13T16:15:06.239 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.8 2024-09-13T16:15:06.539 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:06 smithi194 systemd[1]: Stopping Ceph osd.8 for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:15:06.539 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:06 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:06.393+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:06.539 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:06 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:06.393+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:06.539 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:06 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:06.393+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:06.540 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:06 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:06.393+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:06.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:06 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:06.260+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:06.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:06 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:06.260+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:06.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:06 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:06.260+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:06.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:06 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:06.260+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:06.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:06 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:06.260+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.817646+0000 front 2024-09-13T16:14:36.817664+0000 (oldest deadline 2024-09-13T16:15:02.117630+0000) 2024-09-13T16:15:07.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:06 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:06.537+0000 7ffa9d33c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:07.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:06 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:06.537+0000 7ffa9d33c640 -1 osd.8 98 *** Got signal Terminated *** 2024-09-13T16:15:07.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:06 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:06.537+0000 7ffa9d33c640 -1 osd.8 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:15:07.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:06 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:06.694+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:15:07.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:06 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:06.694+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:15:07.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:06 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:06.694+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:24.564196+0000 front 2024-09-13T16:14:24.564273+0000 (oldest deadline 2024-09-13T16:14:55.764492+0000) 2024-09-13T16:15:07.006 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:06 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:06.694+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.865668+0000 front 2024-09-13T16:14:36.865501+0000 (oldest deadline 2024-09-13T16:15:01.565557+0000) 2024-09-13T16:15:07.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:06 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:06.930+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:07.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:06 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:06.930+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:07.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:06 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:06.930+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:07.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:06 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:06.930+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:07.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:06 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:06.930+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:07.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:07 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:07.303+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:07.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:07 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:07.303+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:07.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:07 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:07.303+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:07.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:07 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:07.303+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:07.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:07 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:07.303+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.817646+0000 front 2024-09-13T16:14:36.817664+0000 (oldest deadline 2024-09-13T16:15:02.117630+0000) 2024-09-13T16:15:07.690 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:07 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:07.379+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:07.690 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:07 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:07.379+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:07.690 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:07 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:07.379+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:07.690 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:07 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:07.379+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:08.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:07 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:07.689+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:15:08.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:07 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:07.689+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:15:08.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:07 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:07.689+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:24.564196+0000 front 2024-09-13T16:14:24.564273+0000 (oldest deadline 2024-09-13T16:14:55.764492+0000) 2024-09-13T16:15:08.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:07 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:07.689+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.865668+0000 front 2024-09-13T16:14:36.865501+0000 (oldest deadline 2024-09-13T16:15:01.565557+0000) 2024-09-13T16:15:08.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:07 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:07.953+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:08.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:07 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:07.953+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:08.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:07 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:07.953+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:08.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:07 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:07.954+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:08.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:07 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:07.954+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:08.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:08 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:08.273+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:08.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:08 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:08.273+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:08.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:08 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:08.273+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:08.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:08 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:08.273+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:08.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:08 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:08.273+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.817646+0000 front 2024-09-13T16:14:36.817664+0000 (oldest deadline 2024-09-13T16:15:02.117630+0000) 2024-09-13T16:15:08.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:08 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:08.273+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:42.619550+0000 front 2024-09-13T16:14:42.619068+0000 (oldest deadline 2024-09-13T16:15:07.918928+0000) 2024-09-13T16:15:08.729 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:08 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:08.391+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:08.730 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:08 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:08.391+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:08.730 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:08 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:08.391+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:08.730 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:08 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:08.391+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:09.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:08 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:08.728+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:15:09.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:08 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:08.728+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:15:09.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:08 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:08.728+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:24.564196+0000 front 2024-09-13T16:14:24.564273+0000 (oldest deadline 2024-09-13T16:14:55.764492+0000) 2024-09-13T16:15:09.005 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:08 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:08.728+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.865668+0000 front 2024-09-13T16:14:36.865501+0000 (oldest deadline 2024-09-13T16:15:01.565557+0000) 2024-09-13T16:15:09.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:08 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:08.927+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:09.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:08 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:08.927+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:09.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:08 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:08.927+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:09.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:08 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:08.927+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:09.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:08 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:08.927+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:09.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:09 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:09.225+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:09.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:09 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:09.225+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:09.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:09 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:09.225+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:09.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:09 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:09.225+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:09.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:09 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:09.225+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.817646+0000 front 2024-09-13T16:14:36.817664+0000 (oldest deadline 2024-09-13T16:15:02.117630+0000) 2024-09-13T16:15:09.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:09 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:09.225+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:42.619550+0000 front 2024-09-13T16:14:42.619068+0000 (oldest deadline 2024-09-13T16:15:07.918928+0000) 2024-09-13T16:15:09.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:09 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:09.399+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:09.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:09 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:09.399+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:09.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:09 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:09.399+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:09.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:09 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:09.399+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:09.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:09 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:09.399+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:10.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:09 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:09.914+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:10.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:09 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:09.914+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:10.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:09 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:09.914+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:10.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:09 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:09.914+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:10.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:09 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:09.914+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:10.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:09 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:09.773+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:15:10.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:09 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:09.773+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:15:10.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:09 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:09.773+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:24.564196+0000 front 2024-09-13T16:14:24.564273+0000 (oldest deadline 2024-09-13T16:14:55.764492+0000) 2024-09-13T16:15:10.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:09 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:09.773+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.865668+0000 front 2024-09-13T16:14:36.865501+0000 (oldest deadline 2024-09-13T16:15:01.565557+0000) 2024-09-13T16:15:10.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:09 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:09.773+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:45.066603+0000 front 2024-09-13T16:14:45.066643+0000 (oldest deadline 2024-09-13T16:15:09.166662+0000) 2024-09-13T16:15:10.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:10 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:10.251+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:10.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:10 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:10.251+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:10.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:10 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:10.251+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:10.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:10 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:10.251+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:10.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:10 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:10.251+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.817646+0000 front 2024-09-13T16:14:36.817664+0000 (oldest deadline 2024-09-13T16:15:02.117630+0000) 2024-09-13T16:15:10.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:10 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:10.251+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:42.619550+0000 front 2024-09-13T16:14:42.619068+0000 (oldest deadline 2024-09-13T16:15:07.918928+0000) 2024-09-13T16:15:10.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:10 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:10.444+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:10.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:10 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:10.444+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:10.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:10 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:10.444+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:10.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:10 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:10.444+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:10.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:10 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:10.444+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:11.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:10 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:10.904+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:11.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:10 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:10.904+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:11.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:10 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:10.904+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:11.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:10 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:10.904+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:11.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:10 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:10.904+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:11.254 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:10 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:10.802+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.962302+0000 front 2024-09-13T16:14:03.962223+0000 (oldest deadline 2024-09-13T16:14:28.662188+0000) 2024-09-13T16:15:11.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:10 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:10.802+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:19.263558+0000 front 2024-09-13T16:14:19.263589+0000 (oldest deadline 2024-09-13T16:14:44.563668+0000) 2024-09-13T16:15:11.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:10 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:10.802+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:24.564196+0000 front 2024-09-13T16:14:24.564273+0000 (oldest deadline 2024-09-13T16:14:55.764492+0000) 2024-09-13T16:15:11.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:10 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:10.802+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.865668+0000 front 2024-09-13T16:14:36.865501+0000 (oldest deadline 2024-09-13T16:15:01.565557+0000) 2024-09-13T16:15:11.255 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:10 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8[54507]: 2024-09-13T16:15:10.802+0000 7ffa95948640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:45.066603+0000 front 2024-09-13T16:14:45.066643+0000 (oldest deadline 2024-09-13T16:15:09.166662+0000) 2024-09-13T16:15:11.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:11 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:11.276+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:11.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:11 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:11.276+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:11.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:11 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:11.276+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:11.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:11 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:11.276+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:11.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:11 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:11.276+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.817646+0000 front 2024-09-13T16:14:36.817664+0000 (oldest deadline 2024-09-13T16:15:02.117630+0000) 2024-09-13T16:15:11.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:11 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:11.276+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:42.619550+0000 front 2024-09-13T16:14:42.619068+0000 (oldest deadline 2024-09-13T16:15:07.918928+0000) 2024-09-13T16:15:11.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:11 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:11.484+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:11.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:11 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:11.484+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:11.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:11 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:11.484+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:11.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:11 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:11.484+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:11.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:11 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:11.484+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:12.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:11 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:11.923+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:12.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:11 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:11.923+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:12.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:11 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:11.923+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:12.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:11 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:11.923+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:12.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:11 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:11.923+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:12.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:11 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:11.923+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.717112+0000 front 2024-09-13T16:14:43.717154+0000 (oldest deadline 2024-09-13T16:15:11.917552+0000) 2024-09-13T16:15:12.412 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:12 smithi194 podman[70539]: 2024-09-13 16:15:12.075581172 +0000 UTC m=+5.638269200 container died f66383921d1bf4c3efadcb3359857ee6dab088794ab51b563a12aa7f4fbbee0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T16:15:12.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:12 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:12.235+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:12.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:12 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:12.235+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:12.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:12 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:12.235+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:12.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:12 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:12.235+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:12.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:12 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:12.235+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.817646+0000 front 2024-09-13T16:14:36.817664+0000 (oldest deadline 2024-09-13T16:15:02.117630+0000) 2024-09-13T16:15:12.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:12 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:12.235+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:42.619550+0000 front 2024-09-13T16:14:42.619068+0000 (oldest deadline 2024-09-13T16:15:07.918928+0000) 2024-09-13T16:15:12.755 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:12 smithi194 podman[70539]: 2024-09-13 16:15:12.412109338 +0000 UTC m=+5.974797354 container cleanup f66383921d1bf4c3efadcb3359857ee6dab088794ab51b563a12aa7f4fbbee0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:15:12.755 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:12 smithi194 bash[70539]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8 2024-09-13T16:15:12.755 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:12 smithi194 podman[70554]: 2024-09-13 16:15:12.630061491 +0000 UTC m=+0.547877804 container remove f66383921d1bf4c3efadcb3359857ee6dab088794ab51b563a12aa7f4fbbee0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T16:15:12.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:12 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:12.462+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:12.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:12 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:12.462+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:12.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:12 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:12.462+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:12.756 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:12 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:12.462+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:12.756 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:12 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:12.462+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:13.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:12 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:12.875+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:13.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:12 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:12.875+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:13.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:12 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:12.875+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:13.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:12 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:12.875+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:13.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:12 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:12.875+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:13.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:12 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:12.875+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.717112+0000 front 2024-09-13T16:14:43.717154+0000 (oldest deadline 2024-09-13T16:15:11.917552+0000) 2024-09-13T16:15:13.367 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:13 smithi194 podman[70645]: 2024-09-13 16:15:12.973841357 +0000 UTC m=+0.015534917 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:15:13.368 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:13 smithi194 podman[70645]: 2024-09-13 16:15:13.098049141 +0000 UTC m=+0.139742694 container create 205496ed8b072938edbabf8d4d18b4ec95aba079c251ff77dc6bfee11a7b0212 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-13T16:15:13.368 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:13 smithi194 podman[70645]: 2024-09-13 16:15:13.36685284 +0000 UTC m=+0.408546390 container init 205496ed8b072938edbabf8d4d18b4ec95aba079c251ff77dc6bfee11a7b0212 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T16:15:13.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:13 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:13.222+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:13.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:13 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:13.222+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:13.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:13 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:13.222+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:13.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:13 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:13.222+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:13.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:13 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:13.222+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.817646+0000 front 2024-09-13T16:14:36.817664+0000 (oldest deadline 2024-09-13T16:15:02.117630+0000) 2024-09-13T16:15:13.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:13 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:13.222+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:42.619550+0000 front 2024-09-13T16:14:42.619068+0000 (oldest deadline 2024-09-13T16:15:07.918928+0000) 2024-09-13T16:15:13.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:13 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:13.442+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:13.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:13 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:13.442+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:13.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:13 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:13.442+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:13.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:13 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:13.442+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:13.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:13 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:13.442+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:13.756 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:13 smithi194 podman[70645]: 2024-09-13 16:15:13.37058025 +0000 UTC m=+0.412273801 container start 205496ed8b072938edbabf8d4d18b4ec95aba079c251ff77dc6bfee11a7b0212 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T16:15:13.756 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:13 smithi194 podman[70645]: 2024-09-13 16:15:13.45868798 +0000 UTC m=+0.500381531 container attach 205496ed8b072938edbabf8d4d18b4ec95aba079c251ff77dc6bfee11a7b0212 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:15:13.756 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:13 smithi194 podman[70645]: 2024-09-13 16:15:13.554198936 +0000 UTC m=+0.595892502 container died 205496ed8b072938edbabf8d4d18b4ec95aba079c251ff77dc6bfee11a7b0212 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-09-13T16:15:14.090 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.8.service' 2024-09-13T16:15:14.112 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:14 smithi194 podman[70668]: 2024-09-13 16:15:14.070154054 +0000 UTC m=+0.506259528 container remove 205496ed8b072938edbabf8d4d18b4ec95aba079c251ff77dc6bfee11a7b0212 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-13T16:15:14.113 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:14 smithi194 systemd[1]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.8.service: Deactivated successfully. 2024-09-13T16:15:14.113 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:14 smithi194 systemd[1]: Stopped Ceph osd.8 for 1ecdfbda-71e9-11ef-bceb-c7b262605968. 2024-09-13T16:15:14.113 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 13 16:15:14 smithi194 systemd[1]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.8.service: Consumed 24.765s CPU time. 2024-09-13T16:15:14.128 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:14.129 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-13T16:15:14.129 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-13T16:15:14.129 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.9 2024-09-13T16:15:14.161 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:13 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:13.907+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:14.161 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:13 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:13.907+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:14.161 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:13 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:13.907+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:14.161 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:13 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:13.907+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:14.161 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:13 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:13.907+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:14.161 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:13 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:13.907+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.717112+0000 front 2024-09-13T16:14:43.717154+0000 (oldest deadline 2024-09-13T16:15:11.917552+0000) 2024-09-13T16:15:14.540 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:14 smithi086 systemd[1]: Stopping Ceph osd.9 for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:15:14.540 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:14 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:14.259+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:14.540 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:14 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:14.259+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:14.540 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:14 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:14.259+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:14.540 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:14 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:14.259+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:14.540 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:14 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:14.259+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.817646+0000 front 2024-09-13T16:14:36.817664+0000 (oldest deadline 2024-09-13T16:15:02.117630+0000) 2024-09-13T16:15:14.540 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:14 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:14.259+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:42.619550+0000 front 2024-09-13T16:14:42.619068+0000 (oldest deadline 2024-09-13T16:15:07.918928+0000) 2024-09-13T16:15:14.540 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:14 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:14.538+0000 7fd11cc00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:14.540 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:14 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:14.538+0000 7fd11cc00640 -1 osd.9 98 *** Got signal Terminated *** 2024-09-13T16:15:14.540 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:14 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:14.538+0000 7fd11cc00640 -1 osd.9 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:15:14.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:14 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:14.441+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:14.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:14 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:14.441+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:14.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:14 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:14.441+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:14.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:14 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:14.441+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:14.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:14 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:14.441+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:15.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:14 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:14.879+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:15.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:14 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:14.879+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:15.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:14 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:14.879+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:15.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:14 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:14.879+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:15.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:14 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:14.879+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:15.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:14 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:14.879+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.717112+0000 front 2024-09-13T16:14:43.717154+0000 (oldest deadline 2024-09-13T16:15:11.917552+0000) 2024-09-13T16:15:15.617 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:15 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:15.221+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:15.617 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:15 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:15.221+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:15.617 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:15 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:15.221+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:15.617 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:15 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:15.221+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:15.617 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:15 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:15.221+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.817646+0000 front 2024-09-13T16:14:36.817664+0000 (oldest deadline 2024-09-13T16:15:02.117630+0000) 2024-09-13T16:15:15.617 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:15 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:15.221+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:42.619550+0000 front 2024-09-13T16:14:42.619068+0000 (oldest deadline 2024-09-13T16:15:07.918928+0000) 2024-09-13T16:15:15.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:15 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:15.428+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:15.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:15 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:15.428+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:15.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:15 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:15.428+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:15.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:15 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:15.428+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:15.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:15 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:15.428+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:16.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:15 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:15.829+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:16.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:15 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:15.829+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:16.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:15 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:15.829+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:16.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:15 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:15.829+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:16.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:15 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:15.829+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:16.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:15 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:15.829+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.717112+0000 front 2024-09-13T16:14:43.717154+0000 (oldest deadline 2024-09-13T16:15:11.917552+0000) 2024-09-13T16:15:16.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:16 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:16.179+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:16.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:16 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:16.179+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:16.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:16 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:16.179+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:16.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:16 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:16.179+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:16.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:16 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:16.179+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.817646+0000 front 2024-09-13T16:14:36.817664+0000 (oldest deadline 2024-09-13T16:15:02.117630+0000) 2024-09-13T16:15:16.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:16 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:16.179+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:42.619550+0000 front 2024-09-13T16:14:42.619068+0000 (oldest deadline 2024-09-13T16:15:07.918928+0000) 2024-09-13T16:15:16.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:16 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:16.455+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:16.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:16 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:16.455+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:16.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:16 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:16.455+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:16.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:16 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:16.455+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:16.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:16 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:16.455+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:17.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:16 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:16.866+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:17.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:16 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:16.866+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:17.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:16 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:16.866+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:17.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:16 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:16.866+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:17.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:16 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:16.866+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:17.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:16 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:16.866+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.717112+0000 front 2024-09-13T16:14:43.717154+0000 (oldest deadline 2024-09-13T16:15:11.917552+0000) 2024-09-13T16:15:17.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:17 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:17.176+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:17.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:17 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:17.176+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:17.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:17 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:17.176+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:17.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:17 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:17.176+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:17.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:17 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:17.176+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.817646+0000 front 2024-09-13T16:14:36.817664+0000 (oldest deadline 2024-09-13T16:15:02.117630+0000) 2024-09-13T16:15:17.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:17 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:17.176+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:42.619550+0000 front 2024-09-13T16:14:42.619068+0000 (oldest deadline 2024-09-13T16:15:07.918928+0000) 2024-09-13T16:15:17.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:17 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:17.496+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:17.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:17 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:17.496+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:17.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:17 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:17.496+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:17.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:17 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:17.496+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:17.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:17 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:17.496+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:18.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:17 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:17.827+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:18.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:17 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:17.827+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:18.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:17 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:17.827+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:18.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:17 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:17.827+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:18.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:17 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:17.827+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:18.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:17 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:17.827+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.717112+0000 front 2024-09-13T16:14:43.717154+0000 (oldest deadline 2024-09-13T16:15:11.917552+0000) 2024-09-13T16:15:18.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:17 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:17.827+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:51.918095+0000 front 2024-09-13T16:14:51.918149+0000 (oldest deadline 2024-09-13T16:15:17.217932+0000) 2024-09-13T16:15:18.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:18 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:18.133+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:18.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:18 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:18.133+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:18.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:18 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:18.133+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:18.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:18 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:18.133+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:18.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:18 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:18.133+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.817646+0000 front 2024-09-13T16:14:36.817664+0000 (oldest deadline 2024-09-13T16:15:02.117630+0000) 2024-09-13T16:15:18.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:18 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:18.133+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:42.619550+0000 front 2024-09-13T16:14:42.619068+0000 (oldest deadline 2024-09-13T16:15:07.918928+0000) 2024-09-13T16:15:18.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:18 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:18.450+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:18.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:18 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:18.450+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:18.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:18 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:18.450+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:18.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:18 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:18.450+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:18.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:18 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:18.450+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:19.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:18 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:18.796+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:19.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:18 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:18.797+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:19.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:18 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:18.797+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:19.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:18 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:18.797+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:19.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:18 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:18.797+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:19.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:18 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:18.797+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.717112+0000 front 2024-09-13T16:14:43.717154+0000 (oldest deadline 2024-09-13T16:15:11.917552+0000) 2024-09-13T16:15:19.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:18 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:18.797+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:51.918095+0000 front 2024-09-13T16:14:51.918149+0000 (oldest deadline 2024-09-13T16:15:17.217932+0000) 2024-09-13T16:15:19.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:19 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:19.144+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:03.210123+0000 front 2024-09-13T16:14:03.210193+0000 (oldest deadline 2024-09-13T16:14:29.110343+0000) 2024-09-13T16:15:19.615 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:19 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:19.144+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:12.611906+0000 front 2024-09-13T16:14:12.611692+0000 (oldest deadline 2024-09-13T16:14:36.111847+0000) 2024-09-13T16:15:19.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:19 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:19.144+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:20.614254+0000 front 2024-09-13T16:14:20.614223+0000 (oldest deadline 2024-09-13T16:14:46.514279+0000) 2024-09-13T16:15:19.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:19 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:19.144+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.115547+0000 front 2024-09-13T16:14:28.115631+0000 (oldest deadline 2024-09-13T16:14:52.815635+0000) 2024-09-13T16:15:19.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:19 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:19.144+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.817646+0000 front 2024-09-13T16:14:36.817664+0000 (oldest deadline 2024-09-13T16:15:02.117630+0000) 2024-09-13T16:15:19.616 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:19 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9[64028]: 2024-09-13T16:15:19.144+0000 7fd118600640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:42.619550+0000 front 2024-09-13T16:14:42.619068+0000 (oldest deadline 2024-09-13T16:15:07.918928+0000) 2024-09-13T16:15:19.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:19 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:19.475+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:19.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:19 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:19.475+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:19.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:19 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:19.475+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:19.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:19 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:19.475+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:19.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:19 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:19.475+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:19.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:19 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:19.475+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:54.476491+0000 front 2024-09-13T16:14:54.476504+0000 (oldest deadline 2024-09-13T16:15:19.176349+0000) 2024-09-13T16:15:20.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:19 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:19.766+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:20.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:19 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:19.766+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:20.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:19 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:19.766+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:20.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:19 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:19.766+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:20.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:19 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:19.766+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:20.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:19 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:19.766+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.717112+0000 front 2024-09-13T16:14:43.717154+0000 (oldest deadline 2024-09-13T16:15:11.917552+0000) 2024-09-13T16:15:20.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:19 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:19.766+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:51.918095+0000 front 2024-09-13T16:14:51.918149+0000 (oldest deadline 2024-09-13T16:15:17.217932+0000) 2024-09-13T16:15:20.271 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:19 smithi086 podman[87133]: 2024-09-13 16:15:19.986941922 +0000 UTC m=+5.578138411 container died 4fcbd150ecf6adb0a48d0d2b73ab37d179bd9aee0798ca60fdc1f443a10a8105 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-13T16:15:20.524 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:20 smithi086 podman[87133]: 2024-09-13 16:15:20.50190396 +0000 UTC m=+6.093100435 container cleanup 4fcbd150ecf6adb0a48d0d2b73ab37d179bd9aee0798ca60fdc1f443a10a8105 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:15:20.524 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:20 smithi086 bash[87133]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9 2024-09-13T16:15:20.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:20 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:20.478+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:20.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:20 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:20.478+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:20.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:20 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:20.478+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:20.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:20 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:20.478+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:20.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:20 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:20.478+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:20.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:20 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:20.478+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:54.476491+0000 front 2024-09-13T16:14:54.476504+0000 (oldest deadline 2024-09-13T16:15:19.176349+0000) 2024-09-13T16:15:20.865 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:20 smithi086 podman[87150]: 2024-09-13 16:15:20.736330274 +0000 UTC m=+0.741222461 container remove 4fcbd150ecf6adb0a48d0d2b73ab37d179bd9aee0798ca60fdc1f443a10a8105 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:15:21.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:20 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:20.759+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:21.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:20 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:20.759+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:21.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:20 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:20.759+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:21.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:20 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:20.759+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:21.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:20 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:20.759+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:21.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:20 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:20.759+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.717112+0000 front 2024-09-13T16:14:43.717154+0000 (oldest deadline 2024-09-13T16:15:11.917552+0000) 2024-09-13T16:15:21.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:20 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:20.759+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:51.918095+0000 front 2024-09-13T16:14:51.918149+0000 (oldest deadline 2024-09-13T16:15:17.217932+0000) 2024-09-13T16:15:21.514 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:21 smithi086 podman[87233]: 2024-09-13 16:15:21.166672105 +0000 UTC m=+0.027037873 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:15:21.514 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:21 smithi086 podman[87233]: 2024-09-13 16:15:21.287308249 +0000 UTC m=+0.147674016 container create 8f7ee40b08ee6aa9b5fed7e6b60b4784e3bc9ee38a310164b9a05546a6dbab59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-13T16:15:21.515 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:21 smithi086 podman[87233]: 2024-09-13 16:15:21.506564382 +0000 UTC m=+0.366930149 container init 8f7ee40b08ee6aa9b5fed7e6b60b4784e3bc9ee38a310164b9a05546a6dbab59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9-deactivate, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T16:15:21.515 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:21 smithi086 podman[87233]: 2024-09-13 16:15:21.51333627 +0000 UTC m=+0.373702038 container start 8f7ee40b08ee6aa9b5fed7e6b60b4784e3bc9ee38a310164b9a05546a6dbab59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T16:15:21.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:21 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:21.469+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:21.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:21 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:21.469+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:21.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:21 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:21.469+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:21.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:21 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:21.469+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:21.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:21 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:21.469+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:21.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:21 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:21.469+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:54.476491+0000 front 2024-09-13T16:14:54.476504+0000 (oldest deadline 2024-09-13T16:15:19.176349+0000) 2024-09-13T16:15:21.774 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:21 smithi086 podman[87233]: 2024-09-13 16:15:21.622764381 +0000 UTC m=+0.483130154 container attach 8f7ee40b08ee6aa9b5fed7e6b60b4784e3bc9ee38a310164b9a05546a6dbab59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-13T16:15:21.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:21 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:21.741+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:21.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:21 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:21.741+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:21.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:21 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:21.741+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:21.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:21 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:21.741+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:21.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:21 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:21.741+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:21.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:21 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:21.741+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.717112+0000 front 2024-09-13T16:14:43.717154+0000 (oldest deadline 2024-09-13T16:15:11.917552+0000) 2024-09-13T16:15:21.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:21 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:21.741+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:51.918095+0000 front 2024-09-13T16:14:51.918149+0000 (oldest deadline 2024-09-13T16:15:17.217932+0000) 2024-09-13T16:15:22.050 INFO:journalctl@ceph.osd.9.smithi086.stdout:Sep 13 16:15:21 smithi086 podman[87233]: 2024-09-13 16:15:21.774362757 +0000 UTC m=+0.634728544 container died 8f7ee40b08ee6aa9b5fed7e6b60b4784e3bc9ee38a310164b9a05546a6dbab59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-9-deactivate, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-13T16:15:22.489 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.9.service' 2024-09-13T16:15:22.566 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:22.566 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-13T16:15:22.567 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-13T16:15:22.567 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.10 2024-09-13T16:15:22.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:22 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:22.502+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:22.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:22 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:22.502+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:22.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:22 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:22.502+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:22.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:22 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:22.502+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:22.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:22 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:22.502+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:22.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:22 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:22.502+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:54.476491+0000 front 2024-09-13T16:14:54.476504+0000 (oldest deadline 2024-09-13T16:15:19.176349+0000) 2024-09-13T16:15:22.966 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:22 smithi139 systemd[1]: Stopping Ceph osd.10 for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:15:22.966 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:22 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:22.728+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:22.966 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:22 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:22.728+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:22.966 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:22 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:22.728+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:22.967 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:22 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:22.728+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:22.967 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:22 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:22.728+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:22.967 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:22 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:22.728+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.717112+0000 front 2024-09-13T16:14:43.717154+0000 (oldest deadline 2024-09-13T16:15:11.917552+0000) 2024-09-13T16:15:22.967 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:22 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:22.728+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:51.918095+0000 front 2024-09-13T16:14:51.918149+0000 (oldest deadline 2024-09-13T16:15:17.217932+0000) 2024-09-13T16:15:22.967 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:22 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:22.964+0000 7fbdafd27640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:22.967 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:22 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:22.965+0000 7fbdafd27640 -1 osd.10 98 *** Got signal Terminated *** 2024-09-13T16:15:22.967 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:22 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:22.965+0000 7fbdafd27640 -1 osd.10 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:15:23.998 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:23 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:23.720+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:23.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:23 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:23.720+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:23.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:23 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:23.720+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:23.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:23 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:23.720+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:23.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:23 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:23.720+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:23.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:23 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:23.720+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.717112+0000 front 2024-09-13T16:14:43.717154+0000 (oldest deadline 2024-09-13T16:15:11.917552+0000) 2024-09-13T16:15:23.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:23 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:23.720+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:51.918095+0000 front 2024-09-13T16:14:51.918149+0000 (oldest deadline 2024-09-13T16:15:17.217932+0000) 2024-09-13T16:15:24.004 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:23 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:23.552+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:24.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:23 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:23.552+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:24.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:23 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:23.552+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:24.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:23 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:23.552+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:24.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:23 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:23.552+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:24.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:23 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:23.552+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:54.476491+0000 front 2024-09-13T16:14:54.476504+0000 (oldest deadline 2024-09-13T16:15:19.176349+0000) 2024-09-13T16:15:24.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:24 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:24.696+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:24.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:24 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:24.696+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:24.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:24 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:24.696+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:24.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:24 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:24.696+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:24.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:24 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:24.696+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:24.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:24 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:24.696+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.717112+0000 front 2024-09-13T16:14:43.717154+0000 (oldest deadline 2024-09-13T16:15:11.917552+0000) 2024-09-13T16:15:24.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:24 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:24.696+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:51.918095+0000 front 2024-09-13T16:14:51.918149+0000 (oldest deadline 2024-09-13T16:15:17.217932+0000) 2024-09-13T16:15:25.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:24 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:24.592+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:25.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:24 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:24.592+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:25.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:24 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:24.592+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:25.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:24 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:24.592+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:25.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:24 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:24.592+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:25.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:24 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:24.592+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:54.476491+0000 front 2024-09-13T16:14:54.476504+0000 (oldest deadline 2024-09-13T16:15:19.176349+0000) 2024-09-13T16:15:25.998 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:25 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:25.731+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:25.998 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:25 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:25.731+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:25.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:25 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:25.731+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:25.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:25 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:25.731+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:25.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:25 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:25.731+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:25.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:25 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:25.731+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.717112+0000 front 2024-09-13T16:14:43.717154+0000 (oldest deadline 2024-09-13T16:15:11.917552+0000) 2024-09-13T16:15:25.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:25 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:25.731+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:51.918095+0000 front 2024-09-13T16:14:51.918149+0000 (oldest deadline 2024-09-13T16:15:17.217932+0000) 2024-09-13T16:15:26.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:25 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:25.618+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:26.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:25 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:25.618+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:26.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:25 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:25.618+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:26.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:25 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:25.618+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:26.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:25 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:25.618+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:26.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:25 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:25.618+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:54.476491+0000 front 2024-09-13T16:14:54.476504+0000 (oldest deadline 2024-09-13T16:15:19.176349+0000) 2024-09-13T16:15:26.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:25 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:25.618+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-13T16:14:59.677263+0000 front 2024-09-13T16:14:59.677307+0000 (oldest deadline 2024-09-13T16:15:24.977269+0000) 2024-09-13T16:15:27.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:26 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:26.666+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:27.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:26 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:26.666+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:27.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:26 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:26.666+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:27.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:26 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:26.666+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:27.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:26 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:26.666+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:27.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:26 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:26.666+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:54.476491+0000 front 2024-09-13T16:14:54.476504+0000 (oldest deadline 2024-09-13T16:15:19.176349+0000) 2024-09-13T16:15:27.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:26 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:26.666+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-13T16:14:59.677263+0000 front 2024-09-13T16:14:59.677307+0000 (oldest deadline 2024-09-13T16:15:24.977269+0000) 2024-09-13T16:15:27.248 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:26 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:26.757+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:27.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:26 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:26.757+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:27.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:26 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:26.757+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:27.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:26 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:26.757+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:27.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:26 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:26.757+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:27.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:26 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:26.757+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.717112+0000 front 2024-09-13T16:14:43.717154+0000 (oldest deadline 2024-09-13T16:15:11.917552+0000) 2024-09-13T16:15:27.249 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:26 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:26.757+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:51.918095+0000 front 2024-09-13T16:14:51.918149+0000 (oldest deadline 2024-09-13T16:15:17.217932+0000) 2024-09-13T16:15:27.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:27 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:27.721+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.510718+0000 front 2024-09-13T16:14:02.510690+0000 (oldest deadline 2024-09-13T16:14:28.410741+0000) 2024-09-13T16:15:27.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:27 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:27.721+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-13T16:14:10.711549+0000 front 2024-09-13T16:14:10.711560+0000 (oldest deadline 2024-09-13T16:14:37.112287+0000) 2024-09-13T16:15:27.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:27 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:27.721+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.112602+0000 front 2024-09-13T16:14:17.112619+0000 (oldest deadline 2024-09-13T16:14:43.012741+0000) 2024-09-13T16:15:27.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:27 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:27.721+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:28.814498+0000 front 2024-09-13T16:14:28.814563+0000 (oldest deadline 2024-09-13T16:14:51.114168+0000) 2024-09-13T16:15:27.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:27 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:27.721+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:36.116109+0000 front 2024-09-13T16:14:36.116068+0000 (oldest deadline 2024-09-13T16:15:01.416158+0000) 2024-09-13T16:15:27.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:27 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:27.721+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.717112+0000 front 2024-09-13T16:14:43.717154+0000 (oldest deadline 2024-09-13T16:15:11.917552+0000) 2024-09-13T16:15:27.999 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:27 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10[59272]: 2024-09-13T16:15:27.721+0000 7fbdac33b640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:51.918095+0000 front 2024-09-13T16:14:51.918149+0000 (oldest deadline 2024-09-13T16:15:17.217932+0000) 2024-09-13T16:15:28.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:27 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:27.662+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:28.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:27 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:27.662+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:28.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:27 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:27.662+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:28.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:27 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:27.662+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:28.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:27 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:27.662+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:28.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:27 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:27.662+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:54.476491+0000 front 2024-09-13T16:14:54.476504+0000 (oldest deadline 2024-09-13T16:15:19.176349+0000) 2024-09-13T16:15:28.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:27 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:27.662+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-13T16:14:59.677263+0000 front 2024-09-13T16:14:59.677307+0000 (oldest deadline 2024-09-13T16:15:24.977269+0000) 2024-09-13T16:15:28.749 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:28 smithi139 podman[68549]: 2024-09-13 16:15:28.48060119 +0000 UTC m=+5.717011640 container died a473654c401db94aec93f9b02d24f08df4100adc3c5d47ac676fb6da663148ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-13T16:15:29.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:28 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:28.680+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:29.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:28 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:28.680+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:29.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:28 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:28.680+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:29.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:28 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:28.680+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:29.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:28 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:28.680+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:29.006 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:28 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:28.680+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:54.476491+0000 front 2024-09-13T16:14:54.476504+0000 (oldest deadline 2024-09-13T16:15:19.176349+0000) 2024-09-13T16:15:29.006 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:28 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:28.680+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-13T16:14:59.677263+0000 front 2024-09-13T16:14:59.677307+0000 (oldest deadline 2024-09-13T16:15:24.977269+0000) 2024-09-13T16:15:29.008 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:28 smithi139 podman[68549]: 2024-09-13 16:15:28.822832124 +0000 UTC m=+6.059242558 container cleanup a473654c401db94aec93f9b02d24f08df4100adc3c5d47ac676fb6da663148ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:15:29.008 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:28 smithi139 bash[68549]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10 2024-09-13T16:15:29.417 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:29 smithi139 podman[68563]: 2024-09-13 16:15:29.007435581 +0000 UTC m=+0.517646877 container remove a473654c401db94aec93f9b02d24f08df4100adc3c5d47ac676fb6da663148ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:15:29.719 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:29 smithi139 podman[68652]: 2024-09-13 16:15:29.416526818 +0000 UTC m=+0.108116997 container create 57e9f492e06b761071fe5bb0e12c36425c05df768148727b9338759b88918d5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-13T16:15:29.720 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:29 smithi139 podman[68652]: 2024-09-13 16:15:29.324038217 +0000 UTC m=+0.015628365 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:15:29.720 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:29 smithi139 podman[68652]: 2024-09-13 16:15:29.643992417 +0000 UTC m=+0.335582566 container init 57e9f492e06b761071fe5bb0e12c36425c05df768148727b9338759b88918d5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:15:29.720 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:29 smithi139 podman[68652]: 2024-09-13 16:15:29.647535696 +0000 UTC m=+0.339125833 container start 57e9f492e06b761071fe5bb0e12c36425c05df768148727b9338759b88918d5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True) 2024-09-13T16:15:29.720 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:29 smithi139 podman[68652]: 2024-09-13 16:15:29.718501378 +0000 UTC m=+0.410091512 container attach 57e9f492e06b761071fe5bb0e12c36425c05df768148727b9338759b88918d5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-13T16:15:30.000 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 13 16:15:29 smithi139 podman[68652]: 2024-09-13 16:15:29.834704508 +0000 UTC m=+0.526294649 container died 57e9f492e06b761071fe5bb0e12c36425c05df768148727b9338759b88918d5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-13T16:15:30.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:29 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:29.656+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:30.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:29 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:29.656+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:30.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:29 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:29.656+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:30.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:29 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:29.656+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:30.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:29 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:29.656+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:30.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:29 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:29.656+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:54.476491+0000 front 2024-09-13T16:14:54.476504+0000 (oldest deadline 2024-09-13T16:15:19.176349+0000) 2024-09-13T16:15:30.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:29 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:29.656+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-13T16:14:59.677263+0000 front 2024-09-13T16:14:59.677307+0000 (oldest deadline 2024-09-13T16:15:24.977269+0000) 2024-09-13T16:15:30.410 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.10.service' 2024-09-13T16:15:30.447 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:30.447 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-13T16:15:30.448 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-13T16:15:30.448 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.11 2024-09-13T16:15:30.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:30 smithi194 systemd[1]: Stopping Ceph osd.11 for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:15:30.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:30 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:30.679+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:30.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:30 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:30.679+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:30.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:30 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:30.679+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:30.756 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:30 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:30.679+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:30.756 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:30 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:30.679+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:30.756 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:30 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:30.679+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:54.476491+0000 front 2024-09-13T16:14:54.476504+0000 (oldest deadline 2024-09-13T16:15:19.176349+0000) 2024-09-13T16:15:30.756 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:30 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:30.679+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-13T16:14:59.677263+0000 front 2024-09-13T16:14:59.677307+0000 (oldest deadline 2024-09-13T16:15:24.977269+0000) 2024-09-13T16:15:31.007 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:30 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:30.777+0000 7f7f54a35640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:31.007 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:30 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:30.777+0000 7f7f54a35640 -1 osd.11 98 *** Got signal Terminated *** 2024-09-13T16:15:31.007 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:30 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:30.777+0000 7f7f54a35640 -1 osd.11 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:15:31.966 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:31 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:31.703+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:31.966 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:31 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:31.703+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:31.966 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:31 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:31.703+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:31.967 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:31 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:31.703+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:31.967 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:31 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:31.703+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:31.967 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:31 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:31.703+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:54.476491+0000 front 2024-09-13T16:14:54.476504+0000 (oldest deadline 2024-09-13T16:15:19.176349+0000) 2024-09-13T16:15:31.967 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:31 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:31.703+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-13T16:14:59.677263+0000 front 2024-09-13T16:14:59.677307+0000 (oldest deadline 2024-09-13T16:15:24.977269+0000) 2024-09-13T16:15:33.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:32 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:32.715+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:33.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:32 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:32.715+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:33.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:32 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:32.715+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:33.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:32 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:32.715+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:33.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:32 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:32.715+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:33.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:32 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:32.715+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:54.476491+0000 front 2024-09-13T16:14:54.476504+0000 (oldest deadline 2024-09-13T16:15:19.176349+0000) 2024-09-13T16:15:33.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:32 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:32.715+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-13T16:14:59.677263+0000 front 2024-09-13T16:14:59.677307+0000 (oldest deadline 2024-09-13T16:15:24.977269+0000) 2024-09-13T16:15:33.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:32 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:32.715+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6820 osd.8 since back 2024-09-13T16:15:10.778292+0000 front 2024-09-13T16:15:10.778323+0000 (oldest deadline 2024-09-13T16:15:32.478321+0000) 2024-09-13T16:15:34.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:33 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:33.716+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:34.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:33 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:33.716+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:34.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:33 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:33.716+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:34.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:33 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:33.716+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:34.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:33 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:33.716+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:34.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:33 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:33.716+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:54.476491+0000 front 2024-09-13T16:14:54.476504+0000 (oldest deadline 2024-09-13T16:15:19.176349+0000) 2024-09-13T16:15:34.006 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:33 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:33.716+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-13T16:14:59.677263+0000 front 2024-09-13T16:14:59.677307+0000 (oldest deadline 2024-09-13T16:15:24.977269+0000) 2024-09-13T16:15:34.006 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:33 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:33.716+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6820 osd.8 since back 2024-09-13T16:15:10.778292+0000 front 2024-09-13T16:15:10.778323+0000 (oldest deadline 2024-09-13T16:15:32.478321+0000) 2024-09-13T16:15:35.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:34 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:34.734+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:35.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:34 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:34.734+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:35.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:34 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:34.734+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:35.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:34 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:34.734+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:35.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:34 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:34.734+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:35.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:34 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:34.734+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:54.476491+0000 front 2024-09-13T16:14:54.476504+0000 (oldest deadline 2024-09-13T16:15:19.176349+0000) 2024-09-13T16:15:35.006 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:34 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:34.734+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-13T16:14:59.677263+0000 front 2024-09-13T16:14:59.677307+0000 (oldest deadline 2024-09-13T16:15:24.977269+0000) 2024-09-13T16:15:35.006 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:34 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:34.734+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6820 osd.8 since back 2024-09-13T16:15:10.778292+0000 front 2024-09-13T16:15:10.778323+0000 (oldest deadline 2024-09-13T16:15:32.478321+0000) 2024-09-13T16:15:36.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:35 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:35.690+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6806 osd.0 since back 2024-09-13T16:14:02.170730+0000 front 2024-09-13T16:14:02.170676+0000 (oldest deadline 2024-09-13T16:14:26.870735+0000) 2024-09-13T16:15:36.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:35 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:35.690+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-13T16:14:17.972759+0000 front 2024-09-13T16:14:17.972796+0000 (oldest deadline 2024-09-13T16:14:43.872877+0000) 2024-09-13T16:15:36.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:35 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:35.690+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6814 osd.3 since back 2024-09-13T16:14:29.774130+0000 front 2024-09-13T16:14:29.774118+0000 (oldest deadline 2024-09-13T16:14:52.673920+0000) 2024-09-13T16:15:36.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:35 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:35.690+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-13T16:14:37.375016+0000 front 2024-09-13T16:14:37.374971+0000 (oldest deadline 2024-09-13T16:15:03.274971+0000) 2024-09-13T16:15:36.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:35 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:35.690+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-13T16:14:43.275512+0000 front 2024-09-13T16:14:43.275428+0000 (oldest deadline 2024-09-13T16:15:08.575501+0000) 2024-09-13T16:15:36.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:35 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:35.690+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.86:6822 osd.6 since back 2024-09-13T16:14:54.476491+0000 front 2024-09-13T16:14:54.476504+0000 (oldest deadline 2024-09-13T16:15:19.176349+0000) 2024-09-13T16:15:36.005 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:35 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:35.690+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-13T16:14:59.677263+0000 front 2024-09-13T16:14:59.677307+0000 (oldest deadline 2024-09-13T16:15:24.977269+0000) 2024-09-13T16:15:36.006 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:35 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11[61475]: 2024-09-13T16:15:35.690+0000 7f7f4d041640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.194:6820 osd.8 since back 2024-09-13T16:15:10.778292+0000 front 2024-09-13T16:15:10.778323+0000 (oldest deadline 2024-09-13T16:15:32.478321+0000) 2024-09-13T16:15:36.499 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:36 smithi194 podman[70760]: 2024-09-13 16:15:36.162340689 +0000 UTC m=+5.511192626 container died 9cfa897f2fc92667fc87140724944b97cf6c53f642cae280887950783a6075cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:15:36.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:36 smithi194 podman[70760]: 2024-09-13 16:15:36.497004143 +0000 UTC m=+5.845856085 container cleanup 9cfa897f2fc92667fc87140724944b97cf6c53f642cae280887950783a6075cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:15:36.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:36 smithi194 bash[70760]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11 2024-09-13T16:15:36.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:36 smithi194 podman[70788]: 2024-09-13 16:15:36.698329769 +0000 UTC m=+0.531437535 container remove 9cfa897f2fc92667fc87140724944b97cf6c53f642cae280887950783a6075cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-13T16:15:37.436 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:37 smithi194 podman[70878]: 2024-09-13 16:15:37.013136388 +0000 UTC m=+0.016103078 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:15:37.436 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:37 smithi194 podman[70878]: 2024-09-13 16:15:37.115590744 +0000 UTC m=+0.118557414 container create 571965d061cd33556c689f3b5cae1bd32d4a3a15cc58f3189491cf84506c7724 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-13T16:15:37.436 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:37 smithi194 podman[70878]: 2024-09-13 16:15:37.351123509 +0000 UTC m=+0.354090179 container init 571965d061cd33556c689f3b5cae1bd32d4a3a15cc58f3189491cf84506c7724 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, io.buildah.version=1.37.2) 2024-09-13T16:15:37.436 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:37 smithi194 podman[70878]: 2024-09-13 16:15:37.354540932 +0000 UTC m=+0.357507603 container start 571965d061cd33556c689f3b5cae1bd32d4a3a15cc58f3189491cf84506c7724 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-13T16:15:37.436 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:37 smithi194 podman[70878]: 2024-09-13 16:15:37.434423902 +0000 UTC m=+0.437390586 container attach 571965d061cd33556c689f3b5cae1bd32d4a3a15cc58f3189491cf84506c7724 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T16:15:37.755 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:37 smithi194 podman[70878]: 2024-09-13 16:15:37.536498381 +0000 UTC m=+0.539465061 container died 571965d061cd33556c689f3b5cae1bd32d4a3a15cc58f3189491cf84506c7724 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-13T16:15:38.106 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 13 16:15:38 smithi194 podman[70901]: 2024-09-13 16:15:38.087666878 +0000 UTC m=+0.545552832 container remove 571965d061cd33556c689f3b5cae1bd32d4a3a15cc58f3189491cf84506c7724 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-09-13T16:15:38.111 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@osd.11.service' 2024-09-13T16:15:38.150 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:38.150 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-13T16:15:38.151 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-13T16:15:38.151 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.a 2024-09-13T16:15:38.567 INFO:journalctl@ceph.mds.a.smithi086.stdout:Sep 13 16:15:38 smithi086 systemd[1]: Stopping Ceph mds.a for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:15:38.865 INFO:journalctl@ceph.mds.a.smithi086.stdout:Sep 13 16:15:38 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-a[70947]: 2024-09-13T16:15:38.565+0000 7f9e93800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:38.865 INFO:journalctl@ceph.mds.a.smithi086.stdout:Sep 13 16:15:38 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-a[70947]: 2024-09-13T16:15:38.565+0000 7f9e93800640 -1 mds.a *** got signal Terminated *** 2024-09-13T16:15:41.505 INFO:journalctl@ceph.mds.a.smithi086.stdout:Sep 13 16:15:41 smithi086 podman[87352]: 2024-09-13 16:15:41.196658082 +0000 UTC m=+2.761761911 container died c0475bdd96afce526eb6477aa45bbfde01555051200e7b96445d7f8b6a7f257d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-a, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T16:15:41.865 INFO:journalctl@ceph.mds.a.smithi086.stdout:Sep 13 16:15:41 smithi086 podman[87352]: 2024-09-13 16:15:41.694844571 +0000 UTC m=+3.259948399 container cleanup c0475bdd96afce526eb6477aa45bbfde01555051200e7b96445d7f8b6a7f257d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-a, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-13T16:15:41.865 INFO:journalctl@ceph.mds.a.smithi086.stdout:Sep 13 16:15:41 smithi086 bash[87352]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-a 2024-09-13T16:15:42.141 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.a.service' 2024-09-13T16:15:42.213 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:42.213 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-13T16:15:42.213 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-13T16:15:42.213 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.d 2024-09-13T16:15:42.604 INFO:journalctl@ceph.mds.d.smithi086.stdout:Sep 13 16:15:42 smithi086 systemd[1]: Stopping Ceph mds.d for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:15:42.865 INFO:journalctl@ceph.mds.d.smithi086.stdout:Sep 13 16:15:42 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-d[69999]: 2024-09-13T16:15:42.602+0000 7f9c31200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:42.865 INFO:journalctl@ceph.mds.d.smithi086.stdout:Sep 13 16:15:42 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-d[69999]: 2024-09-13T16:15:42.602+0000 7f9c31200640 -1 mds.d *** got signal Terminated *** 2024-09-13T16:15:45.993 INFO:journalctl@ceph.mds.d.smithi086.stdout:Sep 13 16:15:45 smithi086 podman[87473]: 2024-09-13 16:15:45.671795862 +0000 UTC m=+3.183881965 container died 4e34b5dbcd759b18fc4dde56a7c087bc21e10b72bae98601f22e83d2852818a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-d, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:15:46.309 INFO:journalctl@ceph.mds.d.smithi086.stdout:Sep 13 16:15:46 smithi086 podman[87473]: 2024-09-13 16:15:46.10723672 +0000 UTC m=+3.619322822 container cleanup 4e34b5dbcd759b18fc4dde56a7c087bc21e10b72bae98601f22e83d2852818a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-d, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T16:15:46.309 INFO:journalctl@ceph.mds.d.smithi086.stdout:Sep 13 16:15:46 smithi086 bash[87473]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-d 2024-09-13T16:15:46.584 INFO:journalctl@ceph.mds.d.smithi086.stdout:Sep 13 16:15:46 smithi086 podman[87485]: 2024-09-13 16:15:46.308310608 +0000 UTC m=+0.624492264 container remove 4e34b5dbcd759b18fc4dde56a7c087bc21e10b72bae98601f22e83d2852818a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-d, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731) 2024-09-13T16:15:46.602 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.d.service' 2024-09-13T16:15:46.672 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:46.673 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-13T16:15:46.673 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-13T16:15:46.673 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.g 2024-09-13T16:15:46.865 INFO:journalctl@ceph.mds.g.smithi086.stdout:Sep 13 16:15:46 smithi086 systemd[1]: Stopping Ceph mds.g for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:15:47.365 INFO:journalctl@ceph.mds.g.smithi086.stdout:Sep 13 16:15:47 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-g[70564]: 2024-09-13T16:15:47.096+0000 7fc747000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:47.365 INFO:journalctl@ceph.mds.g.smithi086.stdout:Sep 13 16:15:47 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-g[70564]: 2024-09-13T16:15:47.096+0000 7fc747000640 -1 mds.g *** got signal Terminated *** 2024-09-13T16:15:50.115 INFO:journalctl@ceph.mds.g.smithi086.stdout:Sep 13 16:15:49 smithi086 podman[87593]: 2024-09-13 16:15:49.860626524 +0000 UTC m=+2.881137033 container died cfdfe5005aa7807c18ffb7560bca10e780fd746265d78c56976f242af3d62c67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T16:15:50.520 INFO:journalctl@ceph.mds.g.smithi086.stdout:Sep 13 16:15:50 smithi086 podman[87593]: 2024-09-13 16:15:50.268829271 +0000 UTC m=+3.289339779 container cleanup cfdfe5005aa7807c18ffb7560bca10e780fd746265d78c56976f242af3d62c67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:15:50.521 INFO:journalctl@ceph.mds.g.smithi086.stdout:Sep 13 16:15:50 smithi086 bash[87593]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-g 2024-09-13T16:15:50.702 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.g.service' 2024-09-13T16:15:50.770 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:50.770 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-13T16:15:50.770 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-13T16:15:50.771 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.j 2024-09-13T16:15:51.115 INFO:journalctl@ceph.mds.j.smithi086.stdout:Sep 13 16:15:50 smithi086 systemd[1]: Stopping Ceph mds.j for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:15:51.615 INFO:journalctl@ceph.mds.j.smithi086.stdout:Sep 13 16:15:51 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-j[69620]: 2024-09-13T16:15:51.150+0000 7ff8f1200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:51.615 INFO:journalctl@ceph.mds.j.smithi086.stdout:Sep 13 16:15:51 smithi086 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-j[69620]: 2024-09-13T16:15:51.150+0000 7ff8f1200640 -1 mds.j *** got signal Terminated *** 2024-09-13T16:15:54.592 INFO:journalctl@ceph.mds.j.smithi086.stdout:Sep 13 16:15:54 smithi086 podman[87713]: 2024-09-13 16:15:54.318779685 +0000 UTC m=+3.281343669 container died 5d04c9426c8b6954eefba84d2581898c88518b7fa4332be985b2e08f358c5984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-13T16:15:54.865 INFO:journalctl@ceph.mds.j.smithi086.stdout:Sep 13 16:15:54 smithi086 podman[87713]: 2024-09-13 16:15:54.68092079 +0000 UTC m=+3.643484768 container cleanup 5d04c9426c8b6954eefba84d2581898c88518b7fa4332be985b2e08f358c5984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-j, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-13T16:15:54.865 INFO:journalctl@ceph.mds.j.smithi086.stdout:Sep 13 16:15:54 smithi086 bash[87713]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-j 2024-09-13T16:15:55.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.j.service' 2024-09-13T16:15:55.142 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:55.143 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-13T16:15:55.143 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-13T16:15:55.143 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.b 2024-09-13T16:15:55.199 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:15:55 smithi139 systemd[1]: Stopping Ceph mds.b for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:15:55.748 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:15:55 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-b[64629]: 2024-09-13T16:15:55.471+0000 7f66fe5d8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:55.748 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:15:55 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-b[64629]: 2024-09-13T16:15:55.471+0000 7f66fe5d8640 -1 mds.b *** got signal Terminated *** 2024-09-13T16:15:59.249 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:15:58 smithi139 podman[68756]: 2024-09-13 16:15:58.976347564 +0000 UTC m=+3.614612690 container died b2ac5437779927c1815eccfd6f070400db73b0eac3eeb17821668c6bb53b784c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T16:15:59.597 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:15:59 smithi139 podman[68756]: 2024-09-13 16:15:59.354290062 +0000 UTC m=+3.992555189 container cleanup b2ac5437779927c1815eccfd6f070400db73b0eac3eeb17821668c6bb53b784c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:15:59.598 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 13 16:15:59 smithi139 bash[68756]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-b 2024-09-13T16:15:59.748 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.b.service' 2024-09-13T16:15:59.784 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:59.784 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-13T16:15:59.785 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-13T16:15:59.785 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.e 2024-09-13T16:16:00.249 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 13 16:15:59 smithi139 systemd[1]: Stopping Ceph mds.e for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:16:00.249 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 13 16:16:00 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-e[64018]: 2024-09-13T16:16:00.099+0000 7f1753883640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:16:00.249 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 13 16:16:00 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-e[64018]: 2024-09-13T16:16:00.099+0000 7f1753883640 -1 mds.e *** got signal Terminated *** 2024-09-13T16:16:03.248 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 13 16:16:02 smithi139 podman[68887]: 2024-09-13 16:16:02.978529781 +0000 UTC m=+2.976559929 container died 3be8561daa2eb90ff990739303aa7a51dabaf014f1f9557057d9252e80b21092 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:16:03.526 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 13 16:16:03 smithi139 podman[68887]: 2024-09-13 16:16:03.357827706 +0000 UTC m=+3.355857862 container cleanup 3be8561daa2eb90ff990739303aa7a51dabaf014f1f9557057d9252e80b21092 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T16:16:03.526 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 13 16:16:03 smithi139 bash[68887]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-e 2024-09-13T16:16:03.777 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 13 16:16:03 smithi139 podman[68899]: 2024-09-13 16:16:03.525664808 +0000 UTC m=+0.543530976 container remove 3be8561daa2eb90ff990739303aa7a51dabaf014f1f9557057d9252e80b21092 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-e, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:16:03.780 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.e.service' 2024-09-13T16:16:03.813 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:16:03.814 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-13T16:16:03.814 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-13T16:16:03.814 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.h 2024-09-13T16:16:04.154 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 13 16:16:03 smithi139 systemd[1]: Stopping Ceph mds.h for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:16:04.498 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 13 16:16:04 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-h[64325]: 2024-09-13T16:16:04.153+0000 7f641e3ce640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:16:04.498 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 13 16:16:04 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-h[64325]: 2024-09-13T16:16:04.153+0000 7f641e3ce640 -1 mds.h *** got signal Terminated *** 2024-09-13T16:16:07.287 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 13 16:16:06 smithi139 podman[69007]: 2024-09-13 16:16:06.998593186 +0000 UTC m=+2.968832063 container died f605058cc4e16a1be81bbe6ea1973f667fc4a49f40a77cdec7e8df1b61049dfe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-h, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731) 2024-09-13T16:16:07.596 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 13 16:16:07 smithi139 podman[69007]: 2024-09-13 16:16:07.386211524 +0000 UTC m=+3.356450404 container cleanup f605058cc4e16a1be81bbe6ea1973f667fc4a49f40a77cdec7e8df1b61049dfe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T16:16:07.596 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 13 16:16:07 smithi139 bash[69007]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-h 2024-09-13T16:16:07.737 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.h.service' 2024-09-13T16:16:07.769 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:16:07.769 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-13T16:16:07.769 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-13T16:16:07.770 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.k 2024-09-13T16:16:08.248 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 13 16:16:07 smithi139 systemd[1]: Stopping Ceph mds.k for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:16:08.248 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 13 16:16:08 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-k[63703]: 2024-09-13T16:16:08.097+0000 7fe2f9888640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:16:08.249 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 13 16:16:08 smithi139 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-k[63703]: 2024-09-13T16:16:08.097+0000 7fe2f9888640 -1 mds.k *** got signal Terminated *** 2024-09-13T16:16:11.366 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 13 16:16:11 smithi139 podman[69127]: 2024-09-13 16:16:11.028633449 +0000 UTC m=+3.034648315 container died 3b9d6f6c9c884f6a8707bf2dc9545e6a8f0bf8e3ab9d00546971b0b1a25d05dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-k, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-13T16:16:11.748 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 13 16:16:11 smithi139 podman[69127]: 2024-09-13 16:16:11.456205056 +0000 UTC m=+3.462219921 container cleanup 3b9d6f6c9c884f6a8707bf2dc9545e6a8f0bf8e3ab9d00546971b0b1a25d05dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:16:11.749 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 13 16:16:11 smithi139 bash[69127]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-k 2024-09-13T16:16:11.749 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 13 16:16:11 smithi139 podman[69139]: 2024-09-13 16:16:11.590397716 +0000 UTC m=+0.560338996 container remove 3b9d6f6c9c884f6a8707bf2dc9545e6a8f0bf8e3ab9d00546971b0b1a25d05dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-13T16:16:11.797 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.k.service' 2024-09-13T16:16:11.828 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:16:11.828 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-13T16:16:11.829 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-13T16:16:11.829 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.c 2024-09-13T16:16:12.121 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 13 16:16:11 smithi194 systemd[1]: Stopping Ceph mds.c for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:16:12.373 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 13 16:16:12 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-c[66435]: 2024-09-13T16:16:12.119+0000 7f450ef96640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:16:12.373 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 13 16:16:12 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-c[66435]: 2024-09-13T16:16:12.119+0000 7f450ef96640 -1 mds.c *** got signal Terminated *** 2024-09-13T16:16:15.255 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 13 16:16:14 smithi194 podman[70981]: 2024-09-13 16:16:14.985610794 +0000 UTC m=+2.968340278 container died 517ce15e54ba8aaed161b312904304eb149984f5a3c512913763be81fe8cdc57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-c, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-13T16:16:15.620 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 13 16:16:15 smithi194 podman[70981]: 2024-09-13 16:16:15.335626573 +0000 UTC m=+3.318356056 container cleanup 517ce15e54ba8aaed161b312904304eb149984f5a3c512913763be81fe8cdc57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-c, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-13T16:16:15.620 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 13 16:16:15 smithi194 bash[70981]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-c 2024-09-13T16:16:15.782 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.c.service' 2024-09-13T16:16:15.818 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:16:15.819 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-13T16:16:15.819 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-13T16:16:15.819 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.f 2024-09-13T16:16:16.158 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:16:15 smithi194 systemd[1]: Stopping Ceph mds.f for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:16:16.505 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:16:16 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-f[66128]: 2024-09-13T16:16:16.156+0000 7f02cef26640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:16:16.505 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:16:16 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-f[66128]: 2024-09-13T16:16:16.156+0000 7f02cef26640 -1 mds.f *** got signal Terminated *** 2024-09-13T16:16:19.255 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:16:18 smithi194 podman[71115]: 2024-09-13 16:16:18.995285933 +0000 UTC m=+2.951669632 container died 0154c4ab9fa0fdc3056dc293026098f5d657de7f8f8cea6c9666eb92cc547afd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T16:16:19.730 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:16:19 smithi194 podman[71115]: 2024-09-13 16:16:19.322799956 +0000 UTC m=+3.279183652 container cleanup 0154c4ab9fa0fdc3056dc293026098f5d657de7f8f8cea6c9666eb92cc547afd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-13T16:16:19.730 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:16:19 smithi194 bash[71115]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-f 2024-09-13T16:16:19.730 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 13 16:16:19 smithi194 podman[71128]: 2024-09-13 16:16:19.490454551 +0000 UTC m=+0.492524707 container remove 0154c4ab9fa0fdc3056dc293026098f5d657de7f8f8cea6c9666eb92cc547afd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-13T16:16:19.752 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.f.service' 2024-09-13T16:16:19.786 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:16:19.786 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-13T16:16:19.786 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-13T16:16:19.787 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.i 2024-09-13T16:16:20.005 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:16:19 smithi194 systemd[1]: Stopping Ceph mds.i for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:16:20.505 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:16:20 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-i[66743]: 2024-09-13T16:16:20.117+0000 7f7747b85640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:16:20.505 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:16:20 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-i[66743]: 2024-09-13T16:16:20.117+0000 7f7747b85640 -1 mds.i *** got signal Terminated *** 2024-09-13T16:16:23.236 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:16:22 smithi194 podman[71238]: 2024-09-13 16:16:22.987248291 +0000 UTC m=+2.988350882 container died 2f6ddfb9e971432d798b508676e5b6cebaffc935030232d26f89202a50273a80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-i, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-13T16:16:23.505 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:16:23 smithi194 podman[71238]: 2024-09-13 16:16:23.325932939 +0000 UTC m=+3.327035527 container cleanup 2f6ddfb9e971432d798b508676e5b6cebaffc935030232d26f89202a50273a80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T16:16:23.505 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 13 16:16:23 smithi194 bash[71238]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-i 2024-09-13T16:16:23.748 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.i.service' 2024-09-13T16:16:23.780 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:16:23.780 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-13T16:16:23.781 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-13T16:16:23.781 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.l 2024-09-13T16:16:24.097 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 13 16:16:23 smithi194 systemd[1]: Stopping Ceph mds.l for 1ecdfbda-71e9-11ef-bceb-c7b262605968... 2024-09-13T16:16:24.505 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 13 16:16:24 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-l[65827]: 2024-09-13T16:16:24.096+0000 7fc22d255640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:16:24.505 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 13 16:16:24 smithi194 ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-l[65827]: 2024-09-13T16:16:24.096+0000 7fc22d255640 -1 mds.l *** got signal Terminated *** 2024-09-13T16:16:28.456 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 13 16:16:28 smithi194 podman[71357]: 2024-09-13 16:16:28.102404652 +0000 UTC m=+4.105782756 container died e07125f3cb3c1a2bbc57d68d32183558cd4f8898a62e9632b04e764221fd7263 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:16:28.755 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 13 16:16:28 smithi194 podman[71357]: 2024-09-13 16:16:28.521189536 +0000 UTC m=+4.524567594 container cleanup e07125f3cb3c1a2bbc57d68d32183558cd4f8898a62e9632b04e764221fd7263 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-l, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:16:28.755 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 13 16:16:28 smithi194 bash[71357]: ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-l 2024-09-13T16:16:28.755 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 13 16:16:28 smithi194 podman[71372]: 2024-09-13 16:16:28.688792816 +0000 UTC m=+0.576389233 container remove e07125f3cb3c1a2bbc57d68d32183558cd4f8898a62e9632b04e764221fd7263 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968-mds-l, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T16:16:28.891 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ecdfbda-71e9-11ef-bceb-c7b262605968@mds.l.service' 2024-09-13T16:16:28.923 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:16:28.923 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-13T16:16:28.924 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T16:16:29.141 INFO:teuthology.orchestra.run.smithi086.stdout:Deleting cluster with fsid: 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:16:32.701 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T16:16:32.854 INFO:teuthology.orchestra.run.smithi139.stdout:Deleting cluster with fsid: 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:16:35.120 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T16:16:35.271 INFO:teuthology.orchestra.run.smithi194.stdout:Deleting cluster with fsid: 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:16:37.581 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:16:37.647 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:16:37.680 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:16:37.707 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-13T16:16:37.710 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903772/remote/smithi086/crash 2024-09-13T16:16:37.710 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/crash -- . 2024-09-13T16:16:37.766 INFO:teuthology.orchestra.run.smithi086.stderr:tar: /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T16:16:37.767 INFO:teuthology.orchestra.run.smithi086.stderr:tar: Error is not recoverable: exiting now 2024-09-13T16:16:37.770 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903772/remote/smithi139/crash 2024-09-13T16:16:37.771 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/crash -- . 2024-09-13T16:16:37.883 INFO:teuthology.orchestra.run.smithi139.stderr:tar: /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T16:16:37.884 INFO:teuthology.orchestra.run.smithi139.stderr:tar: Error is not recoverable: exiting now 2024-09-13T16:16:37.885 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903772/remote/smithi194/crash 2024-09-13T16:16:37.886 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/crash -- . 2024-09-13T16:16:37.919 INFO:teuthology.orchestra.run.smithi194.stderr:tar: /var/lib/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T16:16:37.919 INFO:teuthology.orchestra.run.smithi194.stderr:tar: Error is not recoverable: exiting now 2024-09-13T16:16:37.920 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-13T16:16:37.920 DEBUG:teuthology.orchestra.run.smithi086:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T16:16:37.991 INFO:teuthology.orchestra.run.smithi086.stderr:grep: /var/log/ceph/1ecdfbda-71e9-11ef-bceb-c7b262605968/ceph.log: No such file or directory 2024-09-13T16:16:37.998 INFO:tasks.cephadm:Compressing logs... 2024-09-13T16:16:37.998 DEBUG:teuthology.orchestra.run.smithi086:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T16:16:38.002 DEBUG:teuthology.orchestra.run.smithi139:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T16:16:38.004 DEBUG:teuthology.orchestra.run.smithi194:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T16:16:38.029 INFO:teuthology.orchestra.run.smithi194.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T16:16:38.030 INFO:teuthology.orchestra.run.smithi139.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T16:16:38.051 INFO:teuthology.orchestra.run.smithi086.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T16:17:39.215 INFO:tasks.cephadm:Archiving logs... 2024-09-13T16:17:39.216 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903772/remote/smithi086/log 2024-09-13T16:17:39.217 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T16:17:42.484 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903772/remote/smithi139/log 2024-09-13T16:17:42.485 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T16:17:49.987 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903772/remote/smithi194/log 2024-09-13T16:17:49.988 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T16:17:53.792 INFO:tasks.cephadm:Removing cluster... 2024-09-13T16:17:53.792 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 --force 2024-09-13T16:17:54.012 INFO:teuthology.orchestra.run.smithi086.stdout:Deleting cluster with fsid: 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:17:54.543 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 --force 2024-09-13T16:17:54.696 INFO:teuthology.orchestra.run.smithi139.stdout:Deleting cluster with fsid: 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:17:55.045 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1ecdfbda-71e9-11ef-bceb-c7b262605968 --force 2024-09-13T16:17:55.633 INFO:teuthology.orchestra.run.smithi194.stdout:Deleting cluster with fsid: 1ecdfbda-71e9-11ef-bceb-c7b262605968 2024-09-13T16:17:55.931 INFO:tasks.cephadm:Removing cephadm ... 2024-09-13T16:17:55.931 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T16:17:55.973 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T16:17:55.992 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T16:17:56.008 INFO:tasks.cephadm:Teardown complete 2024-09-13T16:17:56.008 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T16:17:56.020 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T16:17:56.020 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T16:17:56.024 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T16:17:56.034 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T16:17:56.177 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T16:17:56.188 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T16:17:56.189 DEBUG:teuthology.orchestra.run.smithi086:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T16:17:56.193 DEBUG:teuthology.orchestra.run.smithi139:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T16:17:56.196 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T16:17:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-09-13T16:17:56.211 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-09-13T16:17:56.215 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T16:17:56.215 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-09-13T16:17:56.215 INFO:teuthology.orchestra.run.smithi194.stdout:^* hv01.front.sepia.ceph.com 3 6 377 51 +241us[ +246us] +/- 39ms 2024-09-13T16:17:56.215 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 49 -247us[ -247us] +/- 57ms 2024-09-13T16:17:56.215 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 -166us[ -161us] +/- 101ms 2024-09-13T16:17:56.215 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:17:56.216 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T16:17:56.217 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-09-13T16:17:56.217 INFO:teuthology.orchestra.run.smithi139.stdout:^* hv01.front.sepia.ceph.com 3 6 377 55 +238us[ +235us] +/- 39ms 2024-09-13T16:17:56.217 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 52 -260us[ -260us] +/- 57ms 2024-09-13T16:17:56.217 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 -192us[ -192us] +/- 101ms 2024-09-13T16:17:56.217 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:17:56.224 INFO:teuthology.orchestra.run.smithi086.stderr:bash: line 1: ntpq: command not found 2024-09-13T16:17:56.231 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T16:17:56.231 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2024-09-13T16:17:56.231 INFO:teuthology.orchestra.run.smithi086.stdout:^* hv01.front.sepia.ceph.com 3 6 377 53 +245us[ +228us] +/- 39ms 2024-09-13T16:17:56.232 INFO:teuthology.orchestra.run.smithi086.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 53 -246us[ -262us] +/- 57ms 2024-09-13T16:17:56.232 INFO:teuthology.orchestra.run.smithi086.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 -161us[ -161us] +/- 101ms 2024-09-13T16:17:56.232 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:17:56.233 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T16:17:56.245 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T16:17:56.246 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T16:17:56.256 DEBUG:teuthology.orchestra.run.smithi086:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T16:17:56.401 DEBUG:teuthology.orchestra.run.smithi139:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T16:17:56.475 DEBUG:teuthology.orchestra.run.smithi194:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T16:17:56.541 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T16:17:56.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:17:56.602 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T16:17:56.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:17:56.634 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T16:17:56.662 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:17:56.662 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T16:17:56.673 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T16:17:56.684 INFO:teuthology.task.internal:Duration was 1509.378303 seconds 2024-09-13T16:17:56.684 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T16:17:56.695 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T16:17:56.695 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T16:17:56.699 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T16:17:56.701 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T16:17:56.742 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T16:17:56.742 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T16:17:56.781 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T16:17:57.041 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T16:17:57.041 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T16:17:57.041 DEBUG:teuthology.orchestra.run.smithi086:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T16:17:57.090 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T16:17:57.090 DEBUG:teuthology.orchestra.run.smithi139:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T16:17:57.169 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T16:17:57.169 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T16:17:57.192 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T16:17:57.192 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T16:17:57.200 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T16:17:57.202 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T16:17:57.259 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T16:17:57.259 DEBUG:teuthology.orchestra.run.smithi086:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T16:17:57.263 DEBUG:teuthology.orchestra.run.smithi139:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T16:17:57.269 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T16:17:57.708 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T16:17:57.722 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T16:17:57.723 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T16:17:57.779 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T16:17:57.806 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T16:17:57.832 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T16:17:57.843 DEBUG:teuthology.orchestra.run.smithi086:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T16:17:57.847 DEBUG:teuthology.orchestra.run.smithi139:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T16:17:57.850 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T16:17:57.871 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = core 2024-09-13T16:17:57.896 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2024-09-13T16:17:57.913 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = core 2024-09-13T16:17:57.943 DEBUG:teuthology.orchestra.run.smithi086:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T16:17:57.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:17:57.976 DEBUG:teuthology.orchestra.run.smithi139:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T16:17:57.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:17:57.991 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T16:17:58.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:17:58.006 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T16:17:58.019 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T16:17:58.021 DEBUG:teuthology.misc:Transferring archived files from smithi086:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903772/remote/smithi086 2024-09-13T16:17:58.021 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T16:17:58.094 DEBUG:teuthology.misc:Transferring archived files from smithi139:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903772/remote/smithi139 2024-09-13T16:17:58.094 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T16:17:58.131 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903772/remote/smithi194 2024-09-13T16:17:58.131 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T16:17:58.166 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T16:17:58.167 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T16:17:58.171 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T16:17:58.173 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T16:17:58.217 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T16:17:58.229 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T16:17:58.229 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T16:17:58.240 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T16:17:58.240 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T16:17:58.245 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T16:17:58.247 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T16:17:58.260 INFO:teuthology.orchestra.run.smithi139.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 16:17 /home/ubuntu/cephtest 2024-09-13T16:17:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 16:17 /home/ubuntu/cephtest 2024-09-13T16:17:58.276 INFO:teuthology.orchestra.run.smithi086.stdout: 393253 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 16:17 /home/ubuntu/cephtest 2024-09-13T16:17:58.278 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T16:17:58.291 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T16:17:58.376 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/fs/norstats}} duration: 1509.3783025741577 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T16:17:58.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T16:17:58.470 INFO:teuthology.run:pass